2024/11/23-12:31:22.112489 139957181593152 DEBG dcompact_worker.cpp:2214: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-26049/att-00: fork to child time = 0.007100 sec 2024/11/23-12:31:22.113064 139957181593152 DEBG dcompact_worker.cpp:1013: Beg SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-26049/att-00 2024/11/23-12:31:22.119793 139957181593152 DEBG dcompact_worker.cpp:1033: End SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-26049/att-00 2024/11/23-12:31:22.120670 139957181593152 TRAC dcompact_worker.cpp:1083: INFO_LOG_LEVEL: rpc = INFO_LEVEL, env_var = undefined 2024/11/23-12:31:22.120855 139957181593152 [WARN] [column_family.cc:386] multiple cf_paths/db_paths and level_compaction_dynamic_level_bytes can't be used together 2024/11/23-12:31:22.174259 139957181593152 [version_set.cc:6208] Recovering from manifest file: /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-26049/att-00/MANIFEST-206347 2024/11/23-12:31:22.193141 139957181593152 [version_set.cc:6251] Recovered from manifest file:/worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-26049/att-00/MANIFEST-206347 succeeded,manifest_file_number is 206347, next_file_number is 259598, last_sequence is 3975543876, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 259390 2024/11/23-12:31:22.193146 139957181593152 [version_set.cc:6266] Column family [default] (ID 0), log number is 0 2024/11/23-12:31:22.193230 139957181593152 [version_set.cc:5721] Creating manifest 259598 2024/11/23-12:31:22.226247 139957181593152 DEBG dcompact_worker.cpp:1218: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-26049/att-00: bottommost_level: fake = 1, rpc = 0 2024/11/23-12:31:22.246788 139957181593152 [compaction_job.cc:2437] [default] [JOB 26049] Compacting 1@2 + 15@3 files to L3, score 1.00, subcompactions 1 : 1 2024/11/23-12:31:22.246802 139957181593152 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 19524 Base level 2, inputs: [259529(27MB)], [259588(34MB) 259589(7816KB) 259487(37MB) 259489(35MB) 259490(34MB) 259491(34MB) 259492(35MB) 259493(35MB) 259494(35MB) 259495(35MB) 259496(35MB) 259497(35MB) 259498(37MB) 259499(14MB) 259593(37MB)] 2024/11/23-12:31:22.254473 139957181593152 [top_zip_table.cc:59] core git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-12:31:22.254496 139957181593152 [top_zip_table.cc:60] fsa git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-12:31:22.254510 139957181593152 [top_zip_table.cc:61] zbs git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-12:31:22.254515 139957181593152 [top_zip_table.cc:62] topling-zip_table_reader: git_version_hash_info_is: commit a4a382006cb82713acf5b3425835f22711877681 Author: leipeng Date: 2024-04-11 19:44:14 +0800 fixed_len_hole_index.cc: Add env bool FixedLenHoleIndexUseAVX512 for ut & debug 1. FixedLenHoleIndexUseAVX512 is only in unit tests or debug 2. In release mode, use avx512 by compile options(-march=) g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/23-12:31:22.254525 139957181593152 [top_zip_table.cc:64] topling-rocks git_version_hash_info_is: commit feab587e468621ba0204d47b4ffacc52e7c4290d Author: leipeng Date: 2024-03-22 13:35:06 +0800 ToplingZipTableBuilder::Add: immediately return after error This function returns void, and caller does not check builder->status() after calling this function and graceful abandon. So immediately return after error, and return error status in Finish(). g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/23-12:31:22.843426 139957181593152 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-26049/att-00/259599.sst) /dev/shm/ToplingTemp/Topling-49147-jRqCfu 2024/11/23-12:31:23.684012 139957181593152 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-26049/att-00/259599.sst): first pass time = 0.84's, 159.680'MB/sec 2024/11/23-12:31:25.077968 139957181593152 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-26049/att-00/259599.sst): old prealloc_size = 147639500, real_size = 32379584 2024/11/23-12:31:25.078712 139957181593152 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-26049/att-00/259599.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 934501 prefix = 4 raw-key = 0.0150 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1081 GB zip-val = 0.0304 GB avg-val = 115.63 avg-zval = 32.48 2024/11/23-12:31:25.079613 139957181593152 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-26049/att-00/259599.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-12:31:26.273060 139957181593152 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-26049/att-00/259599.sst): second pass time = 1.39's, 77.608'MB/sec, value only(80.5% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.20's, 30.640'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2549.901'MB/sec (index lex order gen) rebuild zvType time = 1.04's, 0.224'MB/sec write SST data time = 0.15's, 241.879'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 35362.280'MB/sec zip my value time = 1.39's, unzip length = 0.108'GB zip my value throughput = 77.608'MB/sec zip pipeline throughput = 77.608'MB/sec entries = 934501 avg-key = 28.00 avg-zkey = 1.91 avg-val = 115.63 avg-zval = 32.48 usrkeys = 934501 avg-key = 20.00 avg-zkey = 1.91 avg-val = 122.63 avg-zval = 32.48 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 934501 bytes = 3387584 } seq expand size = 6541507 multi value expand size = 0 cnt WriteAppend = 15 UnZipSize{ index = 0.0187 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0304 GB dict = 1.08 MB all = 0.0366 GB } UnZip/Zip{ index = 10.4457 value = 3.5594 dict = 1.00 all = 3.6654 } Zip/UnZip{ index = 0.0957 value = 0.2809 dict = 1.00 all = 0.2728 } ---------------------------- total value len = 8.963213 GB avg = 0.168 KB (by entry num) total key len = 1.466987 GB avg = 0.028 KB total ukey len = 1.016568 GB avg = 0.015 KB total ukey num = 0.066484936 Billion total entry num = 0.053292665 Billion write speed all = 0.803927334 MB/sec (with seq num) write speed all = 0.771066274 MB/sec (without seq num) 2024/11/23-12:31:26.318838 139957181593152 [compaction_job.cc:1948] [default] [JOB 26049] Generated table #259599: 934501 keys, 36617710 bytes, temperature: kWarm 2024/11/23-12:31:26.318928 139957181593152 EVENT_LOG_v1 {"time_micros": 1732336286318873, "cf_name": "default", "job": 26049, "event": "table_file_creation", "file_number": 259599, "file_size": 36617710, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3621075956, "largest_seqno": 3975182645, "table_properties": {"data_size": 30356528, "index_size": 1789248, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26166028, "raw_average_key_size": 28, "raw_value_size": 108051790, "raw_average_value_size": 115, "num_data_blocks": 1, "num_entries": 934501, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732336282, "oldest_key_time": 0, "file_creation_time": 1732336282, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 259599, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-12:31:26.354073 139957181593152 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-26049/att-00/259600.sst) /dev/shm/ToplingTemp/Topling-49147-EBpvUs 2024/11/23-12:31:27.663062 139957181593152 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-26049/att-00/259600.sst): first pass time = 1.31's, 102.538'MB/sec 2024/11/23-12:31:29.057363 139957181593152 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-26049/att-00/259600.sst): old prealloc_size = 147639500, real_size = 33652800 2024/11/23-12:31:29.058102 139957181593152 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-26049/att-00/259600.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 935479 prefix = 4 raw-key = 0.0150 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1080 GB zip-val = 0.0316 GB avg-val = 115.47 avg-zval = 33.81 2024/11/23-12:31:29.059014 139957181593152 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-26049/att-00/259600.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-12:31:30.152866 139957181593152 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-26049/att-00/259600.sst): second pass time = 1.39's, 77.520'MB/sec, value only(80.5% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.10's, 34.697'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2516.160'MB/sec (index lex order gen) rebuild zvType time = 0.90's, 0.259'MB/sec write SST data time = 0.19's, 198.304'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 33262.593'MB/sec zip my value time = 1.39's, unzip length = 0.108'GB zip my value throughput = 77.520'MB/sec zip pipeline throughput = 77.520'MB/sec entries = 935479 avg-key = 28.00 avg-zkey = 1.91 avg-val = 115.47 avg-zval = 33.81 usrkeys = 935479 avg-key = 20.00 avg-zkey = 1.91 avg-val = 122.47 avg-zval = 33.81 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 935479 bytes = 3508064 } seq expand size = 6548353 multi value expand size = 0 cnt WriteAppend = 15 UnZipSize{ index = 0.0187 GB value = 0.1080 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0316 GB dict = 1.08 MB all = 0.0380 GB } UnZip/Zip{ index = 10.4470 value = 3.4155 dict = 1.00 all = 3.5311 } Zip/UnZip{ index = 0.0957 value = 0.2928 dict = 1.00 all = 0.2832 } ---------------------------- total value len = 9.077786 GB avg = 0.167 KB (by entry num) total key len = 1.493181 GB avg = 0.028 KB total ukey len = 1.035278 GB avg = 0.015 KB total ukey num = 0.067420415 Billion total entry num = 0.054228144 Billion write speed all = 0.814533572 MB/sec (with seq num) write speed all = 0.781105678 MB/sec (without seq num) 2024/11/23-12:31:30.199417 139957181593152 [compaction_job.cc:1948] [default] [JOB 26049] Generated table #259600: 935479 keys, 38010588 bytes, temperature: kWarm 2024/11/23-12:31:30.199488 139957181593152 EVENT_LOG_v1 {"time_micros": 1732336290199451, "cf_name": "default", "job": 26049, "event": "table_file_creation", "file_number": 259600, "file_size": 38010588, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3376774746, "largest_seqno": 3975182856, "table_properties": {"data_size": 31627824, "index_size": 1790912, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26193412, "raw_average_key_size": 28, "raw_value_size": 108024418, "raw_average_value_size": 115, "num_data_blocks": 1, "num_entries": 935479, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732336286, "oldest_key_time": 0, "file_creation_time": 1732336286, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 259600, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-12:31:30.237542 139957181593152 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-26049/att-00/259601.sst) /dev/shm/ToplingTemp/Topling-49147-4mXTsu 2024/11/23-12:31:31.269023 139957181593152 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-26049/att-00/259601.sst): first pass time = 1.03's, 130.128'MB/sec 2024/11/23-12:31:32.577471 139957181593152 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-26049/att-00/259601.sst): old prealloc_size = 147639500, real_size = 33373184 2024/11/23-12:31:32.578029 139957181593152 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-26049/att-00/259601.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 931965 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1081 GB zip-val = 0.0314 GB avg-val = 116.02 avg-zval = 33.66 2024/11/23-12:31:32.578775 139957181593152 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-26049/att-00/259601.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-12:31:33.430929 139957181593152 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-26049/att-00/259601.sst): second pass time = 1.31's, 82.684'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.85's, 43.923'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3317.488'MB/sec (index lex order gen) rebuild zvType time = 0.73's, 0.320'MB/sec write SST data time = 0.13's, 298.468'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 28211.039'MB/sec zip my value time = 1.31's, unzip length = 0.108'GB zip my value throughput = 82.684'MB/sec zip pipeline throughput = 82.684'MB/sec entries = 931965 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.02 avg-zval = 33.66 usrkeys = 931965 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.02 avg-zval = 33.66 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 931965 bytes = 3261888 } seq expand size = 6523755 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0186 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0314 GB dict = 1.08 MB all = 0.0375 GB } UnZip/Zip{ index = 10.5156 value = 3.4470 dict = 1.00 all = 3.5805 } Zip/UnZip{ index = 0.0951 value = 0.2901 dict = 1.00 all = 0.2793 } ---------------------------- total value len = 9.192432 GB avg = 0.167 KB (by entry num) total key len = 1.519276 GB avg = 0.028 KB total ukey len = 1.053917 GB avg = 0.015 KB total ukey num = 0.068352380 Billion total entry num = 0.055160109 Billion write speed all = 0.825169824 MB/sec (with seq num) write speed all = 0.791176023 MB/sec (without seq num) 2024/11/23-12:31:33.476524 139957181593152 [compaction_job.cc:1948] [default] [JOB 26049] Generated table #259601: 931965 keys, 37485924 bytes, temperature: kWarm 2024/11/23-12:31:33.476596 139957181593152 EVENT_LOG_v1 {"time_micros": 1732336293476562, "cf_name": "default", "job": 26049, "event": "table_file_creation", "file_number": 259601, "file_size": 37485924, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3759280178, "largest_seqno": 3975182706, "table_properties": {"data_size": 31367472, "index_size": 1772544, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26095020, "raw_average_key_size": 28, "raw_value_size": 108122794, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 931965, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732336290, "oldest_key_time": 0, "file_creation_time": 1732336290, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 259601, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-12:31:33.511801 139957181593152 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-26049/att-00/259602.sst) /dev/shm/ToplingTemp/Topling-49147-PJZHQt 2024/11/23-12:31:34.533895 139957181593152 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-26049/att-00/259602.sst): first pass time = 1.02's, 131.322'MB/sec 2024/11/23-12:31:35.938047 139957181593152 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-26049/att-00/259602.sst): old prealloc_size = 147639500, real_size = 35133472 2024/11/23-12:31:35.938664 139957181593152 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-26049/att-00/259602.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 1082151 prefix = 4 raw-key = 0.0173 GB zip-key = 0.0021 GB avg-key = 16.00 avg-zkey = 1.93 raw-val = 0.1039 GB zip-val = 0.0328 GB avg-val = 96.03 avg-zval = 30.29 2024/11/23-12:31:35.938848 139957181593152 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-26049/att-00/259602.sst: sumWaitingMem = 0.003 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0028 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-12:31:36.620174 139957181593152 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-26049/att-00/259602.sst): second pass time = 1.40's, 74.049'MB/sec, value only(77.4% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.68's, 53.018'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3506.955'MB/sec (index lex order gen) rebuild zvType time = 0.54's, 0.498'MB/sec write SST data time = 0.14's, 261.951'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.031'MB, throughput = 23856.294'MB/sec zip my value time = 1.40's, unzip length = 0.104'GB zip my value throughput = 74.049'MB/sec zip pipeline throughput = 74.049'MB/sec entries = 1082151 avg-key = 28.00 avg-zkey = 1.93 avg-val = 96.03 avg-zval = 30.29 usrkeys = 1082151 avg-key = 20.00 avg-zkey = 1.93 avg-val = 96.23 avg-zval = 30.29 TagRS{ kinds = RS_Key0_TagN bytes = 169200 } TagArray{ size = 30974 bytes = 89072 } seq expand size = 216818 multi value expand size = 0 cnt WriteAppend = 18 UnZipSize{ index = 0.0216 GB value = 0.1039 GB dict = 1.03 MB all = 0.1342 GB } __ZipSize{ index = 0.0021 GB value = 0.0328 GB dict = 1.03 MB all = 0.0362 GB } UnZip/Zip{ index = 10.3797 value = 3.1704 dict = 1.00 all = 3.7114 } Zip/UnZip{ index = 0.0963 value = 0.3154 dict = 1.00 all = 0.2694 } ---------------------------- total value len = 9.296567 GB avg = 0.165 KB (by entry num) total key len = 1.549576 GB avg = 0.028 KB total ukey len = 1.075560 GB avg = 0.015 KB total ukey num = 0.069434531 Billion total entry num = 0.056242260 Billion write speed all = 0.835320689 MB/sec (with seq num) write speed all = 0.800668499 MB/sec (without seq num) 2024/11/23-12:31:36.666125 139957181593152 [compaction_job.cc:1948] [default] [JOB 26049] Generated table #259602: 1082151 keys, 36163539 bytes, temperature: kWarm 2024/11/23-12:31:36.666203 139957181593152 EVENT_LOG_v1 {"time_micros": 1732336296666159, "cf_name": "default", "job": 26049, "event": "table_file_creation", "file_number": 259602, "file_size": 36163539, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3975181823, "table_properties": {"data_size": 32777616, "index_size": 2085120, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 30300228, "raw_average_key_size": 28, "raw_value_size": 103917563, "raw_average_value_size": 96, "num_data_blocks": 1, "num_entries": 1082151, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732336293, "oldest_key_time": 0, "file_creation_time": 1732336293, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 259602, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-12:31:36.711137 139957181593152 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-26049/att-00/259603.sst) /dev/shm/ToplingTemp/Topling-49147-pNTeBs 2024/11/23-12:31:37.652218 139957181593152 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-26049/att-00/259603.sst): first pass time = 0.94's, 142.628'MB/sec 2024/11/23-12:31:38.992795 139957181593152 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-26049/att-00/259603.sst): old prealloc_size = 147639500, real_size = 34474832 2024/11/23-12:31:38.993352 139957181593152 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-26049/att-00/259603.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 925713 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0325 GB avg-val = 116.99 avg-zval = 35.09 2024/11/23-12:31:38.993937 139957181593152 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-26049/att-00/259603.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-12:31:39.787246 139957181593152 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-26049/att-00/259603.sst): second pass time = 1.34's, 80.830'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.79's, 47.437'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3279.982'MB/sec (index lex order gen) rebuild zvType time = 0.67's, 0.347'MB/sec write SST data time = 0.13's, 298.401'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 33999.496'MB/sec zip my value time = 1.34's, unzip length = 0.108'GB zip my value throughput = 80.830'MB/sec zip pipeline throughput = 80.830'MB/sec entries = 925713 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.99 avg-zval = 35.09 usrkeys = 925713 avg-key = 20.00 avg-zkey = 1.90 avg-val = 121.44 avg-zval = 35.09 TagRS{ kinds = RS_Key0_TagN bytes = 144760 } TagArray{ size = 588487 bytes = 2206848 } seq expand size = 4119409 multi value expand size = 0 cnt WriteAppend = 17 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0325 GB dict = 1.08 MB all = 0.0377 GB } UnZip/Zip{ index = 10.5130 value = 3.3341 dict = 1.00 all = 3.5616 } Zip/UnZip{ index = 0.0951 value = 0.2999 dict = 1.00 all = 0.2808 } ---------------------------- total value len = 9.408984 GB avg = 0.165 KB (by entry num) total key len = 1.575496 GB avg = 0.028 KB total ukey len = 1.094074 GB avg = 0.016 KB total ukey num = 0.070360244 Billion total entry num = 0.057167973 Billion write speed all = 0.845768497 MB/sec (with seq num) write speed all = 0.810554543 MB/sec (without seq num) 2024/11/23-12:31:39.832926 139957181593152 [compaction_job.cc:1948] [default] [JOB 26049] Generated table #259603: 925713 keys, 37684890 bytes, temperature: kWarm 2024/11/23-12:31:39.833005 139957181593152 EVENT_LOG_v1 {"time_micros": 1732336299832959, "cf_name": "default", "job": 26049, "event": "table_file_creation", "file_number": 259603, "file_size": 37684890, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3975181643, "table_properties": {"data_size": 32482112, "index_size": 1761088, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25919964, "raw_average_key_size": 28, "raw_value_size": 108297822, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 925713, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732336296, "oldest_key_time": 0, "file_creation_time": 1732336296, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 259603, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-12:31:39.869342 139957181593152 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-26049/att-00/259604.sst) /dev/shm/ToplingTemp/Topling-49147-rfeTRs 2024/11/23-12:31:40.730537 139957181593152 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-26049/att-00/259604.sst): first pass time = 0.86's, 155.858'MB/sec 2024/11/23-12:31:42.032570 139957181593152 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-26049/att-00/259604.sst): old prealloc_size = 147639500, real_size = 32893712 2024/11/23-12:31:42.033106 139957181593152 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-26049/att-00/259604.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 934034 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1081 GB zip-val = 0.0309 GB avg-val = 115.70 avg-zval = 33.06 2024/11/23-12:31:42.033926 139957181593152 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-26049/att-00/259604.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-12:31:42.884569 139957181593152 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-26049/att-00/259604.sst): second pass time = 1.30's, 83.045'MB/sec, value only(80.5% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.85's, 43.581'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3457.665'MB/sec (index lex order gen) rebuild zvType time = 0.73's, 0.322'MB/sec write SST data time = 0.13's, 295.019'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 35276.196'MB/sec zip my value time = 1.30's, unzip length = 0.108'GB zip my value throughput = 83.045'MB/sec zip pipeline throughput = 83.045'MB/sec entries = 934034 avg-key = 28.00 avg-zkey = 1.90 avg-val = 115.70 avg-zval = 33.06 usrkeys = 934034 avg-key = 20.00 avg-zkey = 1.90 avg-val = 122.70 avg-zval = 33.06 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 934034 bytes = 3385888 } seq expand size = 6538238 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0187 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0309 GB dict = 1.08 MB all = 0.0371 GB } UnZip/Zip{ index = 10.5150 value = 3.4991 dict = 1.00 all = 3.6148 } Zip/UnZip{ index = 0.0951 value = 0.2858 dict = 1.00 all = 0.2766 } ---------------------------- total value len = 9.523587 GB avg = 0.164 KB (by entry num) total key len = 1.601649 GB avg = 0.028 KB total ukey len = 1.112755 GB avg = 0.016 KB total ukey num = 0.071294278 Billion total entry num = 0.058102007 Billion write speed all = 0.856402004 MB/sec (with seq num) write speed all = 0.820621243 MB/sec (without seq num) 2024/11/23-12:31:42.930588 139957181593152 [compaction_job.cc:1948] [default] [JOB 26049] Generated table #259604: 934034 keys, 37129954 bytes, temperature: kWarm 2024/11/23-12:31:42.930658 139957181593152 EVENT_LOG_v1 {"time_micros": 1732336302930623, "cf_name": "default", "job": 26049, "event": "table_file_creation", "file_number": 259604, "file_size": 37129954, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3487497056, "largest_seqno": 3975183032, "table_properties": {"data_size": 30883456, "index_size": 1776576, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26152952, "raw_average_key_size": 28, "raw_value_size": 108064804, "raw_average_value_size": 115, "num_data_blocks": 1, "num_entries": 934034, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732336299, "oldest_key_time": 0, "file_creation_time": 1732336299, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 259604, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-12:31:42.967778 139957181593152 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-26049/att-00/259605.sst) /dev/shm/ToplingTemp/Topling-49147-Hby66t 2024/11/23-12:31:43.927391 139957181593152 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-26049/att-00/259605.sst): first pass time = 0.96's, 139.872'MB/sec 2024/11/23-12:31:45.215428 139957181593152 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-26049/att-00/259605.sst): old prealloc_size = 147639500, real_size = 33818576 2024/11/23-12:31:45.216000 139957181593152 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-26049/att-00/259605.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 925668 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0318 GB avg-val = 117.00 avg-zval = 34.38 2024/11/23-12:31:45.216810 139957181593152 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-26049/att-00/259605.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-12:31:46.070877 139957181593152 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-26049/att-00/259605.sst): second pass time = 1.29's, 84.141'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.86's, 44.592'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3163.996'MB/sec (index lex order gen) rebuild zvType time = 0.73's, 0.318'MB/sec write SST data time = 0.13's, 298.137'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 35935.681'MB/sec zip my value time = 1.29's, unzip length = 0.108'GB zip my value throughput = 84.141'MB/sec zip pipeline throughput = 84.141'MB/sec entries = 925668 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.00 avg-zval = 34.38 usrkeys = 925668 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.00 avg-zval = 34.38 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 925668 bytes = 3471264 } seq expand size = 6479676 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0318 GB dict = 1.08 MB all = 0.0381 GB } UnZip/Zip{ index = 10.5132 value = 3.4029 dict = 1.00 all = 3.5186 } Zip/UnZip{ index = 0.0951 value = 0.2939 dict = 1.00 all = 0.2842 } ---------------------------- total value len = 9.638366 GB avg = 0.163 KB (by entry num) total key len = 1.627567 GB avg = 0.028 KB total ukey len = 1.131268 GB avg = 0.016 KB total ukey num = 0.072219946 Billion total entry num = 0.059027675 Billion write speed all = 0.867020005 MB/sec (with seq num) write speed all = 0.830678106 MB/sec (without seq num) 2024/11/23-12:31:46.117990 139957181593152 [compaction_job.cc:1948] [default] [JOB 26049] Generated table #259605: 925668 keys, 38144758 bytes, temperature: kWarm 2024/11/23-12:31:46.118060 139957181593152 EVENT_LOG_v1 {"time_micros": 1732336306118024, "cf_name": "default", "job": 26049, "event": "table_file_creation", "file_number": 259605, "file_size": 38144758, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3273701103, "largest_seqno": 3975182820, "table_properties": {"data_size": 31825984, "index_size": 1760960, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25918704, "raw_average_key_size": 28, "raw_value_size": 108299156, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 925668, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732336302, "oldest_key_time": 0, "file_creation_time": 1732336302, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 259605, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-12:31:46.154581 139957181593152 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-26049/att-00/259606.sst) /dev/shm/ToplingTemp/Topling-49147-7BFmUu 2024/11/23-12:31:47.129383 139957181593152 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-26049/att-00/259606.sst): first pass time = 0.97's, 137.692'MB/sec 2024/11/23-12:31:48.397223 139957181593152 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-26049/att-00/259606.sst): old prealloc_size = 147639500, real_size = 30280336 2024/11/23-12:31:48.397785 139957181593152 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-26049/att-00/259606.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 930457 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1082 GB zip-val = 0.0283 GB avg-val = 116.25 avg-zval = 30.38 2024/11/23-12:31:48.398550 139957181593152 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-26049/att-00/259606.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-12:31:49.215184 139957181593152 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-26049/att-00/259606.sst): second pass time = 1.27's, 85.368'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.82's, 41.899'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3302.917'MB/sec (index lex order gen) rebuild zvType time = 0.69's, 0.336'MB/sec write SST data time = 0.12's, 275.332'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 37366.062'MB/sec zip my value time = 1.27's, unzip length = 0.108'GB zip my value throughput = 85.368'MB/sec zip pipeline throughput = 85.368'MB/sec entries = 930457 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.25 avg-zval = 30.38 usrkeys = 930457 avg-key = 20.00 avg-zkey = 1.91 avg-val = 123.25 avg-zval = 30.38 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 930457 bytes = 3140304 } seq expand size = 6513199 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0283 GB dict = 1.08 MB all = 0.0343 GB } UnZip/Zip{ index = 10.4446 value = 3.8267 dict = 1.00 all = 3.9164 } Zip/UnZip{ index = 0.0957 value = 0.2613 dict = 1.00 all = 0.2553 } ---------------------------- total value len = 9.753044 GB avg = 0.163 KB (by entry num) total key len = 1.653620 GB avg = 0.028 KB total ukey len = 1.149877 GB avg = 0.016 KB total ukey num = 0.073150403 Billion total entry num = 0.059958132 Billion write speed all = 0.877638213 MB/sec (with seq num) write speed all = 0.840732386 MB/sec (without seq num) 2024/11/23-12:31:49.257065 139957181593152 [compaction_job.cc:1948] [default] [JOB 26049] Generated table #259606: 930457 keys, 34270550 bytes, temperature: kWarm 2024/11/23-12:31:49.257134 139957181593152 EVENT_LOG_v1 {"time_micros": 1732336309257098, "cf_name": "default", "job": 26049, "event": "table_file_creation", "file_number": 259606, "file_size": 34270550, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3872875407, "largest_seqno": 3975181689, "table_properties": {"data_size": 28265856, "index_size": 1781696, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26052796, "raw_average_key_size": 28, "raw_value_size": 108165038, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 930457, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732336306, "oldest_key_time": 0, "file_creation_time": 1732336306, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 259606, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-12:31:49.300928 139957181593152 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-26049/att-00/259607.sst) /dev/shm/ToplingTemp/Topling-49147-NT8A0q 2024/11/23-12:31:50.185045 139957181593152 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-26049/att-00/259607.sst): first pass time = 0.88's, 151.816'MB/sec 2024/11/23-12:31:51.510891 139957181593152 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-26049/att-00/259607.sst): old prealloc_size = 147639500, real_size = 33020592 2024/11/23-12:31:51.511505 139957181593152 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-26049/att-00/259607.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 928733 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1082 GB zip-val = 0.0310 GB avg-val = 116.52 avg-zval = 33.39 2024/11/23-12:31:51.512309 139957181593152 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-26049/att-00/259607.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-12:31:52.351777 139957181593152 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-26049/att-00/259607.sst): second pass time = 1.32's, 81.701'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.84's, 44.427'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2996.545'MB/sec (index lex order gen) rebuild zvType time = 0.72's, 0.324'MB/sec write SST data time = 0.12's, 302.050'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 30840.836'MB/sec zip my value time = 1.32's, unzip length = 0.108'GB zip my value throughput = 81.701'MB/sec zip pipeline throughput = 81.701'MB/sec entries = 928733 avg-key = 28.00 avg-zkey = 1.92 avg-val = 116.52 avg-zval = 33.39 usrkeys = 928733 avg-key = 20.00 avg-zkey = 1.92 avg-val = 123.52 avg-zval = 33.39 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 928733 bytes = 3482768 } seq expand size = 6501131 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0310 GB dict = 1.08 MB all = 0.0374 GB } UnZip/Zip{ index = 10.4425 value = 3.4897 dict = 1.00 all = 3.5929 } Zip/UnZip{ index = 0.0958 value = 0.2866 dict = 1.00 all = 0.2783 } ---------------------------- total value len = 9.867759 GB avg = 0.162 KB (by entry num) total key len = 1.679625 GB avg = 0.028 KB total ukey len = 1.168452 GB avg = 0.016 KB total ukey num = 0.074079136 Billion total entry num = 0.060886865 Billion write speed all = 0.888250880 MB/sec (with seq num) write speed all = 0.850782435 MB/sec (without seq num) 2024/11/23-12:31:52.396797 139957181593152 [compaction_job.cc:1948] [default] [JOB 26049] Generated table #259607: 928733 keys, 37356748 bytes, temperature: kWarm 2024/11/23-12:31:52.396866 139957181593152 EVENT_LOG_v1 {"time_micros": 1732336312396831, "cf_name": "default", "job": 26049, "event": "table_file_creation", "file_number": 259607, "file_size": 37356748, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3369194706, "largest_seqno": 3975183412, "table_properties": {"data_size": 31009504, "index_size": 1778752, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26004524, "raw_average_key_size": 28, "raw_value_size": 108213270, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 928733, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732336309, "oldest_key_time": 0, "file_creation_time": 1732336309, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 259607, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-12:31:52.436339 139957181593152 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-26049/att-00/259608.sst) /dev/shm/ToplingTemp/Topling-49147-mkkvAu 2024/11/23-12:31:53.430909 139957181593152 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-26049/att-00/259608.sst): first pass time = 0.99's, 134.955'MB/sec 2024/11/23-12:31:54.758566 139957181593152 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-26049/att-00/259608.sst): old prealloc_size = 147639500, real_size = 32257376 2024/11/23-12:31:54.759091 139957181593152 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-26049/att-00/259608.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 928593 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0303 GB avg-val = 116.54 avg-zval = 32.59 2024/11/23-12:31:54.761046 139957181593152 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-26049/att-00/259608.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-12:31:55.599050 139957181593152 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-26049/att-00/259608.sst): second pass time = 1.33's, 81.558'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.84's, 43.401'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3518.349'MB/sec (index lex order gen) rebuild zvType time = 0.71's, 0.326'MB/sec write SST data time = 0.13's, 286.035'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 37560.124'MB/sec zip my value time = 1.33's, unzip length = 0.108'GB zip my value throughput = 81.558'MB/sec zip pipeline throughput = 81.558'MB/sec entries = 928593 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.54 avg-zval = 32.59 usrkeys = 928593 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.54 avg-zval = 32.59 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 928593 bytes = 3366160 } seq expand size = 6500151 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0303 GB dict = 1.08 MB all = 0.0365 GB } UnZip/Zip{ index = 10.5132 value = 3.5764 dict = 1.00 all = 3.6795 } Zip/UnZip{ index = 0.0951 value = 0.2796 dict = 1.00 all = 0.2718 } ---------------------------- total value len = 9.982476 GB avg = 0.161 KB (by entry num) total key len = 1.705625 GB avg = 0.028 KB total ukey len = 1.187024 GB avg = 0.016 KB total ukey num = 0.075007729 Billion total entry num = 0.061815458 Billion write speed all = 0.898850697 MB/sec (with seq num) write speed all = 0.860820316 MB/sec (without seq num) 2024/11/23-12:31:55.643235 139957181593152 [compaction_job.cc:1948] [default] [JOB 26049] Generated table #259608: 928593 keys, 36477016 bytes, temperature: kWarm 2024/11/23-12:31:55.643305 139957181593152 EVENT_LOG_v1 {"time_micros": 1732336315643269, "cf_name": "default", "job": 26049, "event": "table_file_creation", "file_number": 259608, "file_size": 36477016, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3514720078, "largest_seqno": 3975183727, "table_properties": {"data_size": 30258512, "index_size": 1766528, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26000604, "raw_average_key_size": 28, "raw_value_size": 108217134, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 928593, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732336312, "oldest_key_time": 0, "file_creation_time": 1732336312, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 259608, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-12:31:55.682741 139957181593152 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-26049/att-00/259609.sst) /dev/shm/ToplingTemp/Topling-49147-DlGvVt 2024/11/23-12:31:56.681604 139957181593152 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-26049/att-00/259609.sst): first pass time = 1.00's, 134.375'MB/sec 2024/11/23-12:31:57.979846 139957181593152 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-26049/att-00/259609.sst): old prealloc_size = 147639500, real_size = 32256560 2024/11/23-12:31:57.980438 139957181593152 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-26049/att-00/259609.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 930669 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0303 GB avg-val = 116.22 avg-zval = 32.51 2024/11/23-12:31:57.981899 139957181593152 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-26049/att-00/259609.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-12:31:58.826286 139957181593152 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-26049/att-00/259609.sst): second pass time = 1.30's, 83.398'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.85's, 43.102'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3100.831'MB/sec (index lex order gen) rebuild zvType time = 0.72's, 0.324'MB/sec write SST data time = 0.13's, 285.398'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 39041.567'MB/sec zip my value time = 1.30's, unzip length = 0.108'GB zip my value throughput = 83.398'MB/sec zip pipeline throughput = 83.398'MB/sec entries = 930669 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.22 avg-zval = 32.51 usrkeys = 930669 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.22 avg-zval = 32.51 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 930669 bytes = 3373696 } seq expand size = 6514683 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0303 GB dict = 1.08 MB all = 0.0365 GB } UnZip/Zip{ index = 10.5135 value = 3.5751 dict = 1.00 all = 3.6790 } Zip/UnZip{ index = 0.0951 value = 0.2797 dict = 1.00 all = 0.2718 } ---------------------------- total value len = 10.097150 GB avg = 0.161 KB (by entry num) total key len = 1.731684 GB avg = 0.028 KB total ukey len = 1.205637 GB avg = 0.016 KB total ukey num = 0.075938398 Billion total entry num = 0.062746127 Billion write speed all = 0.909447747 MB/sec (with seq num) write speed all = 0.870854374 MB/sec (without seq num) 2024/11/23-12:31:58.873013 139957181593152 [compaction_job.cc:1948] [default] [JOB 26049] Generated table #259609: 930669 keys, 36481722 bytes, temperature: kWarm 2024/11/23-12:31:58.873083 139957181593152 EVENT_LOG_v1 {"time_micros": 1732336318873046, "cf_name": "default", "job": 26049, "event": "table_file_creation", "file_number": 259609, "file_size": 36481722, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3610601794, "largest_seqno": 3975182779, "table_properties": {"data_size": 30253280, "index_size": 1770432, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26058732, "raw_average_key_size": 28, "raw_value_size": 108159098, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 930669, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732336315, "oldest_key_time": 0, "file_creation_time": 1732336315, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 259609, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-12:31:58.920848 139957181593152 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-26049/att-00/259610.sst) /dev/shm/ToplingTemp/Topling-49147-YE6AFs 2024/11/23-12:31:59.971991 139957181593152 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-26049/att-00/259610.sst): first pass time = 1.05's, 127.693'MB/sec 2024/11/23-12:32:01.255084 139957181593152 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-26049/att-00/259610.sst): old prealloc_size = 147639500, real_size = 32536688 2024/11/23-12:32:01.255661 139957181593152 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-26049/att-00/259610.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 931866 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1081 GB zip-val = 0.0305 GB avg-val = 116.03 avg-zval = 32.75 2024/11/23-12:32:01.258240 139957181593152 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-26049/att-00/259610.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-12:32:02.112624 139957181593152 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-26049/att-00/259610.sst): second pass time = 1.28's, 84.324'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.86's, 42.875'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3216.976'MB/sec (index lex order gen) rebuild zvType time = 0.73's, 0.321'MB/sec write SST data time = 0.13's, 280.626'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 35768.960'MB/sec zip my value time = 1.28's, unzip length = 0.108'GB zip my value throughput = 84.324'MB/sec zip pipeline throughput = 84.324'MB/sec entries = 931866 avg-key = 28.00 avg-zkey = 1.92 avg-val = 116.03 avg-zval = 32.75 usrkeys = 931866 avg-key = 20.00 avg-zkey = 1.92 avg-val = 123.03 avg-zval = 32.75 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 931866 bytes = 3378032 } seq expand size = 6523062 multi value expand size = 0 cnt WriteAppend = 15 UnZipSize{ index = 0.0186 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0305 GB dict = 1.08 MB all = 0.0368 GB } UnZip/Zip{ index = 10.4432 value = 3.5429 dict = 1.00 all = 3.6506 } Zip/UnZip{ index = 0.0958 value = 0.2823 dict = 1.00 all = 0.2739 } ---------------------------- total value len = 10.211798 GB avg = 0.160 KB (by entry num) total key len = 1.757776 GB avg = 0.028 KB total ukey len = 1.224275 GB avg = 0.016 KB total ukey num = 0.076870264 Billion total entry num = 0.063677993 Billion write speed all = 0.920035996 MB/sec (with seq num) write speed all = 0.880879352 MB/sec (without seq num) 2024/11/23-12:32:02.159403 139957181593152 [compaction_job.cc:1948] [default] [JOB 26049] Generated table #259610: 931866 keys, 36765716 bytes, temperature: kWarm 2024/11/23-12:32:02.159473 139957181593152 EVENT_LOG_v1 {"time_micros": 1732336322159438, "cf_name": "default", "job": 26049, "event": "table_file_creation", "file_number": 259610, "file_size": 36765716, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3516470397, "largest_seqno": 3975183558, "table_properties": {"data_size": 30518880, "index_size": 1784640, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26092248, "raw_average_key_size": 28, "raw_value_size": 108125484, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 931866, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732336318, "oldest_key_time": 0, "file_creation_time": 1732336318, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 259610, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-12:32:02.196438 139957181593152 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-26049/att-00/259611.sst) /dev/shm/ToplingTemp/Topling-49147-gRc1Sq 2024/11/23-12:32:03.364187 139957181593152 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-26049/att-00/259611.sst): first pass time = 1.17's, 114.942'MB/sec 2024/11/23-12:32:04.664046 139957181593152 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-26049/att-00/259611.sst): old prealloc_size = 147639500, real_size = 31191136 2024/11/23-12:32:04.664577 139957181593152 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-26049/att-00/259611.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 928881 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0292 GB avg-val = 116.49 avg-zval = 31.43 2024/11/23-12:32:04.667141 139957181593152 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-26049/att-00/259611.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-12:32:05.488791 139957181593152 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-26049/att-00/259611.sst): second pass time = 1.30's, 83.299'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.82's, 43.078'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3472.968'MB/sec (index lex order gen) rebuild zvType time = 0.69's, 0.334'MB/sec write SST data time = 0.13's, 274.363'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 34039.856'MB/sec zip my value time = 1.30's, unzip length = 0.108'GB zip my value throughput = 83.299'MB/sec zip pipeline throughput = 83.299'MB/sec entries = 928881 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.49 avg-zval = 31.43 usrkeys = 928881 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.49 avg-zval = 31.43 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 928881 bytes = 3483312 } seq expand size = 6502167 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0292 GB dict = 1.08 MB all = 0.0355 GB } UnZip/Zip{ index = 10.5146 value = 3.7068 dict = 1.00 all = 3.7778 } Zip/UnZip{ index = 0.0951 value = 0.2698 dict = 1.00 all = 0.2647 } ---------------------------- total value len = 10.326509 GB avg = 0.160 KB (by entry num) total key len = 1.783785 GB avg = 0.028 KB total ukey len = 1.242852 GB avg = 0.016 KB total ukey num = 0.077799145 Billion total entry num = 0.064606874 Billion write speed all = 0.930610870 MB/sec (with seq num) write speed all = 0.890893349 MB/sec (without seq num) 2024/11/23-12:32:05.531521 139957181593152 [compaction_job.cc:1948] [default] [JOB 26049] Generated table #259611: 928881 keys, 35527556 bytes, temperature: kWarm 2024/11/23-12:32:05.531592 139957181593152 EVENT_LOG_v1 {"time_micros": 1732336325531557, "cf_name": "default", "job": 26049, "event": "table_file_creation", "file_number": 259611, "file_size": 35527556, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3369353416, "largest_seqno": 3975181889, "table_properties": {"data_size": 29191888, "index_size": 1766848, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26008668, "raw_average_key_size": 28, "raw_value_size": 108209098, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 928881, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732336322, "oldest_key_time": 0, "file_creation_time": 1732336322, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 259611, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-12:32:05.569827 139957181593152 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-26049/att-00/259612.sst) /dev/shm/ToplingTemp/Topling-49147-INqJBu 2024/11/23-12:32:06.014916 139957181593152 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-26049/att-00/259612.sst): first pass time = 0.45's, 245.123'MB/sec 2024/11/23-12:32:07.142697 139957181593152 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-26049/att-00/259612.sst): old prealloc_size = 147639500, real_size = 29453968 2024/11/23-12:32:07.143212 139957181593152 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-26049/att-00/259612.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 756166 prefix = 4 raw-key = 0.0121 GB zip-key = 0.0014 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.0879 GB zip-val = 0.0278 GB avg-val = 116.27 avg-zval = 36.79 2024/11/23-12:32:07.144584 139957181593152 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-26049/att-00/259612.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0019 GB, waited 0.000 sec, Key+Value = 0.109 GB 2024/11/23-12:32:07.791281 139957181593152 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-26049/att-00/259612.sst): second pass time = 1.13's, 78.012'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.65's, 49.987'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2941.825'MB/sec (index lex order gen) rebuild zvType time = 0.54's, 0.348'MB/sec write SST data time = 0.10's, 309.556'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.879'MB, throughput = 25511.697'MB/sec zip my value time = 1.13's, unzip length = 0.088'GB zip my value throughput = 78.012'MB/sec zip pipeline throughput = 78.012'MB/sec entries = 756166 avg-key = 28.00 avg-zkey = 1.92 avg-val = 116.27 avg-zval = 36.79 usrkeys = 756166 avg-key = 20.00 avg-zkey = 1.92 avg-val = 121.58 avg-zval = 36.79 TagRS{ kinds = RS_Key0_TagN bytes = 118240 } TagArray{ size = 573169 bytes = 2149392 } seq expand size = 4012183 multi value expand size = 0 cnt WriteAppend = 15 UnZipSize{ index = 0.0151 GB value = 0.0879 GB dict = 0.88 MB all = 0.1091 GB } __ZipSize{ index = 0.0014 GB value = 0.0278 GB dict = 0.88 MB all = 0.0324 GB } UnZip/Zip{ index = 10.4415 value = 3.1607 dict = 1.00 all = 3.3650 } Zip/UnZip{ index = 0.0958 value = 0.3164 dict = 1.00 all = 0.2972 } ---------------------------- total value len = 10.418441 GB avg = 0.159 KB (by entry num) total key len = 1.804958 GB avg = 0.028 KB total ukey len = 1.257976 GB avg = 0.016 KB total ukey num = 0.078555311 Billion total entry num = 0.065363040 Billion write speed all = 0.939136139 MB/sec (with seq num) write speed all = 0.898960868 MB/sec (without seq num) 2024/11/23-12:32:07.832019 139957181593152 [compaction_job.cc:1948] [default] [JOB 26049] Generated table #259612: 756166 keys, 32419540 bytes, temperature: kWarm 2024/11/23-12:32:07.832089 139957181593152 EVENT_LOG_v1 {"time_micros": 1732336327832054, "cf_name": "default", "job": 26049, "event": "table_file_creation", "file_number": 259612, "file_size": 32419540, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3975183132, "table_properties": {"data_size": 27816384, "index_size": 1448384, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 21172648, "raw_average_key_size": 28, "raw_value_size": 87919176, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 756166, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732336325, "oldest_key_time": 0, "file_creation_time": 1732336325, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 259612, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-12:32:07.854454 139957181593152 [compaction_job.cc:703] job-26049: subcompact[0], size: 0.510536 G, files: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-26049/att-00 [259599,259600,259601,259602,259603,259604,259605,259606,259607,259608,259609,259610,259611,259612] 2024/11/23-12:32:07.937408 139957181593152 (Original Log Time 2024/11/23-12:31:22.246838) EVENT_LOG_v1 {"time_micros": 1732336282246811, "job": 26049, "event": "compaction_started", "compaction_reason": "FilesMarkedForCompaction", "files_L2": [259529], "files_L3": [259588, 259589, 259487, 259489, 259490, 259491, 259492, 259493, 259494, 259495, 259496, 259497, 259498, 259499, 259593], "score": 0.997929, "input_data_size": 537631413, "oldest_snapshot_seqno": 3975543846} 2024/11/23-12:32:07.937411 139957181593152 (Original Log Time 2024/11/23-12:32:07.936224) [compaction_job.cc:2022] [default] [JOB 26049] Compacted 1@2 + 15@3 files to L3 => 510536211 bytes 2024/11/23-12:32:07.937413 139957181593152 (Original Log Time 2024/11/23-12:32:07.937342) [compaction_job.cc:1224] [default] compacted to: files[0 0 0 14 0 0 0] max score 0.02, MB/sec: 11.8 rd, 11.2 wr, level 3, files in(1, 15) out(14 +0 blob) MB in(27.1, 485.6 +0.0 blob) out(486.9 +0.0 blob), read-write-amplify(36.9) write-amplify(18.0) OK, records in: 13041986, records dropped: 37110 output_compression: Snappy 2024/11/23-12:32:07.937419 139957181593152 (Original Log Time 2024/11/23-12:32:07.937385) EVENT_LOG_v1 {"time_micros": 1732336327937365, "cf": "default", "job": 26049, "event": "compaction_finished", "compaction_time_micros": 45607627, "compaction_time_cpu_micros": 19757002, "output_level": 3, "num_output_files": 14, "total_output_size": 510536211, "num_input_records": 13041986, "num_output_records": 13004876, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "file_write_nanos": 362918328, "file_range_sync_nanos": 0, "file_fsync_nanos": 9498, "file_prepare_write_nanos": 35893, "lsm_state": [0, 0, 0, 14, 0, 0, 0]} 2024/11/23-12:32:08.068249 139957181593152 DEBG dcompact_worker.cpp:240: HttpPost: 200 OK: url = http://nlb-7zny4kaa1poal01o64.cn-shenzhen.nlb.aliyuncs.com:8443, body = {"instanceId":"nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137","labourId":"","dbId":"d89b4006-2803-486e-b7a2-759bcf348921","dbStarts":1732256054,"starts":1732336282,"executesMs":45815,"compactionJobId":26049,"attempt":0,"compactionInputRawBytes":1859192793,"compactionInputZipBytes":537631413,"compactionOutputRawBytes":0,"compactionOutputZipBytes":510536211,"headers":{"Accept":"*/*","Connection":"close","Host":"aliyun-topling-saas.topling.cn:18443","RemoteIp":"120.24.192.169","X-Forwarded-For":"120.24.192.169","region":"cn-shenzhen","token":"e6474c481bd4415abc537135cc03626b","instance-token":"e6474c481bd4415abc537135cc03626b","provider":"aliyun","CloudMarketInstanceId":"si-59c0ae5c955845588903","MeteringAssit":"","Transfer-Encoding":"chunked","traceparent":"00-01b592c7be8a8a7500362fd678556361-a13ba1c2d157053d-00"}}, response = 2024/11/23-12:32:08.068341 139957181593152 INFO dcompact_worker.cpp:1459: finish /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-26049/att-00: olev 3, work 45.816 s, result 7.682 ms, install 1.210 ms, input{raw 1.732 GiB zip 512.725 MiB}