2024/11/22-16:35:07.238810 140025129498176 DEBG dcompact_worker.cpp:2214: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04727/att-00: fork to child time = 0.009938 sec 2024/11/22-16:35:07.239641 140025129498176 DEBG dcompact_worker.cpp:1013: Beg SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04727/att-00 2024/11/22-16:35:07.246931 140025129498176 DEBG dcompact_worker.cpp:1033: End SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04727/att-00 2024/11/22-16:35:07.248066 140025129498176 TRAC dcompact_worker.cpp:1083: INFO_LOG_LEVEL: rpc = INFO_LEVEL, env_var = undefined 2024/11/22-16:35:07.248333 140025129498176 [WARN] [column_family.cc:386] multiple cf_paths/db_paths and level_compaction_dynamic_level_bytes can't be used together 2024/11/22-16:35:07.299481 140025129498176 [version_set.cc:6208] Recovering from manifest file: /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-04727/att-00/MANIFEST-206347 2024/11/22-16:35:07.330212 140025129498176 [version_set.cc:6251] Recovered from manifest file:/worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-04727/att-00/MANIFEST-206347 succeeded,manifest_file_number is 206347, next_file_number is 214910, last_sequence is 3384648861, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 214741 2024/11/22-16:35:07.330218 140025129498176 [version_set.cc:6266] Column family [default] (ID 0), log number is 0 2024/11/22-16:35:07.330305 140025129498176 [version_set.cc:5721] Creating manifest 214910 2024/11/22-16:35:07.384035 140025129498176 DEBG dcompact_worker.cpp:1218: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04727/att-00: bottommost_level: fake = 1, rpc = 0 2024/11/22-16:35:07.404142 140025129498176 [compaction_job.cc:2437] [default] [JOB 4727] Compacting 1@2 + 13@3 files to L3, score 0.90, subcompactions 1 : 1 2024/11/22-16:35:07.404157 140025129498176 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 3683 Base level 2, inputs: [214871(27MB)], [214824(36MB) 214825(36MB) 214826(36MB) 214827(36MB) 214828(36MB) 214829(36MB) 214830(38MB) 214831(38MB) 214832(37MB) 214833(35MB) 214834(35MB) 214835(37MB) 214902(39MB)] 2024/11/22-16:35:07.410304 140025129498176 [top_zip_table.cc:59] core git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/22-16:35:07.410339 140025129498176 [top_zip_table.cc:60] fsa git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/22-16:35:07.410357 140025129498176 [top_zip_table.cc:61] zbs git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/22-16:35:07.410361 140025129498176 [top_zip_table.cc:62] topling-zip_table_reader: git_version_hash_info_is: commit a4a382006cb82713acf5b3425835f22711877681 Author: leipeng Date: 2024-04-11 19:44:14 +0800 fixed_len_hole_index.cc: Add env bool FixedLenHoleIndexUseAVX512 for ut & debug 1. FixedLenHoleIndexUseAVX512 is only in unit tests or debug 2. In release mode, use avx512 by compile options(-march=) g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/22-16:35:07.410371 140025129498176 [top_zip_table.cc:64] topling-rocks git_version_hash_info_is: commit feab587e468621ba0204d47b4ffacc52e7c4290d Author: leipeng Date: 2024-03-22 13:35:06 +0800 ToplingZipTableBuilder::Add: immediately return after error This function returns void, and caller does not check builder->status() after calling this function and graceful abandon. So immediately return after error, and return error status in Finish(). g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/22-16:35:07.858836 140025129498176 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04727/att-00/214911.sst) /dev/shm/ToplingTemp/Topling-201193-XCEufr 2024/11/22-16:35:08.547727 140025129498176 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04727/att-00/214911.sst): first pass time = 0.69's, 194.845'MB/sec 2024/11/22-16:35:13.022796 140025129498176 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04727/att-00/214911.sst): old prealloc_size = 147639500, real_size = 33813152 2024/11/22-16:35:13.023385 140025129498176 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04727/att-00/214911.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 921243 prefix = 4 raw-key = 0.0147 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1084 GB zip-val = 0.0318 GB avg-val = 117.69 avg-zval = 34.54 2024/11/22-16:35:13.024186 140025129498176 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04727/att-00/214911.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-16:35:14.442089 140025129498176 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04727/att-00/214911.sst): second pass time = 4.47's, 24.233'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.42's, 26.620'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3140.851'MB/sec (index lex order gen) rebuild zvType time = 1.12's, 0.206'MB/sec write SST data time = 0.30's, 126.160'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.084'MB, throughput = 35175.592'MB/sec zip my value time = 4.47's, unzip length = 0.108'GB zip my value throughput = 24.233'MB/sec zip pipeline throughput = 133.884'MB/sec entries = 921243 avg-key = 28.00 avg-zkey = 1.92 avg-val = 117.69 avg-zval = 34.54 usrkeys = 921243 avg-key = 20.00 avg-zkey = 1.92 avg-val = 124.69 avg-zval = 34.54 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 921243 bytes = 3109216 } seq expand size = 6448701 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0184 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0318 GB dict = 1.08 MB all = 0.0378 GB } UnZip/Zip{ index = 10.4432 value = 3.4076 dict = 1.00 all = 3.5525 } Zip/UnZip{ index = 0.0958 value = 0.2935 dict = 1.00 all = 0.2815 } ---------------------------- total value len = 0.114872 GB avg = 0.125 KB (by entry num) total key len = 0.025795 GB avg = 0.028 KB total ukey len = 0.018425 GB avg = 0.020 KB total ukey num = 0.000921243 Billion total entry num = 0.000921243 Billion write speed all = 0.005065166 MB/sec (with seq num) write speed all = 0.004799787 MB/sec (without seq num) 2024/11/22-16:35:14.479341 140025129498176 [compaction_job.cc:1948] [default] [JOB 4727] Generated table #214911: 921243 keys, 37781632 bytes, temperature: kWarm 2024/11/22-16:35:14.479450 140025129498176 EVENT_LOG_v1 {"time_micros": 1732264514479382, "cf_name": "default", "job": 4727, "event": "table_file_creation", "file_number": 214911, "file_size": 37781632, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3273702550, "largest_seqno": 3384308914, "table_properties": {"data_size": 31818384, "index_size": 1764288, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25794804, "raw_average_key_size": 28, "raw_value_size": 108422982, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 921243, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732264507, "oldest_key_time": 0, "file_creation_time": 1732264507, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 214911, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-16:35:14.547327 140025129498176 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04727/att-00/214912.sst) /dev/shm/ToplingTemp/Topling-201193-1d2VEu 2024/11/22-16:35:16.284328 140025129498176 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04727/att-00/214912.sst): first pass time = 1.74's, 77.272'MB/sec 2024/11/22-16:35:18.060424 140025129498176 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04727/att-00/214912.sst): old prealloc_size = 147639500, real_size = 34348064 2024/11/22-16:35:18.061088 140025129498176 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04727/att-00/214912.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 923261 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1084 GB zip-val = 0.0324 GB avg-val = 117.37 avg-zval = 35.05 2024/11/22-16:35:18.061877 140025129498176 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04727/att-00/214912.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-16:35:19.374918 140025129498176 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04727/att-00/214912.sst): second pass time = 1.78's, 61.037'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.31's, 29.154'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2719.728'MB/sec (index lex order gen) rebuild zvType time = 1.07's, 0.215'MB/sec write SST data time = 0.24's, 158.518'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.083'MB, throughput = 35473.419'MB/sec zip my value time = 1.78's, unzip length = 0.108'GB zip my value throughput = 61.037'MB/sec zip pipeline throughput = 63.846'MB/sec entries = 923261 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.37 avg-zval = 35.05 usrkeys = 923261 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.37 avg-zval = 35.05 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 923261 bytes = 3116016 } seq expand size = 6462827 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0185 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0324 GB dict = 1.08 MB all = 0.0383 GB } UnZip/Zip{ index = 10.5157 value = 3.3487 dict = 1.00 all = 3.5024 } Zip/UnZip{ index = 0.0951 value = 0.2986 dict = 1.00 all = 0.2855 } ---------------------------- total value len = 0.229701 GB avg = 0.125 KB (by entry num) total key len = 0.051646 GB avg = 0.028 KB total ukey len = 0.036890 GB avg = 0.020 KB total ukey num = 0.001844504 Billion total entry num = 0.001844504 Billion write speed all = 0.010129041 MB/sec (with seq num) write speed all = 0.009597795 MB/sec (without seq num) 2024/11/22-16:35:19.413459 140025129498176 [compaction_job.cc:1948] [default] [JOB 4727] Generated table #214912: 923261 keys, 38322024 bytes, temperature: kWarm 2024/11/22-16:35:19.413552 140025129498176 EVENT_LOG_v1 {"time_micros": 1732264519413508, "cf_name": "default", "job": 4727, "event": "table_file_creation", "file_number": 214912, "file_size": 38322024, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3273702561, "largest_seqno": 3384308487, "table_properties": {"data_size": 32361104, "index_size": 1755968, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25851308, "raw_average_key_size": 28, "raw_value_size": 108366454, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 923261, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732264514, "oldest_key_time": 0, "file_creation_time": 1732264514, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 214912, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-16:35:19.485943 140025129498176 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04727/att-00/214913.sst) /dev/shm/ToplingTemp/Topling-201193-HmfWlu 2024/11/22-16:35:20.751928 140025129498176 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04727/att-00/214913.sst): first pass time = 1.27's, 106.023'MB/sec 2024/11/22-16:35:22.348701 140025129498176 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04727/att-00/214913.sst): old prealloc_size = 147639500, real_size = 33900112 2024/11/22-16:35:22.349222 140025129498176 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04727/att-00/214913.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 921116 prefix = 4 raw-key = 0.0147 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1084 GB zip-val = 0.0319 GB avg-val = 117.71 avg-zval = 34.65 2024/11/22-16:35:22.350002 140025129498176 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04727/att-00/214913.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-16:35:23.777054 140025129498176 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04727/att-00/214913.sst): second pass time = 1.60's, 67.934'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.43's, 26.512'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3523.486'MB/sec (index lex order gen) rebuild zvType time = 1.15's, 0.200'MB/sec write SST data time = 0.28's, 136.636'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.084'MB, throughput = 33646.044'MB/sec zip my value time = 1.60's, unzip length = 0.108'GB zip my value throughput = 67.934'MB/sec zip pipeline throughput = 135.849'MB/sec entries = 921116 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.71 avg-zval = 34.65 usrkeys = 921116 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.71 avg-zval = 34.65 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 921116 bytes = 3108784 } seq expand size = 6447812 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0184 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0319 GB dict = 1.08 MB all = 0.0379 GB } UnZip/Zip{ index = 10.5123 value = 3.3971 dict = 1.00 all = 3.5443 } Zip/UnZip{ index = 0.0951 value = 0.2944 dict = 1.00 all = 0.2821 } ---------------------------- total value len = 0.344575 GB avg = 0.125 KB (by entry num) total key len = 0.077437 GB avg = 0.028 KB total ukey len = 0.055312 GB avg = 0.020 KB total ukey num = 0.002765620 Billion total entry num = 0.002765620 Billion write speed all = 0.015190867 MB/sec (with seq num) write speed all = 0.014394452 MB/sec (without seq num) 2024/11/22-16:35:23.810887 140025129498176 [compaction_job.cc:1948] [default] [JOB 4727] Generated table #214913: 921116 keys, 37868240 bytes, temperature: kWarm 2024/11/22-16:35:23.810981 140025129498176 EVENT_LOG_v1 {"time_micros": 1732264523810938, "cf_name": "default", "job": 4727, "event": "table_file_creation", "file_number": 214913, "file_size": 37868240, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3273702585, "largest_seqno": 3384308501, "table_properties": {"data_size": 31917184, "index_size": 1752448, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25791248, "raw_average_key_size": 28, "raw_value_size": 108426500, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 921116, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732264519, "oldest_key_time": 0, "file_creation_time": 1732264519, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 214913, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-16:35:23.859160 140025129498176 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04727/att-00/214914.sst) /dev/shm/ToplingTemp/Topling-201193-CbS6sr 2024/11/22-16:35:24.725709 140025129498176 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04727/att-00/214914.sst): first pass time = 0.87's, 154.895'MB/sec 2024/11/22-16:35:26.380599 140025129498176 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04727/att-00/214914.sst): old prealloc_size = 147639500, real_size = 34387392 2024/11/22-16:35:26.381177 140025129498176 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04727/att-00/214914.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 922969 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1084 GB zip-val = 0.0324 GB avg-val = 117.42 avg-zval = 35.10 2024/11/22-16:35:26.381936 140025129498176 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04727/att-00/214914.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-16:35:27.285096 140025129498176 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04727/att-00/214914.sst): second pass time = 1.65's, 65.539'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.90's, 42.411'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3150.922'MB/sec (index lex order gen) rebuild zvType time = 0.78's, 0.297'MB/sec write SST data time = 0.13's, 300.047'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.083'MB, throughput = 24571.234'MB/sec zip my value time = 1.65's, unzip length = 0.108'GB zip my value throughput = 65.539'MB/sec zip pipeline throughput = 74.240'MB/sec entries = 922969 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.42 avg-zval = 35.10 usrkeys = 922969 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.42 avg-zval = 35.10 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 922969 bytes = 3115040 } seq expand size = 6460783 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0324 GB dict = 1.08 MB all = 0.0384 GB } UnZip/Zip{ index = 10.5124 value = 3.3448 dict = 1.00 all = 3.4989 } Zip/UnZip{ index = 0.0951 value = 0.2990 dict = 1.00 all = 0.2858 } ---------------------------- total value len = 0.459411 GB avg = 0.125 KB (by entry num) total key len = 0.103280 GB avg = 0.028 KB total ukey len = 0.073772 GB avg = 0.020 KB total ukey num = 0.003688589 Billion total entry num = 0.003688589 Billion write speed all = 0.020252207 MB/sec (with seq num) write speed all = 0.019190139 MB/sec (without seq num) 2024/11/22-16:35:27.317383 140025129498176 [compaction_job.cc:1948] [default] [JOB 4727] Generated table #214914: 922969 keys, 38360276 bytes, temperature: kWarm 2024/11/22-16:35:27.317446 140025129498176 EVENT_LOG_v1 {"time_micros": 1732264527317412, "cf_name": "default", "job": 4727, "event": "table_file_creation", "file_number": 214914, "file_size": 38360276, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3273702604, "largest_seqno": 3384309524, "table_properties": {"data_size": 32400496, "index_size": 1755968, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25843132, "raw_average_key_size": 28, "raw_value_size": 108374606, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 922969, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732264523, "oldest_key_time": 0, "file_creation_time": 1732264523, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 214914, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-16:35:27.351349 140025129498176 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04727/att-00/214915.sst) /dev/shm/ToplingTemp/Topling-201193-Alrgtu 2024/11/22-16:35:28.187776 140025129498176 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04727/att-00/214915.sst): first pass time = 0.84's, 160.474'MB/sec 2024/11/22-16:35:29.805709 140025129498176 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04727/att-00/214915.sst): old prealloc_size = 147639500, real_size = 33989840 2024/11/22-16:35:29.806241 140025129498176 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04727/att-00/214915.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 921163 prefix = 4 raw-key = 0.0147 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1084 GB zip-val = 0.0320 GB avg-val = 117.70 avg-zval = 34.75 2024/11/22-16:35:29.806984 140025129498176 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04727/att-00/214915.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-16:35:30.731523 140025129498176 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04727/att-00/214915.sst): second pass time = 1.62's, 67.041'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.93's, 41.000'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3411.679'MB/sec (index lex order gen) rebuild zvType time = 0.80's, 0.289'MB/sec write SST data time = 0.13's, 295.251'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.084'MB, throughput = 39047.598'MB/sec zip my value time = 1.62's, unzip length = 0.108'GB zip my value throughput = 67.041'MB/sec zip pipeline throughput = 134.078'MB/sec entries = 921163 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.70 avg-zval = 34.75 usrkeys = 921163 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.70 avg-zval = 34.75 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 921163 bytes = 3108944 } seq expand size = 6448141 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0184 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0320 GB dict = 1.08 MB all = 0.0380 GB } UnZip/Zip{ index = 10.5106 value = 3.3876 dict = 1.00 all = 3.5360 } Zip/UnZip{ index = 0.0951 value = 0.2952 dict = 1.00 all = 0.2828 } ---------------------------- total value len = 0.574284 GB avg = 0.125 KB (by entry num) total key len = 0.129073 GB avg = 0.028 KB total ukey len = 0.092195 GB avg = 0.020 KB total ukey num = 0.004609752 Billion total entry num = 0.004609752 Billion write speed all = 0.025311873 MB/sec (with seq num) write speed all = 0.023984735 MB/sec (without seq num) 2024/11/22-16:35:30.768490 140025129498176 [compaction_job.cc:1948] [default] [JOB 4727] Generated table #214915: 921163 keys, 37958008 bytes, temperature: kWarm 2024/11/22-16:35:30.768537 140025129498176 EVENT_LOG_v1 {"time_micros": 1732264530768510, "cf_name": "default", "job": 4727, "event": "table_file_creation", "file_number": 214915, "file_size": 37958008, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3273702634, "largest_seqno": 3384308549, "table_properties": {"data_size": 32006528, "index_size": 1752832, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25792564, "raw_average_key_size": 28, "raw_value_size": 108425230, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 921163, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732264527, "oldest_key_time": 0, "file_creation_time": 1732264527, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 214915, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-16:35:30.802179 140025129498176 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04727/att-00/214916.sst) /dev/shm/ToplingTemp/Topling-201193-XrNscs 2024/11/22-16:35:31.595201 140025129498176 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04727/att-00/214916.sst): first pass time = 0.79's, 169.255'MB/sec 2024/11/22-16:35:33.211813 140025129498176 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04727/att-00/214916.sst): old prealloc_size = 147639500, real_size = 34417488 2024/11/22-16:35:33.212356 140025129498176 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04727/att-00/214916.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 923159 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1084 GB zip-val = 0.0324 GB avg-val = 117.39 avg-zval = 35.13 2024/11/22-16:35:33.213086 140025129498176 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04727/att-00/214916.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-16:35:34.115094 140025129498176 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04727/att-00/214916.sst): second pass time = 1.62's, 67.061'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.90's, 42.502'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3362.379'MB/sec (index lex order gen) rebuild zvType time = 0.77's, 0.298'MB/sec write SST data time = 0.13's, 297.324'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.083'MB, throughput = 33498.685'MB/sec zip my value time = 1.62's, unzip length = 0.108'GB zip my value throughput = 67.061'MB/sec zip pipeline throughput = 134.118'MB/sec entries = 923159 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.39 avg-zval = 35.13 usrkeys = 923159 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.39 avg-zval = 35.13 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 923159 bytes = 3115680 } seq expand size = 6462113 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0324 GB dict = 1.08 MB all = 0.0384 GB } UnZip/Zip{ index = 10.5115 value = 3.3416 dict = 1.00 all = 3.4961 } Zip/UnZip{ index = 0.0951 value = 0.2993 dict = 1.00 all = 0.2860 } ---------------------------- total value len = 0.689115 GB avg = 0.125 KB (by entry num) total key len = 0.154922 GB avg = 0.028 KB total ukey len = 0.110658 GB avg = 0.020 KB total ukey num = 0.005532911 Billion total entry num = 0.005532911 Billion write speed all = 0.030370853 MB/sec (with seq num) write speed all = 0.028778134 MB/sec (without seq num) 2024/11/22-16:35:34.154394 140025129498176 [compaction_job.cc:1948] [default] [JOB 4727] Generated table #214916: 923159 keys, 38390820 bytes, temperature: kWarm 2024/11/22-16:35:34.154457 140025129498176 EVENT_LOG_v1 {"time_micros": 1732264534154425, "cf_name": "default", "job": 4727, "event": "table_file_creation", "file_number": 214916, "file_size": 38390820, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3273702649, "largest_seqno": 3384308660, "table_properties": {"data_size": 32430016, "index_size": 1756480, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25848452, "raw_average_key_size": 28, "raw_value_size": 108369306, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 923159, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732264530, "oldest_key_time": 0, "file_creation_time": 1732264530, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 214916, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-16:35:34.190545 140025129498176 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04727/att-00/214917.sst) /dev/shm/ToplingTemp/Topling-201193-jxRXWr 2024/11/22-16:35:35.077133 140025129498176 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04727/att-00/214917.sst): first pass time = 0.89's, 151.394'MB/sec 2024/11/22-16:35:36.704910 140025129498176 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04727/att-00/214917.sst): old prealloc_size = 147639500, real_size = 36013776 2024/11/22-16:35:36.705445 140025129498176 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04727/att-00/214917.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 922819 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1084 GB zip-val = 0.0340 GB avg-val = 117.44 avg-zval = 36.87 2024/11/22-16:35:36.706206 140025129498176 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04727/att-00/214917.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-16:35:37.589528 140025129498176 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04727/att-00/214917.sst): second pass time = 1.63's, 66.621'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.88's, 45.337'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3389.102'MB/sec (index lex order gen) rebuild zvType time = 0.76's, 0.305'MB/sec write SST data time = 0.13's, 316.793'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.083'MB, throughput = 26631.299'MB/sec zip my value time = 1.63's, unzip length = 0.108'GB zip my value throughput = 66.621'MB/sec zip pipeline throughput = 117.026'MB/sec entries = 922819 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.44 avg-zval = 36.87 usrkeys = 922819 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.44 avg-zval = 36.87 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 922819 bytes = 3229888 } seq expand size = 6459733 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0340 GB dict = 1.08 MB all = 0.0401 GB } UnZip/Zip{ index = 10.5110 value = 3.1851 dict = 1.00 all = 3.3466 } Zip/UnZip{ index = 0.0951 value = 0.3140 dict = 1.00 all = 0.2988 } ---------------------------- total value len = 0.803954 GB avg = 0.125 KB (by entry num) total key len = 0.180760 GB avg = 0.028 KB total ukey len = 0.129115 GB avg = 0.020 KB total ukey num = 0.006455730 Billion total entry num = 0.006455730 Billion write speed all = 0.035428401 MB/sec (with seq num) write speed all = 0.033570269 MB/sec (without seq num) 2024/11/22-16:35:37.624545 140025129498176 [compaction_job.cc:1948] [default] [JOB 4727] Generated table #214917: 922819 keys, 40105282 bytes, temperature: kWarm 2024/11/22-16:35:37.624596 140025129498176 EVENT_LOG_v1 {"time_micros": 1732264537624568, "cf_name": "default", "job": 4727, "event": "table_file_creation", "file_number": 214917, "file_size": 40105282, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237868609, "largest_seqno": 3384309343, "table_properties": {"data_size": 34027008, "index_size": 1755904, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25838932, "raw_average_key_size": 28, "raw_value_size": 108378838, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 922819, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732264534, "oldest_key_time": 0, "file_creation_time": 1732264534, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 214917, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-16:35:37.660006 140025129498176 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04727/att-00/214918.sst) /dev/shm/ToplingTemp/Topling-201193-iwmd9r 2024/11/22-16:35:38.550641 140025129498176 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04727/att-00/214918.sst): first pass time = 0.89's, 150.704'MB/sec 2024/11/22-16:35:40.097771 140025129498176 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04727/att-00/214918.sst): old prealloc_size = 147639500, real_size = 36654368 2024/11/22-16:35:40.098314 140025129498176 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04727/att-00/214918.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 922495 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1084 GB zip-val = 0.0347 GB avg-val = 117.49 avg-zval = 37.58 2024/11/22-16:35:40.099047 140025129498176 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04727/att-00/214918.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-16:35:40.938530 140025129498176 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04727/att-00/214918.sst): second pass time = 1.55's, 70.086'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.84's, 48.244'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3399.234'MB/sec (index lex order gen) rebuild zvType time = 0.71's, 0.327'MB/sec write SST data time = 0.13's, 302.847'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.083'MB, throughput = 33705.522'MB/sec zip my value time = 1.55's, unzip length = 0.108'GB zip my value throughput = 70.086'MB/sec zip pipeline throughput = 121.255'MB/sec entries = 922495 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.49 avg-zval = 37.58 usrkeys = 922495 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.27 avg-zval = 37.58 TagRS{ kinds = RS_Key0_TagN bytes = 144240 } TagArray{ size = 893457 bytes = 2903744 } seq expand size = 6254199 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0184 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0347 GB dict = 1.08 MB all = 0.0406 GB } UnZip/Zip{ index = 10.5146 value = 3.1264 dict = 1.00 all = 3.3090 } Zip/UnZip{ index = 0.0951 value = 0.3199 dict = 1.00 all = 0.3022 } ---------------------------- total value len = 0.918596 GB avg = 0.125 KB (by entry num) total key len = 0.206590 GB avg = 0.028 KB total ukey len = 0.147564 GB avg = 0.020 KB total ukey num = 0.007378225 Billion total entry num = 0.007378225 Billion write speed all = 0.040477474 MB/sec (with seq num) write speed all = 0.038354079 MB/sec (without seq num) 2024/11/22-16:35:40.991047 140025129498176 [compaction_job.cc:1948] [default] [JOB 4727] Generated table #214918: 922495 keys, 40560984 bytes, temperature: kWarm 2024/11/22-16:35:40.991108 140025129498176 EVENT_LOG_v1 {"time_micros": 1732264540991075, "cf_name": "default", "job": 4727, "event": "table_file_creation", "file_number": 214918, "file_size": 40560984, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3273699965, "table_properties": {"data_size": 34668880, "index_size": 1754688, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25829860, "raw_average_key_size": 28, "raw_value_size": 108387910, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 922495, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732264537, "oldest_key_time": 0, "file_creation_time": 1732264537, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 214918, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-16:35:41.027966 140025129498176 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04727/att-00/214919.sst) /dev/shm/ToplingTemp/Topling-201193-FlqQtv 2024/11/22-16:35:41.853501 140025129498176 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04727/att-00/214919.sst): first pass time = 0.83's, 162.591'MB/sec 2024/11/22-16:35:43.480871 140025129498176 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04727/att-00/214919.sst): old prealloc_size = 147639500, real_size = 36513888 2024/11/22-16:35:43.481407 140025129498176 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04727/att-00/214919.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 923309 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0017 GB avg-key = 16.00 avg-zkey = 1.89 raw-val = 0.1084 GB zip-val = 0.0345 GB avg-val = 117.37 avg-zval = 37.41 2024/11/22-16:35:43.482042 140025129498176 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04727/att-00/214919.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-16:35:44.291861 140025129498176 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04727/att-00/214919.sst): second pass time = 1.63's, 66.615'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.81's, 49.372'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3371.721'MB/sec (index lex order gen) rebuild zvType time = 0.68's, 0.340'MB/sec write SST data time = 0.13's, 305.815'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.083'MB, throughput = 30580.966'MB/sec zip my value time = 1.63's, unzip length = 0.108'GB zip my value throughput = 66.615'MB/sec zip pipeline throughput = 123.213'MB/sec entries = 923309 avg-key = 28.00 avg-zkey = 1.89 avg-val = 117.37 avg-zval = 37.41 usrkeys = 923309 avg-key = 20.00 avg-zkey = 1.89 avg-val = 123.24 avg-zval = 37.41 TagRS{ kinds = RS_Key0_TagN bytes = 144360 } TagArray{ size = 775125 bytes = 2519168 } seq expand size = 5425875 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0017 GB value = 0.0345 GB dict = 1.08 MB all = 0.0400 GB } UnZip/Zip{ index = 10.5826 value = 3.1376 dict = 1.00 all = 3.3522 } Zip/UnZip{ index = 0.0945 value = 0.3187 dict = 1.00 all = 0.2983 } ---------------------------- total value len = 1.032387 GB avg = 0.124 KB (by entry num) total key len = 0.232443 GB avg = 0.028 KB total ukey len = 0.166031 GB avg = 0.020 KB total ukey num = 0.008301534 Billion total entry num = 0.008301534 Billion write speed all = 0.045495530 MB/sec (with seq num) write speed all = 0.043106702 MB/sec (without seq num) 2024/11/22-16:35:44.329265 140025129498176 [compaction_job.cc:1948] [default] [JOB 4727] Generated table #214919: 923309 keys, 40038984 bytes, temperature: kWarm 2024/11/22-16:35:44.329331 140025129498176 EVENT_LOG_v1 {"time_micros": 1732264544329296, "cf_name": "default", "job": 4727, "event": "table_file_creation", "file_number": 214919, "file_size": 40038984, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3273700833, "table_properties": {"data_size": 34537936, "index_size": 1744960, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25852652, "raw_average_key_size": 28, "raw_value_size": 108365182, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 923309, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732264541, "oldest_key_time": 0, "file_creation_time": 1732264541, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 214919, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-16:35:44.367515 140025129498176 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04727/att-00/214920.sst) /dev/shm/ToplingTemp/Topling-201193-edtcPt 2024/11/22-16:35:45.250184 140025129498176 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04727/att-00/214920.sst): first pass time = 0.88's, 152.066'MB/sec 2024/11/22-16:35:46.975274 140025129498176 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04727/att-00/214920.sst): old prealloc_size = 147639500, real_size = 36403584 2024/11/22-16:35:46.975808 140025129498176 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04727/att-00/214920.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 926908 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.89 raw-val = 0.1083 GB zip-val = 0.0344 GB avg-val = 116.80 avg-zval = 37.13 2024/11/22-16:35:46.975849 140025129498176 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04727/att-00/214920.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-16:35:47.617401 140025129498176 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04727/att-00/214920.sst): second pass time = 1.72's, 62.796'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.64's, 58.030'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3384.079'MB/sec (index lex order gen) rebuild zvType time = 0.52's, 0.448'MB/sec write SST data time = 0.12's, 300.722'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 36330.317'MB/sec zip my value time = 1.72's, unzip length = 0.108'GB zip my value throughput = 62.796'MB/sec zip pipeline throughput = 82.557'MB/sec entries = 926908 avg-key = 28.00 avg-zkey = 1.89 avg-val = 116.80 avg-zval = 37.13 usrkeys = 926908 avg-key = 20.00 avg-zkey = 1.89 avg-val = 116.80 avg-zval = 37.13 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0344 GB dict = 1.08 MB all = 0.0373 GB } UnZip/Zip{ index = 10.5835 value = 3.1454 dict = 1.00 all = 3.6021 } Zip/UnZip{ index = 0.0945 value = 0.3179 dict = 1.00 all = 0.2776 } ---------------------------- total value len = 1.140652 GB avg = 0.124 KB (by entry num) total key len = 0.258396 GB avg = 0.028 KB total ukey len = 0.184569 GB avg = 0.020 KB total ukey num = 0.009228442 Billion total entry num = 0.009228442 Billion write speed all = 0.050317284 MB/sec (with seq num) write speed all = 0.047662049 MB/sec (without seq num) 2024/11/22-16:35:47.649665 140025129498176 [compaction_job.cc:1948] [default] [JOB 4727] Generated table #214920: 926908 keys, 37261442 bytes, temperature: kWarm 2024/11/22-16:35:47.649744 140025129498176 EVENT_LOG_v1 {"time_micros": 1732264547649699, "cf_name": "default", "job": 4727, "event": "table_file_creation", "file_number": 214920, "file_size": 37261442, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 34420080, "index_size": 1751616, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25953424, "raw_average_key_size": 28, "raw_value_size": 108264424, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 926908, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732264544, "oldest_key_time": 0, "file_creation_time": 1732264544, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 214920, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-16:35:47.687023 140025129498176 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04727/att-00/214921.sst) /dev/shm/ToplingTemp/Topling-201193-Bpo8mt 2024/11/22-16:35:48.575584 140025129498176 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04727/att-00/214921.sst): first pass time = 0.89's, 151.056'MB/sec 2024/11/22-16:35:50.250301 140025129498176 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04727/att-00/214921.sst): old prealloc_size = 147639500, real_size = 36425168 2024/11/22-16:35:50.250843 140025129498176 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04727/att-00/214921.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927099 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.89 raw-val = 0.1083 GB zip-val = 0.0344 GB avg-val = 116.77 avg-zval = 37.15 2024/11/22-16:35:50.250881 140025129498176 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04727/att-00/214921.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-16:35:50.897367 140025129498176 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04727/att-00/214921.sst): second pass time = 1.67's, 64.668'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.65's, 57.620'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3361.713'MB/sec (index lex order gen) rebuild zvType time = 0.52's, 0.444'MB/sec write SST data time = 0.12's, 298.502'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 36741.854'MB/sec zip my value time = 1.67's, unzip length = 0.108'GB zip my value throughput = 64.668'MB/sec zip pipeline throughput = 64.668'MB/sec entries = 927099 avg-key = 28.00 avg-zkey = 1.89 avg-val = 116.77 avg-zval = 37.15 usrkeys = 927099 avg-key = 20.00 avg-zkey = 1.89 avg-val = 116.77 avg-zval = 37.15 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0344 GB dict = 1.08 MB all = 0.0373 GB } UnZip/Zip{ index = 10.5822 value = 3.1433 dict = 1.00 all = 3.6000 } Zip/UnZip{ index = 0.0945 value = 0.3181 dict = 1.00 all = 0.2778 } ---------------------------- total value len = 1.248911 GB avg = 0.123 KB (by entry num) total key len = 0.284355 GB avg = 0.028 KB total ukey len = 0.203111 GB avg = 0.020 KB total ukey num = 0.010155541 Billion total entry num = 0.010155541 Billion write speed all = 0.055137971 MB/sec (with seq num) write speed all = 0.052216333 MB/sec (without seq num) 2024/11/22-16:35:50.930152 140025129498176 [compaction_job.cc:1948] [default] [JOB 4727] Generated table #214921: 927099 keys, 37283166 bytes, temperature: kWarm 2024/11/22-16:35:50.930210 140025129498176 EVENT_LOG_v1 {"time_micros": 1732264550930178, "cf_name": "default", "job": 4727, "event": "table_file_creation", "file_number": 214921, "file_size": 37283166, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 34441024, "index_size": 1752192, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25958772, "raw_average_key_size": 28, "raw_value_size": 108258970, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927099, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732264547, "oldest_key_time": 0, "file_creation_time": 1732264547, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 214921, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-16:35:50.968890 140025129498176 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04727/att-00/214922.sst) /dev/shm/ToplingTemp/Topling-201193-rXKIpt 2024/11/22-16:35:51.877284 140025129498176 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04727/att-00/214922.sst): first pass time = 0.91's, 147.758'MB/sec 2024/11/22-16:35:53.221656 140025129498176 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04727/att-00/214922.sst): old prealloc_size = 147639500, real_size = 35750560 2024/11/22-16:35:53.222231 140025129498176 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04727/att-00/214922.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 924433 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0338 GB avg-val = 117.19 avg-zval = 36.52 2024/11/22-16:35:53.222844 140025129498176 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04727/att-00/214922.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-16:35:54.056537 140025129498176 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04727/att-00/214922.sst): second pass time = 1.34's, 80.655'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.83's, 46.800'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3187.101'MB/sec (index lex order gen) rebuild zvType time = 0.70's, 0.329'MB/sec write SST data time = 0.13's, 295.963'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.082'MB, throughput = 35848.856'MB/sec zip my value time = 1.34's, unzip length = 0.108'GB zip my value throughput = 80.655'MB/sec zip pipeline throughput = 80.655'MB/sec entries = 924433 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.19 avg-zval = 36.52 usrkeys = 924433 avg-key = 20.00 avg-zkey = 1.90 avg-val = 122.39 avg-zval = 36.52 TagRS{ kinds = RS_Key0_TagN bytes = 144560 } TagArray{ size = 686418 bytes = 2316672 } seq expand size = 4804926 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0338 GB dict = 1.08 MB all = 0.0391 GB } UnZip/Zip{ index = 10.5099 value = 3.2089 dict = 1.00 all = 3.4352 } Zip/UnZip{ index = 0.0951 value = 0.3116 dict = 1.00 all = 0.2911 } ---------------------------- total value len = 1.362049 GB avg = 0.123 KB (by entry num) total key len = 0.310239 GB avg = 0.028 KB total ukey len = 0.221599 GB avg = 0.020 KB total ukey num = 0.011079974 Billion total entry num = 0.011079974 Billion write speed all = 0.060130556 MB/sec (with seq num) write speed all = 0.056943331 MB/sec (without seq num) 2024/11/22-16:35:54.090050 140025129498176 [compaction_job.cc:1948] [default] [JOB 4727] Generated table #214922: 924433 keys, 39071720 bytes, temperature: kWarm 2024/11/22-16:35:54.090108 140025129498176 EVENT_LOG_v1 {"time_micros": 1732264554090078, "cf_name": "default", "job": 4727, "event": "table_file_creation", "file_number": 214922, "file_size": 39071720, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3384309452, "table_properties": {"data_size": 33760080, "index_size": 1759168, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25884124, "raw_average_key_size": 28, "raw_value_size": 108333722, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 924433, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732264550, "oldest_key_time": 0, "file_creation_time": 1732264550, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 214922, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-16:35:54.131923 140025129498176 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04727/att-00/214923.sst) /dev/shm/ToplingTemp/Topling-201193-UOrrTt 2024/11/22-16:35:55.070849 140025129498176 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04727/att-00/214923.sst): first pass time = 0.94's, 142.953'MB/sec 2024/11/22-16:35:56.427331 140025129498176 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04727/att-00/214923.sst): old prealloc_size = 147639500, real_size = 36370480 2024/11/22-16:35:56.427874 140025129498176 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04727/att-00/214923.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927673 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1082 GB zip-val = 0.0344 GB avg-val = 116.68 avg-zval = 37.04 2024/11/22-16:35:56.428612 140025129498176 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04727/att-00/214923.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-16:35:57.278238 140025129498176 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04727/att-00/214923.sst): second pass time = 1.36's, 79.832'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.85's, 47.427'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3392.014'MB/sec (index lex order gen) rebuild zvType time = 0.72's, 0.323'MB/sec write SST data time = 0.13's, 306.277'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 31455.790'MB/sec zip my value time = 1.36's, unzip length = 0.108'GB zip my value throughput = 79.832'MB/sec zip pipeline throughput = 79.832'MB/sec entries = 927673 avg-key = 28.00 avg-zkey = 1.92 avg-val = 116.68 avg-zval = 37.04 usrkeys = 927673 avg-key = 20.00 avg-zkey = 1.92 avg-val = 123.68 avg-zval = 37.04 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 927673 bytes = 3130912 } seq expand size = 6493711 multi value expand size = 0 cnt WriteAppend = 15 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0344 GB dict = 1.08 MB all = 0.0404 GB } UnZip/Zip{ index = 10.4419 value = 3.1501 dict = 1.00 all = 3.3259 } Zip/UnZip{ index = 0.0958 value = 0.3174 dict = 1.00 all = 0.3007 } ---------------------------- total value len = 1.476786 GB avg = 0.123 KB (by entry num) total key len = 0.336214 GB avg = 0.028 KB total ukey len = 0.240153 GB avg = 0.020 KB total ukey num = 0.012007647 Billion total entry num = 0.012007647 Billion write speed all = 0.065182576 MB/sec (with seq num) write speed all = 0.061728900 MB/sec (without seq num) 2024/11/22-16:35:57.311081 140025129498176 [compaction_job.cc:1948] [default] [JOB 4727] Generated table #214923: 927673 keys, 40355346 bytes, temperature: kWarm 2024/11/22-16:35:57.311139 140025129498176 EVENT_LOG_v1 {"time_micros": 1732264557311107, "cf_name": "default", "job": 4727, "event": "table_file_creation", "file_number": 214923, "file_size": 40355346, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3273701386, "largest_seqno": 3384309558, "table_properties": {"data_size": 34361568, "index_size": 1776832, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25974844, "raw_average_key_size": 28, "raw_value_size": 108242978, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927673, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732264554, "oldest_key_time": 0, "file_creation_time": 1732264554, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 214923, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-16:35:57.347055 140025129498176 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04727/att-00/214924.sst) /dev/shm/ToplingTemp/Topling-201193-KB1Bdt 2024/11/22-16:35:57.437227 140025129498176 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04727/att-00/214924.sst): first pass time = 0.09's, 245.537'MB/sec 2024/11/22-16:35:57.614274 140025129498176 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04727/att-00/214924.sst): old prealloc_size = 147639500, real_size = 6318960 2024/11/22-16:35:57.614411 140025129498176 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04727/att-00/214924.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 154146 prefix = 4 raw-key = 0.0025 GB zip-key = 0.0003 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.0178 GB zip-val = 0.0060 GB avg-val = 115.59 avg-zval = 38.83 2024/11/22-16:35:57.614529 140025129498176 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04727/att-00/214924.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.022 GB 2024/11/22-16:35:57.739140 140025129498176 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04727/att-00/214924.sst): second pass time = 0.18's, 100.929'MB/sec, value only(80.5% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.12's, 54.560'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2617.678'MB/sec (index lex order gen) rebuild zvType time = 0.10's, 0.374'MB/sec write SST data time = 0.02's, 315.279'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.187'MB, throughput = 7184.906'MB/sec zip my value time = 0.18's, unzip length = 0.018'GB zip my value throughput = 100.929'MB/sec zip pipeline throughput = 100.929'MB/sec entries = 154146 avg-key = 28.00 avg-zkey = 1.91 avg-val = 115.59 avg-zval = 38.83 usrkeys = 154146 avg-key = 20.00 avg-zkey = 1.91 avg-val = 120.40 avg-zval = 38.83 TagRS{ kinds = RS_Key0_TagN bytes = 24200 } TagArray{ size = 105931 bytes = 317808 } seq expand size = 741517 multi value expand size = 0 cnt WriteAppend = 16 UnZipSize{ index = 0.0031 GB value = 0.0178 GB dict = 0.19 MB all = 0.0221 GB } __ZipSize{ index = 0.0003 GB value = 0.0060 GB dict = 0.19 MB all = 0.0068 GB } UnZip/Zip{ index = 10.4673 value = 2.9767 dict = 1.00 all = 3.2492 } Zip/UnZip{ index = 0.0955 value = 0.3359 dict = 1.00 all = 0.3078 } ---------------------------- total value len = 1.495345 GB avg = 0.123 KB (by entry num) total key len = 0.340530 GB avg = 0.028 KB total ukey len = 0.243236 GB avg = 0.020 KB total ukey num = 0.012161793 Billion total entry num = 0.012161793 Billion write speed all = 0.066003910 MB/sec (with seq num) write speed all = 0.062505956 MB/sec (without seq num) 2024/11/22-16:35:57.750562 140025129498176 [compaction_job.cc:1948] [default] [JOB 4727] Generated table #214924: 154146 keys, 6812019 bytes, temperature: kWarm 2024/11/22-16:35:57.750620 140025129498176 EVENT_LOG_v1 {"time_micros": 1732264557750589, "cf_name": "default", "job": 4727, "event": "table_file_creation", "file_number": 214924, "file_size": 6812019, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3384309292, "table_properties": {"data_size": 5985696, "index_size": 294528, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 4316088, "raw_average_key_size": 28, "raw_value_size": 17817568, "raw_average_value_size": 115, "num_data_blocks": 1, "num_entries": 154146, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732264557, "oldest_key_time": 0, "file_creation_time": 1732264557, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 214924, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-16:35:57.760819 140025129498176 [compaction_job.cc:703] job-04727: subcompact[0], size: 0.510170 G, files: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04727/att-00 [214911,214912,214913,214914,214915,214916,214917,214918,214919,214920,214921,214922,214923,214924] 2024/11/22-16:35:57.846498 140025129498176 (Original Log Time 2024/11/22-16:35:07.404196) EVENT_LOG_v1 {"time_micros": 1732264507404167, "job": 4727, "event": "compaction_started", "compaction_reason": "FilesMarkedForCompaction", "files_L2": [214871], "files_L3": [214824, 214825, 214826, 214827, 214828, 214829, 214830, 214831, 214832, 214833, 214834, 214835, 214902], "score": 0.898796, "input_data_size": 532918854, "oldest_snapshot_seqno": 3384648685} 2024/11/22-16:35:57.846501 140025129498176 (Original Log Time 2024/11/22-16:35:57.845761) [compaction_job.cc:2022] [default] [JOB 4727] Compacted 1@2 + 13@3 files to L3 => 510169943 bytes 2024/11/22-16:35:57.846502 140025129498176 (Original Log Time 2024/11/22-16:35:57.846434) [compaction_job.cc:1224] [default] compacted to: files[0 0 0 14 0 0 0] max score 0.02, MB/sec: 10.6 rd, 10.1 wr, level 3, files in(1, 13) out(14 +0 blob) MB in(27.2, 481.1 +0.0 blob) out(486.5 +0.0 blob), read-write-amplify(36.6) write-amplify(17.9) OK, records in: 12242459, records dropped: 80666 output_compression: Snappy 2024/11/22-16:35:57.846509 140025129498176 (Original Log Time 2024/11/22-16:35:57.846479) EVENT_LOG_v1 {"time_micros": 1732264557846457, "cf": "default", "job": 4727, "event": "compaction_finished", "compaction_time_micros": 50356630, "compaction_time_cpu_micros": 20092670, "output_level": 3, "num_output_files": 14, "total_output_size": 510169943, "num_input_records": 12242459, "num_output_records": 12161793, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "file_write_nanos": 380555922, "file_range_sync_nanos": 0, "file_fsync_nanos": 13635, "file_prepare_write_nanos": 31091, "lsm_state": [0, 0, 0, 14, 0, 0, 0]} 2024/11/22-16:35:57.975590 140025129498176 DEBG dcompact_worker.cpp:240: HttpPost: 200 OK: url = http://nlb-7zny4kaa1poal01o64.cn-shenzhen.nlb.aliyuncs.com:8443, body = {"instanceId":"nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137","labourId":"","dbId":"d89b4006-2803-486e-b7a2-759bcf348921","dbStarts":1732256054,"starts":1732264507,"executesMs":50601,"compactionJobId":4727,"attempt":0,"compactionInputRawBytes":1778419446,"compactionInputZipBytes":532918854,"compactionOutputRawBytes":0,"compactionOutputZipBytes":510169943,"headers":{"Accept":"*/*","Connection":"close","Host":"aliyun-topling-saas.topling.cn:18443","RemoteIp":"120.24.192.169","X-Forwarded-For":"120.24.192.169","region":"cn-shenzhen","token":"e6474c481bd4415abc537135cc03626b","instance-token":"e6474c481bd4415abc537135cc03626b","provider":"aliyun","CloudMarketInstanceId":"si-59c0ae5c955845588903","MeteringAssit":"","Transfer-Encoding":"chunked","traceparent":"00-61dee45815cc8ffa99291606eb4b2658-402083a1d5506d4c-00"}}, response = 2024/11/22-16:35:57.975666 140025129498176 INFO dcompact_worker.cpp:1459: finish /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-04727/att-00: olev 3, work 50.602 s, result 4.841 ms, install 0.765 ms, input{raw 1.656 GiB zip 508.231 MiB}