2024/11/22-22:16:20.695820 140024944858688 DEBG dcompact_worker.cpp:2214: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12510/att-00: fork to child time = 0.009598 sec 2024/11/22-22:16:20.696577 140024944858688 DEBG dcompact_worker.cpp:1013: Beg SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12510/att-00 2024/11/22-22:16:20.704156 140024944858688 DEBG dcompact_worker.cpp:1033: End SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12510/att-00 2024/11/22-22:16:20.705287 140024944858688 TRAC dcompact_worker.cpp:1083: INFO_LOG_LEVEL: rpc = INFO_LEVEL, env_var = undefined 2024/11/22-22:16:20.705572 140024944858688 [WARN] [column_family.cc:386] multiple cf_paths/db_paths and level_compaction_dynamic_level_bytes can't be used together 2024/11/22-22:16:20.757959 140024944858688 [version_set.cc:6208] Recovering from manifest file: /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-12510/att-00/MANIFEST-206347 2024/11/22-22:16:20.772658 140024944858688 [version_set.cc:6251] Recovered from manifest file:/worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-12510/att-00/MANIFEST-206347 succeeded,manifest_file_number is 206347, next_file_number is 230798, last_sequence is 3603081767, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 230647 2024/11/22-22:16:20.772666 140024944858688 [version_set.cc:6266] Column family [default] (ID 0), log number is 0 2024/11/22-22:16:20.772761 140024944858688 [version_set.cc:5721] Creating manifest 230798 2024/11/22-22:16:20.808066 140024944858688 DEBG dcompact_worker.cpp:1218: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12510/att-00: bottommost_level: fake = 1, rpc = 0 2024/11/22-22:16:20.844183 140024944858688 [compaction_job.cc:2437] [default] [JOB 12510] Compacting 1@2 + 14@3 files to L3, score 1.00, subcompactions 1 : 1 2024/11/22-22:16:20.844204 140024944858688 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 9417 Base level 2, inputs: [230791(27MB)], [230732(35MB) 230733(35MB) 230734(36MB) 230735(35MB) 230736(35MB) 230737(35MB) 230738(35MB) 230739(38MB) 230740(35MB) 230741(36MB) 230742(34MB) 230743(37MB) 230744(34MB) 230745(6938KB)] 2024/11/22-22:16:20.850434 140024944858688 [top_zip_table.cc:59] core git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/22-22:16:20.850471 140024944858688 [top_zip_table.cc:60] fsa git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/22-22:16:20.850498 140024944858688 [top_zip_table.cc:61] zbs git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/22-22:16:20.850506 140024944858688 [top_zip_table.cc:62] topling-zip_table_reader: git_version_hash_info_is: commit a4a382006cb82713acf5b3425835f22711877681 Author: leipeng Date: 2024-04-11 19:44:14 +0800 fixed_len_hole_index.cc: Add env bool FixedLenHoleIndexUseAVX512 for ut & debug 1. FixedLenHoleIndexUseAVX512 is only in unit tests or debug 2. In release mode, use avx512 by compile options(-march=) g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/22-22:16:20.850522 140024944858688 [top_zip_table.cc:64] topling-rocks git_version_hash_info_is: commit feab587e468621ba0204d47b4ffacc52e7c4290d Author: leipeng Date: 2024-03-22 13:35:06 +0800 ToplingZipTableBuilder::Add: immediately return after error This function returns void, and caller does not check builder->status() after calling this function and graceful abandon. So immediately return after error, and return error status in Finish(). g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/22-22:16:21.312456 140024944858688 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12510/att-00/230799.sst) /dev/shm/ToplingTemp/Topling-311741-Yg8HMz 2024/11/22-22:16:22.329480 140024944858688 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12510/att-00/230799.sst): first pass time = 1.02's, 131.978'MB/sec 2024/11/22-22:16:24.669396 140024944858688 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12510/att-00/230799.sst): old prealloc_size = 147639500, real_size = 33330416 2024/11/22-22:16:24.670110 140024944858688 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12510/att-00/230799.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 924646 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0313 GB avg-val = 117.16 avg-zval = 33.89 2024/11/22-22:16:24.670970 140024944858688 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12510/att-00/230799.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-22:16:25.920764 140024944858688 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12510/att-00/230799.sst): second pass time = 2.33's, 46.460'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.25's, 29.813'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2542.118'MB/sec (index lex order gen) rebuild zvType time = 1.09's, 0.212'MB/sec write SST data time = 0.16's, 234.466'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.082'MB, throughput = 35076.344'MB/sec zip my value time = 2.33's, unzip length = 0.108'GB zip my value throughput = 46.460'MB/sec zip pipeline throughput = 102.914'MB/sec entries = 924646 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.16 avg-zval = 33.89 usrkeys = 924646 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.16 avg-zval = 33.89 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 924646 bytes = 3120688 } seq expand size = 6472522 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0313 GB dict = 1.08 MB all = 0.0373 GB } UnZip/Zip{ index = 10.5142 value = 3.4565 dict = 1.00 all = 3.5976 } Zip/UnZip{ index = 0.0951 value = 0.2893 dict = 1.00 all = 0.2780 } ---------------------------- total value len = 0.114800 GB avg = 0.124 KB (by entry num) total key len = 0.025890 GB avg = 0.028 KB total ukey len = 0.018493 GB avg = 0.020 KB total ukey num = 0.000924646 Billion total entry num = 0.000924646 Billion write speed all = 0.002916295 MB/sec (with seq num) write speed all = 0.002762963 MB/sec (without seq num) 2024/11/22-22:16:25.958027 140024944858688 [compaction_job.cc:1948] [default] [JOB 12510] Generated table #230799: 924646 keys, 37307288 bytes, temperature: kWarm 2024/11/22-22:16:25.958114 140024944858688 EVENT_LOG_v1 {"time_micros": 1732284985958059, "cf_name": "default", "job": 12510, "event": "table_file_creation", "file_number": 230799, "file_size": 37307288, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3513012344, "largest_seqno": 3603057024, "table_properties": {"data_size": 31340192, "index_size": 1758848, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25890088, "raw_average_key_size": 28, "raw_value_size": 108327692, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 924646, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732284981, "oldest_key_time": 0, "file_creation_time": 1732284981, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 230799, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-22:16:25.995652 140024944858688 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12510/att-00/230800.sst) /dev/shm/ToplingTemp/Topling-311741-FETdaz 2024/11/22-22:16:27.204696 140024944858688 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12510/att-00/230800.sst): first pass time = 1.21's, 111.015'MB/sec 2024/11/22-22:16:28.943043 140024944858688 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12510/att-00/230800.sst): old prealloc_size = 147639500, real_size = 33506336 2024/11/22-22:16:28.943608 140024944858688 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12510/att-00/230800.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 924418 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1083 GB zip-val = 0.0315 GB avg-val = 117.19 avg-zval = 34.08 2024/11/22-22:16:28.944400 140024944858688 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12510/att-00/230800.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-22:16:30.442246 140024944858688 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12510/att-00/230800.sst): second pass time = 1.73's, 62.474'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.50's, 25.079'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3240.929'MB/sec (index lex order gen) rebuild zvType time = 1.26's, 0.183'MB/sec write SST data time = 0.24's, 159.379'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.082'MB, throughput = 27446.813'MB/sec zip my value time = 1.73's, unzip length = 0.108'GB zip my value throughput = 62.474'MB/sec zip pipeline throughput = 62.474'MB/sec entries = 924418 avg-key = 28.00 avg-zkey = 1.91 avg-val = 117.19 avg-zval = 34.08 usrkeys = 924418 avg-key = 20.00 avg-zkey = 1.91 avg-val = 124.19 avg-zval = 34.08 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 924418 bytes = 3235472 } seq expand size = 6470926 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0315 GB dict = 1.08 MB all = 0.0376 GB } UnZip/Zip{ index = 10.4444 value = 3.4386 dict = 1.00 all = 3.5698 } Zip/UnZip{ index = 0.0957 value = 0.2908 dict = 1.00 all = 0.2801 } ---------------------------- total value len = 0.229605 GB avg = 0.124 KB (by entry num) total key len = 0.051774 GB avg = 0.028 KB total ukey len = 0.036981 GB avg = 0.020 KB total ukey num = 0.001849064 Billion total entry num = 0.001849064 Billion write speed all = 0.005832009 MB/sec (with seq num) write speed all = 0.005525412 MB/sec (without seq num) 2024/11/22-22:16:30.479362 140024944858688 [compaction_job.cc:1948] [default] [JOB 12510] Generated table #230800: 924418 keys, 37598184 bytes, temperature: kWarm 2024/11/22-22:16:30.479438 140024944858688 EVENT_LOG_v1 {"time_micros": 1732284990479395, "cf_name": "default", "job": 12510, "event": "table_file_creation", "file_number": 230800, "file_size": 37598184, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3434038037, "largest_seqno": 3603057912, "table_properties": {"data_size": 31504848, "index_size": 1770176, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25883704, "raw_average_key_size": 28, "raw_value_size": 108334036, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 924418, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732284985, "oldest_key_time": 0, "file_creation_time": 1732284985, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 230800, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-22:16:30.582770 140024944858688 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12510/att-00/230801.sst) /dev/shm/ToplingTemp/Topling-311741-auZL1z 2024/11/22-22:16:31.940804 140024944858688 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12510/att-00/230801.sst): first pass time = 1.36's, 98.838'MB/sec 2024/11/22-22:16:33.938523 140024944858688 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12510/att-00/230801.sst): old prealloc_size = 147639500, real_size = 34203872 2024/11/22-22:16:33.939216 140024944858688 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12510/att-00/230801.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 929907 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0322 GB avg-val = 116.33 avg-zval = 34.63 2024/11/22-22:16:33.940044 140024944858688 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12510/att-00/230801.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-22:16:35.187801 140024944858688 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12510/att-00/230801.sst): second pass time = 2.00's, 54.175'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.25's, 30.667'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2582.372'MB/sec (index lex order gen) rebuild zvType time = 0.99's, 0.235'MB/sec write SST data time = 0.26's, 147.391'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 30916.079'MB/sec zip my value time = 2.00's, unzip length = 0.108'GB zip my value throughput = 54.175'MB/sec zip pipeline throughput = 66.423'MB/sec entries = 929907 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.33 avg-zval = 34.63 usrkeys = 929907 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.33 avg-zval = 34.63 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 929907 bytes = 3254688 } seq expand size = 6509349 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0322 GB dict = 1.08 MB all = 0.0383 GB } UnZip/Zip{ index = 10.5159 value = 3.3594 dict = 1.00 all = 3.5034 } Zip/UnZip{ index = 0.0951 value = 0.2977 dict = 1.00 all = 0.2854 } ---------------------------- total value len = 0.344295 GB avg = 0.124 KB (by entry num) total key len = 0.077811 GB avg = 0.028 KB total ukey len = 0.055579 GB avg = 0.020 KB total ukey num = 0.002778971 Billion total entry num = 0.002778971 Billion write speed all = 0.008747934 MB/sec (with seq num) write speed all = 0.008287192 MB/sec (without seq num) 2024/11/22-22:16:35.227138 140024944858688 [compaction_job.cc:1948] [default] [JOB 12510] Generated table #230801: 929907 keys, 38310550 bytes, temperature: kWarm 2024/11/22-22:16:35.227233 140024944858688 EVENT_LOG_v1 {"time_micros": 1732284995227177, "cf_name": "default", "job": 12510, "event": "table_file_creation", "file_number": 230801, "file_size": 38310550, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3434038075, "largest_seqno": 3603058082, "table_properties": {"data_size": 32202640, "index_size": 1768576, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26037396, "raw_average_key_size": 28, "raw_value_size": 108180418, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 929907, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732284990, "oldest_key_time": 0, "file_creation_time": 1732284990, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 230801, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-22:16:35.292655 140024944858688 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12510/att-00/230802.sst) /dev/shm/ToplingTemp/Topling-311741-IVAFgB 2024/11/22-22:16:36.879526 140024944858688 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12510/att-00/230802.sst): first pass time = 1.59's, 84.583'MB/sec 2024/11/22-22:16:38.526876 140024944858688 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12510/att-00/230802.sst): old prealloc_size = 147639500, real_size = 33279648 2024/11/22-22:16:38.527565 140024944858688 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12510/att-00/230802.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927156 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0313 GB avg-val = 116.76 avg-zval = 33.74 2024/11/22-22:16:38.528375 140024944858688 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12510/att-00/230802.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-22:16:39.886384 140024944858688 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12510/att-00/230802.sst): second pass time = 1.65's, 65.754'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.36's, 27.410'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2644.865'MB/sec (index lex order gen) rebuild zvType time = 1.11's, 0.209'MB/sec write SST data time = 0.25's, 148.323'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 31053.712'MB/sec zip my value time = 1.65's, unzip length = 0.108'GB zip my value throughput = 65.754'MB/sec zip pipeline throughput = 65.754'MB/sec entries = 927156 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.76 avg-zval = 33.74 usrkeys = 927156 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.76 avg-zval = 33.74 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 927156 bytes = 3129168 } seq expand size = 6490092 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0313 GB dict = 1.08 MB all = 0.0373 GB } UnZip/Zip{ index = 10.5114 value = 3.4605 dict = 1.00 all = 3.6019 } Zip/UnZip{ index = 0.0951 value = 0.2890 dict = 1.00 all = 0.2776 } ---------------------------- total value len = 0.459042 GB avg = 0.124 KB (by entry num) total key len = 0.103772 GB avg = 0.028 KB total ukey len = 0.074123 GB avg = 0.020 KB total ukey num = 0.003706127 Billion total entry num = 0.003706127 Billion write speed all = 0.011662897 MB/sec (with seq num) write speed all = 0.011048496 MB/sec (without seq num) 2024/11/22-22:16:39.928283 140024944858688 [compaction_job.cc:1948] [default] [JOB 12510] Generated table #230802: 927156 keys, 37263440 bytes, temperature: kWarm 2024/11/22-22:16:39.928358 140024944858688 EVENT_LOG_v1 {"time_micros": 1732284999928315, "cf_name": "default", "job": 12510, "event": "table_file_creation", "file_number": 230802, "file_size": 37263440, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3523718385, "largest_seqno": 3603056521, "table_properties": {"data_size": 31283600, "index_size": 1764096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25960368, "raw_average_key_size": 28, "raw_value_size": 108257376, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927156, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732284995, "oldest_key_time": 0, "file_creation_time": 1732284995, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 230802, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-22:16:40.000426 140024944858688 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12510/att-00/230803.sst) /dev/shm/ToplingTemp/Topling-311741-lkn6rB 2024/11/22-22:16:41.488511 140024944858688 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12510/att-00/230803.sst): first pass time = 1.49's, 90.198'MB/sec 2024/11/22-22:16:43.153363 140024944858688 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12510/att-00/230803.sst): old prealloc_size = 147639500, real_size = 32538992 2024/11/22-22:16:43.153926 140024944858688 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12510/att-00/230803.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 926713 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1083 GB zip-val = 0.0305 GB avg-val = 116.83 avg-zval = 32.95 2024/11/22-22:16:43.154665 140024944858688 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12510/att-00/230803.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-22:16:44.858801 140024944858688 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12510/att-00/230803.sst): second pass time = 1.66's, 65.351'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.71's, 21.483'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3268.609'MB/sec (index lex order gen) rebuild zvType time = 1.37's, 0.169'MB/sec write SST data time = 0.34's, 109.354'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 33737.048'MB/sec zip my value time = 1.66's, unzip length = 0.108'GB zip my value throughput = 65.351'MB/sec zip pipeline throughput = 65.351'MB/sec entries = 926713 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.83 avg-zval = 32.95 usrkeys = 926713 avg-key = 20.00 avg-zkey = 1.91 avg-val = 123.83 avg-zval = 32.95 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 926713 bytes = 3243504 } seq expand size = 6486991 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0305 GB dict = 1.08 MB all = 0.0366 GB } UnZip/Zip{ index = 10.4446 value = 3.5460 dict = 1.00 all = 3.6635 } Zip/UnZip{ index = 0.0957 value = 0.2820 dict = 1.00 all = 0.2730 } ---------------------------- total value len = 0.573799 GB avg = 0.124 KB (by entry num) total key len = 0.129720 GB avg = 0.028 KB total ukey len = 0.092657 GB avg = 0.020 KB total ukey num = 0.004632840 Billion total entry num = 0.004632840 Billion write speed all = 0.014577147 MB/sec (with seq num) write speed all = 0.013809195 MB/sec (without seq num) 2024/11/22-22:16:44.913803 140024944858688 [compaction_job.cc:1948] [default] [JOB 12510] Generated table #230803: 926713 keys, 36636918 bytes, temperature: kWarm 2024/11/22-22:16:44.913884 140024944858688 EVENT_LOG_v1 {"time_micros": 1732285004913840, "cf_name": "default", "job": 12510, "event": "table_file_creation", "file_number": 230803, "file_size": 36636918, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3434038106, "largest_seqno": 3603057659, "table_properties": {"data_size": 30532576, "index_size": 1774528, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25947964, "raw_average_key_size": 28, "raw_value_size": 108269906, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 926713, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732284999, "oldest_key_time": 0, "file_creation_time": 1732284999, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 230803, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-22:16:44.983995 140024944858688 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12510/att-00/230804.sst) /dev/shm/ToplingTemp/Topling-311741-bryhmC 2024/11/22-22:16:46.008260 140024944858688 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12510/att-00/230804.sst): first pass time = 1.02's, 131.044'MB/sec 2024/11/22-22:16:48.302679 140024944858688 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12510/att-00/230804.sst): old prealloc_size = 147639500, real_size = 33569968 2024/11/22-22:16:48.303265 140024944858688 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12510/att-00/230804.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 924820 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0316 GB avg-val = 117.13 avg-zval = 34.15 2024/11/22-22:16:48.304046 140024944858688 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12510/att-00/230804.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-22:16:49.242869 140024944858688 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12510/att-00/230804.sst): second pass time = 2.29's, 47.225'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.94's, 40.060'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3082.962'MB/sec (index lex order gen) rebuild zvType time = 0.81's, 0.285'MB/sec write SST data time = 0.13's, 295.650'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 33222.106'MB/sec zip my value time = 2.29's, unzip length = 0.108'GB zip my value throughput = 47.225'MB/sec zip pipeline throughput = 79.862'MB/sec entries = 924820 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.13 avg-zval = 34.15 usrkeys = 924820 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.13 avg-zval = 34.15 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 924820 bytes = 3236880 } seq expand size = 6473740 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0316 GB dict = 1.08 MB all = 0.0377 GB } UnZip/Zip{ index = 10.5131 value = 3.4302 dict = 1.00 all = 3.5637 } Zip/UnZip{ index = 0.0951 value = 0.2915 dict = 1.00 all = 0.2806 } ---------------------------- total value len = 0.688596 GB avg = 0.124 KB (by entry num) total key len = 0.155614 GB avg = 0.028 KB total ukey len = 0.111153 GB avg = 0.020 KB total ukey num = 0.005557660 Billion total entry num = 0.005557660 Billion write speed all = 0.017490733 MB/sec (with seq num) write speed all = 0.016569564 MB/sec (without seq num) 2024/11/22-22:16:49.277115 140024944858688 [compaction_job.cc:1948] [default] [JOB 12510] Generated table #230804: 924820 keys, 37662966 bytes, temperature: kWarm 2024/11/22-22:16:49.277177 140024944858688 EVENT_LOG_v1 {"time_micros": 1732285009277144, "cf_name": "default", "job": 12510, "event": "table_file_creation", "file_number": 230804, "file_size": 37662966, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3434038136, "largest_seqno": 3603056543, "table_properties": {"data_size": 31579232, "index_size": 1759360, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25894960, "raw_average_key_size": 28, "raw_value_size": 108322776, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 924820, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732285004, "oldest_key_time": 0, "file_creation_time": 1732285004, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 230804, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-22:16:49.313447 140024944858688 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12510/att-00/230805.sst) /dev/shm/ToplingTemp/Topling-311741-abOnVA 2024/11/22-22:16:50.209708 140024944858688 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12510/att-00/230805.sst): first pass time = 0.90's, 149.759'MB/sec 2024/11/22-22:16:51.568577 140024944858688 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12510/att-00/230805.sst): old prealloc_size = 147639500, real_size = 33519920 2024/11/22-22:16:51.569143 140024944858688 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12510/att-00/230805.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 924541 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0315 GB avg-val = 117.17 avg-zval = 34.10 2024/11/22-22:16:51.569881 140024944858688 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12510/att-00/230805.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-22:16:52.610350 140024944858688 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12510/att-00/230805.sst): second pass time = 1.36's, 79.814'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.04's, 35.993'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3244.984'MB/sec (index lex order gen) rebuild zvType time = 0.91's, 0.254'MB/sec write SST data time = 0.13's, 288.281'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.082'MB, throughput = 31376.269'MB/sec zip my value time = 1.36's, unzip length = 0.108'GB zip my value throughput = 79.814'MB/sec zip pipeline throughput = 79.814'MB/sec entries = 924541 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.17 avg-zval = 34.10 usrkeys = 924541 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.17 avg-zval = 34.10 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 924541 bytes = 3120336 } seq expand size = 6471787 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0315 GB dict = 1.08 MB all = 0.0375 GB } UnZip/Zip{ index = 10.5123 value = 3.4358 dict = 1.00 all = 3.5795 } Zip/UnZip{ index = 0.0951 value = 0.2911 dict = 1.00 all = 0.2794 } ---------------------------- total value len = 0.803398 GB avg = 0.124 KB (by entry num) total key len = 0.181502 GB avg = 0.028 KB total ukey len = 0.129644 GB avg = 0.020 KB total ukey num = 0.006482201 Billion total entry num = 0.006482201 Billion write speed all = 0.020404179 MB/sec (with seq num) write speed all = 0.019329845 MB/sec (without seq num) 2024/11/22-22:16:52.646858 140024944858688 [compaction_job.cc:1948] [default] [JOB 12510] Generated table #230805: 924541 keys, 37496532 bytes, temperature: kWarm 2024/11/22-22:16:52.646921 140024944858688 EVENT_LOG_v1 {"time_micros": 1732285012646890, "cf_name": "default", "job": 12510, "event": "table_file_creation", "file_number": 230805, "file_size": 37496532, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3499102480, "largest_seqno": 3603058017, "table_properties": {"data_size": 31529632, "index_size": 1758976, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25887148, "raw_average_key_size": 28, "raw_value_size": 108330590, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 924541, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732285009, "oldest_key_time": 0, "file_creation_time": 1732285009, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 230805, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-22:16:52.687155 140024944858688 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12510/att-00/230806.sst) /dev/shm/ToplingTemp/Topling-311741-ouBy8z 2024/11/22-22:16:53.581570 140024944858688 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12510/att-00/230806.sst): first pass time = 0.89's, 150.068'MB/sec 2024/11/22-22:16:55.015488 140024944858688 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12510/att-00/230806.sst): old prealloc_size = 147639500, real_size = 36823536 2024/11/22-22:16:55.016065 140024944858688 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12510/att-00/230806.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 928673 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1082 GB zip-val = 0.0348 GB avg-val = 116.53 avg-zval = 37.49 2024/11/22-22:16:55.016673 140024944858688 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12510/att-00/230806.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-22:16:55.903799 140024944858688 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12510/att-00/230806.sst): second pass time = 1.43's, 75.507'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.89's, 45.068'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3208.411'MB/sec (index lex order gen) rebuild zvType time = 0.76's, 0.307'MB/sec write SST data time = 0.13's, 305.141'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 33463.814'MB/sec zip my value time = 1.43's, unzip length = 0.108'GB zip my value throughput = 75.507'MB/sec zip pipeline throughput = 75.507'MB/sec entries = 928673 avg-key = 28.00 avg-zkey = 1.92 avg-val = 116.53 avg-zval = 37.49 usrkeys = 928673 avg-key = 20.00 avg-zkey = 1.92 avg-val = 121.12 avg-zval = 37.49 TagRS{ kinds = RS_Key0_TagN bytes = 145200 } TagArray{ size = 609181 bytes = 2208304 } seq expand size = 4264267 multi value expand size = 0 cnt WriteAppend = 16 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0348 GB dict = 1.08 MB all = 0.0400 GB } UnZip/Zip{ index = 10.4434 value = 3.1085 dict = 1.00 all = 3.3526 } Zip/UnZip{ index = 0.0958 value = 0.3217 dict = 1.00 all = 0.2983 } ---------------------------- total value len = 0.915877 GB avg = 0.124 KB (by entry num) total key len = 0.207504 GB avg = 0.028 KB total ukey len = 0.148217 GB avg = 0.020 KB total ukey num = 0.007410874 Billion total entry num = 0.007410874 Billion write speed all = 0.023271526 MB/sec (with seq num) write speed all = 0.022043361 MB/sec (without seq num) 2024/11/22-22:16:55.940358 140024944858688 [compaction_job.cc:1948] [default] [JOB 12510] Generated table #230806: 928673 keys, 40033528 bytes, temperature: kWarm 2024/11/22-22:16:55.940420 140024944858688 EVENT_LOG_v1 {"time_micros": 1732285015940389, "cf_name": "default", "job": 12510, "event": "table_file_creation", "file_number": 230806, "file_size": 40033528, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3603057516, "table_properties": {"data_size": 34812704, "index_size": 1778496, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26002844, "raw_average_key_size": 28, "raw_value_size": 108214958, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 928673, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732285012, "oldest_key_time": 0, "file_creation_time": 1732285012, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 230806, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-22:16:55.976799 140024944858688 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12510/att-00/230807.sst) /dev/shm/ToplingTemp/Topling-311741-r9RAlA 2024/11/22-22:16:56.769301 140024944858688 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12510/att-00/230807.sst): first pass time = 0.79's, 169.369'MB/sec 2024/11/22-22:16:58.423374 140024944858688 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12510/att-00/230807.sst): old prealloc_size = 147639500, real_size = 36496144 2024/11/22-22:16:58.424018 140024944858688 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12510/att-00/230807.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927148 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0345 GB avg-val = 116.76 avg-zval = 37.21 2024/11/22-22:16:58.424078 140024944858688 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12510/att-00/230807.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-22:16:59.104802 140024944858688 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12510/att-00/230807.sst): second pass time = 1.65's, 65.480'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.68's, 54.820'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2837.026'MB/sec (index lex order gen) rebuild zvType time = 0.53's, 0.440'MB/sec write SST data time = 0.15's, 243.086'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 29833.039'MB/sec zip my value time = 1.65's, unzip length = 0.108'GB zip my value throughput = 65.480'MB/sec zip pipeline throughput = 65.480'MB/sec entries = 927148 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.76 avg-zval = 37.21 usrkeys = 927148 avg-key = 20.00 avg-zkey = 1.90 avg-val = 116.76 avg-zval = 37.21 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0345 GB dict = 1.08 MB all = 0.0374 GB } UnZip/Zip{ index = 10.5132 value = 3.1379 dict = 1.00 all = 3.5931 } Zip/UnZip{ index = 0.0951 value = 0.3187 dict = 1.00 all = 0.2783 } ---------------------------- total value len = 1.024135 GB avg = 0.123 KB (by entry num) total key len = 0.233465 GB avg = 0.028 KB total ukey len = 0.166760 GB avg = 0.020 KB total ukey num = 0.008338022 Billion total entry num = 0.008338022 Billion write speed all = 0.026050199 MB/sec (with seq num) write speed all = 0.024668474 MB/sec (without seq num) 2024/11/22-22:16:59.138593 140024944858688 [compaction_job.cc:1948] [default] [JOB 12510] Generated table #230807: 927148 keys, 37354530 bytes, temperature: kWarm 2024/11/22-22:16:59.138654 140024944858688 EVENT_LOG_v1 {"time_micros": 1732285019138622, "cf_name": "default", "job": 12510, "event": "table_file_creation", "file_number": 230807, "file_size": 37354530, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 34500416, "index_size": 1763776, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25960144, "raw_average_key_size": 28, "raw_value_size": 108257584, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927148, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732285015, "oldest_key_time": 0, "file_creation_time": 1732285015, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 230807, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-22:16:59.174970 140024944858688 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12510/att-00/230808.sst) /dev/shm/ToplingTemp/Topling-311741-GC3Cyy 2024/11/22-22:17:00.018115 140024944858688 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12510/att-00/230808.sst): first pass time = 0.84's, 159.194'MB/sec 2024/11/22-22:17:01.598658 140024944858688 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12510/att-00/230808.sst): old prealloc_size = 147639500, real_size = 36386656 2024/11/22-22:17:01.599257 140024944858688 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12510/att-00/230808.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 926856 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0344 GB avg-val = 116.81 avg-zval = 37.11 2024/11/22-22:17:01.599305 140024944858688 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12510/att-00/230808.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-22:17:02.361347 140024944858688 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12510/att-00/230808.sst): second pass time = 1.58's, 68.557'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.76's, 48.834'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3062.903'MB/sec (index lex order gen) rebuild zvType time = 0.62's, 0.377'MB/sec write SST data time = 0.15's, 253.519'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 32877.054'MB/sec zip my value time = 1.58's, unzip length = 0.108'GB zip my value throughput = 68.557'MB/sec zip pipeline throughput = 68.557'MB/sec entries = 926856 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.81 avg-zval = 37.11 usrkeys = 926856 avg-key = 20.00 avg-zkey = 1.90 avg-val = 116.81 avg-zval = 37.11 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 8 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0344 GB dict = 1.08 MB all = 0.0372 GB } UnZip/Zip{ index = 10.5130 value = 3.1480 dict = 1.00 all = 3.6037 } Zip/UnZip{ index = 0.0951 value = 0.3177 dict = 1.00 all = 0.2775 } ---------------------------- total value len = 1.132401 GB avg = 0.122 KB (by entry num) total key len = 0.259417 GB avg = 0.028 KB total ukey len = 0.185298 GB avg = 0.020 KB total ukey num = 0.009264878 Billion total entry num = 0.009264878 Billion write speed all = 0.028828470 MB/sec (with seq num) write speed all = 0.027293256 MB/sec (without seq num) 2024/11/22-22:17:02.397026 140024944858688 [compaction_job.cc:1948] [default] [JOB 12510] Generated table #230808: 926856 keys, 37244758 bytes, temperature: kWarm 2024/11/22-22:17:02.397089 140024944858688 EVENT_LOG_v1 {"time_micros": 1732285022397057, "cf_name": "default", "job": 12510, "event": "table_file_creation", "file_number": 230808, "file_size": 37244758, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 34391504, "index_size": 1763264, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25951968, "raw_average_key_size": 28, "raw_value_size": 108265764, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 926856, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732285019, "oldest_key_time": 0, "file_creation_time": 1732285019, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 230808, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-22:17:02.441267 140024944858688 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12510/att-00/230809.sst) /dev/shm/ToplingTemp/Topling-311741-ibDX8z 2024/11/22-22:17:03.272546 140024944858688 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12510/att-00/230809.sst): first pass time = 0.83's, 161.468'MB/sec 2024/11/22-22:17:04.628857 140024944858688 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12510/att-00/230809.sst): old prealloc_size = 147639500, real_size = 31814352 2024/11/22-22:17:04.629429 140024944858688 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12510/att-00/230809.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 924995 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0298 GB avg-val = 117.10 avg-zval = 32.24 2024/11/22-22:17:04.631554 140024944858688 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12510/att-00/230809.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-22:17:05.603210 140024944858688 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12510/att-00/230809.sst): second pass time = 1.35's, 80.107'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.97's, 37.108'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3215.821'MB/sec (index lex order gen) rebuild zvType time = 0.84's, 0.275'MB/sec write SST data time = 0.13's, 269.606'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 31712.341'MB/sec zip my value time = 1.35's, unzip length = 0.108'GB zip my value throughput = 80.107'MB/sec zip pipeline throughput = 80.107'MB/sec entries = 924995 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.10 avg-zval = 32.24 usrkeys = 924995 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.07 avg-zval = 32.24 TagRS{ kinds = RS_Key0_TagN bytes = 144640 } TagArray{ size = 920720 bytes = 3337632 } seq expand size = 6445040 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0298 GB dict = 1.08 MB all = 0.0362 GB } UnZip/Zip{ index = 10.5105 value = 3.6321 dict = 1.00 all = 3.7122 } Zip/UnZip{ index = 0.0951 value = 0.2753 dict = 1.00 all = 0.2694 } ---------------------------- total value len = 1.247164 GB avg = 0.122 KB (by entry num) total key len = 0.285316 GB avg = 0.028 KB total ukey len = 0.203797 GB avg = 0.020 KB total ukey num = 0.010189873 Billion total entry num = 0.010189873 Billion write speed all = 0.031739864 MB/sec (with seq num) write speed all = 0.030051489 MB/sec (without seq num) 2024/11/22-22:17:05.636516 140024944858688 [compaction_job.cc:1948] [default] [JOB 12510] Generated table #230809: 924995 keys, 36155938 bytes, temperature: kWarm 2024/11/22-22:17:05.636580 140024944858688 EVENT_LOG_v1 {"time_micros": 1732285025636546, "cf_name": "default", "job": 12510, "event": "table_file_creation", "file_number": 230809, "file_size": 36155938, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3603056183, "table_properties": {"data_size": 29822784, "index_size": 1760128, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25899860, "raw_average_key_size": 28, "raw_value_size": 108317974, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 924995, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732285022, "oldest_key_time": 0, "file_creation_time": 1732285022, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 230809, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-22:17:05.673933 140024944858688 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12510/att-00/230810.sst) /dev/shm/ToplingTemp/Topling-311741-phijZy 2024/11/22-22:17:06.599983 140024944858688 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12510/att-00/230810.sst): first pass time = 0.93's, 144.942'MB/sec 2024/11/22-22:17:07.978297 140024944858688 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12510/att-00/230810.sst): old prealloc_size = 147639500, real_size = 34181248 2024/11/22-22:17:07.978893 140024944858688 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12510/att-00/230810.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 929320 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1082 GB zip-val = 0.0322 GB avg-val = 116.43 avg-zval = 34.62 2024/11/22-22:17:07.979682 140024944858688 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12510/att-00/230810.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-22:17:08.903088 140024944858688 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12510/att-00/230810.sst): second pass time = 1.38's, 78.536'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.92's, 41.527'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3100.693'MB/sec (index lex order gen) rebuild zvType time = 0.79's, 0.293'MB/sec write SST data time = 0.13's, 294.043'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 33547.433'MB/sec zip my value time = 1.38's, unzip length = 0.108'GB zip my value throughput = 78.536'MB/sec zip pipeline throughput = 78.536'MB/sec entries = 929320 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.43 avg-zval = 34.62 usrkeys = 929320 avg-key = 20.00 avg-zkey = 1.91 avg-val = 123.43 avg-zval = 34.62 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 929320 bytes = 3368800 } seq expand size = 6505240 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0322 GB dict = 1.08 MB all = 0.0384 GB } UnZip/Zip{ index = 10.4442 value = 3.3634 dict = 1.00 all = 3.4950 } Zip/UnZip{ index = 0.0957 value = 0.2973 dict = 1.00 all = 0.2861 } ---------------------------- total value len = 1.361866 GB avg = 0.122 KB (by entry num) total key len = 0.311337 GB avg = 0.028 KB total ukey len = 0.222384 GB avg = 0.020 KB total ukey num = 0.011119193 Billion total entry num = 0.011119193 Billion write speed all = 0.034652073 MB/sec (with seq num) write speed all = 0.032809843 MB/sec (without seq num) 2024/11/22-22:17:08.937000 140024944858688 [compaction_job.cc:1948] [default] [JOB 12510] Generated table #230810: 929320 keys, 38402824 bytes, temperature: kWarm 2024/11/22-22:17:08.937062 140024944858688 EVENT_LOG_v1 {"time_micros": 1732285028937031, "cf_name": "default", "job": 12510, "event": "table_file_creation", "file_number": 230810, "file_size": 38402824, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3273701386, "largest_seqno": 3603057830, "table_properties": {"data_size": 32169136, "index_size": 1779584, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26020960, "raw_average_key_size": 28, "raw_value_size": 108196868, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 929320, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732285025, "oldest_key_time": 0, "file_creation_time": 1732285025, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 230810, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-22:17:08.974909 140024944858688 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12510/att-00/230811.sst) /dev/shm/ToplingTemp/Topling-311741-qkxBzy 2024/11/22-22:17:09.788430 140024944858688 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12510/att-00/230811.sst): first pass time = 0.81's, 164.992'MB/sec 2024/11/22-22:17:11.096953 140024944858688 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12510/att-00/230811.sst): old prealloc_size = 147639500, real_size = 31129664 2024/11/22-22:17:11.097489 140024944858688 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12510/att-00/230811.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 921805 prefix = 4 raw-key = 0.0147 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.94 raw-val = 0.1084 GB zip-val = 0.0291 GB avg-val = 117.60 avg-zval = 31.58 2024/11/22-22:17:11.099523 140024944858688 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12510/att-00/230811.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-22:17:11.949301 140024944858688 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12510/att-00/230811.sst): second pass time = 1.31's, 82.889'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.85's, 41.449'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3469.455'MB/sec (index lex order gen) rebuild zvType time = 0.72's, 0.321'MB/sec write SST data time = 0.13's, 264.492'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.084'MB, throughput = 32611.292'MB/sec zip my value time = 1.31's, unzip length = 0.108'GB zip my value throughput = 82.889'MB/sec zip pipeline throughput = 82.889'MB/sec entries = 921805 avg-key = 28.00 avg-zkey = 1.94 avg-val = 117.60 avg-zval = 31.58 usrkeys = 921805 avg-key = 20.00 avg-zkey = 1.94 avg-val = 124.60 avg-zval = 31.58 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 921805 bytes = 3341552 } seq expand size = 6452635 multi value expand size = 0 cnt WriteAppend = 17 UnZipSize{ index = 0.0184 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0291 GB dict = 1.08 MB all = 0.0353 GB } UnZip/Zip{ index = 10.3083 value = 3.7240 dict = 1.00 all = 3.7992 } Zip/UnZip{ index = 0.0970 value = 0.2685 dict = 1.00 all = 0.2632 } ---------------------------- total value len = 1.476726 GB avg = 0.123 KB (by entry num) total key len = 0.337148 GB avg = 0.028 KB total ukey len = 0.240820 GB avg = 0.020 KB total ukey num = 0.012040998 Billion total entry num = 0.012040998 Billion write speed all = 0.037562991 MB/sec (with seq num) write speed all = 0.035568163 MB/sec (without seq num) 2024/11/22-22:17:11.979284 140024944858688 [compaction_job.cc:1948] [default] [JOB 12510] Generated table #230811: 921805 keys, 35328232 bytes, temperature: kWarm 2024/11/22-22:17:11.979348 140024944858688 EVENT_LOG_v1 {"time_micros": 1732285031979316, "cf_name": "default", "job": 12510, "event": "table_file_creation", "file_number": 230811, "file_size": 35328232, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3303385365, "largest_seqno": 3603056228, "table_properties": {"data_size": 29110576, "index_size": 1788480, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25810540, "raw_average_key_size": 28, "raw_value_size": 108407302, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 921805, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732285028, "oldest_key_time": 0, "file_creation_time": 1732285028, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 230811, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-22:17:12.017892 140024944858688 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12510/att-00/230812.sst) /dev/shm/ToplingTemp/Topling-311741-7eyIwy 2024/11/22-22:17:12.261498 140024944858688 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12510/att-00/230812.sst): first pass time = 0.24's, 178.321'MB/sec 2024/11/22-22:17:12.672220 140024944858688 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12510/att-00/230812.sst): old prealloc_size = 147639500, real_size = 12212672 2024/11/22-22:17:12.672436 140024944858688 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12510/att-00/230812.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 300865 prefix = 4 raw-key = 0.0048 GB zip-key = 0.0006 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.0350 GB zip-val = 0.0116 GB avg-val = 116.36 avg-zval = 38.42 2024/11/22-22:17:12.672703 140024944858688 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12510/att-00/230812.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0007 GB, waited 0.000 sec, Key+Value = 0.043 GB 2024/11/22-22:17:12.954044 140024944858688 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12510/att-00/230812.sst): second pass time = 0.41's, 85.366'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.28's, 47.947'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3027.276'MB/sec (index lex order gen) rebuild zvType time = 0.24's, 0.315'MB/sec write SST data time = 0.04's, 317.934'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.356'MB, throughput = 12203.042'MB/sec zip my value time = 0.41's, unzip length = 0.035'GB zip my value throughput = 85.366'MB/sec zip pipeline throughput = 85.366'MB/sec entries = 300865 avg-key = 28.00 avg-zkey = 1.92 avg-val = 116.36 avg-zval = 38.42 usrkeys = 300865 avg-key = 20.00 avg-zkey = 1.92 avg-val = 123.36 avg-zval = 38.42 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 300865 bytes = 1015440 } seq expand size = 2106055 multi value expand size = 0 cnt WriteAppend = 15 UnZipSize{ index = 0.0060 GB value = 0.0350 GB dict = 0.36 MB all = 0.0434 GB } __ZipSize{ index = 0.0006 GB value = 0.0116 GB dict = 0.36 MB all = 0.0135 GB } UnZip/Zip{ index = 10.4224 value = 3.0285 dict = 1.00 all = 3.2145 } Zip/UnZip{ index = 0.0959 value = 0.3302 dict = 1.00 all = 0.3111 } ---------------------------- total value len = 1.513841 GB avg = 0.123 KB (by entry num) total key len = 0.345572 GB avg = 0.028 KB total ukey len = 0.246837 GB avg = 0.020 KB total ukey num = 0.012341863 Billion total entry num = 0.012341863 Billion write speed all = 0.038505258 MB/sec (with seq num) write speed all = 0.036460628 MB/sec (without seq num) 2024/11/22-22:17:12.970280 140024944858688 [compaction_job.cc:1948] [default] [JOB 12510] Generated table #230812: 300865 keys, 13511879 bytes, temperature: kWarm 2024/11/22-22:17:12.970341 140024944858688 EVENT_LOG_v1 {"time_micros": 1732285032970310, "cf_name": "default", "job": 12510, "event": "table_file_creation", "file_number": 230812, "file_size": 13511879, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3470221528, "largest_seqno": 3603057490, "table_properties": {"data_size": 11559920, "index_size": 577344, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 8424220, "raw_average_key_size": 28, "raw_value_size": 35009394, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 300865, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732285032, "oldest_key_time": 0, "file_creation_time": 1732285032, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 230812, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-22:17:12.988028 140024944858688 [compaction_job.cc:703] job-12510: subcompact[0], size: 0.500308 G, files: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12510/att-00 [230799,230800,230801,230802,230803,230804,230805,230806,230807,230808,230809,230810,230811,230812] 2024/11/22-22:17:13.076429 140024944858688 (Original Log Time 2024/11/22-22:16:20.844264) EVENT_LOG_v1 {"time_micros": 1732284980844222, "job": 12510, "event": "compaction_started", "compaction_reason": "FilesMarkedForCompaction", "files_L2": [230791], "files_L3": [230732, 230733, 230734, 230735, 230736, 230737, 230738, 230739, 230740, 230741, 230742, 230743, 230744, 230745], "score": 0.999502, "input_data_size": 524789169, "oldest_snapshot_seqno": 3603081743} 2024/11/22-22:17:13.076432 140024944858688 (Original Log Time 2024/11/22-22:17:13.075699) [compaction_job.cc:2022] [default] [JOB 12510] Compacted 1@2 + 14@3 files to L3 => 500307567 bytes 2024/11/22-22:17:13.076434 140024944858688 (Original Log Time 2024/11/22-22:17:13.076365) [compaction_job.cc:1224] [default] compacted to: files[0 0 0 14 0 0 0] max score 0.02, MB/sec: 10.1 rd, 9.6 wr, level 3, files in(1, 14) out(14 +0 blob) MB in(27.2, 473.3 +0.0 blob) out(477.1 +0.0 blob), read-write-amplify(36.0) write-amplify(17.6) OK, records in: 12426180, records dropped: 84317 output_compression: Snappy 2024/11/22-22:17:13.076440 140024944858688 (Original Log Time 2024/11/22-22:17:13.076409) EVENT_LOG_v1 {"time_micros": 1732285033076390, "cf": "default", "job": 12510, "event": "compaction_finished", "compaction_time_micros": 52143772, "compaction_time_cpu_micros": 22649650, "output_level": 3, "num_output_files": 14, "total_output_size": 500307567, "num_input_records": 12426180, "num_output_records": 12341863, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "file_write_nanos": 381983014, "file_range_sync_nanos": 0, "file_fsync_nanos": 12562, "file_prepare_write_nanos": 35318, "lsm_state": [0, 0, 0, 14, 0, 0, 0]} 2024/11/22-22:17:13.206690 140024944858688 DEBG dcompact_worker.cpp:240: HttpPost: 200 OK: url = http://nlb-7zny4kaa1poal01o64.cn-shenzhen.nlb.aliyuncs.com:8443, body = {"instanceId":"nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137","labourId":"","dbId":"d89b4006-2803-486e-b7a2-759bcf348921","dbStarts":1732256054,"starts":1732284980,"executesMs":52374,"compactionJobId":12510,"attempt":0,"compactionInputRawBytes":1800237816,"compactionInputZipBytes":524789169,"compactionOutputRawBytes":0,"compactionOutputZipBytes":500307567,"headers":{"Accept":"*/*","Connection":"close","Host":"aliyun-topling-saas.topling.cn:18443","RemoteIp":"120.24.192.169","X-Forwarded-For":"120.24.192.169","region":"cn-shenzhen","token":"e6474c481bd4415abc537135cc03626b","instance-token":"e6474c481bd4415abc537135cc03626b","provider":"aliyun","CloudMarketInstanceId":"si-59c0ae5c955845588903","MeteringAssit":"","Transfer-Encoding":"chunked","traceparent":"00-39f814b5119ab2a49375ded5faaa9259-0f5f366fd5ac313b-00"}}, response = 2024/11/22-22:17:13.206788 140024944858688 INFO dcompact_worker.cpp:1459: finish /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-12510/att-00: olev 3, work 52.375 s, result 4.900 ms, install 0.759 ms, input{raw 1.677 GiB zip 500.478 MiB}