2024/11/23-07:23:34.378315 140024743433792 DEBG dcompact_worker.cpp:2214: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21791/att-00: fork to child time = 0.024480 sec 2024/11/23-07:23:34.379419 140024743433792 DEBG dcompact_worker.cpp:1013: Beg SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21791/att-00 2024/11/23-07:23:34.388223 140024743433792 DEBG dcompact_worker.cpp:1033: End SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21791/att-00 2024/11/23-07:23:34.389695 140024743433792 TRAC dcompact_worker.cpp:1083: INFO_LOG_LEVEL: rpc = INFO_LEVEL, env_var = undefined 2024/11/23-07:23:34.390025 140024743433792 [WARN] [column_family.cc:386] multiple cf_paths/db_paths and level_compaction_dynamic_level_bytes can't be used together 2024/11/23-07:23:34.440873 140024743433792 [version_set.cc:6208] Recovering from manifest file: /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-21791/att-00/MANIFEST-206347 2024/11/23-07:23:34.476159 140024743433792 [version_set.cc:6251] Recovered from manifest file:/worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-21791/att-00/MANIFEST-206347 succeeded,manifest_file_number is 206347, next_file_number is 250333, last_sequence is 3858381303, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 250183 2024/11/23-07:23:34.476169 140024743433792 [version_set.cc:6266] Column family [default] (ID 0), log number is 0 2024/11/23-07:23:34.476326 140024743433792 [version_set.cc:5721] Creating manifest 250333 2024/11/23-07:23:34.508745 140024743433792 DEBG dcompact_worker.cpp:1218: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21791/att-00: bottommost_level: fake = 1, rpc = 0 2024/11/23-07:23:34.529102 140024743433792 [compaction_job.cc:2437] [default] [JOB 21791] Compacting 1@2 + 14@3 files to L3, score 0.99, subcompactions 1 : 1 2024/11/23-07:23:34.529129 140024743433792 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 16346 Base level 2, inputs: [250321(26MB)], [250291(35MB) 250292(34MB) 250293(14MB) 250262(33MB) 250263(36MB) 250264(35MB) 250265(35MB) 250266(35MB) 250267(35MB) 250268(35MB) 250269(36MB) 250270(35MB) 250271(35MB) 250272(24MB)] 2024/11/23-07:23:34.538324 140024743433792 [top_zip_table.cc:59] core git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-07:23:34.538372 140024743433792 [top_zip_table.cc:60] fsa git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-07:23:34.538404 140024743433792 [top_zip_table.cc:61] zbs git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-07:23:34.538413 140024743433792 [top_zip_table.cc:62] topling-zip_table_reader: git_version_hash_info_is: commit a4a382006cb82713acf5b3425835f22711877681 Author: leipeng Date: 2024-04-11 19:44:14 +0800 fixed_len_hole_index.cc: Add env bool FixedLenHoleIndexUseAVX512 for ut & debug 1. FixedLenHoleIndexUseAVX512 is only in unit tests or debug 2. In release mode, use avx512 by compile options(-march=) g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/23-07:23:34.538425 140024743433792 [top_zip_table.cc:64] topling-rocks git_version_hash_info_is: commit feab587e468621ba0204d47b4ffacc52e7c4290d Author: leipeng Date: 2024-03-22 13:35:06 +0800 ToplingZipTableBuilder::Add: immediately return after error This function returns void, and caller does not check builder->status() after calling this function and graceful abandon. So immediately return after error, and return error status in Finish(). g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/23-07:23:35.064143 140024743433792 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21791/att-00/250334.sst) /dev/shm/ToplingTemp/Topling-446454-kQBtzW 2024/11/23-07:23:36.148969 140024743433792 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21791/att-00/250334.sst): first pass time = 1.08's, 123.729'MB/sec 2024/11/23-07:23:37.914262 140024743433792 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21791/att-00/250334.sst): old prealloc_size = 147639500, real_size = 32611792 2024/11/23-07:23:37.914958 140024743433792 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21791/att-00/250334.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 928921 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0306 GB avg-val = 116.49 avg-zval = 32.95 2024/11/23-07:23:37.915801 140024743433792 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21791/att-00/250334.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-07:23:39.590988 140024743433792 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21791/att-00/250334.sst): second pass time = 1.76's, 61.628'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.68's, 21.898'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2613.908'MB/sec (index lex order gen) rebuild zvType time = 1.39's, 0.167'MB/sec write SST data time = 0.29's, 127.639'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 37904.016'MB/sec zip my value time = 1.76's, unzip length = 0.108'GB zip my value throughput = 61.628'MB/sec zip pipeline throughput = 61.628'MB/sec entries = 928921 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.49 avg-zval = 32.95 usrkeys = 928921 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.49 avg-zval = 32.95 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 928921 bytes = 3251232 } seq expand size = 6502447 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0306 GB dict = 1.08 MB all = 0.0367 GB } UnZip/Zip{ index = 10.5135 value = 3.5348 dict = 1.00 all = 3.6555 } Zip/UnZip{ index = 0.0951 value = 0.2829 dict = 1.00 all = 0.2736 } ---------------------------- total value len = 0.114711 GB avg = 0.123 KB (by entry num) total key len = 0.026010 GB avg = 0.028 KB total ukey len = 0.018578 GB avg = 0.020 KB total ukey num = 0.000928921 Billion total entry num = 0.000928921 Billion write speed all = 0.001735648 MB/sec (with seq num) write speed all = 0.001643990 MB/sec (without seq num) 2024/11/23-07:23:39.634666 140024743433792 [compaction_job.cc:1948] [default] [JOB 21791] Generated table #250334: 928921 keys, 36716282 bytes, temperature: kWarm 2024/11/23-07:23:39.634788 140024743433792 EVENT_LOG_v1 {"time_micros": 1732317819634708, "cf_name": "default", "job": 21791, "event": "table_file_creation", "file_number": 250334, "file_size": 36716282, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3610601794, "largest_seqno": 3858345708, "table_properties": {"data_size": 30612288, "index_size": 1767104, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26009788, "raw_average_key_size": 28, "raw_value_size": 108208058, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 928921, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732317815, "oldest_key_time": 0, "file_creation_time": 1732317815, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 250334, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-07:23:39.712026 140024743433792 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21791/att-00/250335.sst) /dev/shm/ToplingTemp/Topling-446454-Wha8FX 2024/11/23-07:23:41.100935 140024743433792 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21791/att-00/250335.sst): first pass time = 1.39's, 96.639'MB/sec 2024/11/23-07:23:43.304290 140024743433792 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21791/att-00/250335.sst): old prealloc_size = 147639500, real_size = 31347952 2024/11/23-07:23:43.305144 140024743433792 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21791/att-00/250335.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 928845 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1082 GB zip-val = 0.0293 GB avg-val = 116.50 avg-zval = 31.58 2024/11/23-07:23:43.306187 140024743433792 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21791/att-00/250335.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-07:23:44.549725 140024743433792 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21791/att-00/250335.sst): second pass time = 2.20's, 49.147'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.25's, 28.559'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2151.070'MB/sec (index lex order gen) rebuild zvType time = 1.09's, 0.213'MB/sec write SST data time = 0.15's, 230.628'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 39084.076'MB/sec zip my value time = 2.20's, unzip length = 0.108'GB zip my value throughput = 49.147'MB/sec zip pipeline throughput = 66.031'MB/sec entries = 928845 avg-key = 28.00 avg-zkey = 1.92 avg-val = 116.50 avg-zval = 31.58 usrkeys = 928845 avg-key = 20.00 avg-zkey = 1.92 avg-val = 123.50 avg-zval = 31.58 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 928845 bytes = 3367072 } seq expand size = 6501915 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0293 GB dict = 1.08 MB all = 0.0356 GB } UnZip/Zip{ index = 10.4438 value = 3.6885 dict = 1.00 all = 3.7735 } Zip/UnZip{ index = 0.0958 value = 0.2711 dict = 1.00 all = 0.2650 } ---------------------------- total value len = 0.229423 GB avg = 0.123 KB (by entry num) total key len = 0.052017 GB avg = 0.028 KB total ukey len = 0.037155 GB avg = 0.020 KB total ukey num = 0.001857766 Billion total entry num = 0.001857766 Billion write speed all = 0.003471077 MB/sec (with seq num) write speed all = 0.003287778 MB/sec (without seq num) 2024/11/23-07:23:44.584438 140024743433792 [compaction_job.cc:1948] [default] [JOB 21791] Generated table #250335: 928845 keys, 35568080 bytes, temperature: kWarm 2024/11/23-07:23:44.584499 140024743433792 EVENT_LOG_v1 {"time_micros": 1732317824584469, "cf_name": "default", "job": 21791, "event": "table_file_creation", "file_number": 250335, "file_size": 35568080, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3516470397, "largest_seqno": 3858347451, "table_properties": {"data_size": 29336800, "index_size": 1778752, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26007660, "raw_average_key_size": 28, "raw_value_size": 108210082, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 928845, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732317819, "oldest_key_time": 0, "file_creation_time": 1732317819, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 250335, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-07:23:44.626547 140024743433792 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21791/att-00/250336.sst) /dev/shm/ToplingTemp/Topling-446454-cwNH4V 2024/11/23-07:23:45.767163 140024743433792 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21791/att-00/250336.sst): first pass time = 1.14's, 117.677'MB/sec 2024/11/23-07:23:47.490082 140024743433792 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21791/att-00/250336.sst): old prealloc_size = 147639500, real_size = 33428256 2024/11/23-07:23:47.490661 140024743433792 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21791/att-00/250336.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 923285 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1084 GB zip-val = 0.0314 GB avg-val = 117.37 avg-zval = 34.05 2024/11/23-07:23:47.491455 140024743433792 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21791/att-00/250336.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-07:23:48.458629 140024743433792 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21791/att-00/250336.sst): second pass time = 1.72's, 62.920'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.97's, 38.856'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3147.943'MB/sec (index lex order gen) rebuild zvType time = 0.83's, 0.278'MB/sec write SST data time = 0.14's, 273.615'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.083'MB, throughput = 26784.209'MB/sec zip my value time = 1.72's, unzip length = 0.108'GB zip my value throughput = 62.920'MB/sec zip pipeline throughput = 111.147'MB/sec entries = 923285 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.37 avg-zval = 34.05 usrkeys = 923285 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.37 avg-zval = 34.05 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 923285 bytes = 3346928 } seq expand size = 6462995 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0185 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0314 GB dict = 1.08 MB all = 0.0376 GB } UnZip/Zip{ index = 10.5129 value = 3.4467 dict = 1.00 all = 3.5665 } Zip/UnZip{ index = 0.0951 value = 0.2901 dict = 1.00 all = 0.2804 } ---------------------------- total value len = 0.344251 GB avg = 0.124 KB (by entry num) total key len = 0.077869 GB avg = 0.028 KB total ukey len = 0.055621 GB avg = 0.020 KB total ukey num = 0.002781051 Billion total entry num = 0.002781051 Billion write speed all = 0.005205881 MB/sec (with seq num) write speed all = 0.004931498 MB/sec (without seq num) 2024/11/23-07:23:48.501366 140024743433792 [compaction_job.cc:1948] [default] [JOB 21791] Generated table #250336: 923285 keys, 37632992 bytes, temperature: kWarm 2024/11/23-07:23:48.501425 140024743433792 EVENT_LOG_v1 {"time_micros": 1732317828501395, "cf_name": "default", "job": 21791, "event": "table_file_creation", "file_number": 250336, "file_size": 37632992, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3369353416, "largest_seqno": 3858347475, "table_properties": {"data_size": 31440784, "index_size": 1756480, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25851980, "raw_average_key_size": 28, "raw_value_size": 108365814, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 923285, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732317824, "oldest_key_time": 0, "file_creation_time": 1732317824, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 250336, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-07:23:48.539238 140024743433792 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21791/att-00/250337.sst) /dev/shm/ToplingTemp/Topling-446454-nLTAGX 2024/11/23-07:23:49.605115 140024743433792 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21791/att-00/250337.sst): first pass time = 1.07's, 125.927'MB/sec 2024/11/23-07:23:51.626986 140024743433792 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21791/att-00/250337.sst): old prealloc_size = 147639500, real_size = 33974384 2024/11/23-07:23:51.627685 140024743433792 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21791/att-00/250337.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 930808 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1082 GB zip-val = 0.0320 GB avg-val = 116.19 avg-zval = 34.34 2024/11/23-07:23:51.628463 140024743433792 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21791/att-00/250337.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-07:23:52.871529 140024743433792 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21791/att-00/250337.sst): second pass time = 2.02's, 53.512'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.24's, 30.356'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2680.832'MB/sec (index lex order gen) rebuild zvType time = 1.08's, 0.215'MB/sec write SST data time = 0.16's, 231.098'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 36560.146'MB/sec zip my value time = 2.02's, unzip length = 0.108'GB zip my value throughput = 53.512'MB/sec zip pipeline throughput = 53.512'MB/sec entries = 930808 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.19 avg-zval = 34.34 usrkeys = 930808 avg-key = 20.00 avg-zkey = 1.91 avg-val = 121.82 avg-zval = 34.34 TagRS{ kinds = RS_Key0_TagN bytes = 145520 } TagArray{ size = 747811 bytes = 2804304 } seq expand size = 5234677 multi value expand size = 0 cnt WriteAppend = 18 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0320 GB dict = 1.08 MB all = 0.0378 GB } UnZip/Zip{ index = 10.4467 value = 3.3841 dict = 1.00 all = 3.5526 } Zip/UnZip{ index = 0.0957 value = 0.2955 dict = 1.00 all = 0.2815 } ---------------------------- total value len = 0.457641 GB avg = 0.123 KB (by entry num) total key len = 0.103932 GB avg = 0.028 KB total ukey len = 0.074237 GB avg = 0.020 KB total ukey num = 0.003711859 Billion total entry num = 0.003711859 Billion write speed all = 0.006925327 MB/sec (with seq num) write speed all = 0.006559130 MB/sec (without seq num) 2024/11/23-07:23:52.909085 140024743433792 [compaction_job.cc:1948] [default] [JOB 21791] Generated table #250337: 930808 keys, 37779706 bytes, temperature: kWarm 2024/11/23-07:23:52.909141 140024743433792 EVENT_LOG_v1 {"time_micros": 1732317832909111, "cf_name": "default", "job": 21791, "event": "table_file_creation", "file_number": 250337, "file_size": 37779706, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3858346997, "table_properties": {"data_size": 31959456, "index_size": 1782016, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26062624, "raw_average_key_size": 28, "raw_value_size": 108155196, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 930808, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732317828, "oldest_key_time": 0, "file_creation_time": 1732317828, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 250337, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-07:23:52.947147 140024743433792 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21791/att-00/250338.sst) /dev/shm/ToplingTemp/Topling-446454-bnPVGZ 2024/11/23-07:23:54.004900 140024743433792 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21791/att-00/250338.sst): first pass time = 1.06's, 126.894'MB/sec 2024/11/23-07:23:55.602136 140024743433792 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21791/att-00/250338.sst): old prealloc_size = 147639500, real_size = 30706480 2024/11/23-07:23:55.602800 140024743433792 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21791/att-00/250338.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 926697 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1083 GB zip-val = 0.0287 GB avg-val = 116.83 avg-zval = 30.97 2024/11/23-07:23:55.603600 140024743433792 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21791/att-00/250338.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-07:23:56.731061 140024743433792 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21791/att-00/250338.sst): second pass time = 1.60's, 67.819'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.13's, 30.726'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2764.524'MB/sec (index lex order gen) rebuild zvType time = 0.97's, 0.239'MB/sec write SST data time = 0.16's, 219.333'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 35127.950'MB/sec zip my value time = 1.60's, unzip length = 0.108'GB zip my value throughput = 67.819'MB/sec zip pipeline throughput = 67.819'MB/sec entries = 926697 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.83 avg-zval = 30.97 usrkeys = 926697 avg-key = 20.00 avg-zkey = 1.91 avg-val = 123.83 avg-zval = 30.97 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 926697 bytes = 3127616 } seq expand size = 6486879 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0287 GB dict = 1.08 MB all = 0.0347 GB } UnZip/Zip{ index = 10.4441 value = 3.7725 dict = 1.00 all = 3.8694 } Zip/UnZip{ index = 0.0957 value = 0.2651 dict = 1.00 all = 0.2584 } ---------------------------- total value len = 0.572398 GB avg = 0.123 KB (by entry num) total key len = 0.129880 GB avg = 0.028 KB total ukey len = 0.092771 GB avg = 0.020 KB total ukey num = 0.004638556 Billion total entry num = 0.004638556 Billion write speed all = 0.008660087 MB/sec (with seq num) write speed all = 0.008202487 MB/sec (without seq num) 2024/11/23-07:23:56.764378 140024743433792 [compaction_job.cc:1948] [default] [JOB 21791] Generated table #250338: 926697 keys, 34687022 bytes, temperature: kWarm 2024/11/23-07:23:56.764440 140024743433792 EVENT_LOG_v1 {"time_micros": 1732317836764410, "cf_name": "default", "job": 21791, "event": "table_file_creation", "file_number": 250338, "file_size": 34687022, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3730940484, "largest_seqno": 3858347589, "table_properties": {"data_size": 28700000, "index_size": 1774592, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25947516, "raw_average_key_size": 28, "raw_value_size": 108270326, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 926697, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732317832, "oldest_key_time": 0, "file_creation_time": 1732317832, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 250338, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-07:23:56.802493 140024743433792 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21791/att-00/250339.sst) /dev/shm/ToplingTemp/Topling-446454-p2IC0W 2024/11/23-07:23:57.933205 140024743433792 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21791/att-00/250339.sst): first pass time = 1.13's, 118.706'MB/sec 2024/11/23-07:23:59.428266 140024743433792 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21791/att-00/250339.sst): old prealloc_size = 147639500, real_size = 33366160 2024/11/23-07:23:59.428860 140024743433792 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21791/att-00/250339.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 931420 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1081 GB zip-val = 0.0314 GB avg-val = 116.10 avg-zval = 33.67 2024/11/23-07:23:59.429696 140024743433792 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21791/att-00/250339.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-07:24:00.466684 140024743433792 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21791/att-00/250339.sst): second pass time = 1.49's, 72.366'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.04's, 36.203'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3074.661'MB/sec (index lex order gen) rebuild zvType time = 0.88's, 0.264'MB/sec write SST data time = 0.16's, 239.639'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 34828.272'MB/sec zip my value time = 1.49's, unzip length = 0.108'GB zip my value throughput = 72.366'MB/sec zip pipeline throughput = 72.366'MB/sec entries = 931420 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.10 avg-zval = 33.67 usrkeys = 931420 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.10 avg-zval = 33.67 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 931420 bytes = 3376416 } seq expand size = 6519940 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0314 GB dict = 1.08 MB all = 0.0376 GB } UnZip/Zip{ index = 10.5143 value = 3.4481 dict = 1.00 all = 3.5702 } Zip/UnZip{ index = 0.0951 value = 0.2900 dict = 1.00 all = 0.2801 } ---------------------------- total value len = 0.687056 GB avg = 0.123 KB (by entry num) total key len = 0.155959 GB avg = 0.028 KB total ukey len = 0.111400 GB avg = 0.020 KB total ukey num = 0.005569976 Billion total entry num = 0.005569976 Billion write speed all = 0.010395104 MB/sec (with seq num) write speed all = 0.009845644 MB/sec (without seq num) 2024/11/23-07:24:00.509280 140024743433792 [compaction_job.cc:1948] [default] [JOB 21791] Generated table #250339: 931420 keys, 37593680 bytes, temperature: kWarm 2024/11/23-07:24:00.509340 140024743433792 EVENT_LOG_v1 {"time_micros": 1732317840509310, "cf_name": "default", "job": 21791, "event": "table_file_creation", "file_number": 250339, "file_size": 37593680, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3480997236, "largest_seqno": 3858348016, "table_properties": {"data_size": 31361408, "index_size": 1771712, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26079760, "raw_average_key_size": 28, "raw_value_size": 108137984, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 931420, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732317836, "oldest_key_time": 0, "file_creation_time": 1732317836, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 250339, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-07:24:00.545514 140024743433792 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21791/att-00/250340.sst) /dev/shm/ToplingTemp/Topling-446454-KlwPyW 2024/11/23-07:24:01.491756 140024743433792 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21791/att-00/250340.sst): first pass time = 0.95's, 141.848'MB/sec 2024/11/23-07:24:03.361063 140024743433792 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21791/att-00/250340.sst): old prealloc_size = 147639500, real_size = 30634656 2024/11/23-07:24:03.361688 140024743433792 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21791/att-00/250340.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 928002 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1082 GB zip-val = 0.0286 GB avg-val = 116.63 avg-zval = 30.85 2024/11/23-07:24:03.362521 140024743433792 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21791/att-00/250340.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-07:24:04.427505 140024743433792 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21791/att-00/250340.sst): second pass time = 1.87's, 57.926'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.07's, 32.463'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2971.970'MB/sec (index lex order gen) rebuild zvType time = 0.82's, 0.282'MB/sec write SST data time = 0.24's, 141.960'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 28596.441'MB/sec zip my value time = 1.87's, unzip length = 0.108'GB zip my value throughput = 57.926'MB/sec zip pipeline throughput = 116.903'MB/sec entries = 928002 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.63 avg-zval = 30.85 usrkeys = 928002 avg-key = 20.00 avg-zkey = 1.91 avg-val = 123.63 avg-zval = 30.85 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 928002 bytes = 3132016 } seq expand size = 6496014 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0286 GB dict = 1.08 MB all = 0.0346 GB } UnZip/Zip{ index = 10.4452 value = 3.7810 dict = 1.00 all = 3.8771 } Zip/UnZip{ index = 0.0957 value = 0.2645 dict = 1.00 all = 0.2579 } ---------------------------- total value len = 0.801786 GB avg = 0.123 KB (by entry num) total key len = 0.181943 GB avg = 0.028 KB total ukey len = 0.129960 GB avg = 0.020 KB total ukey num = 0.006497978 Billion total entry num = 0.006497978 Billion write speed all = 0.012129634 MB/sec (with seq num) write speed all = 0.011488660 MB/sec (without seq num) 2024/11/23-07:24:04.464621 140024743433792 [compaction_job.cc:1948] [default] [JOB 21791] Generated table #250340: 928002 keys, 34618492 bytes, temperature: kWarm 2024/11/23-07:24:04.464702 140024743433792 EVENT_LOG_v1 {"time_micros": 1732317844464658, "cf_name": "default", "job": 21791, "event": "table_file_creation", "file_number": 250340, "file_size": 34618492, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3740053703, "largest_seqno": 3858347627, "table_properties": {"data_size": 28625552, "index_size": 1776896, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25984056, "raw_average_key_size": 28, "raw_value_size": 108233756, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 928002, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732317840, "oldest_key_time": 0, "file_creation_time": 1732317840, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 250340, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-07:24:04.507001 140024743433792 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21791/att-00/250341.sst) /dev/shm/ToplingTemp/Topling-446454-5LQHwX 2024/11/23-07:24:05.479000 140024743433792 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21791/att-00/250341.sst): first pass time = 0.97's, 138.090'MB/sec 2024/11/23-07:24:06.790449 140024743433792 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21791/att-00/250341.sst): old prealloc_size = 147639500, real_size = 31053872 2024/11/23-07:24:06.791048 140024743433792 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21791/att-00/250341.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 929741 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1082 GB zip-val = 0.0290 GB avg-val = 116.36 avg-zval = 31.24 2024/11/23-07:24:06.791833 140024743433792 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21791/att-00/250341.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-07:24:07.695982 140024743433792 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21791/att-00/250341.sst): second pass time = 1.31's, 82.574'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.91's, 38.958'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3108.952'MB/sec (index lex order gen) rebuild zvType time = 0.77's, 0.301'MB/sec write SST data time = 0.13's, 266.845'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 36186.421'MB/sec zip my value time = 1.31's, unzip length = 0.108'GB zip my value throughput = 82.574'MB/sec zip pipeline throughput = 82.574'MB/sec entries = 929741 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.36 avg-zval = 31.24 usrkeys = 929741 avg-key = 20.00 avg-zkey = 1.91 avg-val = 123.36 avg-zval = 31.24 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 929741 bytes = 3370320 } seq expand size = 6508187 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0290 GB dict = 1.08 MB all = 0.0353 GB } UnZip/Zip{ index = 10.4441 value = 3.7253 dict = 1.00 all = 3.8047 } Zip/UnZip{ index = 0.0957 value = 0.2684 dict = 1.00 all = 0.2628 } ---------------------------- total value len = 0.916479 GB avg = 0.123 KB (by entry num) total key len = 0.207976 GB avg = 0.028 KB total ukey len = 0.148554 GB avg = 0.020 KB total ukey num = 0.007427719 Billion total entry num = 0.007427719 Billion write speed all = 0.013864262 MB/sec (with seq num) write speed all = 0.013131606 MB/sec (without seq num) 2024/11/23-07:24:07.730594 140024743433792 [compaction_job.cc:1948] [default] [JOB 21791] Generated table #250341: 929741 keys, 35276844 bytes, temperature: kWarm 2024/11/23-07:24:07.730651 140024743433792 EVENT_LOG_v1 {"time_micros": 1732317847730622, "cf_name": "default", "job": 21791, "event": "table_file_creation", "file_number": 250341, "file_size": 35276844, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3485447251, "largest_seqno": 3858347647, "table_properties": {"data_size": 29040864, "index_size": 1780416, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26032748, "raw_average_key_size": 28, "raw_value_size": 108185014, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 929741, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732317844, "oldest_key_time": 0, "file_creation_time": 1732317844, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 250341, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-07:24:07.766005 140024743433792 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21791/att-00/250342.sst) /dev/shm/ToplingTemp/Topling-446454-LIdUoZ 2024/11/23-07:24:08.704235 140024743433792 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21791/att-00/250342.sst): first pass time = 0.94's, 143.060'MB/sec 2024/11/23-07:24:10.012766 140024743433792 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21791/att-00/250342.sst): old prealloc_size = 147639500, real_size = 30748848 2024/11/23-07:24:10.013353 140024743433792 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21791/att-00/250342.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 928924 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0287 GB avg-val = 116.49 avg-zval = 30.95 2024/11/23-07:24:10.015586 140024743433792 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21791/att-00/250342.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-07:24:10.880213 140024743433792 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21791/att-00/250342.sst): second pass time = 1.31's, 82.731'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.87's, 40.314'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3236.496'MB/sec (index lex order gen) rebuild zvType time = 0.74's, 0.316'MB/sec write SST data time = 0.13's, 265.251'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 37300.508'MB/sec zip my value time = 1.31's, unzip length = 0.108'GB zip my value throughput = 82.731'MB/sec zip pipeline throughput = 82.731'MB/sec entries = 928924 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.49 avg-zval = 30.95 usrkeys = 928924 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.49 avg-zval = 30.95 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 928924 bytes = 3367360 } seq expand size = 6502468 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0287 GB dict = 1.08 MB all = 0.0350 GB } UnZip/Zip{ index = 10.5120 value = 3.7639 dict = 1.00 all = 3.8382 } Zip/UnZip{ index = 0.0951 value = 0.2657 dict = 1.00 all = 0.2605 } ---------------------------- total value len = 1.031190 GB avg = 0.123 KB (by entry num) total key len = 0.233986 GB avg = 0.028 KB total ukey len = 0.167133 GB avg = 0.020 KB total ukey num = 0.008356643 Billion total entry num = 0.008356643 Billion write speed all = 0.015598696 MB/sec (with seq num) write speed all = 0.014774446 MB/sec (without seq num) 2024/11/23-07:24:10.916045 140024743433792 [compaction_job.cc:1948] [default] [JOB 21791] Generated table #250342: 928924 keys, 34969386 bytes, temperature: kWarm 2024/11/23-07:24:10.916105 140024743433792 EVENT_LOG_v1 {"time_micros": 1732317850916075, "cf_name": "default", "job": 21791, "event": "table_file_creation", "file_number": 250342, "file_size": 34969386, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3411274482, "largest_seqno": 3858347984, "table_properties": {"data_size": 28749088, "index_size": 1767360, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26009872, "raw_average_key_size": 28, "raw_value_size": 108207948, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 928924, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732317847, "oldest_key_time": 0, "file_creation_time": 1732317847, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 250342, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-07:24:10.952812 140024743433792 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21791/att-00/250343.sst) /dev/shm/ToplingTemp/Topling-446454-xLoNTX 2024/11/23-07:24:11.900338 140024743433792 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21791/att-00/250343.sst): first pass time = 0.95's, 141.657'MB/sec 2024/11/23-07:24:13.248711 140024743433792 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21791/att-00/250343.sst): old prealloc_size = 147639500, real_size = 32133120 2024/11/23-07:24:13.249296 140024743433792 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21791/att-00/250343.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 933845 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1081 GB zip-val = 0.0301 GB avg-val = 115.73 avg-zval = 32.24 2024/11/23-07:24:13.250099 140024743433792 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21791/att-00/250343.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-07:24:14.181097 140024743433792 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21791/att-00/250343.sst): second pass time = 1.35's, 80.198'MB/sec, value only(80.5% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.93's, 39.007'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3224.750'MB/sec (index lex order gen) rebuild zvType time = 0.80's, 0.291'MB/sec write SST data time = 0.13's, 279.790'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 26855.848'MB/sec zip my value time = 1.35's, unzip length = 0.108'GB zip my value throughput = 80.198'MB/sec zip pipeline throughput = 80.198'MB/sec entries = 933845 avg-key = 28.00 avg-zkey = 1.92 avg-val = 115.73 avg-zval = 32.24 usrkeys = 933845 avg-key = 20.00 avg-zkey = 1.92 avg-val = 122.73 avg-zval = 32.24 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 933845 bytes = 3385200 } seq expand size = 6536915 multi value expand size = 0 cnt WriteAppend = 15 UnZipSize{ index = 0.0187 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0301 GB dict = 1.08 MB all = 0.0364 GB } UnZip/Zip{ index = 10.4418 value = 3.5891 dict = 1.00 all = 3.6904 } Zip/UnZip{ index = 0.0958 value = 0.2786 dict = 1.00 all = 0.2710 } ---------------------------- total value len = 1.145797 GB avg = 0.123 KB (by entry num) total key len = 0.260134 GB avg = 0.028 KB total ukey len = 0.185810 GB avg = 0.020 KB total ukey num = 0.009290488 Billion total entry num = 0.009290488 Billion write speed all = 0.017333394 MB/sec (with seq num) write speed all = 0.016417072 MB/sec (without seq num) 2024/11/23-07:24:14.222695 140024743433792 [compaction_job.cc:1948] [default] [JOB 21791] Generated table #250343: 933845 keys, 36369336 bytes, temperature: kWarm 2024/11/23-07:24:14.222767 140024743433792 EVENT_LOG_v1 {"time_micros": 1732317854222735, "cf_name": "default", "job": 21791, "event": "table_file_creation", "file_number": 250343, "file_size": 36369336, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3414933436, "largest_seqno": 3858347689, "table_properties": {"data_size": 30110832, "index_size": 1788672, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26147660, "raw_average_key_size": 28, "raw_value_size": 108070150, "raw_average_value_size": 115, "num_data_blocks": 1, "num_entries": 933845, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732317850, "oldest_key_time": 0, "file_creation_time": 1732317850, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 250343, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-07:24:14.258497 140024743433792 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21791/att-00/250344.sst) /dev/shm/ToplingTemp/Topling-446454-pCc0MV 2024/11/23-07:24:15.273748 140024743433792 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21791/att-00/250344.sst): first pass time = 1.02's, 132.207'MB/sec 2024/11/23-07:24:16.564588 140024743433792 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21791/att-00/250344.sst): old prealloc_size = 147639500, real_size = 30864752 2024/11/23-07:24:16.565185 140024743433792 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21791/att-00/250344.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927141 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.93 raw-val = 0.1083 GB zip-val = 0.0288 GB avg-val = 116.77 avg-zval = 31.11 2024/11/23-07:24:16.565969 140024743433792 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21791/att-00/250344.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-07:24:17.437708 140024743433792 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21791/att-00/250344.sst): second pass time = 1.29's, 83.926'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.87's, 40.045'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3097.161'MB/sec (index lex order gen) rebuild zvType time = 0.74's, 0.311'MB/sec write SST data time = 0.13's, 272.949'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 33435.379'MB/sec zip my value time = 1.29's, unzip length = 0.108'GB zip my value throughput = 83.926'MB/sec zip pipeline throughput = 83.926'MB/sec entries = 927141 avg-key = 28.00 avg-zkey = 1.93 avg-val = 116.77 avg-zval = 31.11 usrkeys = 927141 avg-key = 20.00 avg-zkey = 1.93 avg-val = 123.77 avg-zval = 31.11 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 927141 bytes = 3245008 } seq expand size = 6489987 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0288 GB dict = 1.08 MB all = 0.0350 GB } UnZip/Zip{ index = 10.3768 value = 3.7530 dict = 1.00 all = 3.8389 } Zip/UnZip{ index = 0.0964 value = 0.2665 dict = 1.00 all = 0.2605 } ---------------------------- total value len = 1.260545 GB avg = 0.123 KB (by entry num) total key len = 0.286094 GB avg = 0.028 KB total ukey len = 0.204353 GB avg = 0.020 KB total ukey num = 0.010217629 Billion total entry num = 0.010217629 Billion write speed all = 0.019067384 MB/sec (with seq num) write speed all = 0.018059658 MB/sec (without seq num) 2024/11/23-07:24:17.480986 140024743433792 [compaction_job.cc:1948] [default] [JOB 21791] Generated table #250344: 927141 keys, 34962598 bytes, temperature: kWarm 2024/11/23-07:24:17.481045 140024743433792 EVENT_LOG_v1 {"time_micros": 1732317857481015, "cf_name": "default", "job": 21791, "event": "table_file_creation", "file_number": 250344, "file_size": 34962598, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3600806608, "largest_seqno": 3858347707, "table_properties": {"data_size": 28845856, "index_size": 1786944, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25959948, "raw_average_key_size": 28, "raw_value_size": 108257914, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927141, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732317854, "oldest_key_time": 0, "file_creation_time": 1732317854, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 250344, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-07:24:17.515959 140024743433792 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21791/att-00/250345.sst) /dev/shm/ToplingTemp/Topling-446454-23ZguY 2024/11/23-07:24:18.511408 140024743433792 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21791/att-00/250345.sst): first pass time = 1.00's, 134.837'MB/sec 2024/11/23-07:24:19.849543 140024743433792 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21791/att-00/250345.sst): old prealloc_size = 147639500, real_size = 31331984 2024/11/23-07:24:19.850093 140024743433792 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21791/att-00/250345.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 929734 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0293 GB avg-val = 116.36 avg-zval = 31.55 2024/11/23-07:24:19.850888 140024743433792 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21791/att-00/250345.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-07:24:20.752831 140024743433792 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21791/att-00/250345.sst): second pass time = 1.34's, 80.910'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.90's, 39.363'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3338.847'MB/sec (index lex order gen) rebuild zvType time = 0.77's, 0.301'MB/sec write SST data time = 0.13's, 274.598'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 37481.801'MB/sec zip my value time = 1.34's, unzip length = 0.108'GB zip my value throughput = 80.910'MB/sec zip pipeline throughput = 80.910'MB/sec entries = 929734 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.36 avg-zval = 31.55 usrkeys = 929734 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.36 avg-zval = 31.55 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 929734 bytes = 3370304 } seq expand size = 6508138 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0293 GB dict = 1.08 MB all = 0.0356 GB } UnZip/Zip{ index = 10.5132 value = 3.6885 dict = 1.00 all = 3.7749 } Zip/UnZip{ index = 0.0951 value = 0.2711 dict = 1.00 all = 0.2649 } ---------------------------- total value len = 1.375238 GB avg = 0.123 KB (by entry num) total key len = 0.312126 GB avg = 0.028 KB total ukey len = 0.222947 GB avg = 0.020 KB total ukey num = 0.011147363 Billion total entry num = 0.011147363 Billion write speed all = 0.020801442 MB/sec (with seq num) write speed all = 0.019702064 MB/sec (without seq num) 2024/11/23-07:24:20.787844 140024743433792 [compaction_job.cc:1948] [default] [JOB 21791] Generated table #250345: 929734 keys, 35554904 bytes, temperature: kWarm 2024/11/23-07:24:20.787905 140024743433792 EVENT_LOG_v1 {"time_micros": 1732317860787873, "cf_name": "default", "job": 21791, "event": "table_file_creation", "file_number": 250345, "file_size": 35554904, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3405268578, "largest_seqno": 3858347718, "table_properties": {"data_size": 29330688, "index_size": 1768704, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26032552, "raw_average_key_size": 28, "raw_value_size": 108185240, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 929734, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732317857, "oldest_key_time": 0, "file_creation_time": 1732317857, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 250345, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-07:24:20.824235 140024743433792 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21791/att-00/250346.sst) /dev/shm/ToplingTemp/Topling-446454-rGgYqX 2024/11/23-07:24:21.608068 140024743433792 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21791/att-00/250346.sst): first pass time = 0.78's, 171.241'MB/sec 2024/11/23-07:24:22.919489 140024743433792 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21791/att-00/250346.sst): old prealloc_size = 147639500, real_size = 31529424 2024/11/23-07:24:22.920083 140024743433792 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21791/att-00/250346.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 923989 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1083 GB zip-val = 0.0295 GB avg-val = 117.26 avg-zval = 31.96 2024/11/23-07:24:22.920877 140024743433792 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21791/att-00/250346.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-07:24:23.777402 140024743433792 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21791/att-00/250346.sst): second pass time = 1.31's, 82.683'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.86's, 41.655'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3096.935'MB/sec (index lex order gen) rebuild zvType time = 0.73's, 0.318'MB/sec write SST data time = 0.13's, 270.814'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.082'MB, throughput = 35455.987'MB/sec zip my value time = 1.31's, unzip length = 0.108'GB zip my value throughput = 82.683'MB/sec zip pipeline throughput = 82.683'MB/sec entries = 923989 avg-key = 28.00 avg-zkey = 1.92 avg-val = 117.26 avg-zval = 31.96 usrkeys = 923989 avg-key = 20.00 avg-zkey = 1.92 avg-val = 124.26 avg-zval = 31.96 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 923989 bytes = 3349472 } seq expand size = 6467923 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0295 GB dict = 1.08 MB all = 0.0357 GB } UnZip/Zip{ index = 10.4422 value = 3.6692 dict = 1.00 all = 3.7558 } Zip/UnZip{ index = 0.0958 value = 0.2725 dict = 1.00 all = 0.2663 } ---------------------------- total value len = 1.490052 GB avg = 0.123 KB (by entry num) total key len = 0.337998 GB avg = 0.028 KB total ukey len = 0.241427 GB avg = 0.020 KB total ukey num = 0.012071352 Billion total entry num = 0.012071352 Billion write speed all = 0.022534943 MB/sec (with seq num) write speed all = 0.021344484 MB/sec (without seq num) 2024/11/23-07:24:23.813850 140024743433792 [compaction_job.cc:1948] [default] [JOB 21791] Generated table #250346: 923989 keys, 35735942 bytes, temperature: kWarm 2024/11/23-07:24:23.813911 140024743433792 EVENT_LOG_v1 {"time_micros": 1732317863813880, "cf_name": "default", "job": 21791, "event": "table_file_creation", "file_number": 250346, "file_size": 35735942, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3471845708, "largest_seqno": 3858347729, "table_properties": {"data_size": 29528512, "index_size": 1769728, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25871692, "raw_average_key_size": 28, "raw_value_size": 108346114, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 923989, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732317860, "oldest_key_time": 0, "file_creation_time": 1732317860, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 250346, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-07:24:23.850723 140024743433792 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21791/att-00/250347.sst) /dev/shm/ToplingTemp/Topling-446454-lk66AY 2024/11/23-07:24:23.975159 140024743433792 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21791/att-00/250347.sst): first pass time = 0.12's, 241.885'MB/sec 2024/11/23-07:24:24.260761 140024743433792 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21791/att-00/250347.sst): old prealloc_size = 147639500, real_size = 7825040 2024/11/23-07:24:24.260943 140024743433792 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21791/att-00/250347.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 211902 prefix = 4 raw-key = 0.0034 GB zip-key = 0.0004 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.0242 GB zip-val = 0.0074 GB avg-val = 114.00 avg-zval = 34.76 2024/11/23-07:24:24.261135 140024743433792 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21791/att-00/250347.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0005 GB, waited 0.000 sec, Key+Value = 0.030 GB 2024/11/23-07:24:24.462665 140024743433792 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21791/att-00/250347.sst): second pass time = 0.28's, 84.902'MB/sec, value only(80.3% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.20's, 43.160'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2678.323'MB/sec (index lex order gen) rebuild zvType time = 0.17's, 0.308'MB/sec write SST data time = 0.03's, 294.900'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.251'MB, throughput = 9100.319'MB/sec zip my value time = 0.28's, unzip length = 0.024'GB zip my value throughput = 84.902'MB/sec zip pipeline throughput = 84.902'MB/sec entries = 211902 avg-key = 28.00 avg-zkey = 1.92 avg-val = 114.00 avg-zval = 34.76 usrkeys = 211902 avg-key = 20.00 avg-zkey = 1.92 avg-val = 121.00 avg-zval = 34.76 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 211902 bytes = 688704 } seq expand size = 1483314 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0042 GB value = 0.0242 GB dict = 0.25 MB all = 0.0301 GB } __ZipSize{ index = 0.0004 GB value = 0.0074 GB dict = 0.25 MB all = 0.0087 GB } UnZip/Zip{ index = 10.4168 value = 3.2799 dict = 1.00 all = 3.4533 } Zip/UnZip{ index = 0.0960 value = 0.3049 dict = 1.00 all = 0.2896 } ---------------------------- total value len = 1.515692 GB avg = 0.123 KB (by entry num) total key len = 0.343931 GB avg = 0.028 KB total ukey len = 0.245665 GB avg = 0.020 KB total ukey num = 0.012283254 Billion total entry num = 0.012283254 Billion write speed all = 0.022923965 MB/sec (with seq num) write speed all = 0.021712619 MB/sec (without seq num) 2024/11/23-07:24:24.476178 140024743433792 [compaction_job.cc:1948] [default] [JOB 21791] Generated table #250347: 211902 keys, 8713537 bytes, temperature: kWarm 2024/11/23-07:24:24.476235 140024743433792 EVENT_LOG_v1 {"time_micros": 1732317864476205, "cf_name": "default", "job": 21791, "event": "table_file_creation", "file_number": 250347, "file_size": 8713537, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3821424449, "largest_seqno": 3858345335, "table_properties": {"data_size": 7365056, "index_size": 406848, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5933256, "raw_average_key_size": 28, "raw_value_size": 24156828, "raw_average_value_size": 114, "num_data_blocks": 1, "num_entries": 211902, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 114, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732317863, "oldest_key_time": 0, "file_creation_time": 1732317863, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 250347, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-07:24:24.487946 140024743433792 [compaction_job.cc:703] job-21791: subcompact[0], size: 0.476179 G, files: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21791/att-00 [250334,250335,250336,250337,250338,250339,250340,250341,250342,250343,250344,250345,250346,250347] 2024/11/23-07:24:24.575562 140024743433792 (Original Log Time 2024/11/23-07:23:34.529210) EVENT_LOG_v1 {"time_micros": 1732317814529149, "job": 21791, "event": "compaction_started", "compaction_reason": "FilesMarkedForCompaction", "files_L2": [250321], "files_L3": [250291, 250292, 250293, 250262, 250263, 250264, 250265, 250266, 250267, 250268, 250269, 250270, 250271, 250272], "score": 0.98839, "input_data_size": 513199031, "oldest_snapshot_seqno": 3858381231} 2024/11/23-07:24:24.575565 140024743433792 (Original Log Time 2024/11/23-07:24:24.574853) [compaction_job.cc:2022] [default] [JOB 21791] Compacted 1@2 + 14@3 files to L3 => 476178801 bytes 2024/11/23-07:24:24.575567 140024743433792 (Original Log Time 2024/11/23-07:24:24.575499) [compaction_job.cc:1224] [default] compacted to: files[0 0 0 14 0 0 0] max score 0.02, MB/sec: 10.3 rd, 9.5 wr, level 3, files in(1, 14) out(14 +0 blob) MB in(26.0, 463.4 +0.0 blob) out(454.1 +0.0 blob), read-write-amplify(36.2) write-amplify(17.4) OK, records in: 12371812, records dropped: 88558 output_compression: Snappy 2024/11/23-07:24:24.575573 140024743433792 (Original Log Time 2024/11/23-07:24:24.575543) EVENT_LOG_v1 {"time_micros": 1732317864575523, "cf": "default", "job": 21791, "event": "compaction_finished", "compaction_time_micros": 49958742, "compaction_time_cpu_micros": 22621984, "output_level": 3, "num_output_files": 14, "total_output_size": 476178801, "num_input_records": 12371812, "num_output_records": 12283254, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "file_write_nanos": 338886053, "file_range_sync_nanos": 0, "file_fsync_nanos": 13570, "file_prepare_write_nanos": 40526, "lsm_state": [0, 0, 0, 14, 0, 0, 0]} 2024/11/23-07:24:24.710017 140024743433792 DEBG dcompact_worker.cpp:240: HttpPost: 200 OK: url = http://nlb-7zny4kaa1poal01o64.cn-shenzhen.nlb.aliyuncs.com:8443, body = {"instanceId":"nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137","labourId":"","dbId":"d89b4006-2803-486e-b7a2-759bcf348921","dbStarts":1732256054,"starts":1732317814,"executesMs":50191,"compactionJobId":21791,"attempt":0,"compactionInputRawBytes":1787496772,"compactionInputZipBytes":513199031,"compactionOutputRawBytes":0,"compactionOutputZipBytes":476178801,"headers":{"Accept":"*/*","Connection":"close","Host":"aliyun-topling-saas.topling.cn:18443","RemoteIp":"120.24.192.169","X-Forwarded-For":"120.24.192.169","region":"cn-shenzhen","token":"e6474c481bd4415abc537135cc03626b","instance-token":"e6474c481bd4415abc537135cc03626b","provider":"aliyun","CloudMarketInstanceId":"si-59c0ae5c955845588903","MeteringAssit":"","Transfer-Encoding":"chunked","traceparent":"00-136f073675c525736ac1d9470d438293-8b677f76a3986971-00"}}, response = 2024/11/23-07:24:24.710087 140024743433792 INFO dcompact_worker.cpp:1459: finish /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-21791/att-00: olev 3, work 50.191 s, result 4.942 ms, install 0.738 ms, input{raw 1.665 GiB zip 489.425 MiB}