2024/11/23-03:40:54.228123 140024886109760 DEBG dcompact_worker.cpp:2214: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18547/att-00: fork to child time = 0.009386 sec 2024/11/23-03:40:54.228929 140024886109760 DEBG dcompact_worker.cpp:1013: Beg SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18547/att-00 2024/11/23-03:40:54.236590 140024886109760 DEBG dcompact_worker.cpp:1033: End SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18547/att-00 2024/11/23-03:40:54.237705 140024886109760 TRAC dcompact_worker.cpp:1083: INFO_LOG_LEVEL: rpc = INFO_LEVEL, env_var = undefined 2024/11/23-03:40:54.237971 140024886109760 [WARN] [column_family.cc:386] multiple cf_paths/db_paths and level_compaction_dynamic_level_bytes can't be used together 2024/11/23-03:40:54.283960 140024886109760 [version_set.cc:6208] Recovering from manifest file: /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-18547/att-00/MANIFEST-206347 2024/11/23-03:40:54.316150 140024886109760 [version_set.cc:6251] Recovered from manifest file:/worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-18547/att-00/MANIFEST-206347 succeeded,manifest_file_number is 206347, next_file_number is 243152, last_sequence is 3765465132, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 242963 2024/11/23-03:40:54.316156 140024886109760 [version_set.cc:6266] Column family [default] (ID 0), log number is 0 2024/11/23-03:40:54.316408 140024886109760 [version_set.cc:5721] Creating manifest 243152 2024/11/23-03:40:54.351478 140024886109760 DEBG dcompact_worker.cpp:1218: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18547/att-00: bottommost_level: fake = 1, rpc = 0 2024/11/23-03:40:54.372430 140024886109760 [compaction_job.cc:2437] [default] [JOB 18547] Compacting 1@2 + 14@3 files to L3, score 0.99, subcompactions 1 : 1 2024/11/23-03:40:54.372444 140024886109760 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 13857 Base level 2, inputs: [243097(27MB)], [243121(35MB) 243122(8789KB) 243056(34MB) 243057(36MB) 243058(34MB) 243059(33MB) 243060(35MB) 243061(34MB) 243062(35MB) 243063(35MB) 243064(35MB) 243065(35MB) 243066(35MB) 243143(34MB)] 2024/11/23-03:40:54.378181 140024886109760 [top_zip_table.cc:59] core git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-03:40:54.378210 140024886109760 [top_zip_table.cc:60] fsa git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-03:40:54.378228 140024886109760 [top_zip_table.cc:61] zbs git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-03:40:54.378232 140024886109760 [top_zip_table.cc:62] topling-zip_table_reader: git_version_hash_info_is: commit a4a382006cb82713acf5b3425835f22711877681 Author: leipeng Date: 2024-04-11 19:44:14 +0800 fixed_len_hole_index.cc: Add env bool FixedLenHoleIndexUseAVX512 for ut & debug 1. FixedLenHoleIndexUseAVX512 is only in unit tests or debug 2. In release mode, use avx512 by compile options(-march=) g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/23-03:40:54.378243 140024886109760 [top_zip_table.cc:64] topling-rocks git_version_hash_info_is: commit feab587e468621ba0204d47b4ffacc52e7c4290d Author: leipeng Date: 2024-03-22 13:35:06 +0800 ToplingZipTableBuilder::Add: immediately return after error This function returns void, and caller does not check builder->status() after calling this function and graceful abandon. So immediately return after error, and return error status in Finish(). g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/23-03:40:54.861282 140024886109760 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18547/att-00/243153.sst) /dev/shm/ToplingTemp/Topling-397876-3qymMK 2024/11/23-03:40:55.501071 140024886109760 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18547/att-00/243153.sst): first pass time = 0.64's, 209.807'MB/sec 2024/11/23-03:40:57.078986 140024886109760 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18547/att-00/243153.sst): old prealloc_size = 147639500, real_size = 33127632 2024/11/23-03:40:57.079567 140024886109760 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18547/att-00/243153.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 935776 prefix = 4 raw-key = 0.0150 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1080 GB zip-val = 0.0311 GB avg-val = 115.43 avg-zval = 33.24 2024/11/23-03:40:57.080395 140024886109760 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18547/att-00/243153.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-03:40:58.195687 140024886109760 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18547/att-00/243153.sst): second pass time = 1.58's, 68.492'MB/sec, value only(80.5% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.12's, 33.358'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3219.113'MB/sec (index lex order gen) rebuild zvType time = 0.98's, 0.238'MB/sec write SST data time = 0.13's, 280.271'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.077'MB, throughput = 38830.749'MB/sec zip my value time = 1.58's, unzip length = 0.108'GB zip my value throughput = 68.492'MB/sec zip pipeline throughput = 68.492'MB/sec entries = 935776 avg-key = 28.00 avg-zkey = 1.91 avg-val = 115.43 avg-zval = 33.24 usrkeys = 935776 avg-key = 20.00 avg-zkey = 1.91 avg-val = 122.43 avg-zval = 33.24 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 935776 bytes = 3275232 } seq expand size = 6550432 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0187 GB value = 0.1080 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0311 GB dict = 1.08 MB all = 0.0373 GB } UnZip/Zip{ index = 10.4465 value = 3.4730 dict = 1.00 all = 3.6030 } Zip/UnZip{ index = 0.0957 value = 0.2879 dict = 1.00 all = 0.2775 } ---------------------------- total value len = 0.114566 GB avg = 0.122 KB (by entry num) total key len = 0.026202 GB avg = 0.028 KB total ukey len = 0.018716 GB avg = 0.020 KB total ukey num = 0.000935776 Billion total entry num = 0.000935776 Billion write speed all = 0.002078830 MB/sec (with seq num) write speed all = 0.001968275 MB/sec (without seq num) 2024/11/23-03:40:58.230593 140024886109760 [compaction_job.cc:1948] [default] [JOB 18547] Generated table #243153: 935776 keys, 37251796 bytes, temperature: kWarm 2024/11/23-03:40:58.230664 140024886109760 EVENT_LOG_v1 {"time_micros": 1732304458230617, "cf_name": "default", "job": 18547, "event": "table_file_creation", "file_number": 243153, "file_size": 37251796, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3504428200, "largest_seqno": 3765209971, "table_properties": {"data_size": 31101952, "index_size": 1791552, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26201728, "raw_average_key_size": 28, "raw_value_size": 108016012, "raw_average_value_size": 115, "num_data_blocks": 1, "num_entries": 935776, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732304454, "oldest_key_time": 0, "file_creation_time": 1732304454, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 243153, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-03:40:58.265977 140024886109760 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18547/att-00/243154.sst) /dev/shm/ToplingTemp/Topling-397876-n7UEUJ 2024/11/23-03:40:59.249273 140024886109760 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18547/att-00/243154.sst): first pass time = 0.98's, 136.502'MB/sec 2024/11/23-03:41:00.674292 140024886109760 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18547/att-00/243154.sst): old prealloc_size = 147639500, real_size = 35494400 2024/11/23-03:41:00.674842 140024886109760 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18547/att-00/243154.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 928331 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.93 raw-val = 0.1082 GB zip-val = 0.0335 GB avg-val = 116.58 avg-zval = 36.06 2024/11/23-03:41:00.675404 140024886109760 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18547/att-00/243154.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-03:41:01.511359 140024886109760 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18547/att-00/243154.sst): second pass time = 1.42's, 76.005'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.84's, 46.055'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3379.320'MB/sec (index lex order gen) rebuild zvType time = 0.71's, 0.328'MB/sec write SST data time = 0.13's, 297.708'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 38665.640'MB/sec zip my value time = 1.42's, unzip length = 0.108'GB zip my value throughput = 76.005'MB/sec zip pipeline throughput = 76.005'MB/sec entries = 928331 avg-key = 28.00 avg-zkey = 1.93 avg-val = 116.58 avg-zval = 36.06 usrkeys = 928331 avg-key = 20.00 avg-zkey = 1.93 avg-val = 121.00 avg-zval = 36.06 TagRS{ kinds = RS_Key0_TagN bytes = 145160 } TagArray{ size = 586748 bytes = 2053632 } seq expand size = 4107236 multi value expand size = 0 cnt WriteAppend = 16 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0335 GB dict = 1.08 MB all = 0.0386 GB } UnZip/Zip{ index = 10.3779 value = 3.2332 dict = 1.00 all = 3.4816 } Zip/UnZip{ index = 0.0964 value = 0.3093 dict = 1.00 all = 0.2872 } ---------------------------- total value len = 0.226898 GB avg = 0.122 KB (by entry num) total key len = 0.052195 GB avg = 0.028 KB total ukey len = 0.037282 GB avg = 0.020 KB total ukey num = 0.001864107 Billion total entry num = 0.001864107 Billion write speed all = 0.004121378 MB/sec (with seq num) write speed all = 0.003901160 MB/sec (without seq num) 2024/11/23-03:41:01.546443 140024886109760 [compaction_job.cc:1948] [default] [JOB 18547] Generated table #243154: 928331 keys, 38550410 bytes, temperature: kWarm 2024/11/23-03:41:01.546503 140024886109760 EVENT_LOG_v1 {"time_micros": 1732304461546471, "cf_name": "default", "job": 18547, "event": "table_file_creation", "file_number": 243154, "file_size": 38550410, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3765210322, "table_properties": {"data_size": 33473072, "index_size": 1789056, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25993268, "raw_average_key_size": 28, "raw_value_size": 108224530, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 928331, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732304458, "oldest_key_time": 0, "file_creation_time": 1732304458, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 243154, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-03:41:01.580391 140024886109760 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18547/att-00/243155.sst) /dev/shm/ToplingTemp/Topling-397876-F58GYG 2024/11/23-03:41:02.497299 140024886109760 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18547/att-00/243155.sst): first pass time = 0.92's, 146.387'MB/sec 2024/11/23-03:41:03.929700 140024886109760 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18547/att-00/243155.sst): old prealloc_size = 147639500, real_size = 35258016 2024/11/23-03:41:03.930336 140024886109760 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18547/att-00/243155.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 1081329 prefix = 4 raw-key = 0.0173 GB zip-key = 0.0021 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1039 GB zip-val = 0.0329 GB avg-val = 96.12 avg-zval = 30.44 2024/11/23-03:41:03.930493 140024886109760 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18547/att-00/243155.sst: sumWaitingMem = 0.003 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0028 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-03:41:04.553966 140024886109760 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18547/att-00/243155.sst): second pass time = 1.43's, 72.607'MB/sec, value only(77.4% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.62's, 58.148'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3373.944'MB/sec (index lex order gen) rebuild zvType time = 0.49's, 0.556'MB/sec write SST data time = 0.14's, 263.399'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.032'MB, throughput = 27244.165'MB/sec zip my value time = 1.43's, unzip length = 0.104'GB zip my value throughput = 72.607'MB/sec zip pipeline throughput = 72.607'MB/sec entries = 1081329 avg-key = 28.00 avg-zkey = 1.91 avg-val = 96.12 avg-zval = 30.44 usrkeys = 1081329 avg-key = 20.00 avg-zkey = 1.91 avg-val = 96.35 avg-zval = 30.44 TagRS{ kinds = RS_Key0_TagN bytes = 169040 } TagArray{ size = 34509 bytes = 99232 } seq expand size = 241563 multi value expand size = 0 cnt WriteAppend = 16 UnZipSize{ index = 0.0216 GB value = 0.1039 GB dict = 1.03 MB all = 0.1342 GB } __ZipSize{ index = 0.0021 GB value = 0.0329 GB dict = 1.03 MB all = 0.0363 GB } UnZip/Zip{ index = 10.4475 value = 3.1576 dict = 1.00 all = 3.6976 } Zip/UnZip{ index = 0.0957 value = 0.3167 dict = 1.00 all = 0.2704 } ---------------------------- total value len = 0.331080 GB avg = 0.112 KB (by entry num) total key len = 0.082472 GB avg = 0.028 KB total ukey len = 0.058909 GB avg = 0.020 KB total ukey num = 0.002945436 Billion total entry num = 0.002945436 Billion write speed all = 0.006106671 MB/sec (with seq num) write speed all = 0.005758724 MB/sec (without seq num) 2024/11/23-03:41:04.591860 140024886109760 [compaction_job.cc:1948] [default] [JOB 18547] Generated table #243155: 1081329 keys, 36298558 bytes, temperature: kWarm 2024/11/23-03:41:04.591921 140024886109760 EVENT_LOG_v1 {"time_micros": 1732304464591890, "cf_name": "default", "job": 18547, "event": "table_file_creation", "file_number": 243155, "file_size": 36298558, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3280203551, "table_properties": {"data_size": 32917456, "index_size": 2070016, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 30277212, "raw_average_key_size": 28, "raw_value_size": 103940659, "raw_average_value_size": 96, "num_data_blocks": 1, "num_entries": 1081329, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732304461, "oldest_key_time": 0, "file_creation_time": 1732304461, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 243155, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-03:41:04.627645 140024886109760 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18547/att-00/243156.sst) /dev/shm/ToplingTemp/Topling-397876-qiY4fI 2024/11/23-03:41:05.518417 140024886109760 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18547/att-00/243156.sst): first pass time = 0.89's, 150.681'MB/sec 2024/11/23-03:41:06.875584 140024886109760 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18547/att-00/243156.sst): old prealloc_size = 147639500, real_size = 31062624 2024/11/23-03:41:06.876181 140024886109760 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18547/att-00/243156.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 923562 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1084 GB zip-val = 0.0291 GB avg-val = 117.33 avg-zval = 31.47 2024/11/23-03:41:06.876961 140024886109760 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18547/att-00/243156.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-03:41:07.729692 140024886109760 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18547/att-00/243156.sst): second pass time = 1.36's, 79.876'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.85's, 41.291'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3070.609'MB/sec (index lex order gen) rebuild zvType time = 0.73's, 0.317'MB/sec write SST data time = 0.13's, 280.394'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.083'MB, throughput = 34922.591'MB/sec zip my value time = 1.36's, unzip length = 0.108'GB zip my value throughput = 79.876'MB/sec zip pipeline throughput = 79.876'MB/sec entries = 923562 avg-key = 28.00 avg-zkey = 1.92 avg-val = 117.33 avg-zval = 31.47 usrkeys = 923562 avg-key = 20.00 avg-zkey = 1.92 avg-val = 124.33 avg-zval = 31.47 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 923562 bytes = 3347920 } seq expand size = 6464934 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0185 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0291 GB dict = 1.08 MB all = 0.0353 GB } UnZip/Zip{ index = 10.4438 value = 3.7284 dict = 1.00 all = 3.8058 } Zip/UnZip{ index = 0.0958 value = 0.2682 dict = 1.00 all = 0.2628 } ---------------------------- total value len = 0.445903 GB avg = 0.115 KB (by entry num) total key len = 0.108332 GB avg = 0.028 KB total ukey len = 0.077380 GB avg = 0.020 KB total ukey num = 0.003868998 Billion total entry num = 0.003868998 Billion write speed all = 0.008183661 MB/sec (with seq num) write speed all = 0.007726634 MB/sec (without seq num) 2024/11/23-03:41:07.761079 140024886109760 [compaction_job.cc:1948] [default] [JOB 18547] Generated table #243156: 923562 keys, 35266372 bytes, temperature: kWarm 2024/11/23-03:41:07.761151 140024886109760 EVENT_LOG_v1 {"time_micros": 1732304467761110, "cf_name": "default", "job": 18547, "event": "table_file_creation", "file_number": 243156, "file_size": 35266372, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3280203552, "largest_seqno": 3765210076, "table_properties": {"data_size": 29062928, "index_size": 1768640, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25859736, "raw_average_key_size": 28, "raw_value_size": 108358108, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 923562, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732304464, "oldest_key_time": 0, "file_creation_time": 1732304464, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 243156, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-03:41:07.795865 140024886109760 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18547/att-00/243157.sst) /dev/shm/ToplingTemp/Topling-397876-iPjXdG 2024/11/23-03:41:08.672248 140024886109760 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18547/att-00/243157.sst): first pass time = 0.88's, 153.156'MB/sec 2024/11/23-03:41:10.016790 140024886109760 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18547/att-00/243157.sst): old prealloc_size = 147639500, real_size = 32591216 2024/11/23-03:41:10.017335 140024886109760 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18547/att-00/243157.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 923133 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1084 GB zip-val = 0.0306 GB avg-val = 117.39 avg-zval = 33.14 2024/11/23-03:41:10.018108 140024886109760 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18547/att-00/243157.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-03:41:10.972560 140024886109760 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18547/att-00/243157.sst): second pass time = 1.34's, 80.663'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.96's, 38.498'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3366.676'MB/sec (index lex order gen) rebuild zvType time = 0.78's, 0.295'MB/sec write SST data time = 0.17's, 212.260'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.082'MB, throughput = 35712.900'MB/sec zip my value time = 1.34's, unzip length = 0.108'GB zip my value throughput = 80.663'MB/sec zip pipeline throughput = 80.663'MB/sec entries = 923133 avg-key = 28.00 avg-zkey = 1.92 avg-val = 117.39 avg-zval = 33.14 usrkeys = 923133 avg-key = 20.00 avg-zkey = 1.92 avg-val = 124.39 avg-zval = 33.14 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 923133 bytes = 3346368 } seq expand size = 6461931 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0185 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0306 GB dict = 1.08 MB all = 0.0368 GB } UnZip/Zip{ index = 10.4423 value = 3.5424 dict = 1.00 all = 3.6477 } Zip/UnZip{ index = 0.0958 value = 0.2823 dict = 1.00 all = 0.2741 } ---------------------------- total value len = 0.560735 GB avg = 0.117 KB (by entry num) total key len = 0.134180 GB avg = 0.028 KB total ukey len = 0.095843 GB avg = 0.020 KB total ukey num = 0.004792131 Billion total entry num = 0.004792131 Billion write speed all = 0.010260400 MB/sec (with seq num) write speed all = 0.009694355 MB/sec (without seq num) 2024/11/23-03:41:11.006460 140024886109760 [compaction_job.cc:1948] [default] [JOB 18547] Generated table #243157: 923133 keys, 36794986 bytes, temperature: kWarm 2024/11/23-03:41:11.006521 140024886109760 EVENT_LOG_v1 {"time_micros": 1732304471006490, "cf_name": "default", "job": 18547, "event": "table_file_creation", "file_number": 243157, "file_size": 36794986, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3487497056, "largest_seqno": 3765210091, "table_properties": {"data_size": 30592160, "index_size": 1768064, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25847724, "raw_average_key_size": 28, "raw_value_size": 108370058, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 923133, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732304467, "oldest_key_time": 0, "file_creation_time": 1732304467, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 243157, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-03:41:11.046638 140024886109760 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18547/att-00/243158.sst) /dev/shm/ToplingTemp/Topling-397876-0V9dlK 2024/11/23-03:41:12.046448 140024886109760 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18547/att-00/243158.sst): first pass time = 1.00's, 134.248'MB/sec 2024/11/23-03:41:13.418396 140024886109760 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18547/att-00/243158.sst): old prealloc_size = 147639500, real_size = 32039712 2024/11/23-03:41:13.418939 140024886109760 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18547/att-00/243158.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 934952 prefix = 4 raw-key = 0.0150 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1080 GB zip-val = 0.0300 GB avg-val = 115.56 avg-zval = 32.12 2024/11/23-03:41:13.419708 140024886109760 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18547/att-00/243158.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-03:41:14.380730 140024886109760 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18547/att-00/243158.sst): second pass time = 1.37's, 78.788'MB/sec, value only(80.5% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.96's, 37.700'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3408.116'MB/sec (index lex order gen) rebuild zvType time = 0.83's, 0.280'MB/sec write SST data time = 0.13's, 283.577'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 33162.110'MB/sec zip my value time = 1.37's, unzip length = 0.108'GB zip my value throughput = 78.788'MB/sec zip pipeline throughput = 78.788'MB/sec entries = 934952 avg-key = 28.00 avg-zkey = 1.90 avg-val = 115.56 avg-zval = 32.12 usrkeys = 934952 avg-key = 20.00 avg-zkey = 1.90 avg-val = 122.56 avg-zval = 32.12 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 934952 bytes = 3389216 } seq expand size = 6544664 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0187 GB value = 0.1080 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0300 GB dict = 1.08 MB all = 0.0363 GB } UnZip/Zip{ index = 10.5117 value = 3.5981 dict = 1.00 all = 3.6996 } Zip/UnZip{ index = 0.0951 value = 0.2779 dict = 1.00 all = 0.2703 } ---------------------------- total value len = 0.675319 GB avg = 0.118 KB (by entry num) total key len = 0.160358 GB avg = 0.028 KB total ukey len = 0.114542 GB avg = 0.020 KB total ukey num = 0.005727083 Billion total entry num = 0.005727083 Billion write speed all = 0.012338133 MB/sec (with seq num) write speed all = 0.011661685 MB/sec (without seq num) 2024/11/23-03:41:14.412554 140024886109760 [compaction_job.cc:1948] [default] [JOB 18547] Generated table #243158: 934952 keys, 36279306 bytes, temperature: kWarm 2024/11/23-03:41:14.412613 140024886109760 EVENT_LOG_v1 {"time_micros": 1732304474412582, "cf_name": "default", "job": 18547, "event": "table_file_creation", "file_number": 243158, "file_size": 36279306, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3375334738, "largest_seqno": 3765210106, "table_properties": {"data_size": 30026896, "index_size": 1778880, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26178656, "raw_average_key_size": 28, "raw_value_size": 108039144, "raw_average_value_size": 115, "num_data_blocks": 1, "num_entries": 934952, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732304471, "oldest_key_time": 0, "file_creation_time": 1732304471, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 243158, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-03:41:14.448569 140024886109760 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18547/att-00/243159.sst) /dev/shm/ToplingTemp/Topling-397876-hhe0tI 2024/11/23-03:41:15.376339 140024886109760 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18547/att-00/243159.sst): first pass time = 0.93's, 144.672'MB/sec 2024/11/23-03:41:16.701286 140024886109760 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18547/att-00/243159.sst): old prealloc_size = 147639500, real_size = 31133264 2024/11/23-03:41:16.701850 140024886109760 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18547/att-00/243159.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 926097 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.93 raw-val = 0.1083 GB zip-val = 0.0291 GB avg-val = 116.93 avg-zval = 31.44 2024/11/23-03:41:16.702613 140024886109760 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18547/att-00/243159.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-03:41:17.571025 140024886109760 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18547/att-00/243159.sst): second pass time = 1.32's, 81.775'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.87's, 40.640'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3275.794'MB/sec (index lex order gen) rebuild zvType time = 0.74's, 0.313'MB/sec write SST data time = 0.13's, 273.601'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 31177.139'MB/sec zip my value time = 1.32's, unzip length = 0.108'GB zip my value throughput = 81.775'MB/sec zip pipeline throughput = 81.775'MB/sec entries = 926097 avg-key = 28.00 avg-zkey = 1.93 avg-val = 116.93 avg-zval = 31.44 usrkeys = 926097 avg-key = 20.00 avg-zkey = 1.93 avg-val = 123.93 avg-zval = 31.44 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 926097 bytes = 3357120 } seq expand size = 6482679 multi value expand size = 0 cnt WriteAppend = 16 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0291 GB dict = 1.08 MB all = 0.0353 GB } UnZip/Zip{ index = 10.3752 value = 3.7191 dict = 1.00 all = 3.7973 } Zip/UnZip{ index = 0.0964 value = 0.2689 dict = 1.00 all = 0.2633 } ---------------------------- total value len = 0.790089 GB avg = 0.119 KB (by entry num) total key len = 0.186289 GB avg = 0.028 KB total ukey len = 0.133064 GB avg = 0.020 KB total ukey num = 0.006653180 Billion total entry num = 0.006653180 Billion write speed all = 0.014414788 MB/sec (with seq num) write speed all = 0.013628992 MB/sec (without seq num) 2024/11/23-03:41:17.608101 140024886109760 [compaction_job.cc:1948] [default] [JOB 18547] Generated table #243159: 926097 keys, 35345382 bytes, temperature: kWarm 2024/11/23-03:41:17.608197 140024886109760 EVENT_LOG_v1 {"time_micros": 1732304477608132, "cf_name": "default", "job": 18547, "event": "table_file_creation", "file_number": 243159, "file_size": 35345382, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3273701103, "largest_seqno": 3765210125, "table_properties": {"data_size": 29116352, "index_size": 1785216, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25930716, "raw_average_key_size": 28, "raw_value_size": 108287082, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 926097, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732304474, "oldest_key_time": 0, "file_creation_time": 1732304474, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 243159, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-03:41:17.645237 140024886109760 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18547/att-00/243160.sst) /dev/shm/ToplingTemp/Topling-397876-DHMT5H 2024/11/23-03:41:18.490691 140024886109760 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18547/att-00/243160.sst): first pass time = 0.85's, 158.759'MB/sec 2024/11/23-03:41:19.808176 140024886109760 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18547/att-00/243160.sst): old prealloc_size = 147639500, real_size = 32577792 2024/11/23-03:41:19.808702 140024886109760 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18547/att-00/243160.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 929665 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0306 GB avg-val = 116.37 avg-zval = 32.89 2024/11/23-03:41:19.809479 140024886109760 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18547/att-00/243160.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-03:41:20.709720 140024886109760 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18547/att-00/243160.sst): second pass time = 1.32's, 82.166'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.90's, 40.820'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3519.484'MB/sec (index lex order gen) rebuild zvType time = 0.77's, 0.301'MB/sec write SST data time = 0.13's, 288.024'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 34292.796'MB/sec zip my value time = 1.32's, unzip length = 0.108'GB zip my value throughput = 82.166'MB/sec zip pipeline throughput = 82.166'MB/sec entries = 929665 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.37 avg-zval = 32.89 usrkeys = 929665 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.37 avg-zval = 32.89 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 929665 bytes = 3370048 } seq expand size = 6507655 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0306 GB dict = 1.08 MB all = 0.0368 GB } UnZip/Zip{ index = 10.5131 value = 3.5382 dict = 1.00 all = 3.6472 } Zip/UnZip{ index = 0.0951 value = 0.2826 dict = 1.00 all = 0.2742 } ---------------------------- total value len = 0.904784 GB avg = 0.119 KB (by entry num) total key len = 0.212320 GB avg = 0.028 KB total ukey len = 0.151657 GB avg = 0.020 KB total ukey num = 0.007582845 Billion total entry num = 0.007582845 Billion write speed all = 0.016491628 MB/sec (with seq num) write speed all = 0.015596073 MB/sec (without seq num) 2024/11/23-03:41:20.744242 140024886109760 [compaction_job.cc:1948] [default] [JOB 18547] Generated table #243160: 929665 keys, 36800456 bytes, temperature: kWarm 2024/11/23-03:41:20.744303 140024886109760 EVENT_LOG_v1 {"time_micros": 1732304480744271, "cf_name": "default", "job": 18547, "event": "table_file_creation", "file_number": 243160, "file_size": 36800456, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3369194706, "largest_seqno": 3765210135, "table_properties": {"data_size": 30576624, "index_size": 1768576, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26030620, "raw_average_key_size": 28, "raw_value_size": 108187166, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 929665, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732304477, "oldest_key_time": 0, "file_creation_time": 1732304477, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 243160, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-03:41:20.782013 140024886109760 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18547/att-00/243161.sst) /dev/shm/ToplingTemp/Topling-397876-OxaTRI 2024/11/23-03:41:21.622104 140024886109760 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18547/att-00/243161.sst): first pass time = 0.84's, 159.773'MB/sec 2024/11/23-03:41:22.947218 140024886109760 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18547/att-00/243161.sst): old prealloc_size = 147639500, real_size = 30892096 2024/11/23-03:41:22.947793 140024886109760 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18547/att-00/243161.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927469 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1082 GB zip-val = 0.0289 GB avg-val = 116.71 avg-zval = 31.14 2024/11/23-03:41:22.949502 140024886109760 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18547/att-00/243161.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-03:41:23.815632 140024886109760 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18547/att-00/243161.sst): second pass time = 1.32's, 81.761'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.87's, 40.429'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3216.354'MB/sec (index lex order gen) rebuild zvType time = 0.74's, 0.314'MB/sec write SST data time = 0.13's, 269.564'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 30354.273'MB/sec zip my value time = 1.32's, unzip length = 0.108'GB zip my value throughput = 81.761'MB/sec zip pipeline throughput = 81.761'MB/sec entries = 927469 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.71 avg-zval = 31.14 usrkeys = 927469 avg-key = 20.00 avg-zkey = 1.91 avg-val = 123.71 avg-zval = 31.14 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 927469 bytes = 3362096 } seq expand size = 6492283 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0185 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0289 GB dict = 1.08 MB all = 0.0351 GB } UnZip/Zip{ index = 10.4445 value = 3.7477 dict = 1.00 all = 3.8230 } Zip/UnZip{ index = 0.0957 value = 0.2668 dict = 1.00 all = 0.2616 } ---------------------------- total value len = 1.019525 GB avg = 0.120 KB (by entry num) total key len = 0.238289 GB avg = 0.028 KB total ukey len = 0.170206 GB avg = 0.020 KB total ukey num = 0.008510314 Billion total entry num = 0.008510314 Billion write speed all = 0.018568058 MB/sec (with seq num) write speed all = 0.017563013 MB/sec (without seq num) 2024/11/23-03:41:23.846694 140024886109760 [compaction_job.cc:1948] [default] [JOB 18547] Generated table #243161: 927469 keys, 35108414 bytes, temperature: kWarm 2024/11/23-03:41:23.846756 140024886109760 EVENT_LOG_v1 {"time_micros": 1732304483846723, "cf_name": "default", "job": 18547, "event": "table_file_creation", "file_number": 243161, "file_size": 35108414, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3339428666, "largest_seqno": 3765210146, "table_properties": {"data_size": 28884016, "index_size": 1776000, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25969132, "raw_average_key_size": 28, "raw_value_size": 108248710, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927469, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732304480, "oldest_key_time": 0, "file_creation_time": 1732304480, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 243161, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-03:41:23.883511 140024886109760 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18547/att-00/243162.sst) /dev/shm/ToplingTemp/Topling-397876-TXOFWH 2024/11/23-03:41:24.769616 140024886109760 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18547/att-00/243162.sst): first pass time = 0.89's, 151.476'MB/sec 2024/11/23-03:41:26.092824 140024886109760 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18547/att-00/243162.sst): old prealloc_size = 147639500, real_size = 32894208 2024/11/23-03:41:26.093380 140024886109760 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18547/att-00/243162.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 929496 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0309 GB avg-val = 116.40 avg-zval = 33.24 2024/11/23-03:41:26.095054 140024886109760 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18547/att-00/243162.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-03:41:27.035288 140024886109760 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18547/att-00/243162.sst): second pass time = 1.32's, 81.806'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.94's, 39.383'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3310.940'MB/sec (index lex order gen) rebuild zvType time = 0.81's, 0.286'MB/sec write SST data time = 0.13's, 286.744'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 34480.133'MB/sec zip my value time = 1.32's, unzip length = 0.108'GB zip my value throughput = 81.806'MB/sec zip pipeline throughput = 81.806'MB/sec entries = 929496 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.40 avg-zval = 33.24 usrkeys = 929496 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.40 avg-zval = 33.24 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 929496 bytes = 3369440 } seq expand size = 6506472 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0309 GB dict = 1.08 MB all = 0.0371 GB } UnZip/Zip{ index = 10.5116 value = 3.5021 dict = 1.00 all = 3.6161 } Zip/UnZip{ index = 0.0951 value = 0.2855 dict = 1.00 all = 0.2765 } ---------------------------- total value len = 1.134223 GB avg = 0.120 KB (by entry num) total key len = 0.264315 GB avg = 0.028 KB total ukey len = 0.188796 GB avg = 0.020 KB total ukey num = 0.009439810 Billion total entry num = 0.009439810 Billion write speed all = 0.020644474 MB/sec (with seq num) write speed all = 0.019529710 MB/sec (without seq num) 2024/11/23-03:41:27.069125 140024886109760 [compaction_job.cc:1948] [default] [JOB 18547] Generated table #243162: 929496 keys, 37116640 bytes, temperature: kWarm 2024/11/23-03:41:27.069187 140024886109760 EVENT_LOG_v1 {"time_micros": 1732304487069154, "cf_name": "default", "job": 18547, "event": "table_file_creation", "file_number": 243162, "file_size": 37116640, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3494370280, "largest_seqno": 3765210177, "table_properties": {"data_size": 30893168, "index_size": 1768512, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26025888, "raw_average_key_size": 28, "raw_value_size": 108191972, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 929496, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732304483, "oldest_key_time": 0, "file_creation_time": 1732304483, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 243162, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-03:41:27.109147 140024886109760 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18547/att-00/243163.sst) /dev/shm/ToplingTemp/Topling-397876-WP2VYI 2024/11/23-03:41:27.910940 140024886109760 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18547/att-00/243163.sst): first pass time = 0.80's, 167.406'MB/sec 2024/11/23-03:41:29.257436 140024886109760 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18547/att-00/243163.sst): old prealloc_size = 147639500, real_size = 33434464 2024/11/23-03:41:29.258030 140024886109760 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18547/att-00/243163.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 931730 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1081 GB zip-val = 0.0314 GB avg-val = 116.05 avg-zval = 33.73 2024/11/23-03:41:29.259673 140024886109760 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18547/att-00/243163.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-03:41:30.180190 140024886109760 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18547/att-00/243163.sst): second pass time = 1.35's, 80.377'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.92's, 40.816'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3107.812'MB/sec (index lex order gen) rebuild zvType time = 0.79's, 0.294'MB/sec write SST data time = 0.13's, 289.639'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 26444.215'MB/sec zip my value time = 1.35's, unzip length = 0.108'GB zip my value throughput = 80.377'MB/sec zip pipeline throughput = 80.377'MB/sec entries = 931730 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.05 avg-zval = 33.73 usrkeys = 931730 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.05 avg-zval = 33.73 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 931730 bytes = 3377536 } seq expand size = 6522110 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0186 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0314 GB dict = 1.08 MB all = 0.0377 GB } UnZip/Zip{ index = 10.5110 value = 3.4405 dict = 1.00 all = 3.5637 } Zip/UnZip{ index = 0.0951 value = 0.2907 dict = 1.00 all = 0.2806 } ---------------------------- total value len = 1.248875 GB avg = 0.120 KB (by entry num) total key len = 0.290403 GB avg = 0.028 KB total ukey len = 0.207431 GB avg = 0.020 KB total ukey num = 0.010371540 Billion total entry num = 0.010371540 Billion write speed all = 0.022720947 MB/sec (with seq num) write speed all = 0.021496210 MB/sec (without seq num) 2024/11/23-03:41:30.216170 140024886109760 [compaction_job.cc:1948] [default] [JOB 18547] Generated table #243163: 931730 keys, 37662646 bytes, temperature: kWarm 2024/11/23-03:41:30.216230 140024886109760 EVENT_LOG_v1 {"time_micros": 1732304490216199, "cf_name": "default", "job": 18547, "event": "table_file_creation", "file_number": 243163, "file_size": 37662646, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3369353416, "largest_seqno": 3765210187, "table_properties": {"data_size": 31428496, "index_size": 1772864, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26088440, "raw_average_key_size": 28, "raw_value_size": 108129372, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 931730, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732304487, "oldest_key_time": 0, "file_creation_time": 1732304487, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 243163, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-03:41:30.260951 140024886109760 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18547/att-00/243164.sst) /dev/shm/ToplingTemp/Topling-397876-TjOtKG 2024/11/23-03:41:31.091344 140024886109760 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18547/att-00/243164.sst): first pass time = 0.83's, 161.638'MB/sec 2024/11/23-03:41:32.434671 140024886109760 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18547/att-00/243164.sst): old prealloc_size = 147639500, real_size = 34759696 2024/11/23-03:41:32.435232 140024886109760 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18547/att-00/243164.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927372 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1083 GB zip-val = 0.0328 GB avg-val = 116.73 avg-zval = 35.32 2024/11/23-03:41:32.435940 140024886109760 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18547/att-00/243164.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-03:41:33.299354 140024886109760 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18547/att-00/243164.sst): second pass time = 1.34's, 80.645'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.86's, 44.481'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3280.435'MB/sec (index lex order gen) rebuild zvType time = 0.73's, 0.316'MB/sec write SST data time = 0.13's, 294.621'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 33422.111'MB/sec zip my value time = 1.34's, unzip length = 0.108'GB zip my value throughput = 80.645'MB/sec zip pipeline throughput = 80.645'MB/sec entries = 927372 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.73 avg-zval = 35.32 usrkeys = 927372 avg-key = 20.00 avg-zkey = 1.91 avg-val = 122.35 avg-zval = 35.32 TagRS{ kinds = RS_Key0_TagN bytes = 145000 } TagArray{ size = 744375 bytes = 2698368 } seq expand size = 5210625 multi value expand size = 0 cnt WriteAppend = 18 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0328 GB dict = 1.08 MB all = 0.0385 GB } UnZip/Zip{ index = 10.4468 value = 3.3052 dict = 1.00 all = 3.4897 } Zip/UnZip{ index = 0.0957 value = 0.3026 dict = 1.00 all = 0.2866 } ---------------------------- total value len = 1.362337 GB avg = 0.121 KB (by entry num) total key len = 0.316370 GB avg = 0.028 KB total ukey len = 0.225978 GB avg = 0.020 KB total ukey num = 0.011298912 Billion total entry num = 0.011298912 Billion write speed all = 0.024777878 MB/sec (with seq num) write speed all = 0.023443693 MB/sec (without seq num) 2024/11/23-03:41:33.332591 140024886109760 [compaction_job.cc:1948] [default] [JOB 18547] Generated table #243164: 927372 keys, 38461094 bytes, temperature: kWarm 2024/11/23-03:41:33.332653 140024886109760 EVENT_LOG_v1 {"time_micros": 1732304493332621, "cf_name": "default", "job": 18547, "event": "table_file_creation", "file_number": 243164, "file_size": 38461094, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3765210304, "table_properties": {"data_size": 32752256, "index_size": 1775424, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25966416, "raw_average_key_size": 28, "raw_value_size": 108251320, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927372, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732304490, "oldest_key_time": 0, "file_creation_time": 1732304490, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 243164, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-03:41:33.373277 140024886109760 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18547/att-00/243165.sst) /dev/shm/ToplingTemp/Topling-397876-X0plsJ 2024/11/23-03:41:34.200989 140024886109760 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18547/att-00/243165.sst): first pass time = 0.83's, 162.163'MB/sec 2024/11/23-03:41:35.546405 140024886109760 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18547/att-00/243165.sst): old prealloc_size = 147639500, real_size = 33194480 2024/11/23-03:41:35.547003 140024886109760 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18547/att-00/243165.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927593 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0312 GB avg-val = 116.69 avg-zval = 33.63 2024/11/23-03:41:35.548668 140024886109760 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18547/att-00/243165.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-03:41:36.505392 140024886109760 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18547/att-00/243165.sst): second pass time = 1.34's, 80.492'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.96's, 39.012'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3068.181'MB/sec (index lex order gen) rebuild zvType time = 0.83's, 0.280'MB/sec write SST data time = 0.13's, 288.698'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 34093.558'MB/sec zip my value time = 1.34's, unzip length = 0.108'GB zip my value throughput = 80.492'MB/sec zip pipeline throughput = 80.492'MB/sec entries = 927593 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.69 avg-zval = 33.63 usrkeys = 927593 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.69 avg-zval = 33.63 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 927593 bytes = 3362544 } seq expand size = 6493151 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0312 GB dict = 1.08 MB all = 0.0374 GB } UnZip/Zip{ index = 10.5144 value = 3.4696 dict = 1.00 all = 3.5877 } Zip/UnZip{ index = 0.0951 value = 0.2882 dict = 1.00 all = 0.2787 } ---------------------------- total value len = 1.477075 GB avg = 0.121 KB (by entry num) total key len = 0.342342 GB avg = 0.028 KB total ukey len = 0.244530 GB avg = 0.020 KB total ukey num = 0.012226505 Billion total entry num = 0.012226505 Billion write speed all = 0.026853516 MB/sec (with seq num) write speed all = 0.025409869 MB/sec (without seq num) 2024/11/23-03:41:36.537470 140024886109760 [compaction_job.cc:1948] [default] [JOB 18547] Generated table #243165: 927593 keys, 37411078 bytes, temperature: kWarm 2024/11/23-03:41:36.537534 140024886109760 EVENT_LOG_v1 {"time_micros": 1732304496537502, "cf_name": "default", "job": 18547, "event": "table_file_creation", "file_number": 243165, "file_size": 37411078, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3480997236, "largest_seqno": 3765209648, "table_properties": {"data_size": 31197984, "index_size": 1764416, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25972604, "raw_average_key_size": 28, "raw_value_size": 108245258, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927593, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732304493, "oldest_key_time": 0, "file_creation_time": 1732304493, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 243165, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-03:41:36.576438 140024886109760 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18547/att-00/243166.sst) /dev/shm/ToplingTemp/Topling-397876-s6KDoK 2024/11/23-03:41:36.785072 140024886109760 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18547/att-00/243166.sst): first pass time = 0.21's, 243.535'MB/sec 2024/11/23-03:41:37.268611 140024886109760 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18547/att-00/243166.sst): old prealloc_size = 147639500, real_size = 13073632 2024/11/23-03:41:37.268881 140024886109760 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18547/att-00/243166.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 356047 prefix = 4 raw-key = 0.0057 GB zip-key = 0.0007 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.0408 GB zip-val = 0.0123 GB avg-val = 114.68 avg-zval = 34.56 2024/11/23-03:41:37.269208 140024886109760 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18547/att-00/243166.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0008 GB, waited 0.000 sec, Key+Value = 0.051 GB 2024/11/23-03:41:37.612670 140024886109760 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18547/att-00/243166.sst): second pass time = 0.48's, 84.555'MB/sec, value only(80.4% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.34's, 42.573'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2742.488'MB/sec (index lex order gen) rebuild zvType time = 0.29's, 0.302'MB/sec write SST data time = 0.05's, 298.813'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.413'MB, throughput = 13604.647'MB/sec zip my value time = 0.48's, unzip length = 0.041'GB zip my value throughput = 84.555'MB/sec zip pipeline throughput = 84.555'MB/sec entries = 356047 avg-key = 28.00 avg-zkey = 1.91 avg-val = 114.68 avg-zval = 34.56 usrkeys = 356047 avg-key = 20.00 avg-zkey = 1.91 avg-val = 121.68 avg-zval = 34.56 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 356047 bytes = 1246176 } seq expand size = 2492329 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0071 GB value = 0.0408 GB dict = 0.41 MB all = 0.0508 GB } __ZipSize{ index = 0.0007 GB value = 0.0123 GB dict = 0.41 MB all = 0.0146 GB } UnZip/Zip{ index = 10.4957 value = 3.3180 dict = 1.00 all = 3.4683 } Zip/UnZip{ index = 0.0953 value = 0.3014 dict = 1.00 all = 0.2883 } ---------------------------- total value len = 1.520399 GB avg = 0.121 KB (by entry num) total key len = 0.352311 GB avg = 0.028 KB total ukey len = 0.251651 GB avg = 0.020 KB total ukey num = 0.012582552 Billion total entry num = 0.012582552 Billion write speed all = 0.027639645 MB/sec (with seq num) write speed all = 0.026153981 MB/sec (without seq num) 2024/11/23-03:41:37.630500 140024886109760 [compaction_job.cc:1948] [default] [JOB 18547] Generated table #243166: 356047 keys, 14647093 bytes, temperature: kWarm 2024/11/23-03:41:37.630557 140024886109760 EVENT_LOG_v1 {"time_micros": 1732304497630526, "cf_name": "default", "job": 18547, "event": "table_file_creation", "file_number": 243166, "file_size": 14647093, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3512539342, "largest_seqno": 3765209664, "table_properties": {"data_size": 12306000, "index_size": 678464, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 9969316, "raw_average_key_size": 28, "raw_value_size": 40831842, "raw_average_value_size": 114, "num_data_blocks": 1, "num_entries": 356047, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732304496, "oldest_key_time": 0, "file_creation_time": 1732304496, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 243166, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-03:41:37.645506 140024886109760 [compaction_job.cc:703] job-18547: subcompact[0], size: 0.492994 G, files: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18547/att-00 [243153,243154,243155,243156,243157,243158,243159,243160,243161,243162,243163,243164,243165,243166] 2024/11/23-03:41:37.731294 140024886109760 (Original Log Time 2024/11/23-03:40:54.372484) EVENT_LOG_v1 {"time_micros": 1732304454372455, "job": 18547, "event": "compaction_started", "compaction_reason": "FilesMarkedForCompaction", "files_L2": [243097], "files_L3": [243121, 243122, 243056, 243057, 243058, 243059, 243060, 243061, 243062, 243063, 243064, 243065, 243066, 243143], "score": 0.993328, "input_data_size": 517718943, "oldest_snapshot_seqno": 3765465042} 2024/11/23-03:41:37.731297 140024886109760 (Original Log Time 2024/11/23-03:41:37.730577) [compaction_job.cc:2022] [default] [JOB 18547] Compacted 1@2 + 14@3 files to L3 => 492994231 bytes 2024/11/23-03:41:37.731299 140024886109760 (Original Log Time 2024/11/23-03:41:37.731232) [compaction_job.cc:1224] [default] compacted to: files[0 0 0 14 0 0 0] max score 0.02, MB/sec: 12.0 rd, 11.4 wr, level 3, files in(1, 14) out(14 +0 blob) MB in(27.1, 466.6 +0.0 blob) out(470.2 +0.0 blob), read-write-amplify(35.5) write-amplify(17.3) OK, records in: 12664191, records dropped: 81639 output_compression: Snappy 2024/11/23-03:41:37.731305 140024886109760 (Original Log Time 2024/11/23-03:41:37.731274) EVENT_LOG_v1 {"time_micros": 1732304497731254, "cf": "default", "job": 18547, "event": "compaction_finished", "compaction_time_micros": 43273029, "compaction_time_cpu_micros": 19826903, "output_level": 3, "num_output_files": 14, "total_output_size": 492994231, "num_input_records": 12664191, "num_output_records": 12582552, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "file_write_nanos": 310761756, "file_range_sync_nanos": 0, "file_fsync_nanos": 12914, "file_prepare_write_nanos": 32621, "lsm_state": [0, 0, 0, 14, 0, 0, 0]} 2024/11/23-03:41:37.850352 140024886109760 DEBG dcompact_worker.cpp:240: HttpPost: 200 OK: url = http://nlb-7zny4kaa1poal01o64.cn-shenzhen.nlb.aliyuncs.com:8443, body = {"instanceId":"nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137","labourId":"","dbId":"d89b4006-2803-486e-b7a2-759bcf348921","dbStarts":1732256054,"starts":1732304454,"executesMs":43495,"compactionJobId":18547,"attempt":0,"compactionInputRawBytes":1807225427,"compactionInputZipBytes":517718943,"compactionOutputRawBytes":0,"compactionOutputZipBytes":492994231,"headers":{"Accept":"*/*","Connection":"close","Host":"aliyun-topling-saas.topling.cn:18443","RemoteIp":"120.24.192.169","X-Forwarded-For":"120.24.192.169","region":"cn-shenzhen","token":"e6474c481bd4415abc537135cc03626b","instance-token":"e6474c481bd4415abc537135cc03626b","provider":"aliyun","CloudMarketInstanceId":"si-59c0ae5c955845588903","MeteringAssit":"","Transfer-Encoding":"chunked","traceparent":"00-6d2e5870bc67f116d58db7bb4383bc1a-ddd6c3ab55deb7bd-00"}}, response = 2024/11/23-03:41:37.850413 140024886109760 INFO dcompact_worker.cpp:1459: finish /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-18547/att-00: olev 3, work 43.496 s, result 6.334 ms, install 0.744 ms, input{raw 1.683 GiB zip 493.735 MiB}