2024/11/23-06:03:24.360315 140024995214912 DEBG dcompact_worker.cpp:2214: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-20694/att-00: fork to child time = 0.012113 sec 2024/11/23-06:03:24.361453 140024995214912 DEBG dcompact_worker.cpp:1013: Beg SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-20694/att-00 2024/11/23-06:03:24.369133 140024995214912 DEBG dcompact_worker.cpp:1033: End SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-20694/att-00 2024/11/23-06:03:24.370498 140024995214912 TRAC dcompact_worker.cpp:1083: INFO_LOG_LEVEL: rpc = INFO_LEVEL, env_var = undefined 2024/11/23-06:03:24.370774 140024995214912 [WARN] [column_family.cc:386] multiple cf_paths/db_paths and level_compaction_dynamic_level_bytes can't be used together 2024/11/23-06:03:24.412157 140024995214912 [version_set.cc:6208] Recovering from manifest file: /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-20694/att-00/MANIFEST-206347 2024/11/23-06:03:24.438983 140024995214912 [version_set.cc:6251] Recovered from manifest file:/worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-20694/att-00/MANIFEST-206347 succeeded,manifest_file_number is 206347, next_file_number is 247782, last_sequence is 3825560948, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 247593 2024/11/23-06:03:24.438990 140024995214912 [version_set.cc:6266] Column family [default] (ID 0), log number is 0 2024/11/23-06:03:24.439082 140024995214912 [version_set.cc:5721] Creating manifest 247782 2024/11/23-06:03:24.467929 140024995214912 DEBG dcompact_worker.cpp:1218: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-20694/att-00: bottommost_level: fake = 1, rpc = 0 2024/11/23-06:03:24.485869 140024995214912 [compaction_job.cc:2437] [default] [JOB 20694] Compacting 1@2 + 14@3 files to L3, score 1.00, subcompactions 1 : 1 2024/11/23-06:03:24.485886 140024995214912 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 15477 Base level 2, inputs: [247740(27MB)], [247764(12MB) 247660(34MB) 247661(36MB) 247662(36MB) 247663(35MB) 247676(35MB) 247677(34MB) 247678(34MB) 247679(34MB) 247680(34MB) 247681(36MB) 247682(35MB) 247683(33MB) 247775(35MB)] 2024/11/23-06:03:24.491802 140024995214912 [top_zip_table.cc:59] core git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-06:03:24.491833 140024995214912 [top_zip_table.cc:60] fsa git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-06:03:24.491853 140024995214912 [top_zip_table.cc:61] zbs git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-06:03:24.491859 140024995214912 [top_zip_table.cc:62] topling-zip_table_reader: git_version_hash_info_is: commit a4a382006cb82713acf5b3425835f22711877681 Author: leipeng Date: 2024-04-11 19:44:14 +0800 fixed_len_hole_index.cc: Add env bool FixedLenHoleIndexUseAVX512 for ut & debug 1. FixedLenHoleIndexUseAVX512 is only in unit tests or debug 2. In release mode, use avx512 by compile options(-march=) g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/23-06:03:24.491869 140024995214912 [top_zip_table.cc:64] topling-rocks git_version_hash_info_is: commit feab587e468621ba0204d47b4ffacc52e7c4290d Author: leipeng Date: 2024-03-22 13:35:06 +0800 ToplingZipTableBuilder::Add: immediately return after error This function returns void, and caller does not check builder->status() after calling this function and graceful abandon. So immediately return after error, and return error status in Finish(). g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/23-06:03:24.791182 140024995214912 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-20694/att-00/247783.sst) /dev/shm/ToplingTemp/Topling-429286-kAcO5N 2024/11/23-06:03:25.853265 140024995214912 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-20694/att-00/247783.sst): first pass time = 1.06's, 126.378'MB/sec 2024/11/23-06:03:27.706166 140024995214912 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-20694/att-00/247783.sst): old prealloc_size = 147639500, real_size = 34594272 2024/11/23-06:03:27.706871 140024995214912 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-20694/att-00/247783.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 932560 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.93 raw-val = 0.1081 GB zip-val = 0.0326 GB avg-val = 115.92 avg-zval = 34.92 2024/11/23-06:03:27.707359 140024995214912 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-20694/att-00/247783.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-06:03:28.988697 140024995214912 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-20694/att-00/247783.sst): second pass time = 1.85's, 58.397'MB/sec, value only(80.5% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.28's, 28.916'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2637.905'MB/sec (index lex order gen) rebuild zvType time = 1.13's, 0.207'MB/sec write SST data time = 0.16's, 237.512'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 35151.450'MB/sec zip my value time = 1.85's, unzip length = 0.108'GB zip my value throughput = 58.397'MB/sec zip pipeline throughput = 58.397'MB/sec entries = 932560 avg-key = 28.00 avg-zkey = 1.93 avg-val = 115.92 avg-zval = 34.92 usrkeys = 932560 avg-key = 20.00 avg-zkey = 1.93 avg-val = 119.37 avg-zval = 34.92 TagRS{ kinds = RS_Key0_TagN bytes = 145800 } TagArray{ size = 458874 bytes = 1491360 } seq expand size = 3212118 multi value expand size = 0 cnt WriteAppend = 17 UnZipSize{ index = 0.0187 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0326 GB dict = 1.08 MB all = 0.0371 GB } UnZip/Zip{ index = 10.3769 value = 3.3198 dict = 1.00 all = 3.6191 } Zip/UnZip{ index = 0.0964 value = 0.3012 dict = 1.00 all = 0.2763 } ---------------------------- total value len = 0.111318 GB avg = 0.119 KB (by entry num) total key len = 0.026112 GB avg = 0.028 KB total ukey len = 0.018651 GB avg = 0.020 KB total ukey num = 0.000932560 Billion total entry num = 0.000932560 Billion write speed all = 0.001801984 MB/sec (with seq num) write speed all = 0.001704162 MB/sec (without seq num) 2024/11/23-06:03:29.021343 140024995214912 [compaction_job.cc:1948] [default] [JOB 20694] Generated table #247783: 932560 keys, 37085589 bytes, temperature: kWarm 2024/11/23-06:03:29.021429 140024995214912 EVENT_LOG_v1 {"time_micros": 1732313009021376, "cf_name": "default", "job": 20694, "event": "table_file_creation", "file_number": 247783, "file_size": 37085589, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3825361288, "table_properties": {"data_size": 32563600, "index_size": 1797376, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26111680, "raw_average_key_size": 28, "raw_value_size": 108106148, "raw_average_value_size": 115, "num_data_blocks": 1, "num_entries": 932560, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732313004, "oldest_key_time": 0, "file_creation_time": 1732313004, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 247783, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-06:03:29.058019 140024995214912 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-20694/att-00/247784.sst) /dev/shm/ToplingTemp/Topling-429286-OUBR0K 2024/11/23-06:03:30.132728 140024995214912 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-20694/att-00/247784.sst): first pass time = 1.07's, 124.892'MB/sec 2024/11/23-06:03:32.237325 140024995214912 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-20694/att-00/247784.sst): old prealloc_size = 147639500, real_size = 35447232 2024/11/23-06:03:32.238143 140024995214912 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-20694/att-00/247784.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 1080226 prefix = 4 raw-key = 0.0173 GB zip-key = 0.0021 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1040 GB zip-val = 0.0331 GB avg-val = 96.25 avg-zval = 30.66 2024/11/23-06:03:32.238442 140024995214912 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-20694/att-00/247784.sst: sumWaitingMem = 0.003 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0028 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-06:03:32.921066 140024995214912 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-20694/att-00/247784.sst): second pass time = 2.10's, 49.422'MB/sec, value only(77.5% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.68's, 54.060'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2570.008'MB/sec (index lex order gen) rebuild zvType time = 0.52's, 0.517'MB/sec write SST data time = 0.16's, 230.622'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.026'MB, throughput = 27650.140'MB/sec zip my value time = 2.10's, unzip length = 0.104'GB zip my value throughput = 49.422'MB/sec zip pipeline throughput = 49.422'MB/sec entries = 1080226 avg-key = 28.00 avg-zkey = 1.90 avg-val = 96.25 avg-zval = 30.66 usrkeys = 1080226 avg-key = 20.00 avg-zkey = 1.90 avg-val = 97.32 avg-zval = 30.66 TagRS{ kinds = RS_Key0_TagN bytes = 168880 } TagArray{ size = 165509 bytes = 579296 } seq expand size = 1158563 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0216 GB value = 0.1040 GB dict = 1.03 MB all = 0.1342 GB } __ZipSize{ index = 0.0021 GB value = 0.0331 GB dict = 1.03 MB all = 0.0370 GB } UnZip/Zip{ index = 10.5165 value = 3.1390 dict = 1.00 all = 3.6312 } Zip/UnZip{ index = 0.0951 value = 0.3186 dict = 1.00 all = 0.2754 } ---------------------------- total value len = 0.216448 GB avg = 0.108 KB (by entry num) total key len = 0.056358 GB avg = 0.028 KB total ukey len = 0.040256 GB avg = 0.020 KB total ukey num = 0.002012786 Billion total entry num = 0.002012786 Billion write speed all = 0.003576858 MB/sec (with seq num) write speed all = 0.003365735 MB/sec (without seq num) 2024/11/23-06:03:32.959126 140024995214912 [compaction_job.cc:1948] [default] [JOB 20694] Generated table #247784: 1080226 keys, 36962487 bytes, temperature: kWarm 2024/11/23-06:03:32.959193 140024995214912 EVENT_LOG_v1 {"time_micros": 1732313012959160, "cf_name": "default", "job": 20694, "event": "table_file_creation", "file_number": 247784, "file_size": 36962487, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3413278771, "table_properties": {"data_size": 33122672, "index_size": 2054336, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 30246328, "raw_average_key_size": 28, "raw_value_size": 103971477, "raw_average_value_size": 96, "num_data_blocks": 1, "num_entries": 1080226, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732313009, "oldest_key_time": 0, "file_creation_time": 1732313009, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 247784, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-06:03:32.997172 140024995214912 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-20694/att-00/247785.sst) /dev/shm/ToplingTemp/Topling-429286-h9ONoM 2024/11/23-06:03:34.059255 140024995214912 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-20694/att-00/247785.sst): first pass time = 1.06's, 126.377'MB/sec 2024/11/23-06:03:35.664434 140024995214912 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-20694/att-00/247785.sst): old prealloc_size = 147639500, real_size = 34215936 2024/11/23-06:03:35.665031 140024995214912 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-20694/att-00/247785.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 929245 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0322 GB avg-val = 116.44 avg-zval = 34.67 2024/11/23-06:03:35.665849 140024995214912 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-20694/att-00/247785.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-06:03:36.576172 140024995214912 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-20694/att-00/247785.sst): second pass time = 1.60's, 67.667'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.91's, 42.160'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3064.672'MB/sec (index lex order gen) rebuild zvType time = 0.78's, 0.296'MB/sec write SST data time = 0.13's, 302.161'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 33720.060'MB/sec zip my value time = 1.60's, unzip length = 0.108'GB zip my value throughput = 67.667'MB/sec zip pipeline throughput = 76.826'MB/sec entries = 929245 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.44 avg-zval = 34.67 usrkeys = 929245 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.44 avg-zval = 34.67 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 929245 bytes = 3368528 } seq expand size = 6504715 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0322 GB dict = 1.08 MB all = 0.0384 GB } UnZip/Zip{ index = 10.5122 value = 3.3586 dict = 1.00 all = 3.4918 } Zip/UnZip{ index = 0.0951 value = 0.2977 dict = 1.00 all = 0.2864 } ---------------------------- total value len = 0.331152 GB avg = 0.113 KB (by entry num) total key len = 0.082377 GB avg = 0.028 KB total ukey len = 0.058841 GB avg = 0.020 KB total ukey num = 0.002942031 Billion total entry num = 0.002942031 Billion write speed all = 0.005421660 MB/sec (with seq num) write speed all = 0.005113083 MB/sec (without seq num) 2024/11/23-06:03:36.615750 140024995214912 [compaction_job.cc:1948] [default] [JOB 20694] Generated table #247785: 929245 keys, 38437546 bytes, temperature: kWarm 2024/11/23-06:03:36.615822 140024995214912 EVENT_LOG_v1 {"time_micros": 1732313016615789, "cf_name": "default", "job": 20694, "event": "table_file_creation", "file_number": 247785, "file_size": 38437546, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3413278772, "largest_seqno": 3825361618, "table_properties": {"data_size": 32215536, "index_size": 1767936, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26018860, "raw_average_key_size": 28, "raw_value_size": 108198998, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 929245, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732313012, "oldest_key_time": 0, "file_creation_time": 1732313012, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 247785, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-06:03:36.651858 140024995214912 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-20694/att-00/247786.sst) /dev/shm/ToplingTemp/Topling-429286-CffEwO 2024/11/23-06:03:37.535314 140024995214912 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-20694/att-00/247786.sst): first pass time = 0.88's, 151.930'MB/sec 2024/11/23-06:03:38.977100 140024995214912 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-20694/att-00/247786.sst): old prealloc_size = 147639500, real_size = 34396000 2024/11/23-06:03:38.977697 140024995214912 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-20694/att-00/247786.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 930335 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1082 GB zip-val = 0.0324 GB avg-val = 116.27 avg-zval = 34.81 2024/11/23-06:03:38.978538 140024995214912 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-20694/att-00/247786.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-06:03:39.885272 140024995214912 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-20694/att-00/247786.sst): second pass time = 1.44's, 75.063'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.91's, 42.654'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3126.416'MB/sec (index lex order gen) rebuild zvType time = 0.78's, 0.298'MB/sec write SST data time = 0.13's, 303.009'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 34254.551'MB/sec zip my value time = 1.44's, unzip length = 0.108'GB zip my value throughput = 75.063'MB/sec zip pipeline throughput = 75.063'MB/sec entries = 930335 avg-key = 28.00 avg-zkey = 1.92 avg-val = 116.27 avg-zval = 34.81 usrkeys = 930335 avg-key = 20.00 avg-zkey = 1.92 avg-val = 123.27 avg-zval = 34.81 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 930335 bytes = 3488768 } seq expand size = 6512345 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0324 GB dict = 1.08 MB all = 0.0387 GB } UnZip/Zip{ index = 10.4436 value = 3.3404 dict = 1.00 all = 3.4649 } Zip/UnZip{ index = 0.0958 value = 0.2994 dict = 1.00 all = 0.2886 } ---------------------------- total value len = 0.445833 GB avg = 0.115 KB (by entry num) total key len = 0.108426 GB avg = 0.028 KB total ukey len = 0.077447 GB avg = 0.020 KB total ukey num = 0.003872366 Billion total entry num = 0.003872366 Billion write speed all = 0.007266418 MB/sec (with seq num) write speed all = 0.006860280 MB/sec (without seq num) 2024/11/23-06:03:39.920589 140024995214912 [compaction_job.cc:1948] [default] [JOB 20694] Generated table #247786: 930335 keys, 38736162 bytes, temperature: kWarm 2024/11/23-06:03:39.920655 140024995214912 EVENT_LOG_v1 {"time_micros": 1732313019920622, "cf_name": "default", "job": 20694, "event": "table_file_creation", "file_number": 247786, "file_size": 38736162, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3273701103, "largest_seqno": 3825361112, "table_properties": {"data_size": 32381584, "index_size": 1781632, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26049380, "raw_average_key_size": 28, "raw_value_size": 108168426, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 930335, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732313016, "oldest_key_time": 0, "file_creation_time": 1732313016, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 247786, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-06:03:39.960557 140024995214912 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-20694/att-00/247787.sst) /dev/shm/ToplingTemp/Topling-429286-MDQXGN 2024/11/23-06:03:40.860242 140024995214912 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-20694/att-00/247787.sst): first pass time = 0.90's, 149.189'MB/sec 2024/11/23-06:03:42.301213 140024995214912 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-20694/att-00/247787.sst): old prealloc_size = 147639500, real_size = 32007824 2024/11/23-06:03:42.301756 140024995214912 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-20694/att-00/247787.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 928346 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0300 GB avg-val = 116.58 avg-zval = 32.33 2024/11/23-06:03:42.302558 140024995214912 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-20694/att-00/247787.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-06:03:43.198649 140024995214912 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-20694/att-00/247787.sst): second pass time = 1.44's, 75.163'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.90's, 40.367'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3387.396'MB/sec (index lex order gen) rebuild zvType time = 0.77's, 0.302'MB/sec write SST data time = 0.13's, 281.617'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 35351.626'MB/sec zip my value time = 1.44's, unzip length = 0.108'GB zip my value throughput = 75.163'MB/sec zip pipeline throughput = 75.163'MB/sec entries = 928346 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.58 avg-zval = 32.33 usrkeys = 928346 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.58 avg-zval = 32.33 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 928346 bytes = 3365264 } seq expand size = 6498422 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0300 GB dict = 1.08 MB all = 0.0362 GB } UnZip/Zip{ index = 10.5127 value = 3.6063 dict = 1.00 all = 3.7050 } Zip/UnZip{ index = 0.0951 value = 0.2773 dict = 1.00 all = 0.2699 } ---------------------------- total value len = 0.560555 GB avg = 0.117 KB (by entry num) total key len = 0.134420 GB avg = 0.028 KB total ukey len = 0.096014 GB avg = 0.020 KB total ukey num = 0.004800712 Billion total entry num = 0.004800712 Billion write speed all = 0.009110833 MB/sec (with seq num) write speed all = 0.008607351 MB/sec (without seq num) 2024/11/23-06:03:43.231984 140024995214912 [compaction_job.cc:1948] [default] [JOB 20694] Generated table #247787: 928346 keys, 36226506 bytes, temperature: kWarm 2024/11/23-06:03:43.232047 140024995214912 EVENT_LOG_v1 {"time_micros": 1732313023232014, "cf_name": "default", "job": 20694, "event": "table_file_creation", "file_number": 247787, "file_size": 36226506, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3369194706, "largest_seqno": 3825361151, "table_properties": {"data_size": 30009408, "index_size": 1766144, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25993688, "raw_average_key_size": 28, "raw_value_size": 108224152, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 928346, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732313019, "oldest_key_time": 0, "file_creation_time": 1732313019, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 247787, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-06:03:43.266465 140024995214912 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-20694/att-00/247788.sst) /dev/shm/ToplingTemp/Topling-429286-nU3agM 2024/11/23-06:03:44.144831 140024995214912 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-20694/att-00/247788.sst): first pass time = 0.88's, 152.810'MB/sec 2024/11/23-06:03:45.568286 140024995214912 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-20694/att-00/247788.sst): old prealloc_size = 147639500, real_size = 33334928 2024/11/23-06:03:45.568828 140024995214912 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-20694/att-00/247788.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 925177 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0313 GB avg-val = 117.07 avg-zval = 33.88 2024/11/23-06:03:45.569626 140024995214912 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-20694/att-00/247788.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-06:03:46.495634 140024995214912 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-20694/att-00/247788.sst): second pass time = 1.42's, 76.149'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.93's, 40.486'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3364.417'MB/sec (index lex order gen) rebuild zvType time = 0.80's, 0.290'MB/sec write SST data time = 0.13's, 292.170'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 24951.550'MB/sec zip my value time = 1.42's, unzip length = 0.108'GB zip my value throughput = 76.149'MB/sec zip pipeline throughput = 76.149'MB/sec entries = 925177 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.07 avg-zval = 33.88 usrkeys = 925177 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.07 avg-zval = 33.88 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 925177 bytes = 3353776 } seq expand size = 6476239 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0313 GB dict = 1.08 MB all = 0.0375 GB } UnZip/Zip{ index = 10.5111 value = 3.4557 dict = 1.00 all = 3.5749 } Zip/UnZip{ index = 0.0951 value = 0.2894 dict = 1.00 all = 0.2797 } ---------------------------- total value len = 0.675344 GB avg = 0.118 KB (by entry num) total key len = 0.160325 GB avg = 0.028 KB total ukey len = 0.114518 GB avg = 0.020 KB total ukey num = 0.005725889 Billion total entry num = 0.005725889 Billion write speed all = 0.010954799 MB/sec (with seq num) write speed all = 0.010354313 MB/sec (without seq num) 2024/11/23-06:03:46.530280 140024995214912 [compaction_job.cc:1948] [default] [JOB 20694] Generated table #247788: 925177 keys, 37544160 bytes, temperature: kWarm 2024/11/23-06:03:46.530350 140024995214912 EVENT_LOG_v1 {"time_micros": 1732313026530312, "cf_name": "default", "job": 20694, "event": "table_file_creation", "file_number": 247788, "file_size": 37544160, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3514720078, "largest_seqno": 3825361496, "table_properties": {"data_size": 31343040, "index_size": 1760384, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25904956, "raw_average_key_size": 28, "raw_value_size": 108312798, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 925177, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732313023, "oldest_key_time": 0, "file_creation_time": 1732313023, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 247788, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-06:03:46.566177 140024995214912 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-20694/att-00/247789.sst) /dev/shm/ToplingTemp/Topling-429286-FPczaP 2024/11/23-06:03:47.467028 140024995214912 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-20694/att-00/247789.sst): first pass time = 0.90's, 148.996'MB/sec 2024/11/23-06:03:48.889718 140024995214912 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-20694/att-00/247789.sst): old prealloc_size = 147639500, real_size = 33170224 2024/11/23-06:03:48.890245 140024995214912 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-20694/att-00/247789.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 928135 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0312 GB avg-val = 116.61 avg-zval = 33.59 2024/11/23-06:03:48.891047 140024995214912 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-20694/att-00/247789.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-06:03:49.840074 140024995214912 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-20694/att-00/247789.sst): second pass time = 1.42's, 76.111'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.95's, 39.220'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3497.286'MB/sec (index lex order gen) rebuild zvType time = 0.82's, 0.282'MB/sec write SST data time = 0.13's, 295.234'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 31247.049'MB/sec zip my value time = 1.42's, unzip length = 0.108'GB zip my value throughput = 76.111'MB/sec zip pipeline throughput = 76.111'MB/sec entries = 928135 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.61 avg-zval = 33.59 usrkeys = 928135 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.61 avg-zval = 33.59 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 928135 bytes = 3248480 } seq expand size = 6496945 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0312 GB dict = 1.08 MB all = 0.0373 GB } UnZip/Zip{ index = 10.5130 value = 3.4720 dict = 1.00 all = 3.6010 } Zip/UnZip{ index = 0.0951 value = 0.2880 dict = 1.00 all = 0.2777 } ---------------------------- total value len = 0.790071 GB avg = 0.119 KB (by entry num) total key len = 0.186313 GB avg = 0.028 KB total ukey len = 0.133080 GB avg = 0.020 KB total ukey num = 0.006654024 Billion total entry num = 0.006654024 Billion write speed all = 0.012798868 MB/sec (with seq num) write speed all = 0.012101077 MB/sec (without seq num) 2024/11/23-06:03:49.872110 140024995214912 [compaction_job.cc:1948] [default] [JOB 20694] Generated table #247789: 928135 keys, 37272426 bytes, temperature: kWarm 2024/11/23-06:03:49.872173 140024995214912 EVENT_LOG_v1 {"time_micros": 1732313029872141, "cf_name": "default", "job": 20694, "event": "table_file_creation", "file_number": 247789, "file_size": 37272426, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3610601794, "largest_seqno": 3825360045, "table_properties": {"data_size": 31172320, "index_size": 1765696, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25987780, "raw_average_key_size": 28, "raw_value_size": 108229974, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 928135, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732313026, "oldest_key_time": 0, "file_creation_time": 1732313026, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 247789, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-06:03:49.907699 140024995214912 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-20694/att-00/247790.sst) /dev/shm/ToplingTemp/Topling-429286-pXfPqM 2024/11/23-06:03:50.736493 140024995214912 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-20694/att-00/247790.sst): first pass time = 0.83's, 161.951'MB/sec 2024/11/23-06:03:52.201772 140024995214912 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-20694/att-00/247790.sst): old prealloc_size = 147639500, real_size = 33287584 2024/11/23-06:03:52.202324 140024995214912 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-20694/att-00/247790.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 928340 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1082 GB zip-val = 0.0313 GB avg-val = 116.58 avg-zval = 33.69 2024/11/23-06:03:52.203106 140024995214912 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-20694/att-00/247790.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-06:03:53.156759 140024995214912 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-20694/att-00/247790.sst): second pass time = 1.46's, 73.896'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.95's, 39.275'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3408.766'MB/sec (index lex order gen) rebuild zvType time = 0.83's, 0.280'MB/sec write SST data time = 0.13's, 295.547'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 26405.448'MB/sec zip my value time = 1.46's, unzip length = 0.108'GB zip my value throughput = 73.896'MB/sec zip pipeline throughput = 73.896'MB/sec entries = 928340 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.58 avg-zval = 33.69 usrkeys = 928340 avg-key = 20.00 avg-zkey = 1.91 avg-val = 123.58 avg-zval = 33.69 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 928340 bytes = 3365248 } seq expand size = 6498380 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0313 GB dict = 1.08 MB all = 0.0375 GB } UnZip/Zip{ index = 10.4449 value = 3.4601 dict = 1.00 all = 3.5785 } Zip/UnZip{ index = 0.0957 value = 0.2890 dict = 1.00 all = 0.2794 } ---------------------------- total value len = 0.904794 GB avg = 0.119 KB (by entry num) total key len = 0.212306 GB avg = 0.028 KB total ukey len = 0.151647 GB avg = 0.020 KB total ukey num = 0.007582364 Billion total entry num = 0.007582364 Billion write speed all = 0.014642801 MB/sec (with seq num) write speed all = 0.013847692 MB/sec (without seq num) 2024/11/23-06:03:53.188366 140024995214912 [compaction_job.cc:1948] [default] [JOB 20694] Generated table #247790: 928340 keys, 37506506 bytes, temperature: kWarm 2024/11/23-06:03:53.188429 140024995214912 EVENT_LOG_v1 {"time_micros": 1732313033188396, "cf_name": "default", "job": 20694, "event": "table_file_creation", "file_number": 247790, "file_size": 37506506, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3516470397, "largest_seqno": 3825361704, "table_properties": {"data_size": 31277712, "index_size": 1777600, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25993520, "raw_average_key_size": 28, "raw_value_size": 108224304, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 928340, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732313029, "oldest_key_time": 0, "file_creation_time": 1732313029, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 247790, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-06:03:53.224710 140024995214912 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-20694/att-00/247791.sst) /dev/shm/ToplingTemp/Topling-429286-PwFw9K 2024/11/23-06:03:54.113418 140024995214912 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-20694/att-00/247791.sst): first pass time = 0.89's, 151.032'MB/sec 2024/11/23-06:03:55.581982 140024995214912 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-20694/att-00/247791.sst): old prealloc_size = 147639500, real_size = 33067552 2024/11/23-06:03:55.582522 140024995214912 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-20694/att-00/247791.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 928397 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0311 GB avg-val = 116.57 avg-zval = 33.47 2024/11/23-06:03:55.583335 140024995214912 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-20694/att-00/247791.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-06:03:56.528331 140024995214912 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-20694/att-00/247791.sst): second pass time = 1.47's, 73.750'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.95's, 39.401'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3404.202'MB/sec (index lex order gen) rebuild zvType time = 0.82's, 0.283'MB/sec write SST data time = 0.13's, 298.025'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 33781.734'MB/sec zip my value time = 1.47's, unzip length = 0.108'GB zip my value throughput = 73.750'MB/sec zip pipeline throughput = 73.750'MB/sec entries = 928397 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.57 avg-zval = 33.47 usrkeys = 928397 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.57 avg-zval = 33.47 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 928397 bytes = 3365456 } seq expand size = 6498779 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0311 GB dict = 1.08 MB all = 0.0373 GB } UnZip/Zip{ index = 10.5114 value = 3.4833 dict = 1.00 all = 3.5996 } Zip/UnZip{ index = 0.0951 value = 0.2871 dict = 1.00 all = 0.2778 } ---------------------------- total value len = 1.019515 GB avg = 0.120 KB (by entry num) total key len = 0.238301 GB avg = 0.028 KB total ukey len = 0.170215 GB avg = 0.020 KB total ukey num = 0.008510761 Billion total entry num = 0.008510761 Billion write speed all = 0.016486566 MB/sec (with seq num) write speed all = 0.015594142 MB/sec (without seq num) 2024/11/23-06:03:56.561188 140024995214912 [compaction_job.cc:1948] [default] [JOB 20694] Generated table #247791: 928397 keys, 37286434 bytes, temperature: kWarm 2024/11/23-06:03:56.561260 140024995214912 EVENT_LOG_v1 {"time_micros": 1732313036561227, "cf_name": "default", "job": 20694, "event": "table_file_creation", "file_number": 247791, "file_size": 37286434, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3369353416, "largest_seqno": 3825361082, "table_properties": {"data_size": 31068816, "index_size": 1766464, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25995116, "raw_average_key_size": 28, "raw_value_size": 108222638, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 928397, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732313033, "oldest_key_time": 0, "file_creation_time": 1732313033, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 247791, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-06:03:56.597246 140024995214912 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-20694/att-00/247792.sst) /dev/shm/ToplingTemp/Topling-429286-UOa53K 2024/11/23-06:03:57.501040 140024995214912 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-20694/att-00/247792.sst): first pass time = 0.90's, 148.511'MB/sec 2024/11/23-06:03:58.970372 140024995214912 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-20694/att-00/247792.sst): old prealloc_size = 147639500, real_size = 32985056 2024/11/23-06:03:58.970939 140024995214912 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-20694/att-00/247792.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 930256 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1082 GB zip-val = 0.0310 GB avg-val = 116.28 avg-zval = 33.29 2024/11/23-06:03:58.971640 140024995214912 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-20694/att-00/247792.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-06:03:59.847056 140024995214912 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-20694/att-00/247792.sst): second pass time = 1.47's, 73.655'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.88's, 41.964'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3283.700'MB/sec (index lex order gen) rebuild zvType time = 0.75's, 0.311'MB/sec write SST data time = 0.13's, 288.962'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 34628.936'MB/sec zip my value time = 1.47's, unzip length = 0.108'GB zip my value throughput = 73.655'MB/sec zip pipeline throughput = 73.655'MB/sec entries = 930256 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.28 avg-zval = 33.29 usrkeys = 930256 avg-key = 20.00 avg-zkey = 1.91 avg-val = 121.90 avg-zval = 33.29 TagRS{ kinds = RS_Key0_TagN bytes = 145440 } TagArray{ size = 747259 bytes = 2802240 } seq expand size = 5230813 multi value expand size = 0 cnt WriteAppend = 16 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0310 GB dict = 1.08 MB all = 0.0368 GB } UnZip/Zip{ index = 10.4476 value = 3.4926 dict = 1.00 all = 3.6483 } Zip/UnZip{ index = 0.0957 value = 0.2863 dict = 1.00 all = 0.2741 } ---------------------------- total value len = 1.132917 GB avg = 0.120 KB (by entry num) total key len = 0.264348 GB avg = 0.028 KB total ukey len = 0.188820 GB avg = 0.020 KB total ukey num = 0.009441017 Billion total entry num = 0.009441017 Billion write speed all = 0.018313562 MB/sec (with seq num) write speed all = 0.017323636 MB/sec (without seq num) 2024/11/23-06:03:59.881095 140024995214912 [compaction_job.cc:1948] [default] [JOB 20694] Generated table #247792: 930256 keys, 36788630 bytes, temperature: kWarm 2024/11/23-06:03:59.881160 140024995214912 EVENT_LOG_v1 {"time_micros": 1732313039881127, "cf_name": "default", "job": 20694, "event": "table_file_creation", "file_number": 247792, "file_size": 36788630, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3825360466, "table_properties": {"data_size": 30971536, "index_size": 1780800, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26047168, "raw_average_key_size": 28, "raw_value_size": 108170604, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 930256, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732313036, "oldest_key_time": 0, "file_creation_time": 1732313036, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 247792, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-06:03:59.916603 140024995214912 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-20694/att-00/247793.sst) /dev/shm/ToplingTemp/Topling-429286-dTVVOO 2024/11/23-06:04:00.811607 140024995214912 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-20694/att-00/247793.sst): first pass time = 0.89's, 149.969'MB/sec 2024/11/23-06:04:02.224131 140024995214912 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-20694/att-00/247793.sst): old prealloc_size = 147639500, real_size = 30478864 2024/11/23-06:04:02.224672 140024995214912 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-20694/att-00/247793.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 928364 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.93 raw-val = 0.1082 GB zip-val = 0.0285 GB avg-val = 116.57 avg-zval = 30.65 2024/11/23-06:04:02.225502 140024995214912 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-20694/att-00/247793.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-06:04:03.068503 140024995214912 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-20694/att-00/247793.sst): second pass time = 1.41's, 76.655'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.84's, 41.229'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3514.980'MB/sec (index lex order gen) rebuild zvType time = 0.72's, 0.324'MB/sec write SST data time = 0.13's, 274.873'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 33055.935'MB/sec zip my value time = 1.41's, unzip length = 0.108'GB zip my value throughput = 76.655'MB/sec zip pipeline throughput = 76.655'MB/sec entries = 928364 avg-key = 28.00 avg-zkey = 1.93 avg-val = 116.57 avg-zval = 30.65 usrkeys = 928364 avg-key = 20.00 avg-zkey = 1.93 avg-val = 123.57 avg-zval = 30.65 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 928364 bytes = 3481376 } seq expand size = 6498548 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0285 GB dict = 1.08 MB all = 0.0348 GB } UnZip/Zip{ index = 10.3771 value = 3.8030 dict = 1.00 all = 3.8555 } Zip/UnZip{ index = 0.0964 value = 0.2629 dict = 1.00 all = 0.2594 } ---------------------------- total value len = 1.247639 GB avg = 0.120 KB (by entry num) total key len = 0.290343 GB avg = 0.028 KB total ukey len = 0.207388 GB avg = 0.020 KB total ukey num = 0.010369381 Billion total entry num = 0.010369381 Billion write speed all = 0.020157040 MB/sec (with seq num) write speed all = 0.019069818 MB/sec (without seq num) 2024/11/23-06:04:03.098012 140024995214912 [compaction_job.cc:1948] [default] [JOB 20694] Generated table #247793: 928364 keys, 34811818 bytes, temperature: kWarm 2024/11/23-06:04:03.098076 140024995214912 EVENT_LOG_v1 {"time_micros": 1732313043098044, "cf_name": "default", "job": 20694, "event": "table_file_creation", "file_number": 247793, "file_size": 34811818, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3282133760, "largest_seqno": 3825361843, "table_properties": {"data_size": 28457344, "index_size": 1789248, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25994192, "raw_average_key_size": 28, "raw_value_size": 108223556, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 928364, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732313039, "oldest_key_time": 0, "file_creation_time": 1732313039, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 247793, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-06:04:03.133873 140024995214912 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-20694/att-00/247794.sst) /dev/shm/ToplingTemp/Topling-429286-jtukOM 2024/11/23-06:04:04.025464 140024995214912 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-20694/att-00/247794.sst): first pass time = 0.89's, 150.543'MB/sec 2024/11/23-06:04:05.473526 140024995214912 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-20694/att-00/247794.sst): old prealloc_size = 147639500, real_size = 33331520 2024/11/23-06:04:05.474093 140024995214912 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-20694/att-00/247794.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 926141 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0313 GB avg-val = 116.92 avg-zval = 33.84 2024/11/23-06:04:05.474902 140024995214912 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-20694/att-00/247794.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-06:04:06.419313 140024995214912 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-20694/att-00/247794.sst): second pass time = 1.45's, 74.841'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.95's, 39.696'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3128.833'MB/sec (index lex order gen) rebuild zvType time = 0.82's, 0.282'MB/sec write SST data time = 0.13's, 299.125'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 34440.746'MB/sec zip my value time = 1.45's, unzip length = 0.108'GB zip my value throughput = 74.841'MB/sec zip pipeline throughput = 74.841'MB/sec entries = 926141 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.92 avg-zval = 33.84 usrkeys = 926141 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.92 avg-zval = 33.84 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 926141 bytes = 3357280 } seq expand size = 6482987 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0313 GB dict = 1.08 MB all = 0.0375 GB } UnZip/Zip{ index = 10.5152 value = 3.4554 dict = 1.00 all = 3.5750 } Zip/UnZip{ index = 0.0951 value = 0.2894 dict = 1.00 all = 0.2797 } ---------------------------- total value len = 1.362408 GB avg = 0.121 KB (by entry num) total key len = 0.316275 GB avg = 0.028 KB total ukey len = 0.225910 GB avg = 0.020 KB total ukey num = 0.011295522 Billion total entry num = 0.011295522 Billion write speed all = 0.022000122 MB/sec (with seq num) write speed all = 0.020815846 MB/sec (without seq num) 2024/11/23-06:04:06.458415 140024995214912 [compaction_job.cc:1948] [default] [JOB 20694] Generated table #247794: 926141 keys, 37543354 bytes, temperature: kWarm 2024/11/23-06:04:06.458479 140024995214912 EVENT_LOG_v1 {"time_micros": 1732313046458448, "cf_name": "default", "job": 20694, "event": "table_file_creation", "file_number": 247794, "file_size": 37543354, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3480997236, "largest_seqno": 3825361858, "table_properties": {"data_size": 31338288, "index_size": 1761536, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25931948, "raw_average_key_size": 28, "raw_value_size": 108285842, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 926141, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732313043, "oldest_key_time": 0, "file_creation_time": 1732313043, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 247794, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-06:04:06.493344 140024995214912 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-20694/att-00/247795.sst) /dev/shm/ToplingTemp/Topling-429286-5gIkLM 2024/11/23-06:04:07.493921 140024995214912 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-20694/att-00/247795.sst): first pass time = 1.00's, 134.146'MB/sec 2024/11/23-06:04:08.850440 140024995214912 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-20694/att-00/247795.sst): old prealloc_size = 147639500, real_size = 32769120 2024/11/23-06:04:08.851026 140024995214912 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-20694/att-00/247795.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 932393 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1081 GB zip-val = 0.0308 GB avg-val = 115.95 avg-zval = 32.98 2024/11/23-06:04:08.851813 140024995214912 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-20694/att-00/247795.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-06:04:09.810243 140024995214912 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-20694/att-00/247795.sst): second pass time = 1.36's, 79.742'MB/sec, value only(80.5% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.96's, 38.428'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3166.133'MB/sec (index lex order gen) rebuild zvType time = 0.83's, 0.281'MB/sec write SST data time = 0.13's, 286.718'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 36731.666'MB/sec zip my value time = 1.36's, unzip length = 0.108'GB zip my value throughput = 79.742'MB/sec zip pipeline throughput = 79.742'MB/sec entries = 932393 avg-key = 28.00 avg-zkey = 1.92 avg-val = 115.95 avg-zval = 32.98 usrkeys = 932393 avg-key = 20.00 avg-zkey = 1.92 avg-val = 122.95 avg-zval = 32.98 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 932393 bytes = 3263392 } seq expand size = 6526751 multi value expand size = 0 cnt WriteAppend = 15 UnZipSize{ index = 0.0186 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0308 GB dict = 1.08 MB all = 0.0369 GB } UnZip/Zip{ index = 10.4431 value = 3.5158 dict = 1.00 all = 3.6390 } Zip/UnZip{ index = 0.0958 value = 0.2844 dict = 1.00 all = 0.2748 } ---------------------------- total value len = 1.477045 GB avg = 0.121 KB (by entry num) total key len = 0.342382 GB avg = 0.028 KB total ukey len = 0.244558 GB avg = 0.020 KB total ukey num = 0.012227915 Billion total entry num = 0.012227915 Billion write speed all = 0.023843601 MB/sec (with seq num) write speed all = 0.022561626 MB/sec (without seq num) 2024/11/23-06:04:09.844574 140024995214912 [compaction_job.cc:1948] [default] [JOB 20694] Generated table #247795: 932393 keys, 36883118 bytes, temperature: kWarm 2024/11/23-06:04:09.844639 140024995214912 EVENT_LOG_v1 {"time_micros": 1732313049844606, "cf_name": "default", "job": 20694, "event": "table_file_creation", "file_number": 247795, "file_size": 36883118, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3604582272, "largest_seqno": 3825361891, "table_properties": {"data_size": 30750160, "index_size": 1785664, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26107004, "raw_average_key_size": 28, "raw_value_size": 108110726, "raw_average_value_size": 115, "num_data_blocks": 1, "num_entries": 932393, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732313046, "oldest_key_time": 0, "file_creation_time": 1732313046, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 247795, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-06:04:09.885406 140024995214912 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-20694/att-00/247796.sst) /dev/shm/ToplingTemp/Topling-429286-iYDMrN 2024/11/23-06:04:10.165544 140024995214912 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-20694/att-00/247796.sst): first pass time = 0.28's, 248.482'MB/sec 2024/11/23-06:04:11.051627 140024995214912 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-20694/att-00/247796.sst): old prealloc_size = 147639500, real_size = 18716272 2024/11/23-06:04:11.051970 140024995214912 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-20694/att-00/247796.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 481623 prefix = 4 raw-key = 0.0077 GB zip-key = 0.0009 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.0561 GB zip-val = 0.0177 GB avg-val = 116.51 avg-zval = 36.71 2024/11/23-06:04:11.052428 140024995214912 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-20694/att-00/247796.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0011 GB, waited 0.000 sec, Key+Value = 0.070 GB 2024/11/23-06:04:11.523606 140024995214912 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-20694/att-00/247796.sst): second pass time = 0.89's, 63.373'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.47's, 44.298'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2852.638'MB/sec (index lex order gen) rebuild zvType time = 0.41's, 0.297'MB/sec write SST data time = 0.07's, 315.972'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.562'MB, throughput = 13896.901'MB/sec zip my value time = 0.89's, unzip length = 0.056'GB zip my value throughput = 63.373'MB/sec zip pipeline throughput = 141.723'MB/sec entries = 481623 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.51 avg-zval = 36.71 usrkeys = 481623 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.51 avg-zval = 36.71 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 481623 bytes = 1745904 } seq expand size = 3371361 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0096 GB value = 0.0561 GB dict = 0.56 MB all = 0.0696 GB } __ZipSize{ index = 0.0009 GB value = 0.0177 GB dict = 0.56 MB all = 0.0209 GB } UnZip/Zip{ index = 10.5044 value = 3.1741 dict = 1.00 all = 3.3290 } Zip/UnZip{ index = 0.0952 value = 0.3151 dict = 1.00 all = 0.3004 } ---------------------------- total value len = 1.536530 GB avg = 0.121 KB (by entry num) total key len = 0.355867 GB avg = 0.028 KB total ukey len = 0.254191 GB avg = 0.020 KB total ukey num = 0.012709538 Billion total entry num = 0.012709538 Billion write speed all = 0.024799324 MB/sec (with seq num) write speed all = 0.023466886 MB/sec (without seq num) 2024/11/23-06:04:11.545005 140024995214912 [compaction_job.cc:1948] [default] [JOB 20694] Generated table #247796: 481623 keys, 20907169 bytes, temperature: kWarm 2024/11/23-06:04:11.545075 140024995214912 EVENT_LOG_v1 {"time_micros": 1732313051545044, "cf_name": "default", "job": 20694, "event": "table_file_creation", "file_number": 247796, "file_size": 20907169, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3485447251, "largest_seqno": 3825362055, "table_properties": {"data_size": 17678688, "index_size": 916992, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 13485444, "raw_average_key_size": 28, "raw_value_size": 56113770, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 481623, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732313049, "oldest_key_time": 0, "file_creation_time": 1732313049, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 247796, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-06:04:11.562114 140024995214912 [compaction_job.cc:703] job-20694: subcompact[0], size: 0.503992 G, files: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-20694/att-00 [247783,247784,247785,247786,247787,247788,247789,247790,247791,247792,247793,247794,247795,247796] 2024/11/23-06:04:11.654364 140024995214912 (Original Log Time 2024/11/23-06:03:24.485938) EVENT_LOG_v1 {"time_micros": 1732313004485899, "job": 20694, "event": "compaction_started", "compaction_reason": "FilesMarkedForCompaction", "files_L2": [247740], "files_L3": [247764, 247660, 247661, 247662, 247663, 247676, 247677, 247678, 247679, 247680, 247681, 247682, 247683, 247775], "score": 0.999247, "input_data_size": 523463328, "oldest_snapshot_seqno": 3825560879} 2024/11/23-06:04:11.654367 140024995214912 (Original Log Time 2024/11/23-06:04:11.653585) [compaction_job.cc:2022] [default] [JOB 20694] Compacted 1@2 + 14@3 files to L3 => 503991905 bytes 2024/11/23-06:04:11.654369 140024995214912 (Original Log Time 2024/11/23-06:04:11.654300) [compaction_job.cc:1224] [default] compacted to: files[0 0 0 14 0 0 0] max score 0.02, MB/sec: 11.1 rd, 10.7 wr, level 3, files in(1, 14) out(14 +0 blob) MB in(27.1, 472.1 +0.0 blob) out(480.6 +0.0 blob), read-write-amplify(36.1) write-amplify(17.7) OK, records in: 12780983, records dropped: 71445 output_compression: Snappy 2024/11/23-06:04:11.654375 140024995214912 (Original Log Time 2024/11/23-06:04:11.654344) EVENT_LOG_v1 {"time_micros": 1732313051654323, "cf": "default", "job": 20694, "event": "compaction_finished", "compaction_time_micros": 47076183, "compaction_time_cpu_micros": 20337952, "output_level": 3, "num_output_files": 14, "total_output_size": 503991905, "num_input_records": 12780983, "num_output_records": 12709538, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "file_write_nanos": 330270183, "file_range_sync_nanos": 0, "file_fsync_nanos": 12812, "file_prepare_write_nanos": 32893, "lsm_state": [0, 0, 0, 14, 0, 0, 0]} 2024/11/23-06:04:11.781705 140024995214912 DEBG dcompact_worker.cpp:240: HttpPost: 200 OK: url = http://nlb-7zny4kaa1poal01o64.cn-shenzhen.nlb.aliyuncs.com:8443, body = {"instanceId":"nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137","labourId":"","dbId":"d89b4006-2803-486e-b7a2-759bcf348921","dbStarts":1732256054,"starts":1732313004,"executesMs":47286,"compactionJobId":20694,"attempt":0,"compactionInputRawBytes":1824575667,"compactionInputZipBytes":523463328,"compactionOutputRawBytes":0,"compactionOutputZipBytes":503991905,"headers":{"Accept":"*/*","Connection":"close","Host":"aliyun-topling-saas.topling.cn:18443","RemoteIp":"120.24.192.169","X-Forwarded-For":"120.24.192.169","region":"cn-shenzhen","token":"e6474c481bd4415abc537135cc03626b","instance-token":"e6474c481bd4415abc537135cc03626b","provider":"aliyun","CloudMarketInstanceId":"si-59c0ae5c955845588903","MeteringAssit":"","Transfer-Encoding":"chunked","traceparent":"00-f5ac6b92e7e3d2f00bd22d23aed55cb0-c2fff269ae1e3103-00"}}, response = 2024/11/23-06:04:11.781796 140024995214912 INFO dcompact_worker.cpp:1459: finish /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-20694/att-00: olev 3, work 47.287 s, result 6.301 ms, install 0.807 ms, input{raw 1.699 GiB zip 499.214 MiB}