2024/11/20-13:59:14.067158 140257651189312 DEBG dcompact_worker.cpp:2219: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08542/att-00: fork to child time = 0.008171 sec 2024/11/20-13:59:14.067615 140257651189312 DEBG dcompact_worker.cpp:1013: Beg SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08542/att-00 2024/11/20-13:59:14.073940 140257651189312 DEBG dcompact_worker.cpp:1033: End SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08542/att-00 2024/11/20-13:59:14.075592 140257651189312 TRAC dcompact_worker.cpp:1083: INFO_LOG_LEVEL: rpc = INFO_LEVEL, env_var = undefined 2024/11/20-13:59:14.075789 140257651189312 [WARN] [column_family.cc:386] multiple cf_paths/db_paths and level_compaction_dynamic_level_bytes can't be used together 2024/11/20-13:59:14.132384 140257651189312 [version_set.cc:6211] Recovering from manifest file: /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-20T12.20.00/.rocksdb/job-08542/att-00/MANIFEST-019309 2024/11/20-13:59:14.147307 140257651189312 [version_set.cc:6254] Recovered from manifest file:/worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-20T12.20.00/.rocksdb/job-08542/att-00/MANIFEST-019309 succeeded,manifest_file_number is 19309, next_file_number is 32575, last_sequence is 599621958, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 32424 2024/11/20-13:59:14.147312 140257651189312 [version_set.cc:6269] Column family [default] (ID 0), log number is 0 2024/11/20-13:59:14.147371 140257651189312 [version_set.cc:5724] Creating manifest 32575 2024/11/20-13:59:14.194696 140257651189312 DEBG dcompact_worker.cpp:1225: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08542/att-00: bottommost_level: fake = 1, rpc = 0 2024/11/20-13:59:14.215748 140257651189312 [compaction_job.cc:2437] [default] [JOB 8542] Compacting 1@2 + 14@3 files to L3, score 0.98, subcompactions 1 : 1 2024/11/20-13:59:14.215759 140257651189312 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 7680 Base level 2, inputs: [32537(27MB)], [32572(37MB) 32573(5239KB) 32518(38MB) 32520(38MB) 32522(38MB) 32524(37MB) 32526(36MB) 32528(35MB) 32529(36MB) 32530(38MB) 32531(36MB) 32532(38MB) 32533(37MB) 32558(37MB)] 2024/11/20-13:59:14.221856 140257651189312 [top_zip_table.cc:59] core git_version_hash_info_is:commit 81964c21ebbcc178d8e99dae0fbf61bded2729cc Author: rockeet Date: Mon Nov 11 21:28:46 2024 +0800 Makefile: fix gen git-version-*.cpp GIT_PATH_ARG = :!src/terark/fsa :!tools/fsa :!src/terark/zbs :!tools/zbs g++ (GCC) 12.2.1 20221121 (Red Hat 12.2.1-7) Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/zstd -Iboost-include DEFS = -DTOPLING_IO_WITH_URING=1 -DDIVSUFSORT_API= CXXFLAGS = -fPIC -time -fdiagnostics-color -mcx16 -fno-stack-protector WARNINGS = -Wno-class-memaccess -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -Wno-deprecated-declarations -Wstrict-aliasing=3 RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 LDFLAGS = -fPIC -rdynamic 2024/11/20-13:59:14.221874 140257651189312 [top_zip_table.cc:60] fsa git_version_hash_info_is:commit 5dfecb7d107196f044ff5bf78dc39d2e725b9d9b Author: leipeng Date: Thu Nov 7 15:22:45 2024 +0800 Makefile: fix for x86_64 CPU older than haswell GIT_PATH_ARG = src/terark/fsa tools/fsa g++ (GCC) 12.2.1 20221121 (Red Hat 12.2.1-7) Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/zstd -Iboost-include DEFS = -DTOPLING_IO_WITH_URING=1 -DDIVSUFSORT_API= CXXFLAGS = -fPIC -time -fdiagnostics-color -mcx16 -fno-stack-protector WARNINGS = -Wno-class-memaccess -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -Wno-deprecated-declarations -Wstrict-aliasing=3 RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 LDFLAGS = -fPIC -rdynamic 2024/11/20-13:59:14.221888 140257651189312 [top_zip_table.cc:61] zbs git_version_hash_info_is:commit d44dd5ff72707128fe3c916077b43d2093c01f7c Author: leipeng Date: Sun Oct 27 23:38:26 2024 +0800 Fix for msvc, when toplingdb on msvc GIT_PATH_ARG = src/terark/zbs tools/zbs g++ (GCC) 12.2.1 20221121 (Red Hat 12.2.1-7) Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/zstd -Iboost-include DEFS = -DTOPLING_IO_WITH_URING=1 -DDIVSUFSORT_API= CXXFLAGS = -fPIC -time -fdiagnostics-color -mcx16 -fno-stack-protector WARNINGS = -Wno-class-memaccess -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -Wno-deprecated-declarations -Wstrict-aliasing=3 RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 LDFLAGS = -fPIC -rdynamic 2024/11/20-13:59:14.221894 140257651189312 [top_zip_table.cc:62] topling-zip_table_reader: git_version_hash_info_is: commit 79614a7e7dc27362fc5151b0797eb7d83c674c7b Author: rockeet Date: Sun Nov 10 15:02:21 2024 +0800 cpu_has_bmi2.sh: detect by compile c++ code check __BMI2__ g++ (GCC) 12.2.1 20221121 (Red Hat 12.2.1-7) Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/20-13:59:14.221903 140257651189312 [top_zip_table.cc:64] topling-rocks git_version_hash_info_is: commit c46b65a52d9c74aa8b87aeb8438620ff2dbc669c Author: rockeet Date: Sun Nov 10 15:02:42 2024 +0800 cpu_has_bmi2.sh: detect by compile c++ code check __BMI2__ g++ (GCC) 12.2.1 20221121 (Red Hat 12.2.1-7) Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/20-13:59:14.800193 140257651189312 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08542/att-00/032576.sst) /dev/shm/ToplingTemp/Topling-265746-e7snRD 2024/11/20-13:59:15.659899 140257651189312 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08542/att-00/032576.sst): first pass time = 0.86's, 156.130'MB/sec 2024/11/20-13:59:16.960911 140257651189312 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08542/att-00/032576.sst): old prealloc_size = 147639500, real_size = 36554000 2024/11/20-13:59:16.961469 140257651189312 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08542/att-00/032576.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 925642 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.93 raw-val = 0.1083 GB zip-val = 0.0345 GB avg-val = 117.00 avg-zval = 37.31 2024/11/20-13:59:16.961975 140257651189312 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08542/att-00/032576.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-13:59:17.718286 140257651189312 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08542/att-00/032576.sst): second pass time = 1.30's, 83.305'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.76's, 51.726'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3343.250'MB/sec (index lex order gen) rebuild zvType time = 0.63's, 0.366'MB/sec write SST data time = 0.12's, 314.817'MB/sec dict compress time = 7793265246.25's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 28232.124'MB/sec zip my value time = 1.30's, unzip length = 0.108'GB zip my value throughput = 83.305'MB/sec zip pipeline throughput = 83.305'MB/sec entries = 925642 avg-key = 28.00 avg-zkey = 1.93 avg-val = 117.00 avg-zval = 37.31 usrkeys = 925642 avg-key = 20.00 avg-zkey = 1.93 avg-val = 120.50 avg-zval = 37.31 TagRS{ kinds = RS_Key0_TagN bytes = 144720 } TagArray{ size = 462704 bytes = 1619472 } seq expand size = 3238928 multi value expand size = 0 cnt WriteAppend = 17 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0345 GB dict = 1.08 MB all = 0.0392 GB } UnZip/Zip{ index = 10.3757 value = 3.1357 dict = 1.00 all = 3.4260 } Zip/UnZip{ index = 0.0964 value = 0.3189 dict = 1.00 all = 0.2919 } ---------------------------- total value len = 0.111539 GB avg = 0.120 KB (by entry num) total key len = 0.025918 GB avg = 0.028 KB total ukey len = 0.018513 GB avg = 0.020 KB total ukey num = 0.000925642 Billion total entry num = 0.000925642 Billion write speed all = 0.007352246 MB/sec (with seq num) write speed all = 0.006956162 MB/sec (without seq num) 2024/11/20-13:59:17.766062 140257651189312 [compaction_job.cc:1948] [default] [JOB 8542] Generated table #32576: 925642 keys, 39176545 bytes, temperature: kWarm 2024/11/20-13:59:17.766145 140257651189312 EVENT_LOG_v1 {"time_micros": 1732082357766106, "cf_name": "default", "job": 8542, "event": "table_file_creation", "file_number": 32576, "file_size": 39176545, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 598111865, "table_properties": {"data_size": 34538176, "index_size": 1784256, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25917976, "raw_average_key_size": 28, "raw_value_size": 108299796, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 925642, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732082354, "oldest_key_time": 0, "file_creation_time": 1732082354, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "92E45FH6K6HCJOD41QCQ", "orig_file_number": 32576, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-13:59:17.804618 140257651189312 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08542/att-00/032577.sst) /dev/shm/ToplingTemp/Topling-265746-QrSEJF 2024/11/20-13:59:18.845211 140257651189312 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08542/att-00/032577.sst): first pass time = 1.04's, 128.988'MB/sec 2024/11/20-13:59:20.268059 140257651189312 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08542/att-00/032577.sst): old prealloc_size = 147639500, real_size = 36181968 2024/11/20-13:59:20.268793 140257651189312 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08542/att-00/032577.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 923883 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.94 raw-val = 0.1083 GB zip-val = 0.0342 GB avg-val = 117.28 avg-zval = 36.97 2024/11/20-13:59:20.269578 140257651189312 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08542/att-00/032577.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-13:59:21.196534 140257651189312 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08542/att-00/032577.sst): second pass time = 1.42's, 76.202'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.93's, 42.998'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2528.126'MB/sec (index lex order gen) rebuild zvType time = 0.77's, 0.300'MB/sec write SST data time = 0.16's, 254.342'MB/sec dict compress time = 141538.05's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.082'MB, throughput = 31551.481'MB/sec zip my value time = 1.42's, unzip length = 0.108'GB zip my value throughput = 76.202'MB/sec zip pipeline throughput = 139.621'MB/sec entries = 923883 avg-key = 28.00 avg-zkey = 1.94 avg-val = 117.28 avg-zval = 36.97 usrkeys = 923883 avg-key = 20.00 avg-zkey = 1.94 avg-val = 123.20 avg-zval = 36.97 TagRS{ kinds = RS_Key0_TagN bytes = 144440 } TagArray{ size = 781645 bytes = 2735776 } seq expand size = 5471515 multi value expand size = 0 cnt WriteAppend = 35 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0342 GB dict = 1.08 MB all = 0.0399 GB } UnZip/Zip{ index = 10.3082 value = 3.1720 dict = 1.00 all = 3.3619 } Zip/UnZip{ index = 0.0970 value = 0.3153 dict = 1.00 all = 0.2974 } ---------------------------- total value len = 0.225359 GB avg = 0.122 KB (by entry num) total key len = 0.051787 GB avg = 0.028 KB total ukey len = 0.036991 GB avg = 0.020 KB total ukey num = 0.001849525 Billion total entry num = 0.001849525 Billion write speed all = 0.014821154 MB/sec (with seq num) write speed all = 0.014029886 MB/sec (without seq num) 2024/11/20-13:59:21.251566 140257651189312 [compaction_job.cc:1948] [default] [JOB 8542] Generated table #32577: 923883 keys, 39922934 bytes, temperature: kWarm 2024/11/20-13:59:21.251634 140257651189312 EVENT_LOG_v1 {"time_micros": 1732082361251603, "cf_name": "default", "job": 8542, "event": "table_file_creation", "file_number": 32577, "file_size": 39922934, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 598111178, "table_properties": {"data_size": 34158272, "index_size": 1792512, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25868724, "raw_average_key_size": 28, "raw_value_size": 108349130, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 923883, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732082357, "oldest_key_time": 0, "file_creation_time": 1732082357, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "92E45FH6K6HCJOD41QCQ", "orig_file_number": 32577, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-13:59:21.285019 140257651189312 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08542/att-00/032578.sst) /dev/shm/ToplingTemp/Topling-265746-Wr6HqF 2024/11/20-13:59:22.190311 140257651189312 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08542/att-00/032578.sst): first pass time = 0.91's, 148.268'MB/sec 2024/11/20-13:59:23.620646 140257651189312 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08542/att-00/032578.sst): old prealloc_size = 147639500, real_size = 35677568 2024/11/20-13:59:23.621206 140257651189312 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08542/att-00/032578.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 922219 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1084 GB zip-val = 0.0337 GB avg-val = 117.54 avg-zval = 36.53 2024/11/20-13:59:23.621934 140257651189312 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08542/att-00/032578.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-13:59:24.548363 140257651189312 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08542/att-00/032578.sst): second pass time = 1.43's, 75.819'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.93's, 42.583'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3243.487'MB/sec (index lex order gen) rebuild zvType time = 0.80's, 0.288'MB/sec write SST data time = 0.13's, 311.540'MB/sec dict compress time = 140278.07's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.083'MB, throughput = 34541.780'MB/sec zip my value time = 1.43's, unzip length = 0.108'GB zip my value throughput = 75.819'MB/sec zip pipeline throughput = 167.890'MB/sec entries = 922219 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.54 avg-zval = 36.53 usrkeys = 922219 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.13 avg-zval = 36.53 TagRS{ kinds = RS_Key0_TagN bytes = 144200 } TagArray{ size = 868855 bytes = 2823792 } seq expand size = 6081985 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0184 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0337 GB dict = 1.08 MB all = 0.0395 GB } UnZip/Zip{ index = 10.5126 value = 3.2172 dict = 1.00 all = 3.3975 } Zip/UnZip{ index = 0.0951 value = 0.3108 dict = 1.00 all = 0.2943 } ---------------------------- total value len = 0.339837 GB avg = 0.123 KB (by entry num) total key len = 0.077609 GB avg = 0.028 KB total ukey len = 0.055435 GB avg = 0.020 KB total ukey num = 0.002771744 Billion total entry num = 0.002771744 Billion write speed all = 0.022320070 MB/sec (with seq num) write speed all = 0.021134469 MB/sec (without seq num) 2024/11/20-13:59:24.603125 140257651189312 [compaction_job.cc:1948] [default] [JOB 8542] Generated table #32578: 922219 keys, 39504352 bytes, temperature: kWarm 2024/11/20-13:59:24.603190 140257651189312 EVENT_LOG_v1 {"time_micros": 1732082364603160, "cf_name": "default", "job": 8542, "event": "table_file_creation", "file_number": 32578, "file_size": 39504352, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 598111219, "table_properties": {"data_size": 33692336, "index_size": 1754496, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25822132, "raw_average_key_size": 28, "raw_value_size": 108395614, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 922219, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732082361, "oldest_key_time": 0, "file_creation_time": 1732082361, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "92E45FH6K6HCJOD41QCQ", "orig_file_number": 32578, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-13:59:24.640587 140257651189312 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08542/att-00/032579.sst) /dev/shm/ToplingTemp/Topling-265746-xgWyVD 2024/11/20-13:59:25.585836 140257651189312 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08542/att-00/032579.sst): first pass time = 0.95's, 141.998'MB/sec 2024/11/20-13:59:26.870798 140257651189312 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08542/att-00/032579.sst): old prealloc_size = 147639500, real_size = 35830624 2024/11/20-13:59:26.871372 140257651189312 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08542/att-00/032579.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 922242 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1084 GB zip-val = 0.0338 GB avg-val = 117.53 avg-zval = 36.70 2024/11/20-13:59:26.872540 140257651189312 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08542/att-00/032579.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-13:59:27.697538 140257651189312 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08542/att-00/032579.sst): second pass time = 1.28's, 84.403'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.83's, 48.005'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3170.410'MB/sec (index lex order gen) rebuild zvType time = 0.70's, 0.328'MB/sec write SST data time = 0.12's, 324.613'MB/sec dict compress time = 140278.07's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.083'MB, throughput = 21523.844'MB/sec zip my value time = 1.28's, unzip length = 0.108'GB zip my value throughput = 84.403'MB/sec zip pipeline throughput = 84.403'MB/sec entries = 922242 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.53 avg-zval = 36.70 usrkeys = 922242 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.53 avg-zval = 36.70 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 922242 bytes = 2997296 } seq expand size = 6455694 multi value expand size = 0 cnt WriteAppend = 11 UnZipSize{ index = 0.0184 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0338 GB dict = 1.08 MB all = 0.0397 GB } UnZip/Zip{ index = 10.5114 value = 3.2027 dict = 1.00 all = 3.3820 } Zip/UnZip{ index = 0.0951 value = 0.3122 dict = 1.00 all = 0.2957 } ---------------------------- total value len = 0.454688 GB avg = 0.123 KB (by entry num) total key len = 0.103432 GB avg = 0.028 KB total ukey len = 0.073880 GB avg = 0.020 KB total ukey num = 0.003693986 Billion total entry num = 0.003693986 Billion write speed all = 0.029836604 MB/sec (with seq num) write speed all = 0.028256784 MB/sec (without seq num) 2024/11/20-13:59:27.751446 140257651189312 [compaction_job.cc:1948] [default] [JOB 8542] Generated table #32579: 922242 keys, 39686404 bytes, temperature: kWarm 2024/11/20-13:59:27.751506 140257651189312 EVENT_LOG_v1 {"time_micros": 1732082367751477, "cf_name": "default", "job": 8542, "event": "table_file_creation", "file_number": 32579, "file_size": 39686404, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 542657290, "largest_seqno": 598111629, "table_properties": {"data_size": 33845136, "index_size": 1754752, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25822776, "raw_average_key_size": 28, "raw_value_size": 108395036, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 922242, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732082364, "oldest_key_time": 0, "file_creation_time": 1732082364, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "92E45FH6K6HCJOD41QCQ", "orig_file_number": 32579, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-13:59:27.788408 140257651189312 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08542/att-00/032580.sst) /dev/shm/ToplingTemp/Topling-265746-8xbyWE 2024/11/20-13:59:28.572525 140257651189312 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08542/att-00/032580.sst): first pass time = 0.78's, 171.177'MB/sec 2024/11/20-13:59:29.770699 140257651189312 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08542/att-00/032580.sst): old prealloc_size = 147639500, real_size = 36292032 2024/11/20-13:59:29.771241 140257651189312 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08542/att-00/032580.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 924791 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0017 GB avg-key = 16.00 avg-zkey = 1.89 raw-val = 0.1083 GB zip-val = 0.0343 GB avg-val = 117.13 avg-zval = 37.10 2024/11/20-13:59:29.771718 140257651189312 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08542/att-00/032580.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-13:59:30.536224 140257651189312 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08542/att-00/032580.sst): second pass time = 1.20's, 90.466'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.77's, 50.873'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3448.837'MB/sec (index lex order gen) rebuild zvType time = 0.64's, 0.360'MB/sec write SST data time = 0.12's, 315.662'MB/sec dict compress time = 140278.07's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 33585.091'MB/sec zip my value time = 1.20's, unzip length = 0.108'GB zip my value throughput = 90.466'MB/sec zip pipeline throughput = 90.466'MB/sec entries = 924791 avg-key = 28.00 avg-zkey = 1.89 avg-val = 117.13 avg-zval = 37.10 usrkeys = 924791 avg-key = 20.00 avg-zkey = 1.89 avg-val = 120.97 avg-zval = 37.10 TagRS{ kinds = RS_Key0_TagN bytes = 144600 } TagArray{ size = 506991 bytes = 1647728 } seq expand size = 3548937 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0017 GB value = 0.0343 GB dict = 1.08 MB all = 0.0389 GB } UnZip/Zip{ index = 10.5829 value = 3.1569 dict = 1.00 all = 3.4464 } Zip/UnZip{ index = 0.0945 value = 0.3168 dict = 1.00 all = 0.2902 } ---------------------------- total value len = 0.566560 GB avg = 0.123 KB (by entry num) total key len = 0.129326 GB avg = 0.028 KB total ukey len = 0.092376 GB avg = 0.020 KB total ukey num = 0.004618777 Billion total entry num = 0.004618777 Billion write speed all = 0.037195858 MB/sec (with seq num) write speed all = 0.035220829 MB/sec (without seq num) 2024/11/20-13:59:30.587331 140257651189312 [compaction_job.cc:1948] [default] [JOB 8542] Generated table #32580: 924791 keys, 38944007 bytes, temperature: kWarm 2024/11/20-13:59:30.587393 140257651189312 EVENT_LOG_v1 {"time_micros": 1732082370587364, "cf_name": "default", "job": 8542, "event": "table_file_creation", "file_number": 32580, "file_size": 38944007, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 598111287, "table_properties": {"data_size": 34312944, "index_size": 1747712, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25894148, "raw_average_key_size": 28, "raw_value_size": 108323674, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 924791, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732082367, "oldest_key_time": 0, "file_creation_time": 1732082367, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "92E45FH6K6HCJOD41QCQ", "orig_file_number": 32580, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-13:59:30.622112 140257651189312 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08542/att-00/032581.sst) /dev/shm/ToplingTemp/Topling-265746-WCKrpH 2024/11/20-13:59:31.390648 140257651189312 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08542/att-00/032581.sst): first pass time = 0.77's, 174.648'MB/sec 2024/11/20-13:59:32.696843 140257651189312 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08542/att-00/032581.sst): old prealloc_size = 147639500, real_size = 36508240 2024/11/20-13:59:32.697421 140257651189312 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08542/att-00/032581.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 926895 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.97 raw-val = 0.1083 GB zip-val = 0.0345 GB avg-val = 116.80 avg-zval = 37.17 2024/11/20-13:59:32.697893 140257651189312 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08542/att-00/032581.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-13:59:33.390891 140257651189312 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08542/att-00/032581.sst): second pass time = 1.31's, 82.941'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.69's, 56.305'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3270.762'MB/sec (index lex order gen) rebuild zvType time = 0.57's, 0.407'MB/sec write SST data time = 0.12's, 313.235'MB/sec dict compress time = 140278.07's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 18361.535'MB/sec zip my value time = 1.31's, unzip length = 0.108'GB zip my value throughput = 82.941'MB/sec zip pipeline throughput = 82.941'MB/sec entries = 926895 avg-key = 28.00 avg-zkey = 1.97 avg-val = 116.80 avg-zval = 37.17 usrkeys = 926895 avg-key = 20.00 avg-zkey = 1.97 avg-val = 120.31 avg-zval = 37.17 TagRS{ kinds = RS_Key0_TagN bytes = 144920 } TagArray{ size = 463937 bytes = 1565808 } seq expand size = 3247559 multi value expand size = 0 cnt WriteAppend = 49 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0345 GB dict = 1.08 MB all = 0.0391 GB } UnZip/Zip{ index = 10.1755 value = 3.1422 dict = 1.00 all = 3.4347 } Zip/UnZip{ index = 0.0983 value = 0.3182 dict = 1.00 all = 0.2911 } ---------------------------- total value len = 0.678073 GB avg = 0.122 KB (by entry num) total key len = 0.155279 GB avg = 0.028 KB total ukey len = 0.110913 GB avg = 0.020 KB total ukey num = 0.005545672 Billion total entry num = 0.005545672 Billion write speed all = 0.044536734 MB/sec (with seq num) write speed all = 0.042165718 MB/sec (without seq num) 2024/11/20-13:59:33.445332 140257651189312 [compaction_job.cc:1948] [default] [JOB 8542] Generated table #32581: 926895 keys, 39077299 bytes, temperature: kWarm 2024/11/20-13:59:33.445392 140257651189312 EVENT_LOG_v1 {"time_micros": 1732082373445363, "cf_name": "default", "job": 8542, "event": "table_file_creation", "file_number": 32581, "file_size": 39077299, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 534475941, "table_properties": {"data_size": 34454528, "index_size": 1821824, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25953060, "raw_average_key_size": 28, "raw_value_size": 108264738, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 926895, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732082370, "oldest_key_time": 0, "file_creation_time": 1732082370, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "92E45FH6K6HCJOD41QCQ", "orig_file_number": 32581, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-13:59:33.478295 140257651189312 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08542/att-00/032582.sst) /dev/shm/ToplingTemp/Topling-265746-k23Q2F 2024/11/20-13:59:34.228367 140257651189312 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08542/att-00/032582.sst): first pass time = 0.75's, 178.947'MB/sec 2024/11/20-13:59:35.533259 140257651189312 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08542/att-00/032582.sst): old prealloc_size = 147639500, real_size = 36495136 2024/11/20-13:59:35.533805 140257651189312 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08542/att-00/032582.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 926956 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.95 raw-val = 0.1083 GB zip-val = 0.0345 GB avg-val = 116.79 avg-zval = 37.17 2024/11/20-13:59:35.533936 140257651189312 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08542/att-00/032582.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-13:59:36.221836 140257651189312 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08542/att-00/032582.sst): second pass time = 1.30's, 83.024'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.69's, 54.486'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3537.548'MB/sec (index lex order gen) rebuild zvType time = 0.57's, 0.407'MB/sec write SST data time = 0.12's, 314.301'MB/sec dict compress time = 140278.07's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 19645.077'MB/sec zip my value time = 1.30's, unzip length = 0.108'GB zip my value throughput = 83.024'MB/sec zip pipeline throughput = 83.024'MB/sec entries = 926956 avg-key = 28.00 avg-zkey = 1.95 avg-val = 116.79 avg-zval = 37.17 usrkeys = 926956 avg-key = 20.00 avg-zkey = 1.95 avg-val = 116.84 avg-zval = 37.17 TagRS{ kinds = RS_Key0_TagN bytes = 144920 } TagArray{ size = 5968 bytes = 19408 } seq expand size = 41776 multi value expand size = 0 cnt WriteAppend = 68 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0345 GB dict = 1.08 MB all = 0.0375 GB } UnZip/Zip{ index = 10.2398 value = 3.1424 dict = 1.00 all = 3.5775 } Zip/UnZip{ index = 0.0977 value = 0.3182 dict = 1.00 all = 0.2795 } ---------------------------- total value len = 0.786377 GB avg = 0.121 KB (by entry num) total key len = 0.181234 GB avg = 0.028 KB total ukey len = 0.129453 GB avg = 0.020 KB total ukey num = 0.006472628 Billion total entry num = 0.006472628 Billion write speed all = 0.051704135 MB/sec (with seq num) write speed all = 0.048937225 MB/sec (without seq num) 2024/11/20-13:59:36.273517 140257651189312 [compaction_job.cc:1948] [default] [JOB 8542] Generated table #32582: 926956 keys, 37517369 bytes, temperature: kWarm 2024/11/20-13:59:36.273579 140257651189312 EVENT_LOG_v1 {"time_micros": 1732082376273550, "cf_name": "default", "job": 8542, "event": "table_file_creation", "file_number": 32582, "file_size": 37517369, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 538604047, "table_properties": {"data_size": 34452688, "index_size": 1810496, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25954768, "raw_average_key_size": 28, "raw_value_size": 108263040, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 926956, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732082373, "oldest_key_time": 0, "file_creation_time": 1732082373, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "92E45FH6K6HCJOD41QCQ", "orig_file_number": 32582, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-13:59:36.311211 140257651189312 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08542/att-00/032583.sst) /dev/shm/ToplingTemp/Topling-265746-jGv9lE 2024/11/20-13:59:37.066570 140257651189312 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08542/att-00/032583.sst): first pass time = 0.76's, 177.695'MB/sec 2024/11/20-13:59:38.371456 140257651189312 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08542/att-00/032583.sst): old prealloc_size = 147639500, real_size = 36481296 2024/11/20-13:59:38.372012 140257651189312 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08542/att-00/032583.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 926977 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.94 raw-val = 0.1083 GB zip-val = 0.0345 GB avg-val = 116.79 avg-zval = 37.16 2024/11/20-13:59:38.372291 140257651189312 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08542/att-00/032583.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-13:59:39.062162 140257651189312 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08542/att-00/032583.sst): second pass time = 1.30's, 83.015'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.69's, 55.165'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3363.967'MB/sec (index lex order gen) rebuild zvType time = 0.57's, 0.407'MB/sec write SST data time = 0.12's, 317.000'MB/sec dict compress time = 140278.07's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 31919.080'MB/sec zip my value time = 1.30's, unzip length = 0.108'GB zip my value throughput = 83.015'MB/sec zip pipeline throughput = 83.015'MB/sec entries = 926977 avg-key = 28.00 avg-zkey = 1.94 avg-val = 116.79 avg-zval = 37.16 usrkeys = 926977 avg-key = 20.00 avg-zkey = 1.94 avg-val = 118.17 avg-zval = 37.16 TagRS{ kinds = RS_Key0_TagN bytes = 144960 } TagArray{ size = 183072 bytes = 617888 } seq expand size = 1281504 multi value expand size = 0 cnt WriteAppend = 28 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0345 GB dict = 1.08 MB all = 0.0381 GB } UnZip/Zip{ index = 10.3071 value = 3.1425 dict = 1.00 all = 3.5226 } Zip/UnZip{ index = 0.0970 value = 0.3182 dict = 1.00 all = 0.2839 } ---------------------------- total value len = 0.895921 GB avg = 0.121 KB (by entry num) total key len = 0.207189 GB avg = 0.028 KB total ukey len = 0.147992 GB avg = 0.020 KB total ukey num = 0.007399605 Billion total entry num = 0.007399605 Billion write speed all = 0.058935573 MB/sec (with seq num) write speed all = 0.055772879 MB/sec (without seq num) 2024/11/20-13:59:39.114421 140257651189312 [compaction_job.cc:1948] [default] [JOB 8542] Generated table #32583: 926977 keys, 38102045 bytes, temperature: kWarm 2024/11/20-13:59:39.114484 140257651189312 EVENT_LOG_v1 {"time_micros": 1732082379114453, "cf_name": "default", "job": 8542, "event": "table_file_creation", "file_number": 32583, "file_size": 38102045, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 538604114, "table_properties": {"data_size": 34450624, "index_size": 1798720, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25955356, "raw_average_key_size": 28, "raw_value_size": 108262430, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 926977, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732082376, "oldest_key_time": 0, "file_creation_time": 1732082376, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "92E45FH6K6HCJOD41QCQ", "orig_file_number": 32583, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-13:59:39.146466 140257651189312 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08542/att-00/032584.sst) /dev/shm/ToplingTemp/Topling-265746-3jHbDD 2024/11/20-13:59:39.926496 140257651189312 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08542/att-00/032584.sst): first pass time = 0.78's, 172.074'MB/sec 2024/11/20-13:59:41.199675 140257651189312 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08542/att-00/032584.sst): old prealloc_size = 147639500, real_size = 36727856 2024/11/20-13:59:41.200230 140257651189312 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08542/att-00/032584.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 926797 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.97 raw-val = 0.1083 GB zip-val = 0.0347 GB avg-val = 116.82 avg-zval = 37.41 2024/11/20-13:59:41.200666 140257651189312 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08542/att-00/032584.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-13:59:41.893494 140257651189312 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08542/att-00/032584.sst): second pass time = 1.27's, 85.084'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.69's, 56.640'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3386.231'MB/sec (index lex order gen) rebuild zvType time = 0.57's, 0.406'MB/sec write SST data time = 0.12's, 319.947'MB/sec dict compress time = 140278.07's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 19261.416'MB/sec zip my value time = 1.27's, unzip length = 0.108'GB zip my value throughput = 85.084'MB/sec zip pipeline throughput = 85.084'MB/sec entries = 926797 avg-key = 28.00 avg-zkey = 1.97 avg-val = 116.82 avg-zval = 37.41 usrkeys = 926797 avg-key = 20.00 avg-zkey = 1.97 avg-val = 120.32 avg-zval = 37.41 TagRS{ kinds = RS_Key0_TagN bytes = 144920 } TagArray{ size = 463904 bytes = 1565696 } seq expand size = 3247328 multi value expand size = 0 cnt WriteAppend = 52 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0347 GB dict = 1.08 MB all = 0.0393 GB } UnZip/Zip{ index = 10.1765 value = 3.1224 dict = 1.00 all = 3.4155 } Zip/UnZip{ index = 0.0983 value = 0.3203 dict = 1.00 all = 0.2928 } ---------------------------- total value len = 1.007436 GB avg = 0.121 KB (by entry num) total key len = 0.233139 GB avg = 0.028 KB total ukey len = 0.166528 GB avg = 0.020 KB total ukey num = 0.008326402 Billion total entry num = 0.008326402 Billion write speed all = 0.066269860 MB/sec (with seq num) write speed all = 0.062711579 MB/sec (without seq num) 2024/11/20-13:59:41.946147 140257651189312 [compaction_job.cc:1948] [default] [JOB 8542] Generated table #32584: 926797 keys, 39296637 bytes, temperature: kWarm 2024/11/20-13:59:41.946211 140257651189312 EVENT_LOG_v1 {"time_micros": 1732082381946181, "cf_name": "default", "job": 8542, "event": "table_file_creation", "file_number": 32584, "file_size": 39296637, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 598109636, "table_properties": {"data_size": 34674528, "index_size": 1821440, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25950316, "raw_average_key_size": 28, "raw_value_size": 108267478, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 926797, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732082379, "oldest_key_time": 0, "file_creation_time": 1732082379, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "92E45FH6K6HCJOD41QCQ", "orig_file_number": 32584, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-13:59:41.979154 140257651189312 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08542/att-00/032585.sst) /dev/shm/ToplingTemp/Topling-265746-k88qdE 2024/11/20-13:59:42.750190 140257651189312 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08542/att-00/032585.sst): first pass time = 0.77's, 174.082'MB/sec 2024/11/20-13:59:44.009585 140257651189312 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08542/att-00/032585.sst): old prealloc_size = 147639500, real_size = 37601024 2024/11/20-13:59:44.010158 140257651189312 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08542/att-00/032585.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927234 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.93 raw-val = 0.1083 GB zip-val = 0.0356 GB avg-val = 116.75 avg-zval = 38.37 2024/11/20-13:59:44.010510 140257651189312 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08542/att-00/032585.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-13:59:44.715138 140257651189312 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08542/att-00/032585.sst): second pass time = 1.26's, 86.017'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.71's, 56.249'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3318.159'MB/sec (index lex order gen) rebuild zvType time = 0.58's, 0.397'MB/sec write SST data time = 0.12's, 328.829'MB/sec dict compress time = 140278.07's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 18322.082'MB/sec zip my value time = 1.26's, unzip length = 0.108'GB zip my value throughput = 86.017'MB/sec zip pipeline throughput = 86.017'MB/sec entries = 927234 avg-key = 28.00 avg-zkey = 1.93 avg-val = 116.75 avg-zval = 38.37 usrkeys = 927234 avg-key = 20.00 avg-zkey = 1.93 avg-val = 119.17 avg-zval = 38.37 TagRS{ kinds = RS_Key0_TagN bytes = 145000 } TagArray{ size = 320572 bytes = 1081952 } seq expand size = 2244004 multi value expand size = 0 cnt WriteAppend = 22 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0356 GB dict = 1.08 MB all = 0.0397 GB } UnZip/Zip{ index = 10.3749 value = 3.0425 dict = 1.00 all = 3.3820 } Zip/UnZip{ index = 0.0964 value = 0.3287 dict = 1.00 all = 0.2957 } ---------------------------- total value len = 1.117935 GB avg = 0.121 KB (by entry num) total key len = 0.259102 GB avg = 0.028 KB total ukey len = 0.185073 GB avg = 0.020 KB total ukey num = 0.009253636 Billion total entry num = 0.009253636 Billion write speed all = 0.073548382 MB/sec (with seq num) write speed all = 0.069594444 MB/sec (without seq num) 2024/11/20-13:59:44.768819 140257651189312 [compaction_job.cc:1948] [default] [JOB 8542] Generated table #32585: 927234 keys, 39685935 bytes, temperature: kWarm 2024/11/20-13:59:44.768880 140257651189312 EVENT_LOG_v1 {"time_micros": 1732082384768850, "cf_name": "default", "job": 8542, "event": "table_file_creation", "file_number": 32585, "file_size": 39685935, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 598111697, "table_properties": {"data_size": 35581552, "index_size": 1787456, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25962552, "raw_average_key_size": 28, "raw_value_size": 108255304, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927234, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732082381, "oldest_key_time": 0, "file_creation_time": 1732082381, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "92E45FH6K6HCJOD41QCQ", "orig_file_number": 32585, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-13:59:44.802158 140257651189312 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08542/att-00/032586.sst) /dev/shm/ToplingTemp/Topling-265746-aawytH 2024/11/20-13:59:45.611636 140257651189312 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08542/att-00/032586.sst): first pass time = 0.81's, 165.814'MB/sec 2024/11/20-13:59:46.774509 140257651189312 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08542/att-00/032586.sst): old prealloc_size = 147639500, real_size = 36099696 2024/11/20-13:59:46.775041 140257651189312 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08542/att-00/032586.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 923914 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1083 GB zip-val = 0.0341 GB avg-val = 117.27 avg-zval = 36.91 2024/11/20-13:59:46.775785 140257651189312 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08542/att-00/032586.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-13:59:47.551367 140257651189312 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08542/att-00/032586.sst): second pass time = 1.16's, 93.243'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.78's, 51.398'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3339.870'MB/sec (index lex order gen) rebuild zvType time = 0.65's, 0.355'MB/sec write SST data time = 0.13's, 318.854'MB/sec dict compress time = 140278.07's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.082'MB, throughput = 15860.465'MB/sec zip my value time = 1.16's, unzip length = 0.108'GB zip my value throughput = 93.243'MB/sec zip pipeline throughput = 93.243'MB/sec entries = 923914 avg-key = 28.00 avg-zkey = 1.92 avg-val = 117.27 avg-zval = 36.91 usrkeys = 923914 avg-key = 20.00 avg-zkey = 1.92 avg-val = 123.61 avg-zval = 36.91 TagRS{ kinds = RS_Key0_TagN bytes = 144480 } TagArray{ size = 836293 bytes = 2822496 } seq expand size = 5854051 multi value expand size = 0 cnt WriteAppend = 16 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0341 GB dict = 1.08 MB all = 0.0399 GB } UnZip/Zip{ index = 10.4421 value = 3.1775 dict = 1.00 all = 3.3615 } Zip/UnZip{ index = 0.0958 value = 0.3147 dict = 1.00 all = 0.2975 } ---------------------------- total value len = 1.232138 GB avg = 0.121 KB (by entry num) total key len = 0.284971 GB avg = 0.028 KB total ukey len = 0.203551 GB avg = 0.020 KB total ukey num = 0.010177550 Billion total entry num = 0.010177550 Billion write speed all = 0.081017431 MB/sec (with seq num) write speed all = 0.076669377 MB/sec (without seq num) 2024/11/20-13:59:47.604549 140257651189312 [compaction_job.cc:1948] [default] [JOB 8542] Generated table #32586: 923914 keys, 39927662 bytes, temperature: kWarm 2024/11/20-13:59:47.604611 140257651189312 EVENT_LOG_v1 {"time_micros": 1732082387604580, "cf_name": "default", "job": 8542, "event": "table_file_creation", "file_number": 32586, "file_size": 39927662, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 598110899, "table_properties": {"data_size": 34098912, "index_size": 1769600, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25869592, "raw_average_key_size": 28, "raw_value_size": 108348220, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 923914, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732082384, "oldest_key_time": 0, "file_creation_time": 1732082384, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "92E45FH6K6HCJOD41QCQ", "orig_file_number": 32586, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-13:59:47.639634 140257651189312 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08542/att-00/032587.sst) /dev/shm/ToplingTemp/Topling-265746-OaanpH 2024/11/20-13:59:48.442318 140257651189312 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08542/att-00/032587.sst): first pass time = 0.80's, 167.217'MB/sec 2024/11/20-13:59:49.576078 140257651189312 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08542/att-00/032587.sst): old prealloc_size = 147639500, real_size = 35627200 2024/11/20-13:59:49.576584 140257651189312 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08542/att-00/032587.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 922438 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1084 GB zip-val = 0.0336 GB avg-val = 117.50 avg-zval = 36.47 2024/11/20-13:59:49.577315 140257651189312 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08542/att-00/032587.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-13:59:50.400270 140257651189312 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08542/att-00/032587.sst): second pass time = 1.13's, 95.678'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.82's, 47.905'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3705.624'MB/sec (index lex order gen) rebuild zvType time = 0.70's, 0.329'MB/sec write SST data time = 0.12's, 320.908'MB/sec dict compress time = 140278.07's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.083'MB, throughput = 19323.368'MB/sec zip my value time = 1.13's, unzip length = 0.108'GB zip my value throughput = 95.678'MB/sec zip pipeline throughput = 95.678'MB/sec entries = 922438 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.50 avg-zval = 36.47 usrkeys = 922438 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.50 avg-zval = 36.47 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 922438 bytes = 2997936 } seq expand size = 6457066 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0184 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0336 GB dict = 1.08 MB all = 0.0395 GB } UnZip/Zip{ index = 10.5144 value = 3.2219 dict = 1.00 all = 3.3993 } Zip/UnZip{ index = 0.0951 value = 0.3104 dict = 1.00 all = 0.2942 } ---------------------------- total value len = 1.346984 GB avg = 0.121 KB (by entry num) total key len = 0.310800 GB avg = 0.028 KB total ukey len = 0.222000 GB avg = 0.020 KB total ukey num = 0.011099988 Billion total entry num = 0.011099988 Billion write speed all = 0.088516355 MB/sec (with seq num) write speed all = 0.083774939 MB/sec (without seq num) 2024/11/20-13:59:50.454118 140257651189312 [compaction_job.cc:1948] [default] [JOB 8542] Generated table #32587: 922438 keys, 39483662 bytes, temperature: kWarm 2024/11/20-13:59:50.454176 140257651189312 EVENT_LOG_v1 {"time_micros": 1732082390454148, "cf_name": "default", "job": 8542, "event": "table_file_creation", "file_number": 32587, "file_size": 39483662, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 542625181, "largest_seqno": 598111613, "table_properties": {"data_size": 33641776, "index_size": 1754624, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25828264, "raw_average_key_size": 28, "raw_value_size": 108389540, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 922438, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732082387, "oldest_key_time": 0, "file_creation_time": 1732082387, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "92E45FH6K6HCJOD41QCQ", "orig_file_number": 32587, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-13:59:50.487410 140257651189312 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08542/att-00/032588.sst) /dev/shm/ToplingTemp/Topling-265746-3QaDlG 2024/11/20-13:59:51.297145 140257651189312 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08542/att-00/032588.sst): first pass time = 0.81's, 165.762'MB/sec 2024/11/20-13:59:52.435324 140257651189312 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08542/att-00/032588.sst): old prealloc_size = 147639500, real_size = 35752320 2024/11/20-13:59:52.435844 140257651189312 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08542/att-00/032588.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 922497 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1084 GB zip-val = 0.0338 GB avg-val = 117.49 avg-zval = 36.59 2024/11/20-13:59:52.436569 140257651189312 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08542/att-00/032588.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-13:59:53.255727 140257651189312 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08542/att-00/032588.sst): second pass time = 1.14's, 95.292'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.82's, 48.280'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3545.873'MB/sec (index lex order gen) rebuild zvType time = 0.70's, 0.330'MB/sec write SST data time = 0.12's, 324.813'MB/sec dict compress time = 140278.07's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.083'MB, throughput = 33984.188'MB/sec zip my value time = 1.14's, unzip length = 0.108'GB zip my value throughput = 95.292'MB/sec zip pipeline throughput = 95.292'MB/sec entries = 922497 avg-key = 28.00 avg-zkey = 1.92 avg-val = 117.49 avg-zval = 36.59 usrkeys = 922497 avg-key = 20.00 avg-zkey = 1.92 avg-val = 124.49 avg-zval = 36.59 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 922497 bytes = 2998128 } seq expand size = 6457479 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0184 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0338 GB dict = 1.08 MB all = 0.0396 GB } UnZip/Zip{ index = 10.4415 value = 3.2111 dict = 1.00 all = 3.3886 } Zip/UnZip{ index = 0.0958 value = 0.3114 dict = 1.00 all = 0.2951 } ---------------------------- total value len = 1.461830 GB avg = 0.122 KB (by entry num) total key len = 0.336630 GB avg = 0.028 KB total ukey len = 0.240450 GB avg = 0.020 KB total ukey num = 0.012022485 Billion total entry num = 0.012022485 Billion write speed all = 0.096012985 MB/sec (with seq num) write speed all = 0.090878302 MB/sec (without seq num) 2024/11/20-13:59:53.308783 140257651189312 [compaction_job.cc:1948] [default] [JOB 8542] Generated table #32588: 922497 keys, 39608860 bytes, temperature: kWarm 2024/11/20-13:59:53.308835 140257651189312 EVENT_LOG_v1 {"time_micros": 1732082393308807, "cf_name": "default", "job": 8542, "event": "table_file_creation", "file_number": 32588, "file_size": 39608860, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 542625216, "largest_seqno": 598111153, "table_properties": {"data_size": 33754544, "index_size": 1766976, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25829916, "raw_average_key_size": 28, "raw_value_size": 108387862, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 922497, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732082390, "oldest_key_time": 0, "file_creation_time": 1732082390, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "92E45FH6K6HCJOD41QCQ", "orig_file_number": 32588, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-13:59:53.341639 140257651189312 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08542/att-00/032589.sst) /dev/shm/ToplingTemp/Topling-265746-twjrUF 2024/11/20-13:59:53.481804 140257651189312 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08542/att-00/032589.sst): first pass time = 0.14's, 256.427'MB/sec 2024/11/20-13:59:53.780725 140257651189312 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08542/att-00/032589.sst): old prealloc_size = 147639500, real_size = 10154160 2024/11/20-13:59:53.780920 140257651189312 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08542/att-00/032589.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 247162 prefix = 4 raw-key = 0.0040 GB zip-key = 0.0005 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.0290 GB zip-val = 0.0096 GB avg-val = 117.39 avg-zval = 38.93 2024/11/20-13:59:53.781156 140257651189312 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08542/att-00/032589.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.036 GB 2024/11/20-13:59:53.999312 140257651189312 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08542/att-00/032589.sst): second pass time = 0.30's, 97.288'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.22's, 51.221'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2911.122'MB/sec (index lex order gen) rebuild zvType time = 0.18's, 0.336'MB/sec write SST data time = 0.03's, 325.636'MB/sec dict compress time = 140278.07's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.297'MB, throughput = 11100.612'MB/sec zip my value time = 0.30's, unzip length = 0.029'GB zip my value throughput = 97.288'MB/sec zip pipeline throughput = 97.288'MB/sec entries = 247162 avg-key = 28.00 avg-zkey = 1.91 avg-val = 117.39 avg-zval = 38.93 usrkeys = 247162 avg-key = 20.00 avg-zkey = 1.91 avg-val = 124.39 avg-zval = 38.93 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 247162 bytes = 803296 } seq expand size = 1730134 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0049 GB value = 0.0290 GB dict = 0.30 MB all = 0.0359 GB } __ZipSize{ index = 0.0005 GB value = 0.0096 GB dict = 0.30 MB all = 0.0112 GB } UnZip/Zip{ index = 10.4900 value = 3.0157 dict = 1.00 all = 3.2098 } Zip/UnZip{ index = 0.0953 value = 0.3316 dict = 1.00 all = 0.3115 } ---------------------------- total value len = 1.492574 GB avg = 0.122 KB (by entry num) total key len = 0.343550 GB avg = 0.028 KB total ukey len = 0.245393 GB avg = 0.020 KB total ukey num = 0.012269647 Billion total entry num = 0.012269647 Billion write speed all = 0.098019890 MB/sec (with seq num) write speed all = 0.092779856 MB/sec (without seq num) 2024/11/20-13:59:54.019322 140257651189312 [compaction_job.cc:1948] [default] [JOB 8542] Generated table #32589: 247162 keys, 11195357 bytes, temperature: kWarm 2024/11/20-13:59:54.019374 140257651189312 EVENT_LOG_v1 {"time_micros": 1732082394019348, "cf_name": "default", "job": 8542, "event": "table_file_creation", "file_number": 32589, "file_size": 11195357, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 542625257, "largest_seqno": 598111403, "table_properties": {"data_size": 9620960, "index_size": 471232, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 6920536, "raw_average_key_size": 28, "raw_value_size": 29014408, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 247162, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732082393, "oldest_key_time": 0, "file_creation_time": 1732082393, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "92E45FH6K6HCJOD41QCQ", "orig_file_number": 32589, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-13:59:54.032484 140257651189312 [compaction_job.cc:703] job-08542: subcompact[0], size: 0.521129 G, files: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08542/att-00 [032576,032577,032578,032579,032580,032581,032582,032583,032584,032585,032586,032587,032588,032589] 2024/11/20-13:59:54.116065 140257651189312 (Original Log Time 2024/11/20-13:59:14.215790) EVENT_LOG_v1 {"time_micros": 1732082354215767, "job": 8542, "event": "compaction_started", "compaction_reason": "FilesMarkedForCompaction", "files_L2": [32537], "files_L3": [32572, 32573, 32518, 32520, 32522, 32524, 32526, 32528, 32529, 32530, 32531, 32532, 32533, 32558], "score": 0.97515, "input_data_size": 544769483, "oldest_snapshot_seqno": 599621884} 2024/11/20-13:59:54.116068 140257651189312 (Original Log Time 2024/11/20-13:59:54.114858) [compaction_job.cc:2022] [default] [JOB 8542] Compacted 1@2 + 14@3 files to L3 => 521129068 bytes 2024/11/20-13:59:54.116069 140257651189312 (Original Log Time 2024/11/20-13:59:54.115979) [compaction_job.cc:1224] [default] compacted to: files[0 0 0 14 0 0 0] max score 0.02, MB/sec: 13.7 rd, 13.1 wr, level 3, files in(1, 14) out(14 +0 blob) MB in(27.2, 492.4 +0.0 blob) out(497.0 +0.0 blob), read-write-amplify(37.4) write-amplify(18.3) OK, records in: 12380031, records dropped: 110384 output_compression: Snappy 2024/11/20-13:59:54.116074 140257651189312 (Original Log Time 2024/11/20-13:59:54.116026) EVENT_LOG_v1 {"time_micros": 1732082394116001, "cf": "default", "job": 8542, "event": "compaction_finished", "compaction_time_micros": 39816698, "compaction_time_cpu_micros": 17409529, "output_level": 3, "num_output_files": 14, "total_output_size": 521129068, "num_input_records": 12380031, "num_output_records": 12269647, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "file_write_nanos": 331109855, "file_range_sync_nanos": 0, "file_fsync_nanos": 12487, "file_prepare_write_nanos": 38025, "lsm_state": [0, 0, 0, 14, 0, 0, 0]} 2024/11/20-13:59:54.255475 140257651189312 DEBG dcompact_worker.cpp:240: HttpPost: 200 OK: url = http://nlb-7zny4kaa1poal01o64.cn-shenzhen.nlb.aliyuncs.com:8443, body = {"instanceId":"nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137","labourId":"","dbId":"d89b4006-2803-486e-b7a2-759bcf348921","dbStarts":1732076400,"starts":1732082354,"executesMs":40039,"compactionJobId":8542,"attempt":0,"compactionInputRawBytes":1796440914,"compactionInputZipBytes":544769483,"compactionOutputRawBytes":0,"compactionOutputZipBytes":521129068,"headers":{"Accept":"*/*","Connection":"close","Host":"aliyun-topling-saas.topling.cn:18443","RemoteIp":"120.24.192.169","X-Forwarded-For":"120.24.192.169","region":"cn-shenzhen","token":"e6474c481bd4415abc537135cc03626b","instance-token":"e6474c481bd4415abc537135cc03626b","provider":"aliyun","CloudMarketInstanceId":"si-59c0ae5c955845588903","MeteringAssit":"","Transfer-Encoding":"chunked","traceparent":"00-7ccfd65a45877e103783e9687dc56470-ef786dcd8812fbe0-00"}}, response = 2024/11/20-13:59:54.255526 140257651189312 INFO dcompact_worker.cpp:1464: finish /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-20T12.20.00/.rocksdb/job-08542/att-00: olev 3, work 40.040 s, result 7.747 ms, install 1.231 ms, input{raw 1.673 GiB zip 519.533 MiB}