2024/11/20-15:19:09.786494 140257508513344 DEBG dcompact_worker.cpp:2219: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12312/att-00: fork to child time = 0.009828 sec 2024/11/20-15:19:09.787027 140257508513344 DEBG dcompact_worker.cpp:1013: Beg SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12312/att-00 2024/11/20-15:19:09.793720 140257508513344 DEBG dcompact_worker.cpp:1033: End SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12312/att-00 2024/11/20-15:19:09.795437 140257508513344 TRAC dcompact_worker.cpp:1083: INFO_LOG_LEVEL: rpc = INFO_LEVEL, env_var = undefined 2024/11/20-15:19:09.795651 140257508513344 [WARN] [column_family.cc:386] multiple cf_paths/db_paths and level_compaction_dynamic_level_bytes can't be used together 2024/11/20-15:19:09.846309 140257508513344 [version_set.cc:6211] Recovering from manifest file: /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-20T12.20.00/.rocksdb/job-12312/att-00/MANIFEST-019309 2024/11/20-15:19:09.895555 140257508513344 [version_set.cc:6254] Recovered from manifest file:/worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-20T12.20.00/.rocksdb/job-12312/att-00/MANIFEST-019309 succeeded,manifest_file_number is 19309, next_file_number is 39040, last_sequence is 696418882, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 38929 2024/11/20-15:19:09.895561 140257508513344 [version_set.cc:6269] Column family [default] (ID 0), log number is 0 2024/11/20-15:19:09.895634 140257508513344 [version_set.cc:5724] Creating manifest 39040 2024/11/20-15:19:09.927662 140257508513344 DEBG dcompact_worker.cpp:1225: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12312/att-00: bottommost_level: fake = 1, rpc = 0 2024/11/20-15:19:09.948759 140257508513344 [compaction_job.cc:2437] [default] [JOB 12312] Compacting 1@2 + 13@3 files to L3, score 1.00, subcompactions 1 : 1 2024/11/20-15:19:09.948771 140257508513344 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 10032 Base level 2, inputs: [39020(27MB)], [38991(36MB) 38992(37MB) 38993(38MB) 38994(38MB) 38995(36MB) 38996(35MB) 38997(36MB) 38998(38MB) 38999(38MB) 39000(38MB) 39001(36MB) 39002(37MB) 39031(38MB)] 2024/11/20-15:19:09.955709 140257508513344 [top_zip_table.cc:59] core git_version_hash_info_is:commit 81964c21ebbcc178d8e99dae0fbf61bded2729cc Author: rockeet Date: Mon Nov 11 21:28:46 2024 +0800 Makefile: fix gen git-version-*.cpp GIT_PATH_ARG = :!src/terark/fsa :!tools/fsa :!src/terark/zbs :!tools/zbs g++ (GCC) 12.2.1 20221121 (Red Hat 12.2.1-7) Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/zstd -Iboost-include DEFS = -DTOPLING_IO_WITH_URING=1 -DDIVSUFSORT_API= CXXFLAGS = -fPIC -time -fdiagnostics-color -mcx16 -fno-stack-protector WARNINGS = -Wno-class-memaccess -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -Wno-deprecated-declarations -Wstrict-aliasing=3 RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 LDFLAGS = -fPIC -rdynamic 2024/11/20-15:19:09.955732 140257508513344 [top_zip_table.cc:60] fsa git_version_hash_info_is:commit 5dfecb7d107196f044ff5bf78dc39d2e725b9d9b Author: leipeng Date: Thu Nov 7 15:22:45 2024 +0800 Makefile: fix for x86_64 CPU older than haswell GIT_PATH_ARG = src/terark/fsa tools/fsa g++ (GCC) 12.2.1 20221121 (Red Hat 12.2.1-7) Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/zstd -Iboost-include DEFS = -DTOPLING_IO_WITH_URING=1 -DDIVSUFSORT_API= CXXFLAGS = -fPIC -time -fdiagnostics-color -mcx16 -fno-stack-protector WARNINGS = -Wno-class-memaccess -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -Wno-deprecated-declarations -Wstrict-aliasing=3 RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 LDFLAGS = -fPIC -rdynamic 2024/11/20-15:19:09.955751 140257508513344 [top_zip_table.cc:61] zbs git_version_hash_info_is:commit d44dd5ff72707128fe3c916077b43d2093c01f7c Author: leipeng Date: Sun Oct 27 23:38:26 2024 +0800 Fix for msvc, when toplingdb on msvc GIT_PATH_ARG = src/terark/zbs tools/zbs g++ (GCC) 12.2.1 20221121 (Red Hat 12.2.1-7) Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/zstd -Iboost-include DEFS = -DTOPLING_IO_WITH_URING=1 -DDIVSUFSORT_API= CXXFLAGS = -fPIC -time -fdiagnostics-color -mcx16 -fno-stack-protector WARNINGS = -Wno-class-memaccess -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -Wno-deprecated-declarations -Wstrict-aliasing=3 RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 LDFLAGS = -fPIC -rdynamic 2024/11/20-15:19:09.955758 140257508513344 [top_zip_table.cc:62] topling-zip_table_reader: git_version_hash_info_is: commit 79614a7e7dc27362fc5151b0797eb7d83c674c7b Author: rockeet Date: Sun Nov 10 15:02:21 2024 +0800 cpu_has_bmi2.sh: detect by compile c++ code check __BMI2__ g++ (GCC) 12.2.1 20221121 (Red Hat 12.2.1-7) Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/20-15:19:09.955768 140257508513344 [top_zip_table.cc:64] topling-rocks git_version_hash_info_is: commit c46b65a52d9c74aa8b87aeb8438620ff2dbc669c Author: rockeet Date: Sun Nov 10 15:02:42 2024 +0800 cpu_has_bmi2.sh: detect by compile c++ code check __BMI2__ g++ (GCC) 12.2.1 20221121 (Red Hat 12.2.1-7) Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/20-15:19:10.549433 140257508513344 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12312/att-00/039041.sst) /dev/shm/ToplingTemp/Topling-475902-NOnCkH 2024/11/20-15:19:11.083610 140257508513344 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12312/att-00/039041.sst): first pass time = 0.53's, 251.285'MB/sec 2024/11/20-15:19:12.377947 140257508513344 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12312/att-00/039041.sst): old prealloc_size = 147639500, real_size = 34725248 2024/11/20-15:19:12.378551 140257508513344 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12312/att-00/039041.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 925273 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.93 raw-val = 0.1083 GB zip-val = 0.0327 GB avg-val = 117.06 avg-zval = 35.35 2024/11/20-15:19:12.379200 140257508513344 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12312/att-00/039041.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-15:19:13.188845 140257508513344 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12312/att-00/039041.sst): second pass time = 1.29's, 83.731'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.81's, 46.911'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3041.143'MB/sec (index lex order gen) rebuild zvType time = 0.68's, 0.341'MB/sec write SST data time = 0.13's, 288.244'MB/sec dict compress time = 3403650639.64's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 30030.742'MB/sec zip my value time = 1.29's, unzip length = 0.108'GB zip my value throughput = 83.731'MB/sec zip pipeline throughput = 94.998'MB/sec entries = 925273 avg-key = 28.00 avg-zkey = 1.93 avg-val = 117.06 avg-zval = 35.35 usrkeys = 925273 avg-key = 20.00 avg-zkey = 1.93 avg-val = 122.05 avg-zval = 35.35 TagRS{ kinds = RS_Key0_TagN bytes = 144680 } TagArray{ size = 660242 bytes = 2310864 } seq expand size = 4621694 multi value expand size = 0 cnt WriteAppend = 20 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0327 GB dict = 1.08 MB all = 0.0380 GB } UnZip/Zip{ index = 10.3767 value = 3.3112 dict = 1.00 all = 3.5284 } Zip/UnZip{ index = 0.0964 value = 0.3020 dict = 1.00 all = 0.2834 } ---------------------------- total value len = 0.112932 GB avg = 0.122 KB (by entry num) total key len = 0.025908 GB avg = 0.028 KB total ukey len = 0.018505 GB avg = 0.020 KB total ukey num = 0.000925273 Billion total entry num = 0.000925273 Billion write speed all = 0.005910239 MB/sec (with seq num) write speed all = 0.005595136 MB/sec (without seq num) 2024/11/20-15:19:13.236373 140257508513344 [compaction_job.cc:1948] [default] [JOB 12312] Generated table #39041: 925273 keys, 38039344 bytes, temperature: kWarm 2024/11/20-15:19:13.236461 140257508513344 EVENT_LOG_v1 {"time_micros": 1732087153236420, "cf_name": "default", "job": 12312, "event": "table_file_creation", "file_number": 39041, "file_size": 38039344, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 694819220, "table_properties": {"data_size": 32710384, "index_size": 1783360, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25907644, "raw_average_key_size": 28, "raw_value_size": 108310146, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 925273, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732087150, "oldest_key_time": 0, "file_creation_time": 1732087150, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "92E45FH6K6HCJOD41QCQ", "orig_file_number": 39041, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-15:19:13.274602 140257508513344 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12312/att-00/039042.sst) /dev/shm/ToplingTemp/Topling-475902-iHVoeF 2024/11/20-15:19:14.063248 140257508513344 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12312/att-00/039042.sst): first pass time = 0.79's, 170.194'MB/sec 2024/11/20-15:19:15.286918 140257508513344 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12312/att-00/039042.sst): old prealloc_size = 147639500, real_size = 36109392 2024/11/20-15:19:15.287535 140257508513344 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12312/att-00/039042.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 925443 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.94 raw-val = 0.1083 GB zip-val = 0.0341 GB avg-val = 117.03 avg-zval = 36.83 2024/11/20-15:19:15.288126 140257508513344 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12312/att-00/039042.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-15:19:16.049207 140257508513344 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12312/att-00/039042.sst): second pass time = 1.22's, 88.566'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.76's, 51.481'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3018.952'MB/sec (index lex order gen) rebuild zvType time = 0.63's, 0.367'MB/sec write SST data time = 0.13's, 298.755'MB/sec dict compress time = 140278.07's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 35261.681'MB/sec zip my value time = 1.22's, unzip length = 0.108'GB zip my value throughput = 88.566'MB/sec zip pipeline throughput = 88.566'MB/sec entries = 925443 avg-key = 28.00 avg-zkey = 1.94 avg-val = 117.03 avg-zval = 36.83 usrkeys = 925443 avg-key = 20.00 avg-zkey = 1.94 avg-val = 121.63 avg-zval = 36.83 TagRS{ kinds = RS_Key0_TagN bytes = 144720 } TagArray{ size = 608574 bytes = 2130016 } seq expand size = 4260018 multi value expand size = 0 cnt WriteAppend = 32 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0341 GB dict = 1.08 MB all = 0.0392 GB } UnZip/Zip{ index = 10.3073 value = 3.1778 dict = 1.00 all = 3.4202 } Zip/UnZip{ index = 0.0970 value = 0.3147 dict = 1.00 all = 0.2924 } ---------------------------- total value len = 0.225497 GB avg = 0.122 KB (by entry num) total key len = 0.051820 GB avg = 0.028 KB total ukey len = 0.037014 GB avg = 0.020 KB total ukey num = 0.001850716 Billion total entry num = 0.001850716 Billion write speed all = 0.011803643 MB/sec (with seq num) write speed all = 0.011173457 MB/sec (without seq num) 2024/11/20-15:19:16.096204 140257508513344 [compaction_job.cc:1948] [default] [JOB 12312] Generated table #39042: 925443 keys, 39242956 bytes, temperature: kWarm 2024/11/20-15:19:16.096266 140257508513344 EVENT_LOG_v1 {"time_micros": 1732087156096235, "cf_name": "default", "job": 12312, "event": "table_file_creation", "file_number": 39042, "file_size": 39242956, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 694819491, "table_properties": {"data_size": 34082112, "index_size": 1795712, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25912404, "raw_average_key_size": 28, "raw_value_size": 108305378, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 925443, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732087153, "oldest_key_time": 0, "file_creation_time": 1732087153, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "92E45FH6K6HCJOD41QCQ", "orig_file_number": 39042, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-15:19:16.134734 140257508513344 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12312/att-00/039043.sst) /dev/shm/ToplingTemp/Topling-475902-jrrpIH 2024/11/20-15:19:17.020309 140257508513344 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12312/att-00/039043.sst): first pass time = 0.89's, 151.566'MB/sec 2024/11/20-15:19:18.175157 140257508513344 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12312/att-00/039043.sst): old prealloc_size = 147639500, real_size = 36131952 2024/11/20-15:19:18.175722 140257508513344 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12312/att-00/039043.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 926198 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0341 GB avg-val = 116.91 avg-zval = 36.86 2024/11/20-15:19:18.176477 140257508513344 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12312/att-00/039043.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-15:19:19.002325 140257508513344 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12312/att-00/039043.sst): second pass time = 1.15's, 93.829'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.83's, 48.354'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3231.688'MB/sec (index lex order gen) rebuild zvType time = 0.70's, 0.333'MB/sec write SST data time = 0.13's, 306.578'MB/sec dict compress time = 140278.11's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 33445.793'MB/sec zip my value time = 1.15's, unzip length = 0.108'GB zip my value throughput = 93.829'MB/sec zip pipeline throughput = 93.829'MB/sec entries = 926198 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.91 avg-zval = 36.86 usrkeys = 926198 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.91 avg-zval = 36.86 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 926198 bytes = 3010160 } seq expand size = 6483386 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0341 GB dict = 1.08 MB all = 0.0400 GB } UnZip/Zip{ index = 10.5131 value = 3.1719 dict = 1.00 all = 3.3557 } Zip/UnZip{ index = 0.0951 value = 0.3153 dict = 1.00 all = 0.2980 } ---------------------------- total value len = 0.340265 GB avg = 0.123 KB (by entry num) total key len = 0.077754 GB avg = 0.028 KB total ukey len = 0.055538 GB avg = 0.020 KB total ukey num = 0.002776914 Billion total entry num = 0.002776914 Billion write speed all = 0.017790166 MB/sec (with seq num) write speed all = 0.016844720 MB/sec (without seq num) 2024/11/20-15:19:19.052127 140257508513344 [compaction_job.cc:1948] [default] [JOB 12312] Generated table #39043: 926198 keys, 39996734 bytes, temperature: kWarm 2024/11/20-15:19:19.052194 140257508513344 EVENT_LOG_v1 {"time_micros": 1732087159052164, "cf_name": "default", "job": 12312, "event": "table_file_creation", "file_number": 39043, "file_size": 39996734, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 635932301, "largest_seqno": 694819541, "table_properties": {"data_size": 34138208, "index_size": 1761984, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25933544, "raw_average_key_size": 28, "raw_value_size": 108284232, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 926198, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732087156, "oldest_key_time": 0, "file_creation_time": 1732087156, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "92E45FH6K6HCJOD41QCQ", "orig_file_number": 39043, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-15:19:19.088706 140257508513344 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12312/att-00/039044.sst) /dev/shm/ToplingTemp/Topling-475902-ceyEAE 2024/11/20-15:19:19.970493 140257508513344 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12312/att-00/039044.sst): first pass time = 0.88's, 152.217'MB/sec 2024/11/20-15:19:21.128882 140257508513344 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12312/att-00/039044.sst): old prealloc_size = 147639500, real_size = 36633984 2024/11/20-15:19:21.129486 140257508513344 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12312/att-00/039044.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927420 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.97 raw-val = 0.1083 GB zip-val = 0.0346 GB avg-val = 116.72 avg-zval = 37.29 2024/11/20-15:19:21.130266 140257508513344 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12312/att-00/039044.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-15:19:21.935460 140257508513344 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12312/att-00/039044.sst): second pass time = 1.16's, 93.515'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.81's, 50.507'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3117.877'MB/sec (index lex order gen) rebuild zvType time = 0.68's, 0.343'MB/sec write SST data time = 0.13's, 315.553'MB/sec dict compress time = 140278.11's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 18198.180'MB/sec zip my value time = 1.16's, unzip length = 0.108'GB zip my value throughput = 93.515'MB/sec zip pipeline throughput = 93.515'MB/sec entries = 927420 avg-key = 28.00 avg-zkey = 1.97 avg-val = 116.72 avg-zval = 37.29 usrkeys = 927420 avg-key = 20.00 avg-zkey = 1.97 avg-val = 123.72 avg-zval = 37.29 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 927420 bytes = 3245984 } seq expand size = 6491940 multi value expand size = 0 cnt WriteAppend = 28 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0346 GB dict = 1.08 MB all = 0.0407 GB } UnZip/Zip{ index = 10.1762 value = 3.1305 dict = 1.00 all = 3.2947 } Zip/UnZip{ index = 0.0983 value = 0.3194 dict = 1.00 all = 0.3035 } ---------------------------- total value len = 0.455007 GB avg = 0.123 KB (by entry num) total key len = 0.103721 GB avg = 0.028 KB total ukey len = 0.074087 GB avg = 0.020 KB total ukey num = 0.003704334 Billion total entry num = 0.003704334 Billion write speed all = 0.023775568 MB/sec (with seq num) write speed all = 0.022514524 MB/sec (without seq num) 2024/11/20-15:19:21.985128 140257508513344 [compaction_job.cc:1948] [default] [JOB 12312] Generated table #39044: 927420 keys, 40737742 bytes, temperature: kWarm 2024/11/20-15:19:21.985190 140257508513344 EVENT_LOG_v1 {"time_micros": 1732087161985160, "cf_name": "default", "job": 12312, "event": "table_file_creation", "file_number": 39044, "file_size": 40737742, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 442876808, "largest_seqno": 694819611, "table_properties": {"data_size": 34579248, "index_size": 1822720, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25967760, "raw_average_key_size": 28, "raw_value_size": 108250012, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927420, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732087159, "oldest_key_time": 0, "file_creation_time": 1732087159, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "92E45FH6K6HCJOD41QCQ", "orig_file_number": 39044, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-15:19:22.023267 140257508513344 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12312/att-00/039045.sst) /dev/shm/ToplingTemp/Topling-475902-nkriyG 2024/11/20-15:19:22.783371 140257508513344 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12312/att-00/039045.sst): first pass time = 0.76's, 176.586'MB/sec 2024/11/20-15:19:24.075544 140257508513344 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12312/att-00/039045.sst): old prealloc_size = 147639500, real_size = 36512656 2024/11/20-15:19:24.076183 140257508513344 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12312/att-00/039045.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927047 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.94 raw-val = 0.1083 GB zip-val = 0.0345 GB avg-val = 116.78 avg-zval = 37.20 2024/11/20-15:19:24.076440 140257508513344 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12312/att-00/039045.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-15:19:24.774635 140257508513344 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12312/att-00/039045.sst): second pass time = 1.29's, 83.835'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.70's, 54.434'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2922.717'MB/sec (index lex order gen) rebuild zvType time = 0.57's, 0.406'MB/sec write SST data time = 0.13's, 297.824'MB/sec dict compress time = 140278.11's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 19143.313'MB/sec zip my value time = 1.29's, unzip length = 0.108'GB zip my value throughput = 83.835'MB/sec zip pipeline throughput = 83.835'MB/sec entries = 927047 avg-key = 28.00 avg-zkey = 1.94 avg-val = 116.78 avg-zval = 37.20 usrkeys = 927047 avg-key = 20.00 avg-zkey = 1.94 avg-val = 117.98 avg-zval = 37.20 TagRS{ kinds = RS_Key0_TagN bytes = 144960 } TagArray{ size = 159403 bytes = 538000 } seq expand size = 1115821 multi value expand size = 0 cnt WriteAppend = 46 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0345 GB dict = 1.08 MB all = 0.0381 GB } UnZip/Zip{ index = 10.3064 value = 3.1396 dict = 1.00 all = 3.5271 } Zip/UnZip{ index = 0.0970 value = 0.3185 dict = 1.00 all = 0.2835 } ---------------------------- total value len = 0.564383 GB avg = 0.122 KB (by entry num) total key len = 0.129679 GB avg = 0.028 KB total ukey len = 0.092628 GB avg = 0.020 KB total ukey num = 0.004631381 Billion total entry num = 0.004631381 Billion write speed all = 0.029530856 MB/sec (with seq num) write speed all = 0.027954412 MB/sec (without seq num) 2024/11/20-15:19:24.821315 140257508513344 [compaction_job.cc:1948] [default] [JOB 12312] Generated table #39045: 927047 keys, 38053565 bytes, temperature: kWarm 2024/11/20-15:19:24.821380 140257508513344 EVENT_LOG_v1 {"time_micros": 1732087164821350, "cf_name": "default", "job": 12312, "event": "table_file_creation", "file_number": 39045, "file_size": 38053565, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 535975517, "table_properties": {"data_size": 34481728, "index_size": 1798976, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25957316, "raw_average_key_size": 28, "raw_value_size": 108260518, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927047, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732087162, "oldest_key_time": 0, "file_creation_time": 1732087162, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "92E45FH6K6HCJOD41QCQ", "orig_file_number": 39045, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-15:19:24.859612 140257508513344 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12312/att-00/039046.sst) /dev/shm/ToplingTemp/Topling-475902-zdmzWE 2024/11/20-15:19:25.610621 140257508513344 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12312/att-00/039046.sst): first pass time = 0.75's, 178.724'MB/sec 2024/11/20-15:19:26.922992 140257508513344 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12312/att-00/039046.sst): old prealloc_size = 147639500, real_size = 36393360 2024/11/20-15:19:26.923631 140257508513344 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12312/att-00/039046.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 926864 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.94 raw-val = 0.1083 GB zip-val = 0.0344 GB avg-val = 116.81 avg-zval = 37.07 2024/11/20-15:19:26.923762 140257508513344 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12312/att-00/039046.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-15:19:27.621477 140257508513344 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12312/att-00/039046.sst): second pass time = 1.31's, 82.545'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.70's, 53.559'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2892.948'MB/sec (index lex order gen) rebuild zvType time = 0.57's, 0.406'MB/sec write SST data time = 0.13's, 294.480'MB/sec dict compress time = 140278.11's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 18844.573'MB/sec zip my value time = 1.31's, unzip length = 0.108'GB zip my value throughput = 82.545'MB/sec zip pipeline throughput = 82.545'MB/sec entries = 926864 avg-key = 28.00 avg-zkey = 1.94 avg-val = 116.81 avg-zval = 37.07 usrkeys = 926864 avg-key = 20.00 avg-zkey = 1.94 avg-val = 116.84 avg-zval = 37.07 TagRS{ kinds = RS_Key0_TagN bytes = 144920 } TagArray{ size = 3959 bytes = 12880 } seq expand size = 27713 multi value expand size = 0 cnt WriteAppend = 52 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0344 GB dict = 1.08 MB all = 0.0374 GB } UnZip/Zip{ index = 10.3066 value = 3.1507 dict = 1.00 all = 3.5878 } Zip/UnZip{ index = 0.0970 value = 0.3174 dict = 1.00 all = 0.2787 } ---------------------------- total value len = 0.672676 GB avg = 0.121 KB (by entry num) total key len = 0.155631 GB avg = 0.028 KB total ukey len = 0.111165 GB avg = 0.020 KB total ukey num = 0.005558245 Billion total entry num = 0.005558245 Billion write speed all = 0.035238449 MB/sec (with seq num) write speed all = 0.033346746 MB/sec (without seq num) 2024/11/20-15:19:27.667885 140257508513344 [compaction_job.cc:1948] [default] [JOB 12312] Generated table #39046: 926864 keys, 37409259 bytes, temperature: kWarm 2024/11/20-15:19:27.667941 140257508513344 EVENT_LOG_v1 {"time_micros": 1732087167667912, "cf_name": "default", "job": 12312, "event": "table_file_creation", "file_number": 39046, "file_size": 37409259, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 538604047, "table_properties": {"data_size": 34362880, "index_size": 1798592, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25952192, "raw_average_key_size": 28, "raw_value_size": 108265624, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 926864, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732087164, "oldest_key_time": 0, "file_creation_time": 1732087164, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "92E45FH6K6HCJOD41QCQ", "orig_file_number": 39046, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-15:19:27.706466 140257508513344 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12312/att-00/039047.sst) /dev/shm/ToplingTemp/Topling-475902-aFF1XG 2024/11/20-15:19:28.477670 140257508513344 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12312/att-00/039047.sst): first pass time = 0.77's, 174.044'MB/sec 2024/11/20-15:19:29.777156 140257508513344 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12312/att-00/039047.sst): old prealloc_size = 147639500, real_size = 36534640 2024/11/20-15:19:29.777791 140257508513344 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12312/att-00/039047.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 926915 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.94 raw-val = 0.1083 GB zip-val = 0.0345 GB avg-val = 116.80 avg-zval = 37.22 2024/11/20-15:19:29.778165 140257508513344 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12312/att-00/039047.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-15:19:30.480168 140257508513344 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12312/att-00/039047.sst): second pass time = 1.30's, 83.371'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.70's, 54.852'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3011.862'MB/sec (index lex order gen) rebuild zvType time = 0.57's, 0.405'MB/sec write SST data time = 0.13's, 295.387'MB/sec dict compress time = 140278.11's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 21524.876'MB/sec zip my value time = 1.30's, unzip length = 0.108'GB zip my value throughput = 83.371'MB/sec zip pipeline throughput = 83.371'MB/sec entries = 926915 avg-key = 28.00 avg-zkey = 1.94 avg-val = 116.80 avg-zval = 37.22 usrkeys = 926915 avg-key = 20.00 avg-zkey = 1.94 avg-val = 119.09 avg-zval = 37.22 TagRS{ kinds = RS_Key0_TagN bytes = 144920 } TagArray{ size = 303251 bytes = 1023488 } seq expand size = 2122757 multi value expand size = 0 cnt WriteAppend = 44 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0345 GB dict = 1.08 MB all = 0.0386 GB } UnZip/Zip{ index = 10.3064 value = 3.1377 dict = 1.00 all = 3.4806 } Zip/UnZip{ index = 0.0970 value = 0.3187 dict = 1.00 all = 0.2873 } ---------------------------- total value len = 0.783063 GB avg = 0.121 KB (by entry num) total key len = 0.181584 GB avg = 0.028 KB total ukey len = 0.129703 GB avg = 0.020 KB total ukey num = 0.006485160 Billion total entry num = 0.006485160 Billion write speed all = 0.041033758 MB/sec (with seq num) write speed all = 0.038826856 MB/sec (without seq num) 2024/11/20-15:19:30.527234 140257508513344 [compaction_job.cc:1948] [default] [JOB 12312] Generated table #39047: 926915 keys, 38561223 bytes, temperature: kWarm 2024/11/20-15:19:30.527295 140257508513344 EVENT_LOG_v1 {"time_micros": 1732087170527266, "cf_name": "default", "job": 12312, "event": "table_file_creation", "file_number": 39047, "file_size": 38561223, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 541395865, "table_properties": {"data_size": 34504032, "index_size": 1798720, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25953620, "raw_average_key_size": 28, "raw_value_size": 108264202, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 926915, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732087167, "oldest_key_time": 0, "file_creation_time": 1732087167, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "92E45FH6K6HCJOD41QCQ", "orig_file_number": 39047, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-15:19:30.566626 140257508513344 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12312/att-00/039048.sst) /dev/shm/ToplingTemp/Topling-475902-AuxtNE 2024/11/20-15:19:31.369208 140257508513344 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12312/att-00/039048.sst): first pass time = 0.80's, 167.239'MB/sec 2024/11/20-15:19:32.578817 140257508513344 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12312/att-00/039048.sst): old prealloc_size = 147639500, real_size = 36804352 2024/11/20-15:19:32.579496 140257508513344 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12312/att-00/039048.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 924885 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.96 raw-val = 0.1083 GB zip-val = 0.0348 GB avg-val = 117.12 avg-zval = 37.58 2024/11/20-15:19:32.580162 140257508513344 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12312/att-00/039048.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-15:19:33.346638 140257508513344 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12312/att-00/039048.sst): second pass time = 1.21's, 89.615'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.77's, 52.403'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2894.929'MB/sec (index lex order gen) rebuild zvType time = 0.63's, 0.364'MB/sec write SST data time = 0.13's, 303.692'MB/sec dict compress time = 140278.11's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 33407.405'MB/sec zip my value time = 1.21's, unzip length = 0.108'GB zip my value throughput = 89.615'MB/sec zip pipeline throughput = 89.615'MB/sec entries = 924885 avg-key = 28.00 avg-zkey = 1.96 avg-val = 117.12 avg-zval = 37.58 usrkeys = 924885 avg-key = 20.00 avg-zkey = 1.96 avg-val = 122.37 avg-zval = 37.58 TagRS{ kinds = RS_Key0_TagN bytes = 144600 } TagArray{ size = 693453 bytes = 2427104 } seq expand size = 4854171 multi value expand size = 0 cnt WriteAppend = 38 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0348 GB dict = 1.08 MB all = 0.0402 GB } UnZip/Zip{ index = 10.1784 value = 3.1166 dict = 1.00 all = 3.3358 } Zip/UnZip{ index = 0.0982 value = 0.3209 dict = 1.00 all = 0.2998 } ---------------------------- total value len = 0.896239 GB avg = 0.121 KB (by entry num) total key len = 0.207481 GB avg = 0.028 KB total ukey len = 0.148201 GB avg = 0.020 KB total ukey num = 0.007410045 Billion total entry num = 0.007410045 Billion write speed all = 0.046943814 MB/sec (with seq num) write speed all = 0.044422481 MB/sec (without seq num) 2024/11/20-15:19:33.395753 140257508513344 [compaction_job.cc:1948] [default] [JOB 12312] Generated table #39048: 924885 keys, 40235442 bytes, temperature: kWarm 2024/11/20-15:19:33.395812 140257508513344 EVENT_LOG_v1 {"time_micros": 1732087173395784, "cf_name": "default", "job": 12312, "event": "table_file_creation", "file_number": 39048, "file_size": 40235442, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 694819337, "table_properties": {"data_size": 34755632, "index_size": 1817344, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25896780, "raw_average_key_size": 28, "raw_value_size": 108320998, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 924885, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732087170, "oldest_key_time": 0, "file_creation_time": 1732087170, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "92E45FH6K6HCJOD41QCQ", "orig_file_number": 39048, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-15:19:33.432583 140257508513344 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12312/att-00/039049.sst) /dev/shm/ToplingTemp/Topling-475902-1osZ3H 2024/11/20-15:19:34.254283 140257508513344 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12312/att-00/039049.sst): first pass time = 0.82's, 163.348'MB/sec 2024/11/20-15:19:35.365779 140257508513344 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12312/att-00/039049.sst): old prealloc_size = 147639500, real_size = 36363360 2024/11/20-15:19:35.366422 140257508513344 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12312/att-00/039049.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 923610 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1084 GB zip-val = 0.0344 GB avg-val = 117.32 avg-zval = 37.22 2024/11/20-15:19:35.367214 140257508513344 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12312/att-00/039049.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-15:19:36.188781 140257508513344 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12312/att-00/039049.sst): second pass time = 1.11's, 97.556'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.82's, 49.015'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2833.192'MB/sec (index lex order gen) rebuild zvType time = 0.69's, 0.333'MB/sec write SST data time = 0.13's, 312.144'MB/sec dict compress time = 140278.11's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.083'MB, throughput = 20714.237'MB/sec zip my value time = 1.11's, unzip length = 0.108'GB zip my value throughput = 97.556'MB/sec zip pipeline throughput = 97.556'MB/sec entries = 923610 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.32 avg-zval = 37.22 usrkeys = 923610 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.32 avg-zval = 37.22 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 923610 bytes = 3117200 } seq expand size = 6465270 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0185 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0344 GB dict = 1.08 MB all = 0.0403 GB } UnZip/Zip{ index = 10.5128 value = 3.1522 dict = 1.00 all = 3.3273 } Zip/UnZip{ index = 0.0951 value = 0.3172 dict = 1.00 all = 0.3005 } ---------------------------- total value len = 1.011061 GB avg = 0.121 KB (by entry num) total key len = 0.233342 GB avg = 0.028 KB total ukey len = 0.166673 GB avg = 0.020 KB total ukey num = 0.008333655 Billion total entry num = 0.008333655 Billion write speed all = 0.052920999 MB/sec (with seq num) write speed all = 0.050085741 MB/sec (without seq num) 2024/11/20-15:19:36.237231 140257508513344 [compaction_job.cc:1948] [default] [JOB 12312] Generated table #39049: 923610 keys, 40338320 bytes, temperature: kWarm 2024/11/20-15:19:36.237290 140257508513344 EVENT_LOG_v1 {"time_micros": 1732087176237261, "cf_name": "default", "job": 12312, "event": "table_file_creation", "file_number": 39049, "file_size": 40338320, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 591121934, "largest_seqno": 694819424, "table_properties": {"data_size": 34375184, "index_size": 1757120, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25861080, "raw_average_key_size": 28, "raw_value_size": 108356684, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 923610, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732087173, "oldest_key_time": 0, "file_creation_time": 1732087173, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "92E45FH6K6HCJOD41QCQ", "orig_file_number": 39049, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-15:19:36.279247 140257508513344 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12312/att-00/039050.sst) /dev/shm/ToplingTemp/Topling-475902-gcQ52E 2024/11/20-15:19:37.100931 140257508513344 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12312/att-00/039050.sst): first pass time = 0.82's, 163.351'MB/sec 2024/11/20-15:19:38.232909 140257508513344 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12312/att-00/039050.sst): old prealloc_size = 147639500, real_size = 36265568 2024/11/20-15:19:38.233537 140257508513344 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12312/att-00/039050.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 923482 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.93 raw-val = 0.1084 GB zip-val = 0.0343 GB avg-val = 117.34 avg-zval = 37.09 2024/11/20-15:19:38.234369 140257508513344 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12312/att-00/039050.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-15:19:39.059975 140257508513344 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12312/att-00/039050.sst): second pass time = 1.13's, 95.799'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.83's, 48.794'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2939.295'MB/sec (index lex order gen) rebuild zvType time = 0.70's, 0.332'MB/sec write SST data time = 0.13's, 310.231'MB/sec dict compress time = 140278.11's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.083'MB, throughput = 17833.819'MB/sec zip my value time = 1.13's, unzip length = 0.108'GB zip my value throughput = 95.799'MB/sec zip pipeline throughput = 95.799'MB/sec entries = 923482 avg-key = 28.00 avg-zkey = 1.93 avg-val = 117.34 avg-zval = 37.09 usrkeys = 923482 avg-key = 20.00 avg-zkey = 1.93 avg-val = 124.34 avg-zval = 37.09 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 923482 bytes = 3232208 } seq expand size = 6464374 multi value expand size = 0 cnt WriteAppend = 16 UnZipSize{ index = 0.0185 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0343 GB dict = 1.08 MB all = 0.0404 GB } UnZip/Zip{ index = 10.3756 value = 3.1634 dict = 1.00 all = 3.3259 } Zip/UnZip{ index = 0.0964 value = 0.3161 dict = 1.00 all = 0.3007 } ---------------------------- total value len = 1.125885 GB avg = 0.122 KB (by entry num) total key len = 0.259200 GB avg = 0.028 KB total ukey len = 0.185143 GB avg = 0.020 KB total ukey num = 0.009257137 Billion total entry num = 0.009257137 Billion write speed all = 0.058896627 MB/sec (with seq num) write speed all = 0.055747569 MB/sec (without seq num) 2024/11/20-15:19:39.107907 140257508513344 [compaction_job.cc:1948] [default] [JOB 12312] Generated table #39050: 923482 keys, 40355450 bytes, temperature: kWarm 2024/11/20-15:19:39.107962 140257508513344 EVENT_LOG_v1 {"time_micros": 1732087179107933, "cf_name": "default", "job": 12312, "event": "table_file_creation", "file_number": 39050, "file_size": 40355450, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 487201374, "largest_seqno": 694819856, "table_properties": {"data_size": 34254416, "index_size": 1780096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25857496, "raw_average_key_size": 28, "raw_value_size": 108360244, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 923482, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732087176, "oldest_key_time": 0, "file_creation_time": 1732087176, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "92E45FH6K6HCJOD41QCQ", "orig_file_number": 39050, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-15:19:39.146828 140257508513344 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12312/att-00/039051.sst) /dev/shm/ToplingTemp/Topling-475902-neXi3G 2024/11/20-15:19:39.915627 140257508513344 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12312/att-00/039051.sst): first pass time = 0.77's, 174.588'MB/sec 2024/11/20-15:19:41.214305 140257508513344 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12312/att-00/039051.sst): old prealloc_size = 147639500, real_size = 36790912 2024/11/20-15:19:41.214932 140257508513344 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12312/att-00/039051.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927248 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.94 raw-val = 0.1083 GB zip-val = 0.0348 GB avg-val = 116.75 avg-zval = 37.49 2024/11/20-15:19:41.215255 140257508513344 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12312/att-00/039051.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-15:19:41.935282 140257508513344 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12312/att-00/039051.sst): second pass time = 1.30's, 83.412'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.72's, 53.553'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2965.356'MB/sec (index lex order gen) rebuild zvType time = 0.59's, 0.392'MB/sec write SST data time = 0.13's, 299.033'MB/sec dict compress time = 140278.11's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 31641.934'MB/sec zip my value time = 1.30's, unzip length = 0.108'GB zip my value throughput = 83.412'MB/sec zip pipeline throughput = 83.412'MB/sec entries = 927248 avg-key = 28.00 avg-zkey = 1.94 avg-val = 116.75 avg-zval = 37.49 usrkeys = 927248 avg-key = 20.00 avg-zkey = 1.94 avg-val = 118.51 avg-zval = 37.49 TagRS{ kinds = RS_Key0_TagN bytes = 145000 } TagArray{ size = 232965 bytes = 815392 } seq expand size = 1630755 multi value expand size = 0 cnt WriteAppend = 22 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0348 GB dict = 1.08 MB all = 0.0386 GB } UnZip/Zip{ index = 10.3083 value = 3.1144 dict = 1.00 all = 3.4763 } Zip/UnZip{ index = 0.0970 value = 0.3211 dict = 1.00 all = 0.2877 } ---------------------------- total value len = 1.235771 GB avg = 0.121 KB (by entry num) total key len = 0.285163 GB avg = 0.028 KB total ukey len = 0.203688 GB avg = 0.020 KB total ukey num = 0.010184385 Billion total entry num = 0.010184385 Billion write speed all = 0.064665280 MB/sec (with seq num) write speed all = 0.061201217 MB/sec (without seq num) 2024/11/20-15:19:41.981936 140257508513344 [compaction_job.cc:1948] [default] [JOB 12312] Generated table #39051: 927248 keys, 38609263 bytes, temperature: kWarm 2024/11/20-15:19:41.981994 140257508513344 EVENT_LOG_v1 {"time_micros": 1732087181981965, "cf_name": "default", "job": 12312, "event": "table_file_creation", "file_number": 39051, "file_size": 38609263, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 694819479, "table_properties": {"data_size": 34759856, "index_size": 1799040, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25962944, "raw_average_key_size": 28, "raw_value_size": 108254912, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927248, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732087179, "oldest_key_time": 0, "file_creation_time": 1732087179, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "92E45FH6K6HCJOD41QCQ", "orig_file_number": 39051, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-15:19:42.016484 140257508513344 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12312/att-00/039052.sst) /dev/shm/ToplingTemp/Topling-475902-VrRkZE 2024/11/20-15:19:42.822023 140257508513344 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12312/att-00/039052.sst): first pass time = 0.81's, 166.624'MB/sec 2024/11/20-15:19:43.986792 140257508513344 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12312/att-00/039052.sst): old prealloc_size = 147639500, real_size = 34757408 2024/11/20-15:19:43.987445 140257508513344 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12312/att-00/039052.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 924593 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1083 GB zip-val = 0.0328 GB avg-val = 117.16 avg-zval = 35.43 2024/11/20-15:19:43.988254 140257508513344 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12312/att-00/039052.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-15:19:44.813194 140257508513344 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12312/att-00/039052.sst): second pass time = 1.16's, 93.071'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.83's, 47.016'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2814.165'MB/sec (index lex order gen) rebuild zvType time = 0.70's, 0.332'MB/sec write SST data time = 0.13's, 299.799'MB/sec dict compress time = 140278.11's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.082'MB, throughput = 20756.458'MB/sec zip my value time = 1.16's, unzip length = 0.108'GB zip my value throughput = 93.071'MB/sec zip pipeline throughput = 93.071'MB/sec entries = 924593 avg-key = 28.00 avg-zkey = 1.92 avg-val = 117.16 avg-zval = 35.43 usrkeys = 924593 avg-key = 20.00 avg-zkey = 1.92 avg-val = 124.16 avg-zval = 35.43 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 924593 bytes = 3236096 } seq expand size = 6472151 multi value expand size = 0 cnt WriteAppend = 15 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0328 GB dict = 1.08 MB all = 0.0389 GB } UnZip/Zip{ index = 10.4426 value = 3.3072 dict = 1.00 all = 3.4545 } Zip/UnZip{ index = 0.0958 value = 0.3024 dict = 1.00 all = 0.2895 } ---------------------------- total value len = 1.350572 GB avg = 0.122 KB (by entry num) total key len = 0.311051 GB avg = 0.028 KB total ukey len = 0.222180 GB avg = 0.020 KB total ukey num = 0.011108978 Billion total entry num = 0.011108978 Billion write speed all = 0.070638330 MB/sec (with seq num) write speed all = 0.066860244 MB/sec (without seq num) 2024/11/20-15:19:44.860299 140257508513344 [compaction_job.cc:1948] [default] [JOB 12312] Generated table #39052: 924593 keys, 38853456 bytes, temperature: kWarm 2024/11/20-15:19:44.860351 140257508513344 EVENT_LOG_v1 {"time_micros": 1732087184860324, "cf_name": "default", "job": 12312, "event": "table_file_creation", "file_number": 39052, "file_size": 38853456, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 491740713, "largest_seqno": 694819960, "table_properties": {"data_size": 32755280, "index_size": 1770816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25888604, "raw_average_key_size": 28, "raw_value_size": 108329262, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 924593, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732087182, "oldest_key_time": 0, "file_creation_time": 1732087182, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "92E45FH6K6HCJOD41QCQ", "orig_file_number": 39052, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-15:19:44.897509 140257508513344 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12312/att-00/039053.sst) /dev/shm/ToplingTemp/Topling-475902-DIgaPH 2024/11/20-15:19:45.732056 140257508513344 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12312/att-00/039053.sst): first pass time = 0.83's, 160.835'MB/sec 2024/11/20-15:19:46.870502 140257508513344 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12312/att-00/039053.sst): old prealloc_size = 147639500, real_size = 36625376 2024/11/20-15:19:46.871148 140257508513344 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12312/att-00/039053.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 929695 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1082 GB zip-val = 0.0346 GB avg-val = 116.37 avg-zval = 37.23 2024/11/20-15:19:46.871926 140257508513344 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12312/att-00/039053.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-15:19:47.683496 140257508513344 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12312/att-00/039053.sst): second pass time = 1.14's, 95.092'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.81's, 49.959'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2851.045'MB/sec (index lex order gen) rebuild zvType time = 0.68's, 0.340'MB/sec write SST data time = 0.13's, 313.310'MB/sec dict compress time = 140278.11's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 33152.776'MB/sec zip my value time = 1.14's, unzip length = 0.108'GB zip my value throughput = 95.092'MB/sec zip pipeline throughput = 95.092'MB/sec entries = 929695 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.37 avg-zval = 37.23 usrkeys = 929695 avg-key = 20.00 avg-zkey = 1.91 avg-val = 123.37 avg-zval = 37.23 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 929695 bytes = 3137728 } seq expand size = 6507865 multi value expand size = 0 cnt WriteAppend = 15 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0346 GB dict = 1.08 MB all = 0.0406 GB } UnZip/Zip{ index = 10.4447 value = 3.1256 dict = 1.00 all = 3.3046 } Zip/UnZip{ index = 0.0957 value = 0.3199 dict = 1.00 all = 0.3026 } ---------------------------- total value len = 1.465267 GB avg = 0.122 KB (by entry num) total key len = 0.337083 GB avg = 0.028 KB total ukey len = 0.240773 GB avg = 0.020 KB total ukey num = 0.012038673 Billion total entry num = 0.012038673 Billion write speed all = 0.076611461 MB/sec (with seq num) write speed all = 0.072517692 MB/sec (without seq num) 2024/11/20-15:19:47.733057 140257508513344 [compaction_job.cc:1948] [default] [JOB 12312] Generated table #39053: 929695 keys, 40615748 bytes, temperature: kWarm 2024/11/20-15:19:47.733117 140257508513344 EVENT_LOG_v1 {"time_micros": 1732087187733086, "cf_name": "default", "job": 12312, "event": "table_file_creation", "file_number": 39053, "file_size": 40615748, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 621221382, "largest_seqno": 694819764, "table_properties": {"data_size": 34612560, "index_size": 1780224, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26031460, "raw_average_key_size": 28, "raw_value_size": 108186390, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 929695, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732087184, "oldest_key_time": 0, "file_creation_time": 1732087184, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "92E45FH6K6HCJOD41QCQ", "orig_file_number": 39053, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-15:19:47.772142 140257508513344 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12312/att-00/039054.sst) /dev/shm/ToplingTemp/Topling-475902-qQnD9H 2024/11/20-15:19:47.848459 140257508513344 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12312/att-00/039054.sst): first pass time = 0.08's, 252.138'MB/sec 2024/11/20-15:19:48.007760 140257508513344 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12312/att-00/039054.sst): old prealloc_size = 147639500, real_size = 5793712 2024/11/20-15:19:48.007902 140257508513344 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12312/att-00/039054.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 133344 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0003 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.0155 GB zip-val = 0.0055 GB avg-val = 116.25 avg-zval = 41.29 2024/11/20-15:19:48.008077 140257508513344 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12312/att-00/039054.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.019 GB 2024/11/20-15:19:48.121019 140257508513344 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12312/att-00/039054.sst): second pass time = 0.16's, 97.718'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.11's, 56.437'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2083.553'MB/sec (index lex order gen) rebuild zvType time = 0.09's, 0.352'MB/sec write SST data time = 0.02's, 346.966'MB/sec dict compress time = 140278.11's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.162'MB, throughput = 4704.924'MB/sec zip my value time = 0.16's, unzip length = 0.016'GB zip my value throughput = 97.718'MB/sec zip pipeline throughput = 97.718'MB/sec entries = 133344 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.25 avg-zval = 41.29 usrkeys = 133344 avg-key = 20.00 avg-zkey = 1.91 avg-val = 123.25 avg-zval = 41.29 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 133344 bytes = 466720 } seq expand size = 933408 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0027 GB value = 0.0155 GB dict = 0.16 MB all = 0.0192 GB } __ZipSize{ index = 0.0003 GB value = 0.0055 GB dict = 0.16 MB all = 0.0064 GB } UnZip/Zip{ index = 10.4541 value = 2.8159 dict = 1.00 all = 3.0096 } Zip/UnZip{ index = 0.0957 value = 0.3551 dict = 1.00 all = 0.3323 } ---------------------------- total value len = 1.481702 GB avg = 0.122 KB (by entry num) total key len = 0.340816 GB avg = 0.028 KB total ukey len = 0.243440 GB avg = 0.020 KB total ukey num = 0.012172017 Billion total entry num = 0.012172017 Billion write speed all = 0.077467320 MB/sec (with seq num) write speed all = 0.073328284 MB/sec (without seq num) 2024/11/20-15:19:48.134891 140257508513344 [compaction_job.cc:1948] [default] [JOB 12312] Generated table #39054: 133344 keys, 6391261 bytes, temperature: kWarm 2024/11/20-15:19:48.134940 140257508513344 EVENT_LOG_v1 {"time_micros": 1732087188134914, "cf_name": "default", "job": 12312, "event": "table_file_creation", "file_number": 39054, "file_size": 6391261, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 542625257, "largest_seqno": 694817933, "table_properties": {"data_size": 5505120, "index_size": 255104, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 3733632, "raw_average_key_size": 28, "raw_value_size": 15501656, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 133344, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732087187, "oldest_key_time": 0, "file_creation_time": 1732087187, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "92E45FH6K6HCJOD41QCQ", "orig_file_number": 39054, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-15:19:48.147732 140257508513344 [compaction_job.cc:703] job-12312: subcompact[0], size: 0.517440 G, files: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12312/att-00 [039041,039042,039043,039044,039045,039046,039047,039048,039049,039050,039051,039052,039053,039054] 2024/11/20-15:19:48.240037 140257508513344 (Original Log Time 2024/11/20-15:19:09.948818) EVENT_LOG_v1 {"time_micros": 1732087149948779, "job": 12312, "event": "compaction_started", "compaction_reason": "FilesMarkedForCompaction", "files_L2": [39020], "files_L3": [38991, 38992, 38993, 38994, 38995, 38996, 38997, 38998, 38999, 39000, 39001, 39002, 39031], "score": 0.999513, "input_data_size": 539627232, "oldest_snapshot_seqno": 696418882} 2024/11/20-15:19:48.240040 140257508513344 (Original Log Time 2024/11/20-15:19:48.238838) [compaction_job.cc:2022] [default] [JOB 12312] Compacted 1@2 + 13@3 files to L3 => 517439763 bytes 2024/11/20-15:19:48.240042 140257508513344 (Original Log Time 2024/11/20-15:19:48.239970) [compaction_job.cc:1224] [default] compacted to: files[0 0 0 14 0 0 0] max score 0.02, MB/sec: 14.1 rd, 13.5 wr, level 3, files in(1, 13) out(14 +0 blob) MB in(27.1, 487.5 +0.0 blob) out(493.5 +0.0 blob), read-write-amplify(37.2) write-amplify(18.2) OK, records in: 12272613, records dropped: 100596 output_compression: Snappy 2024/11/20-15:19:48.240060 140257508513344 (Original Log Time 2024/11/20-15:19:48.240016) EVENT_LOG_v1 {"time_micros": 1732087188239991, "cf": "default", "job": 12312, "event": "compaction_finished", "compaction_time_micros": 38198918, "compaction_time_cpu_micros": 16909023, "output_level": 3, "num_output_files": 14, "total_output_size": 517439763, "num_input_records": 12272613, "num_output_records": 12172017, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "file_write_nanos": 359287204, "file_range_sync_nanos": 0, "file_fsync_nanos": 12501, "file_prepare_write_nanos": 39324, "lsm_state": [0, 0, 0, 14, 0, 0, 0]} 2024/11/20-15:19:48.368720 140257508513344 DEBG dcompact_worker.cpp:240: HttpPost: 200 OK: url = http://nlb-7zny4kaa1poal01o64.cn-shenzhen.nlb.aliyuncs.com:8443, body = {"instanceId":"nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137","labourId":"","dbId":"d89b4006-2803-486e-b7a2-759bcf348921","dbStarts":1732076400,"starts":1732087149,"executesMs":38444,"compactionJobId":12312,"attempt":0,"compactionInputRawBytes":1778351366,"compactionInputZipBytes":539627232,"compactionOutputRawBytes":0,"compactionOutputZipBytes":517439763,"headers":{"Accept":"*/*","Connection":"close","Host":"aliyun-topling-saas.topling.cn:18443","RemoteIp":"120.24.192.169","X-Forwarded-For":"120.24.192.169","region":"cn-shenzhen","token":"e6474c481bd4415abc537135cc03626b","instance-token":"e6474c481bd4415abc537135cc03626b","provider":"aliyun","CloudMarketInstanceId":"si-59c0ae5c955845588903","MeteringAssit":"","Transfer-Encoding":"chunked","traceparent":"00-e0d5f23322654c031cd1ce7eed065d53-4f2ff12e1bd1f99c-00"}}, response = 2024/11/20-15:19:48.368770 140257508513344 INFO dcompact_worker.cpp:1464: finish /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-20T12.20.00/.rocksdb/job-12312/att-00: olev 3, work 38.444 s, result 7.831 ms, install 1.235 ms, input{raw 1.656 GiB zip 514.629 MiB}