2024/11/20-13:42:43.316415 140257021736512 DEBG dcompact_worker.cpp:2219: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07873/att-00: fork to child time = 0.009781 sec 2024/11/20-13:42:43.316902 140257021736512 DEBG dcompact_worker.cpp:1013: Beg SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07873/att-00 2024/11/20-13:42:43.328937 140257021736512 DEBG dcompact_worker.cpp:1033: End SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07873/att-00 2024/11/20-13:42:43.330580 140257021736512 TRAC dcompact_worker.cpp:1083: INFO_LOG_LEVEL: rpc = INFO_LEVEL, env_var = undefined 2024/11/20-13:42:43.330815 140257021736512 [WARN] [column_family.cc:386] multiple cf_paths/db_paths and level_compaction_dynamic_level_bytes can't be used together 2024/11/20-13:42:43.374134 140257021736512 [version_set.cc:6211] Recovering from manifest file: /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-20T12.20.00/.rocksdb/job-07873/att-00/MANIFEST-019309 2024/11/20-13:42:43.426175 140257021736512 [version_set.cc:6254] Recovered from manifest file:/worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-20T12.20.00/.rocksdb/job-07873/att-00/MANIFEST-019309 succeeded,manifest_file_number is 19309, next_file_number is 31268, last_sequence is 583174388, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 31097 2024/11/20-13:42:43.426181 140257021736512 [version_set.cc:6269] Column family [default] (ID 0), log number is 0 2024/11/20-13:42:43.426262 140257021736512 [version_set.cc:5724] Creating manifest 31268 2024/11/20-13:42:43.458211 140257021736512 DEBG dcompact_worker.cpp:1225: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07873/att-00: bottommost_level: fake = 1, rpc = 0 2024/11/20-13:42:43.484162 140257021736512 [compaction_job.cc:2437] [default] [JOB 7873] Compacting 1@2 + 10@3 files to L3, score 0.80, subcompactions 1 : 1 2024/11/20-13:42:43.484175 140257021736512 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 7180 Base level 2, inputs: [31259(22MB)], [31203(124MB) 31204(124MB) 31205(124MB) 31206(124MB) 31207(100MB) 31208(100MB) 31209(124MB) 31210(124MB) 31211(100MB) 31212(116MB)] 2024/11/20-13:42:43.491665 140257021736512 [top_zip_table.cc:59] core git_version_hash_info_is:commit 81964c21ebbcc178d8e99dae0fbf61bded2729cc Author: rockeet Date: Mon Nov 11 21:28:46 2024 +0800 Makefile: fix gen git-version-*.cpp GIT_PATH_ARG = :!src/terark/fsa :!tools/fsa :!src/terark/zbs :!tools/zbs g++ (GCC) 12.2.1 20221121 (Red Hat 12.2.1-7) Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/zstd -Iboost-include DEFS = -DTOPLING_IO_WITH_URING=1 -DDIVSUFSORT_API= CXXFLAGS = -fPIC -time -fdiagnostics-color -mcx16 -fno-stack-protector WARNINGS = -Wno-class-memaccess -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -Wno-deprecated-declarations -Wstrict-aliasing=3 RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 LDFLAGS = -fPIC -rdynamic 2024/11/20-13:42:43.491688 140257021736512 [top_zip_table.cc:60] fsa git_version_hash_info_is:commit 5dfecb7d107196f044ff5bf78dc39d2e725b9d9b Author: leipeng Date: Thu Nov 7 15:22:45 2024 +0800 Makefile: fix for x86_64 CPU older than haswell GIT_PATH_ARG = src/terark/fsa tools/fsa g++ (GCC) 12.2.1 20221121 (Red Hat 12.2.1-7) Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/zstd -Iboost-include DEFS = -DTOPLING_IO_WITH_URING=1 -DDIVSUFSORT_API= CXXFLAGS = -fPIC -time -fdiagnostics-color -mcx16 -fno-stack-protector WARNINGS = -Wno-class-memaccess -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -Wno-deprecated-declarations -Wstrict-aliasing=3 RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 LDFLAGS = -fPIC -rdynamic 2024/11/20-13:42:43.491706 140257021736512 [top_zip_table.cc:61] zbs git_version_hash_info_is:commit d44dd5ff72707128fe3c916077b43d2093c01f7c Author: leipeng Date: Sun Oct 27 23:38:26 2024 +0800 Fix for msvc, when toplingdb on msvc GIT_PATH_ARG = src/terark/zbs tools/zbs g++ (GCC) 12.2.1 20221121 (Red Hat 12.2.1-7) Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/zstd -Iboost-include DEFS = -DTOPLING_IO_WITH_URING=1 -DDIVSUFSORT_API= CXXFLAGS = -fPIC -time -fdiagnostics-color -mcx16 -fno-stack-protector WARNINGS = -Wno-class-memaccess -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -Wno-deprecated-declarations -Wstrict-aliasing=3 RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 LDFLAGS = -fPIC -rdynamic 2024/11/20-13:42:43.491719 140257021736512 [top_zip_table.cc:62] topling-zip_table_reader: git_version_hash_info_is: commit 79614a7e7dc27362fc5151b0797eb7d83c674c7b Author: rockeet Date: Sun Nov 10 15:02:21 2024 +0800 cpu_has_bmi2.sh: detect by compile c++ code check __BMI2__ g++ (GCC) 12.2.1 20221121 (Red Hat 12.2.1-7) Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/20-13:42:43.491731 140257021736512 [top_zip_table.cc:64] topling-rocks git_version_hash_info_is: commit c46b65a52d9c74aa8b87aeb8438620ff2dbc669c Author: rockeet Date: Sun Nov 10 15:02:42 2024 +0800 cpu_has_bmi2.sh: detect by compile c++ code check __BMI2__ g++ (GCC) 12.2.1 20221121 (Red Hat 12.2.1-7) Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/20-13:42:44.910447 140257021736512 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07873/att-00/031269.sst) /dev/shm/ToplingTemp/Topling-249064-EkBDie 2024/11/20-13:42:45.065728 140257021736512 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07873/att-00/031269.sst): first pass time = 0.16's, 864.628'MB/sec 2024/11/20-13:42:46.194861 140257021736512 [top_zip_table_builder.cc:2752] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07873/att-00/031269.sst): part-0: reject ZipStore ratio = 0.804 2024/11/20-13:42:46.450879 140257021736512 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07873/att-00/031269.sst): old prealloc_size = 147639500, real_size = 130036016 2024/11/20-13:42:46.451028 140257021736512 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07873/att-00/031269.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = ZipOffsetBlobStore usrkeys = 200102 prefix = 4 raw-key = 0.0024 GB zip-key = 0.0004 GB avg-key = 12.00 avg-zkey = 1.79 raw-val = 0.1294 GB zip-val = 0.1296 GB avg-val = 646.75 avg-zval = 647.81 2024/11/20-13:42:46.451248 140257021736512 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07873/att-00/031269.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0005 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-13:42:46.803227 140257021736512 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07873/att-00/031269.sst): second pass time = 1.13's, 114.698'MB/sec, value only(96.4% of KV) wait indexing time = 0.26's, remap KeyValue time = 0.35's, 370.910'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2630.195'MB/sec (index lex order gen) rebuild zvType time = 0.30's, 0.168'MB/sec write SST data time = 0.05's, 2396.053'MB/sec dict compress time = 2843009850.57's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.000'MB, throughput = 0.000'MB/sec zip my value time = 1.13's, unzip length = 0.129'GB zip my value throughput = 114.698'MB/sec zip pipeline throughput = 231.358'MB/sec entries = 200102 avg-key = 24.00 avg-zkey = 1.79 avg-val = 646.75 avg-zval = 647.81 usrkeys = 200102 avg-key = 16.00 avg-zkey = 1.79 avg-val = 653.75 avg-zval = 647.81 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 200102 bytes = 700368 } seq expand size = 1400714 multi value expand size = 0 cnt WriteAppend = 15808 UnZipSize{ index = 0.0032 GB value = 0.1294 GB dict = 0.00 MB all = 0.1342 GB } __ZipSize{ index = 0.0004 GB value = 0.1296 GB dict = 0.00 MB all = 0.1307 GB } UnZip/Zip{ index = 8.9507 value = 0.9984 dict = 0.00 all = 1.0270 } Zip/UnZip{ index = 0.1117 value = 1.0016 dict = 0.00 all = 0.9737 } ---------------------------- total value len = 0.130817 GB avg = 0.654 KB (by entry num) total key len = 0.004802 GB avg = 0.024 KB total ukey len = 0.003202 GB avg = 0.016 KB total ukey num = 0.000200102 Billion total entry num = 0.000200102 Billion write speed all = 0.007659942 MB/sec (with seq num) write speed all = 0.007569526 MB/sec (without seq num) 2024/11/20-13:42:46.950357 140257021736512 [compaction_job.cc:1948] [default] [JOB 7873] Generated table #31269: 200102 keys, 130689183 bytes, temperature: kWarm 2024/11/20-13:42:46.950441 140257021736512 EVENT_LOG_v1 {"time_micros": 1732081366950402, "cf_name": "default", "job": 7873, "event": "table_file_creation", "file_number": 31269, "file_size": 130689183, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 420730534, "largest_seqno": 583105312, "table_properties": {"data_size": 129628128, "index_size": 357696, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 4802448, "raw_average_key_size": 24, "raw_value_size": 129415840, "raw_average_value_size": 646, "num_data_blocks": 1, "num_entries": 200102, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 24, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-ZipOffsetBlobStore", "creation_time": 1732081364, "oldest_key_time": 0, "file_creation_time": 1732081364, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "92E45FH6K6HCJOD41QCQ", "orig_file_number": 31269, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-13:42:47.005789 140257021736512 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07873/att-00/031270.sst) /dev/shm/ToplingTemp/Topling-249064-lQG0nd 2024/11/20-13:42:48.604638 140257021736512 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07873/att-00/031270.sst): first pass time = 1.60's, 83.949'MB/sec 2024/11/20-13:42:49.635928 140257021736512 [top_zip_table_builder.cc:2752] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07873/att-00/031270.sst): part-0: reject ZipStore ratio = 0.803 2024/11/20-13:42:49.940644 140257021736512 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07873/att-00/031270.sst): old prealloc_size = 147639500, real_size = 130026848 2024/11/20-13:42:49.940832 140257021736512 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07873/att-00/031270.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = ZipOffsetBlobStore usrkeys = 200167 prefix = 4 raw-key = 0.0024 GB zip-key = 0.0004 GB avg-key = 12.00 avg-zkey = 1.75 raw-val = 0.1294 GB zip-val = 0.1296 GB avg-val = 646.53 avg-zval = 647.59 2024/11/20-13:42:49.941104 140257021736512 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07873/att-00/031270.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0005 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-13:42:50.309464 140257021736512 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07873/att-00/031270.sst): second pass time = 1.03's, 125.610'MB/sec, value only(96.4% of KV) wait indexing time = 0.30's, remap KeyValue time = 0.37's, 354.290'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2046.684'MB/sec (index lex order gen) rebuild zvType time = 0.30's, 0.168'MB/sec write SST data time = 0.07's, 1828.684'MB/sec dict compress time = 2843009850.57's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.000'MB, throughput = 0.000'MB/sec zip my value time = 1.03's, unzip length = 0.129'GB zip my value throughput = 125.610'MB/sec zip pipeline throughput = 125.610'MB/sec entries = 200167 avg-key = 24.00 avg-zkey = 1.75 avg-val = 646.53 avg-zval = 647.59 usrkeys = 200167 avg-key = 16.00 avg-zkey = 1.75 avg-val = 653.10 avg-zval = 647.59 TagRS{ kinds = RS_Key0_TagN bytes = 31360 } TagArray{ size = 187826 bytes = 657408 } seq expand size = 1314782 multi value expand size = 0 cnt WriteAppend = 15808 UnZipSize{ index = 0.0032 GB value = 0.1294 GB dict = 0.00 MB all = 0.1342 GB } __ZipSize{ index = 0.0004 GB value = 0.1296 GB dict = 0.00 MB all = 0.1307 GB } UnZip/Zip{ index = 9.1384 value = 0.9984 dict = 0.00 all = 1.0272 } Zip/UnZip{ index = 0.1094 value = 1.0016 dict = 0.00 all = 0.9736 } ---------------------------- total value len = 0.261545 GB avg = 0.653 KB (by entry num) total key len = 0.009606 GB avg = 0.024 KB total ukey len = 0.006404 GB avg = 0.016 KB total ukey num = 0.000400269 Billion total entry num = 0.000400269 Billion write speed all = 0.015311967 MB/sec (with seq num) write speed all = 0.015131141 MB/sec (without seq num) 2024/11/20-13:42:50.445886 140257021736512 [compaction_job.cc:1948] [default] [JOB 7873] Generated table #31270: 200167 keys, 130668383 bytes, temperature: kWarm 2024/11/20-13:42:50.445952 140257021736512 EVENT_LOG_v1 {"time_micros": 1732081370445923, "cf_name": "default", "job": 7873, "event": "table_file_creation", "file_number": 31270, "file_size": 130668383, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 583105408, "table_properties": {"data_size": 129626128, "index_size": 350464, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 4804008, "raw_average_key_size": 24, "raw_value_size": 129413738, "raw_average_value_size": 646, "num_data_blocks": 1, "num_entries": 200167, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 24, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-ZipOffsetBlobStore", "creation_time": 1732081366, "oldest_key_time": 0, "file_creation_time": 1732081366, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "92E45FH6K6HCJOD41QCQ", "orig_file_number": 31270, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-13:42:50.498927 140257021736512 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07873/att-00/031271.sst) /dev/shm/ToplingTemp/Topling-249064-WYoWVh 2024/11/20-13:42:52.148307 140257021736512 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07873/att-00/031271.sst): first pass time = 1.65's, 81.377'MB/sec 2024/11/20-13:42:53.158257 140257021736512 [top_zip_table_builder.cc:2752] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07873/att-00/031271.sst): part-0: reject ZipStore ratio = 0.801 2024/11/20-13:42:53.413270 140257021736512 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07873/att-00/031271.sst): old prealloc_size = 147639500, real_size = 130015936 2024/11/20-13:42:53.413422 140257021736512 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07873/att-00/031271.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = ZipOffsetBlobStore usrkeys = 200500 prefix = 4 raw-key = 0.0024 GB zip-key = 0.0003 GB avg-key = 12.00 avg-zkey = 1.73 raw-val = 0.1294 GB zip-val = 0.1296 GB avg-val = 645.42 avg-zval = 646.48 2024/11/20-13:42:53.413582 140257021736512 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07873/att-00/031271.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0005 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-13:42:53.713066 140257021736512 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07873/att-00/031271.sst): second pass time = 1.01's, 128.214'MB/sec, value only(96.4% of KV) wait indexing time = 0.26's, remap KeyValue time = 0.30's, 435.151'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2572.211'MB/sec (index lex order gen) rebuild zvType time = 0.25's, 0.204'MB/sec write SST data time = 0.05's, 2399.376'MB/sec dict compress time = 0.00's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.000'MB, throughput = 0.000'MB/sec zip my value time = 1.01's, unzip length = 0.129'GB zip my value throughput = 128.214'MB/sec zip pipeline throughput = 153.040'MB/sec entries = 200500 avg-key = 24.00 avg-zkey = 1.73 avg-val = 645.42 avg-zval = 646.48 usrkeys = 200500 avg-key = 16.00 avg-zkey = 1.73 avg-val = 650.03 avg-zval = 646.48 TagRS{ kinds = RS_Key0_TagN bytes = 31440 } TagArray{ size = 131981 bytes = 445456 } seq expand size = 923867 multi value expand size = 0 cnt WriteAppend = 15807 UnZipSize{ index = 0.0032 GB value = 0.1294 GB dict = 0.00 MB all = 0.1342 GB } __ZipSize{ index = 0.0003 GB value = 0.1296 GB dict = 0.00 MB all = 0.1304 GB } UnZip/Zip{ index = 9.2516 value = 0.9984 dict = 0.00 all = 1.0289 } Zip/UnZip{ index = 0.1081 value = 1.0016 dict = 0.00 all = 0.9719 } ---------------------------- total value len = 0.391875 GB avg = 0.652 KB (by entry num) total key len = 0.014418 GB avg = 0.024 KB total ukey len = 0.009612 GB avg = 0.016 KB total ukey num = 0.000600769 Billion total entry num = 0.000600769 Billion write speed all = 0.022939049 MB/sec (with seq num) write speed all = 0.022667697 MB/sec (without seq num) 2024/11/20-13:42:53.858351 140257021736512 [compaction_job.cc:1948] [default] [JOB 7873] Generated table #31271: 200500 keys, 130445471 bytes, temperature: kWarm 2024/11/20-13:42:53.858418 140257021736512 EVENT_LOG_v1 {"time_micros": 1732081373858386, "cf_name": "default", "job": 7873, "event": "table_file_creation", "file_number": 31271, "file_size": 130445471, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 583105353, "table_properties": {"data_size": 129618864, "index_size": 346752, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 4812000, "raw_average_key_size": 24, "raw_value_size": 129406160, "raw_average_value_size": 645, "num_data_blocks": 1, "num_entries": 200500, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 24, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-ZipOffsetBlobStore", "creation_time": 1732081370, "oldest_key_time": 0, "file_creation_time": 1732081370, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "92E45FH6K6HCJOD41QCQ", "orig_file_number": 31271, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-13:42:53.909525 140257021736512 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07873/att-00/031272.sst) /dev/shm/ToplingTemp/Topling-249064-GErhVd 2024/11/20-13:42:55.322134 140257021736512 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07873/att-00/031272.sst): first pass time = 1.41's, 95.017'MB/sec 2024/11/20-13:42:56.336057 140257021736512 [top_zip_table_builder.cc:2752] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07873/att-00/031272.sst): part-0: reject ZipStore ratio = 0.800 2024/11/20-13:42:56.703177 140257021736512 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07873/att-00/031272.sst): old prealloc_size = 147639500, real_size = 130012416 2024/11/20-13:42:56.703356 140257021736512 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07873/att-00/031272.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = ZipOffsetBlobStore usrkeys = 200388 prefix = 4 raw-key = 0.0024 GB zip-key = 0.0003 GB avg-key = 12.00 avg-zkey = 1.70 raw-val = 0.1294 GB zip-val = 0.1296 GB avg-val = 645.79 avg-zval = 646.85 2024/11/20-13:42:56.703558 140257021736512 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07873/att-00/031272.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0005 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-13:42:57.046390 140257021736512 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07873/att-00/031272.sst): second pass time = 1.01's, 127.741'MB/sec, value only(96.4% of KV) wait indexing time = 0.37's, remap KeyValue time = 0.34's, 380.187'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2116.034'MB/sec (index lex order gen) rebuild zvType time = 0.28's, 0.176'MB/sec write SST data time = 0.06's, 2236.454'MB/sec dict compress time = 140278.07's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.000'MB, throughput = 0.000'MB/sec zip my value time = 1.01's, unzip length = 0.129'GB zip my value throughput = 127.741'MB/sec zip pipeline throughput = 127.741'MB/sec entries = 200388 avg-key = 24.00 avg-zkey = 1.70 avg-val = 645.79 avg-zval = 646.85 usrkeys = 200388 avg-key = 16.00 avg-zkey = 1.70 avg-val = 650.84 avg-zval = 646.85 TagRS{ kinds = RS_Key0_TagN bytes = 31400 } TagArray{ size = 144497 bytes = 487696 } seq expand size = 1011479 multi value expand size = 0 cnt WriteAppend = 15808 UnZipSize{ index = 0.0032 GB value = 0.1294 GB dict = 0.00 MB all = 0.1342 GB } __ZipSize{ index = 0.0003 GB value = 0.1296 GB dict = 0.00 MB all = 0.1305 GB } UnZip/Zip{ index = 9.4079 value = 0.9984 dict = 0.00 all = 1.0286 } Zip/UnZip{ index = 0.1063 value = 1.0016 dict = 0.00 all = 0.9722 } ---------------------------- total value len = 0.522295 GB avg = 0.652 KB (by entry num) total key len = 0.019228 GB avg = 0.024 KB total ukey len = 0.012819 GB avg = 0.016 KB total ukey num = 0.000801157 Billion total entry num = 0.000801157 Billion write speed all = 0.030568258 MB/sec (with seq num) write speed all = 0.030206464 MB/sec (without seq num) 2024/11/20-13:42:57.221757 140257021736512 [compaction_job.cc:1948] [default] [JOB 7873] Generated table #31272: 200388 keys, 130484255 bytes, temperature: kWarm 2024/11/20-13:42:57.221823 140257021736512 EVENT_LOG_v1 {"time_micros": 1732081377221794, "cf_name": "default", "job": 7873, "event": "table_file_creation", "file_number": 31272, "file_size": 130484255, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 583105074, "table_properties": {"data_size": 129621360, "index_size": 340800, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 4809312, "raw_average_key_size": 24, "raw_value_size": 129408696, "raw_average_value_size": 645, "num_data_blocks": 1, "num_entries": 200388, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 24, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-ZipOffsetBlobStore", "creation_time": 1732081373, "oldest_key_time": 0, "file_creation_time": 1732081373, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "92E45FH6K6HCJOD41QCQ", "orig_file_number": 31272, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-13:42:57.272294 140257021736512 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07873/att-00/031273.sst) /dev/shm/ToplingTemp/Topling-249064-O101Yh 2024/11/20-13:42:58.538115 140257021736512 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07873/att-00/031273.sst): first pass time = 1.27's, 106.036'MB/sec 2024/11/20-13:42:59.616948 140257021736512 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07873/att-00/031273.sst): old prealloc_size = 147639500, real_size = 103894512 2024/11/20-13:42:59.617165 140257021736512 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07873/att-00/031273.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 200593 prefix = 4 raw-key = 0.0024 GB zip-key = 0.0003 GB avg-key = 12.00 avg-zkey = 1.70 raw-val = 0.1294 GB zip-val = 0.1035 GB avg-val = 645.11 avg-zval = 515.99 2024/11/20-13:42:59.617321 140257021736512 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07873/att-00/031273.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0005 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-13:43:00.051436 140257021736512 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07873/att-00/031273.sst): second pass time = 1.08's, 120.046'MB/sec, value only(96.4% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.43's, 242.921'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1756.043'MB/sec (index lex order gen) rebuild zvType time = 0.37's, 0.137'MB/sec write SST data time = 0.07's, 1526.683'MB/sec dict compress time = 140278.07's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.351'MB, throughput = 26518.979'MB/sec zip my value time = 1.08's, unzip length = 0.129'GB zip my value throughput = 120.046'MB/sec zip pipeline throughput = 120.046'MB/sec entries = 200593 avg-key = 24.00 avg-zkey = 1.70 avg-val = 645.11 avg-zval = 515.99 usrkeys = 200593 avg-key = 16.00 avg-zkey = 1.70 avg-val = 648.35 avg-zval = 515.99 TagRS{ kinds = RS_Key0_TagN bytes = 31440 } TagArray{ size = 93076 bytes = 314144 } seq expand size = 651532 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0032 GB value = 0.1294 GB dict = 1.35 MB all = 0.1342 GB } __ZipSize{ index = 0.0003 GB value = 0.1035 GB dict = 1.35 MB all = 0.1055 GB } UnZip/Zip{ index = 9.4281 value = 1.2502 dict = 1.00 all = 1.2717 } Zip/UnZip{ index = 0.1061 value = 0.7999 dict = 1.00 all = 0.7864 } ---------------------------- total value len = 0.652350 GB avg = 0.651 KB (by entry num) total key len = 0.024042 GB avg = 0.024 KB total ukey len = 0.016028 GB avg = 0.016 KB total ukey num = 0.001001750 Billion total entry num = 0.001001750 Billion write speed all = 0.038174984 MB/sec (with seq num) write speed all = 0.037722681 MB/sec (without seq num) 2024/11/20-13:43:00.175864 140257021736512 [compaction_job.cc:1948] [default] [JOB 7873] Generated table #31273: 200593 keys, 105543917 bytes, temperature: kWarm 2024/11/20-13:43:00.175954 140257021736512 EVENT_LOG_v1 {"time_micros": 1732081380175910, "cf_name": "default", "job": 7873, "event": "table_file_creation", "file_number": 31273, "file_size": 105543917, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 583080936, "table_properties": {"data_size": 103503776, "index_size": 340416, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 4814232, "raw_average_key_size": 24, "raw_value_size": 129403677, "raw_average_value_size": 645, "num_data_blocks": 1, "num_entries": 200593, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 24, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732081377, "oldest_key_time": 0, "file_creation_time": 1732081377, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "92E45FH6K6HCJOD41QCQ", "orig_file_number": 31273, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-13:43:00.228250 140257021736512 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07873/att-00/031274.sst) /dev/shm/ToplingTemp/Topling-249064-9TIAYd 2024/11/20-13:43:01.558882 140257021736512 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07873/att-00/031274.sst): first pass time = 1.33's, 100.872'MB/sec 2024/11/20-13:43:02.494734 140257021736512 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07873/att-00/031274.sst): old prealloc_size = 147639500, real_size = 103860864 2024/11/20-13:43:02.494918 140257021736512 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07873/att-00/031274.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 200574 prefix = 4 raw-key = 0.0024 GB zip-key = 0.0003 GB avg-key = 12.00 avg-zkey = 1.69 raw-val = 0.1294 GB zip-val = 0.1035 GB avg-val = 645.17 avg-zval = 515.87 2024/11/20-13:43:02.495022 140257021736512 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07873/att-00/031274.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0005 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-13:43:02.950089 140257021736512 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07873/att-00/031274.sst): second pass time = 0.94's, 138.398'MB/sec, value only(96.4% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.46's, 231.404'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2609.685'MB/sec (index lex order gen) rebuild zvType time = 0.36's, 0.140'MB/sec write SST data time = 0.10's, 1088.289'MB/sec dict compress time = 140278.07's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.348'MB, throughput = 27855.257'MB/sec zip my value time = 0.94's, unzip length = 0.129'GB zip my value throughput = 138.398'MB/sec zip pipeline throughput = 138.398'MB/sec entries = 200574 avg-key = 24.00 avg-zkey = 1.69 avg-val = 645.17 avg-zval = 515.87 usrkeys = 200574 avg-key = 16.00 avg-zkey = 1.69 avg-val = 646.96 avg-zval = 515.87 TagRS{ kinds = RS_Key0_TagN bytes = 31440 } TagArray{ size = 51163 bytes = 172688 } seq expand size = 358141 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0032 GB value = 0.1294 GB dict = 1.35 MB all = 0.1342 GB } __ZipSize{ index = 0.0003 GB value = 0.1035 GB dict = 1.35 MB all = 0.1054 GB } UnZip/Zip{ index = 9.4521 value = 1.2506 dict = 1.00 all = 1.2738 } Zip/UnZip{ index = 0.1058 value = 0.7996 dict = 1.00 all = 0.7850 } ---------------------------- total value len = 0.782113 GB avg = 0.651 KB (by entry num) total key len = 0.028856 GB avg = 0.024 KB total ukey len = 0.019237 GB avg = 0.016 KB total ukey num = 0.001202324 Billion total entry num = 0.001202324 Billion write speed all = 0.045762855 MB/sec (with seq num) write speed all = 0.045220079 MB/sec (without seq num) 2024/11/20-13:43:03.072126 140257021736512 [compaction_job.cc:1948] [default] [JOB 7873] Generated table #31274: 200574 keys, 105365949 bytes, temperature: kWarm 2024/11/20-13:43:03.072190 140257021736512 EVENT_LOG_v1 {"time_micros": 1732081383072161, "cf_name": "default", "job": 7873, "event": "table_file_creation", "file_number": 31274, "file_size": 105365949, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 583078403, "table_properties": {"data_size": 103471024, "index_size": 339520, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 4813776, "raw_average_key_size": 24, "raw_value_size": 129404254, "raw_average_value_size": 645, "num_data_blocks": 1, "num_entries": 200574, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 24, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732081380, "oldest_key_time": 0, "file_creation_time": 1732081380, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "92E45FH6K6HCJOD41QCQ", "orig_file_number": 31274, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-13:43:03.112944 140257021736512 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07873/att-00/031275.sst) /dev/shm/ToplingTemp/Topling-249064-3kimnd 2024/11/20-13:43:04.739780 140257021736512 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07873/att-00/031275.sst): first pass time = 1.63's, 82.505'MB/sec 2024/11/20-13:43:05.732955 140257021736512 [top_zip_table_builder.cc:2752] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07873/att-00/031275.sst): part-0: reject ZipStore ratio = 0.800 2024/11/20-13:43:06.047882 140257021736512 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07873/att-00/031275.sst): old prealloc_size = 147639500, real_size = 130016032 2024/11/20-13:43:06.048088 140257021736512 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07873/att-00/031275.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = ZipOffsetBlobStore usrkeys = 200288 prefix = 4 raw-key = 0.0024 GB zip-key = 0.0003 GB avg-key = 12.00 avg-zkey = 1.71 raw-val = 0.1294 GB zip-val = 0.1296 GB avg-val = 646.13 avg-zval = 647.19 2024/11/20-13:43:06.048297 140257021736512 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07873/att-00/031275.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0005 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-13:43:06.344112 140257021736512 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07873/att-00/031275.sst): second pass time = 0.99's, 130.402'MB/sec, value only(96.4% of KV) wait indexing time = 0.32's, remap KeyValue time = 0.30's, 440.682'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1848.917'MB/sec (index lex order gen) rebuild zvType time = 0.24's, 0.209'MB/sec write SST data time = 0.06's, 2322.783'MB/sec dict compress time = 140278.07's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.000'MB, throughput = 0.000'MB/sec zip my value time = 0.99's, unzip length = 0.129'GB zip my value throughput = 130.402'MB/sec zip pipeline throughput = 130.402'MB/sec entries = 200288 avg-key = 24.00 avg-zkey = 1.71 avg-val = 646.13 avg-zval = 647.19 usrkeys = 200288 avg-key = 16.00 avg-zkey = 1.71 avg-val = 651.77 avg-zval = 647.19 TagRS{ kinds = RS_Key0_TagN bytes = 31400 } TagArray{ size = 161500 bytes = 545072 } seq expand size = 1130500 multi value expand size = 0 cnt WriteAppend = 15809 UnZipSize{ index = 0.0032 GB value = 0.1294 GB dict = 0.00 MB all = 0.1342 GB } __ZipSize{ index = 0.0003 GB value = 0.1296 GB dict = 0.00 MB all = 0.1305 GB } UnZip/Zip{ index = 9.3663 value = 0.9984 dict = 0.00 all = 1.0281 } Zip/UnZip{ index = 0.1068 value = 1.0016 dict = 0.00 all = 0.9726 } ---------------------------- total value len = 0.912654 GB avg = 0.651 KB (by entry num) total key len = 0.033663 GB avg = 0.024 KB total ukey len = 0.022442 GB avg = 0.016 KB total ukey num = 0.001402612 Billion total entry num = 0.001402612 Billion write speed all = 0.053390328 MB/sec (with seq num) write speed all = 0.052757256 MB/sec (without seq num) 2024/11/20-13:43:06.481512 140257021736512 [compaction_job.cc:1948] [default] [JOB 7873] Generated table #31275: 200288 keys, 130545439 bytes, temperature: kWarm 2024/11/20-13:43:06.481588 140257021736512 EVENT_LOG_v1 {"time_micros": 1732081386481553, "cf_name": "default", "job": 7873, "event": "table_file_creation", "file_number": 31275, "file_size": 130545439, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 583105276, "table_properties": {"data_size": 129623632, "index_size": 342144, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 4806912, "raw_average_key_size": 24, "raw_value_size": 129411102, "raw_average_value_size": 646, "num_data_blocks": 1, "num_entries": 200288, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 24, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-ZipOffsetBlobStore", "creation_time": 1732081383, "oldest_key_time": 0, "file_creation_time": 1732081383, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "92E45FH6K6HCJOD41QCQ", "orig_file_number": 31275, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-13:43:06.534822 140257021736512 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07873/att-00/031276.sst) /dev/shm/ToplingTemp/Topling-249064-hpCfae 2024/11/20-13:43:07.900789 140257021736512 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07873/att-00/031276.sst): first pass time = 1.37's, 98.263'MB/sec 2024/11/20-13:43:08.882246 140257021736512 [top_zip_table_builder.cc:2752] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07873/att-00/031276.sst): part-0: reject ZipStore ratio = 0.800 2024/11/20-13:43:09.206084 140257021736512 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07873/att-00/031276.sst): old prealloc_size = 147639500, real_size = 130008960 2024/11/20-13:43:09.206217 140257021736512 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07873/att-00/031276.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = ZipOffsetBlobStore usrkeys = 200566 prefix = 4 raw-key = 0.0024 GB zip-key = 0.0003 GB avg-key = 12.00 avg-zkey = 1.70 raw-val = 0.1294 GB zip-val = 0.1296 GB avg-val = 645.20 avg-zval = 646.26 2024/11/20-13:43:09.206375 140257021736512 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07873/att-00/031276.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0005 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-13:43:09.500313 140257021736512 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07873/att-00/031276.sst): second pass time = 0.98's, 131.944'MB/sec, value only(96.4% of KV) wait indexing time = 0.32's, remap KeyValue time = 0.29's, 443.408'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2763.784'MB/sec (index lex order gen) rebuild zvType time = 0.24's, 0.209'MB/sec write SST data time = 0.05's, 2430.365'MB/sec dict compress time = 140278.07's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.000'MB, throughput = 0.000'MB/sec zip my value time = 0.98's, unzip length = 0.129'GB zip my value throughput = 131.944'MB/sec zip pipeline throughput = 133.753'MB/sec entries = 200566 avg-key = 24.00 avg-zkey = 1.70 avg-val = 645.20 avg-zval = 646.26 usrkeys = 200566 avg-key = 16.00 avg-zkey = 1.70 avg-val = 650.23 avg-zval = 646.26 TagRS{ kinds = RS_Key0_TagN bytes = 31440 } TagArray{ size = 144063 bytes = 468224 } seq expand size = 1008441 multi value expand size = 0 cnt WriteAppend = 15807 UnZipSize{ index = 0.0032 GB value = 0.1294 GB dict = 0.00 MB all = 0.1342 GB } __ZipSize{ index = 0.0003 GB value = 0.1296 GB dict = 0.00 MB all = 0.1305 GB } UnZip/Zip{ index = 9.4074 value = 0.9984 dict = 0.00 all = 1.0288 } Zip/UnZip{ index = 0.1063 value = 1.0016 dict = 0.00 all = 0.9720 } ---------------------------- total value len = 1.043068 GB avg = 0.651 KB (by entry num) total key len = 0.038476 GB avg = 0.024 KB total ukey len = 0.025651 GB avg = 0.016 KB total ukey num = 0.001603178 Billion total entry num = 0.001603178 Billion write speed all = 0.061008832 MB/sec (with seq num) write speed all = 0.060285363 MB/sec (without seq num) 2024/11/20-13:43:09.639931 140257021736512 [compaction_job.cc:1948] [default] [JOB 7873] Generated table #31276: 200566 keys, 130461279 bytes, temperature: kWarm 2024/11/20-13:43:09.639996 140257021736512 EVENT_LOG_v1 {"time_micros": 1732081389639967, "cf_name": "default", "job": 7873, "event": "table_file_creation", "file_number": 31276, "file_size": 130461279, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 583096301, "table_properties": {"data_size": 129617520, "index_size": 341120, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 4813584, "raw_average_key_size": 24, "raw_value_size": 129404749, "raw_average_value_size": 645, "num_data_blocks": 1, "num_entries": 200566, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 24, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-ZipOffsetBlobStore", "creation_time": 1732081386, "oldest_key_time": 0, "file_creation_time": 1732081386, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "92E45FH6K6HCJOD41QCQ", "orig_file_number": 31276, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-13:43:09.694794 140257021736512 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07873/att-00/031277.sst) /dev/shm/ToplingTemp/Topling-249064-1jZRWh 2024/11/20-13:43:10.905357 140257021736512 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07873/att-00/031277.sst): first pass time = 1.21's, 110.876'MB/sec 2024/11/20-13:43:12.030384 140257021736512 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07873/att-00/031277.sst): old prealloc_size = 147639500, real_size = 103894256 2024/11/20-13:43:12.030528 140257021736512 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07873/att-00/031277.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 200577 prefix = 4 raw-key = 0.0024 GB zip-key = 0.0003 GB avg-key = 12.00 avg-zkey = 1.69 raw-val = 0.1294 GB zip-val = 0.1035 GB avg-val = 645.16 avg-zval = 516.03 2024/11/20-13:43:12.030652 140257021736512 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07873/att-00/031277.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0005 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-13:43:12.303645 140257021736512 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07873/att-00/031277.sst): second pass time = 1.12's, 115.099'MB/sec, value only(96.4% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.27's, 386.203'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2750.531'MB/sec (index lex order gen) rebuild zvType time = 0.21's, 0.236'MB/sec write SST data time = 0.06's, 1728.683'MB/sec dict compress time = 140278.07's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.350'MB, throughput = 24548.533'MB/sec zip my value time = 1.12's, unzip length = 0.129'GB zip my value throughput = 115.099'MB/sec zip pipeline throughput = 135.559'MB/sec entries = 200577 avg-key = 24.00 avg-zkey = 1.69 avg-val = 645.16 avg-zval = 516.03 usrkeys = 200577 avg-key = 16.00 avg-zkey = 1.69 avg-val = 648.40 avg-zval = 516.03 TagRS{ kinds = RS_Key0_TagN bytes = 31440 } TagArray{ size = 92736 bytes = 301408 } seq expand size = 649152 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0032 GB value = 0.1294 GB dict = 1.35 MB all = 0.1342 GB } __ZipSize{ index = 0.0003 GB value = 0.1035 GB dict = 1.35 MB all = 0.1055 GB } UnZip/Zip{ index = 9.4523 value = 1.2502 dict = 1.00 all = 1.2719 } Zip/UnZip{ index = 0.1058 value = 0.7999 dict = 1.00 all = 0.7863 } ---------------------------- total value len = 1.173121 GB avg = 0.650 KB (by entry num) total key len = 0.043290 GB avg = 0.024 KB total ukey len = 0.028860 GB avg = 0.016 KB total ukey num = 0.001803755 Billion total entry num = 0.001803755 Billion write speed all = 0.068605708 MB/sec (with seq num) write speed all = 0.067791852 MB/sec (without seq num) 2024/11/20-13:43:12.419454 140257021736512 [compaction_job.cc:1948] [default] [JOB 7873] Generated table #31277: 200577 keys, 105529535 bytes, temperature: kWarm 2024/11/20-13:43:12.419517 140257021736512 EVENT_LOG_v1 {"time_micros": 1732081392419489, "cf_name": "default", "job": 7873, "event": "table_file_creation", "file_number": 31277, "file_size": 105529535, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 583104147, "table_properties": {"data_size": 103504416, "index_size": 339520, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 4813848, "raw_average_key_size": 24, "raw_value_size": 129404158, "raw_average_value_size": 645, "num_data_blocks": 1, "num_entries": 200577, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 24, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732081389, "oldest_key_time": 0, "file_creation_time": 1732081389, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "92E45FH6K6HCJOD41QCQ", "orig_file_number": 31277, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-13:43:12.461039 140257021736512 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07873/att-00/031278.sst) /dev/shm/ToplingTemp/Topling-249064-xH9vFe 2024/11/20-13:43:13.807266 140257021736512 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07873/att-00/031278.sst): first pass time = 1.35's, 95.279'MB/sec 2024/11/20-13:43:14.805479 140257021736512 [top_zip_table_builder.cc:2752] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07873/att-00/031278.sst): part-0: reject ZipStore ratio = 0.800 2024/11/20-13:43:15.104011 140257021736512 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07873/att-00/031278.sst): old prealloc_size = 147639500, real_size = 124238512 2024/11/20-13:43:15.104159 140257021736512 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07873/att-00/031278.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = ZipOffsetBlobStore usrkeys = 191703 prefix = 4 raw-key = 0.0023 GB zip-key = 0.0003 GB avg-key = 12.00 avg-zkey = 1.69 raw-val = 0.1237 GB zip-val = 0.1239 GB avg-val = 645.07 avg-zval = 646.13 2024/11/20-13:43:15.104254 140257021736512 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07873/att-00/031278.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0004 GB, waited 0.000 sec, Key+Value = 0.128 GB 2024/11/20-13:43:15.384512 140257021736512 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07873/att-00/031278.sst): second pass time = 1.00's, 123.968'MB/sec, value only(96.4% of KV) wait indexing time = 0.30's, remap KeyValue time = 0.28's, 443.494'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2346.627'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.208'MB/sec write SST data time = 0.05's, 2508.775'MB/sec dict compress time = 140278.07's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.000'MB, throughput = 0.000'MB/sec zip my value time = 1.00's, unzip length = 0.124'GB zip my value throughput = 123.968'MB/sec zip pipeline throughput = 123.968'MB/sec entries = 191703 avg-key = 24.00 avg-zkey = 1.69 avg-val = 645.07 avg-zval = 646.13 usrkeys = 191703 avg-key = 16.00 avg-zkey = 1.69 avg-val = 647.00 avg-zval = 646.13 TagRS{ kinds = RS_Key0_TagN bytes = 30040 } TagArray{ size = 52853 bytes = 171792 } seq expand size = 369971 multi value expand size = 0 cnt WriteAppend = 15107 UnZipSize{ index = 0.0031 GB value = 0.1237 GB dict = 0.00 MB all = 0.1283 GB } __ZipSize{ index = 0.0003 GB value = 0.1239 GB dict = 0.00 MB all = 0.1244 GB } UnZip/Zip{ index = 9.4398 value = 0.9984 dict = 0.00 all = 1.0311 } Zip/UnZip{ index = 0.1059 value = 1.0016 dict = 0.00 all = 0.9698 } ---------------------------- total value len = 1.297153 GB avg = 0.650 KB (by entry num) total key len = 0.047891 GB avg = 0.024 KB total ukey len = 0.031927 GB avg = 0.016 KB total ukey num = 0.001995458 Billion total entry num = 0.001995458 Billion write speed all = 0.075847438 MB/sec (with seq num) write speed all = 0.074947242 MB/sec (without seq num) 2024/11/20-13:43:15.518175 140257021736512 [compaction_job.cc:1948] [default] [JOB 7873] Generated table #31278: 191703 keys, 124395167 bytes, temperature: kWarm 2024/11/20-13:43:15.518240 140257021736512 EVENT_LOG_v1 {"time_micros": 1732081395518210, "cf_name": "default", "job": 7873, "event": "table_file_creation", "file_number": 31278, "file_size": 124395167, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 583098648, "table_properties": {"data_size": 123865504, "index_size": 324928, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 4600872, "raw_average_key_size": 24, "raw_value_size": 123662074, "raw_average_value_size": 645, "num_data_blocks": 1, "num_entries": 191703, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 24, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-ZipOffsetBlobStore", "creation_time": 1732081392, "oldest_key_time": 0, "file_creation_time": 1732081392, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "92E45FH6K6HCJOD41QCQ", "orig_file_number": 31278, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-13:43:15.558379 140257021736512 [compaction_job.cc:703] job-07873: subcompact[0], size: 1.224129 G, files: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07873/att-00 [031269,031270,031271,031272,031273,031274,031275,031276,031277,031278] 2024/11/20-13:43:15.670380 140257021736512 (Original Log Time 2024/11/20-13:42:43.484230) EVENT_LOG_v1 {"time_micros": 1732081363484190, "job": 7873, "event": "compaction_started", "compaction_reason": "FilesMarkedForCompaction", "files_L2": [31259], "files_L3": [31203, 31204, 31205, 31206, 31207, 31208, 31209, 31210, 31211, 31212], "score": 0.802841, "input_data_size": 1244650654, "oldest_snapshot_seqno": 583174336} 2024/11/20-13:43:15.670383 140257021736512 (Original Log Time 2024/11/20-13:43:15.669447) [compaction_job.cc:2022] [default] [JOB 7873] Compacted 1@2 + 10@3 files to L3 => 1224128578 bytes 2024/11/20-13:43:15.670385 140257021736512 (Original Log Time 2024/11/20-13:43:15.670311) [compaction_job.cc:1224] [default] compacted to: files[0 0 0 10 0 0 0] max score 0.05, MB/sec: 38.8 rd, 38.2 wr, level 3, files in(1, 10) out(10 +0 blob) MB in(22.0, 1165.0 +0.0 blob) out(1167.4 +0.0 blob), read-write-amplify(107.0) write-amplify(53.0) OK, records in: 2026469, records dropped: 31011 output_compression: Snappy 2024/11/20-13:43:15.670389 140257021736512 (Original Log Time 2024/11/20-13:43:15.670359) EVENT_LOG_v1 {"time_micros": 1732081395670335, "cf": "default", "job": 7873, "event": "compaction_finished", "compaction_time_micros": 32074158, "compaction_time_cpu_micros": 7442152, "output_level": 3, "num_output_files": 10, "total_output_size": 1224128578, "num_input_records": 2026469, "num_output_records": 1995458, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "file_write_nanos": 904288594, "file_range_sync_nanos": 0, "file_fsync_nanos": 9871, "file_prepare_write_nanos": 4157797, "lsm_state": [0, 0, 0, 10, 0, 0, 0]} 2024/11/20-13:43:15.791651 140257021736512 DEBG dcompact_worker.cpp:240: HttpPost: 200 OK: url = http://nlb-7zny4kaa1poal01o64.cn-shenzhen.nlb.aliyuncs.com:8443, body = {"instanceId":"nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137","labourId":"","dbId":"d89b4006-2803-486e-b7a2-759bcf348921","dbStarts":1732076400,"starts":1732081363,"executesMs":32346,"compactionJobId":7873,"attempt":0,"compactionInputRawBytes":1357222412,"compactionInputZipBytes":1244650654,"compactionOutputRawBytes":0,"compactionOutputZipBytes":1224128578,"headers":{"Accept":"*/*","Connection":"close","Host":"aliyun-topling-saas.topling.cn:18443","RemoteIp":"120.24.192.169","X-Forwarded-For":"120.24.192.169","region":"cn-shenzhen","token":"e6474c481bd4415abc537135cc03626b","instance-token":"e6474c481bd4415abc537135cc03626b","provider":"aliyun","CloudMarketInstanceId":"si-59c0ae5c955845588903","MeteringAssit":"","Transfer-Encoding":"chunked","traceparent":"00-e2407412848cb801394fa88cd43bf19d-645367d015cde434-00"}}, response = 2024/11/20-13:43:15.791747 140257021736512 INFO dcompact_worker.cpp:1464: finish /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-20T12.20.00/.rocksdb/job-07873/att-00: olev 3, work 32.347 s, result 6.240 ms, install 0.958 ms, input{raw 1.264 GiB zip 1.159 GiB}