2024/11/20-14:37:53.247248 140257265124928 DEBG dcompact_worker.cpp:2219: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10470/att-01: fork to child time = 0.009880 sec 2024/11/20-14:37:53.247780 140257265124928 DEBG dcompact_worker.cpp:1013: Beg SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10470/att-01 2024/11/20-14:37:53.254386 140257265124928 DEBG dcompact_worker.cpp:1033: End SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10470/att-01 2024/11/20-14:37:53.256019 140257265124928 TRAC dcompact_worker.cpp:1083: INFO_LOG_LEVEL: rpc = INFO_LEVEL, env_var = undefined 2024/11/20-14:37:53.256261 140257265124928 [WARN] [column_family.cc:386] multiple cf_paths/db_paths and level_compaction_dynamic_level_bytes can't be used together 2024/11/20-14:37:53.307280 140257265124928 [version_set.cc:6211] Recovering from manifest file: /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-20T12.20.00/.rocksdb/job-10470/att-01/MANIFEST-019309 2024/11/20-14:37:53.357629 140257265124928 [version_set.cc:6254] Recovered from manifest file:/worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-20T12.20.00/.rocksdb/job-10470/att-01/MANIFEST-019309 succeeded,manifest_file_number is 19309, next_file_number is 35860, last_sequence is 647602318, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 35691 2024/11/20-14:37:53.357642 140257265124928 [version_set.cc:6269] Column family [default] (ID 0), log number is 0 2024/11/20-14:37:53.357729 140257265124928 [version_set.cc:5724] Creating manifest 35860 2024/11/20-14:37:53.391004 140257265124928 DEBG dcompact_worker.cpp:1225: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10470/att-01: bottommost_level: fake = 1, rpc = 0 2024/11/20-14:37:53.408343 140257265124928 [compaction_job.cc:2437] [default] [JOB 10470] Compacting 1@2 + 9@3 files to L3, score 0.86, subcompactions 1 : 1 2024/11/20-14:37:53.408368 140257265124928 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 8897 Base level 2, inputs: [35829(63MB)], [35647(40MB) 35648(40MB) 35554(39MB) 35555(39MB) 35556(39MB) 35755(40MB) 35758(40MB) 35759(39MB) 35853(40MB)] 2024/11/20-14:37:53.418142 140257265124928 [top_zip_table.cc:59] core git_version_hash_info_is:commit 81964c21ebbcc178d8e99dae0fbf61bded2729cc Author: rockeet Date: Mon Nov 11 21:28:46 2024 +0800 Makefile: fix gen git-version-*.cpp GIT_PATH_ARG = :!src/terark/fsa :!tools/fsa :!src/terark/zbs :!tools/zbs g++ (GCC) 12.2.1 20221121 (Red Hat 12.2.1-7) Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/zstd -Iboost-include DEFS = -DTOPLING_IO_WITH_URING=1 -DDIVSUFSORT_API= CXXFLAGS = -fPIC -time -fdiagnostics-color -mcx16 -fno-stack-protector WARNINGS = -Wno-class-memaccess -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -Wno-deprecated-declarations -Wstrict-aliasing=3 RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 LDFLAGS = -fPIC -rdynamic 2024/11/20-14:37:53.418165 140257265124928 [top_zip_table.cc:60] fsa git_version_hash_info_is:commit 5dfecb7d107196f044ff5bf78dc39d2e725b9d9b Author: leipeng Date: Thu Nov 7 15:22:45 2024 +0800 Makefile: fix for x86_64 CPU older than haswell GIT_PATH_ARG = src/terark/fsa tools/fsa g++ (GCC) 12.2.1 20221121 (Red Hat 12.2.1-7) Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/zstd -Iboost-include DEFS = -DTOPLING_IO_WITH_URING=1 -DDIVSUFSORT_API= CXXFLAGS = -fPIC -time -fdiagnostics-color -mcx16 -fno-stack-protector WARNINGS = -Wno-class-memaccess -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -Wno-deprecated-declarations -Wstrict-aliasing=3 RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 LDFLAGS = -fPIC -rdynamic 2024/11/20-14:37:53.418183 140257265124928 [top_zip_table.cc:61] zbs git_version_hash_info_is:commit d44dd5ff72707128fe3c916077b43d2093c01f7c Author: leipeng Date: Sun Oct 27 23:38:26 2024 +0800 Fix for msvc, when toplingdb on msvc GIT_PATH_ARG = src/terark/zbs tools/zbs g++ (GCC) 12.2.1 20221121 (Red Hat 12.2.1-7) Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/zstd -Iboost-include DEFS = -DTOPLING_IO_WITH_URING=1 -DDIVSUFSORT_API= CXXFLAGS = -fPIC -time -fdiagnostics-color -mcx16 -fno-stack-protector WARNINGS = -Wno-class-memaccess -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -Wno-deprecated-declarations -Wstrict-aliasing=3 RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 LDFLAGS = -fPIC -rdynamic 2024/11/20-14:37:53.418190 140257265124928 [top_zip_table.cc:62] topling-zip_table_reader: git_version_hash_info_is: commit 79614a7e7dc27362fc5151b0797eb7d83c674c7b Author: rockeet Date: Sun Nov 10 15:02:21 2024 +0800 cpu_has_bmi2.sh: detect by compile c++ code check __BMI2__ g++ (GCC) 12.2.1 20221121 (Red Hat 12.2.1-7) Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/20-14:37:53.418201 140257265124928 [top_zip_table.cc:64] topling-rocks git_version_hash_info_is: commit c46b65a52d9c74aa8b87aeb8438620ff2dbc669c Author: rockeet Date: Sun Nov 10 15:02:42 2024 +0800 cpu_has_bmi2.sh: detect by compile c++ code check __BMI2__ g++ (GCC) 12.2.1 20221121 (Red Hat 12.2.1-7) Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/20-14:37:54.338193 140257265124928 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10470/att-01/035861.sst) /dev/shm/ToplingTemp/Topling-373492-cWOEGU 2024/11/20-14:37:54.650876 140257265124928 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10470/att-01/035861.sst): first pass time = 0.31's, 429.337'MB/sec 2024/11/20-14:37:55.200615 140257265124928 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10470/att-01/035861.sst): old prealloc_size = 147639500, real_size = 40715744 2024/11/20-14:37:55.200744 140257265124928 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10470/att-01/035861.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129424 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.70 raw-val = 0.1316 GB zip-val = 0.0405 GB avg-val =1017.04 avg-zval = 312.64 2024/11/20-14:37:55.200894 140257265124928 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10470/att-01/035861.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-14:37:55.366766 140257265124928 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10470/att-01/035861.sst): second pass time = 0.55's, 239.811'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.17's, 254.762'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2054.535'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.268'MB/sec write SST data time = 0.05's, 934.276'MB/sec dict compress time = 7238476739.76's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 33155.912'MB/sec zip my value time = 0.55's, unzip length = 0.132'GB zip my value throughput = 239.811'MB/sec zip pipeline throughput = 285.302'MB/sec entries = 129424 avg-key = 20.00 avg-zkey = 1.70 avg-val = 1017.04 avg-zval = 312.64 usrkeys = 129424 avg-key = 12.00 avg-zkey = 1.70 avg-val = 1020.95 avg-zval = 312.64 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 72362 bytes = 244240 } seq expand size = 506534 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0405 GB dict = 1.38 MB all = 0.0423 GB } UnZip/Zip{ index = 7.0687 value = 3.2530 dict = 1.00 all = 3.1709 } Zip/UnZip{ index = 0.1415 value = 0.3074 dict = 1.00 all = 0.3154 } ---------------------------- total value len = 0.132136 GB avg = 1.021 KB (by entry num) total key len = 0.002588 GB avg = 0.020 KB total ukey len = 0.001553 GB avg = 0.012 KB total ukey num = 0.000129424 Billion total entry num = 0.000129424 Billion write speed all = 0.006411316 MB/sec (with seq num) write speed all = 0.006362044 MB/sec (without seq num) 2024/11/20-14:37:55.467481 140257265124928 [compaction_job.cc:1948] [default] [JOB 10470] Generated table #35861: 129424 keys, 42327657 bytes, temperature: kWarm 2024/11/20-14:37:55.467573 140257265124928 EVENT_LOG_v1 {"time_micros": 1732084675467532, "cf_name": "default", "job": 10470, "event": "table_file_creation", "file_number": 35861, "file_size": 42327657, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 646475921, "table_properties": {"data_size": 40463504, "index_size": 219712, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588480, "raw_average_key_size": 20, "raw_value_size": 131629361, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129424, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732084674, "oldest_key_time": 0, "file_creation_time": 1732084674, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "92E45FH6K6HCJOD41QCQ", "orig_file_number": 35861, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-14:37:55.503842 140257265124928 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10470/att-01/035862.sst) /dev/shm/ToplingTemp/Topling-373492-h2YlMU 2024/11/20-14:37:56.029308 140257265124928 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10470/att-01/035862.sst): first pass time = 0.53's, 255.450'MB/sec 2024/11/20-14:37:56.582801 140257265124928 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10470/att-01/035862.sst): old prealloc_size = 147639500, real_size = 40868144 2024/11/20-14:37:56.582920 140257265124928 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10470/att-01/035862.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129434 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.75 raw-val = 0.1316 GB zip-val = 0.0406 GB avg-val =1016.97 avg-zval = 313.74 2024/11/20-14:37:56.583059 140257265124928 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10470/att-01/035862.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-14:37:56.750701 140257265124928 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10470/att-01/035862.sst): second pass time = 0.55's, 238.141'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.17's, 253.596'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2275.792'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.272'MB/sec write SST data time = 0.05's, 874.962'MB/sec dict compress time = 0.00's, 1378719.000'MB/sec z-dict build time = 0.00's, sample length = 1.379'MB, throughput = 45874.725'MB/sec zip my value time = 0.55's, unzip length = 0.132'GB zip my value throughput = 238.141'MB/sec zip pipeline throughput = 238.141'MB/sec entries = 129434 avg-key = 20.00 avg-zkey = 1.75 avg-val = 1016.97 avg-zval = 313.74 usrkeys = 129434 avg-key = 12.00 avg-zkey = 1.75 avg-val = 1022.42 avg-zval = 313.74 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 100930 bytes = 340656 } seq expand size = 706510 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0406 GB dict = 1.38 MB all = 0.0426 GB } UnZip/Zip{ index = 6.8421 value = 3.2414 dict = 1.00 all = 3.1524 } Zip/UnZip{ index = 0.1462 value = 0.3085 dict = 1.00 all = 0.3172 } ---------------------------- total value len = 0.264472 GB avg = 1.022 KB (by entry num) total key len = 0.005177 GB avg = 0.020 KB total ukey len = 0.003106 GB avg = 0.012 KB total ukey num = 0.000258858 Billion total entry num = 0.000258858 Billion write speed all = 0.012831340 MB/sec (with seq num) write speed all = 0.012732798 MB/sec (without seq num) 2024/11/20-14:37:56.801766 140257265124928 [compaction_job.cc:1948] [default] [JOB 10470] Generated table #35862: 129434 keys, 42577246 bytes, temperature: kWarm 2024/11/20-14:37:56.801830 140257265124928 EVENT_LOG_v1 {"time_micros": 1732084676801799, "cf_name": "default", "job": 10470, "event": "table_file_creation", "file_number": 35862, "file_size": 42577246, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 646476968, "table_properties": {"data_size": 40608608, "index_size": 227008, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588680, "raw_average_key_size": 20, "raw_value_size": 131629923, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129434, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732084675, "oldest_key_time": 0, "file_creation_time": 1732084675, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "92E45FH6K6HCJOD41QCQ", "orig_file_number": 35862, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-14:37:56.838542 140257265124928 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10470/att-01/035863.sst) /dev/shm/ToplingTemp/Topling-373492-60tUCT 2024/11/20-14:37:57.663122 140257265124928 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10470/att-01/035863.sst): first pass time = 0.82's, 162.781'MB/sec 2024/11/20-14:37:58.195362 140257265124928 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10470/att-01/035863.sst): old prealloc_size = 147639500, real_size = 40379168 2024/11/20-14:37:58.195516 140257265124928 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10470/att-01/035863.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129430 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.71 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1016.99 avg-zval = 310.01 2024/11/20-14:37:58.195584 140257265124928 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10470/att-01/035863.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-14:37:58.374382 140257265124928 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10470/att-01/035863.sst): second pass time = 0.53's, 247.677'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.18's, 233.288'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2118.881'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.264'MB/sec write SST data time = 0.06's, 738.925'MB/sec dict compress time = 140278.07's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 27900.186'MB/sec zip my value time = 0.53's, unzip length = 0.132'GB zip my value throughput = 247.677'MB/sec zip pipeline throughput = 247.677'MB/sec entries = 129430 avg-key = 20.00 avg-zkey = 1.71 avg-val = 1016.99 avg-zval = 310.01 usrkeys = 129430 avg-key = 12.00 avg-zkey = 1.71 avg-val = 1017.28 avg-zval = 310.01 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 5365 bytes = 18128 } seq expand size = 37555 multi value expand size = 0 cnt WriteAppend = 11 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0418 GB } UnZip/Zip{ index = 7.0139 value = 3.2805 dict = 1.00 all = 3.2136 } Zip/UnZip{ index = 0.1426 value = 0.3048 dict = 1.00 all = 0.3112 } ---------------------------- total value len = 0.396139 GB avg = 1.020 KB (by entry num) total key len = 0.007766 GB avg = 0.020 KB total ukey len = 0.004659 GB avg = 0.012 KB total ukey num = 0.000388288 Billion total entry num = 0.000388288 Billion write speed all = 0.019218448 MB/sec (with seq num) write speed all = 0.019070645 MB/sec (without seq num) 2024/11/20-14:37:58.425018 140257265124928 [compaction_job.cc:1948] [default] [JOB 10470] Generated table #35863: 129430 keys, 41765268 bytes, temperature: kWarm 2024/11/20-14:37:58.425087 140257265124928 EVENT_LOG_v1 {"time_micros": 1732084678425057, "cf_name": "default", "job": 10470, "event": "table_file_creation", "file_number": 35863, "file_size": 41765268, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 646458303, "table_properties": {"data_size": 40125200, "index_size": 221440, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588600, "raw_average_key_size": 20, "raw_value_size": 131629548, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129430, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732084676, "oldest_key_time": 0, "file_creation_time": 1732084676, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "92E45FH6K6HCJOD41QCQ", "orig_file_number": 35863, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-14:37:58.459920 140257265124928 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10470/att-01/035864.sst) /dev/shm/ToplingTemp/Topling-373492-W3Fy3U 2024/11/20-14:37:59.156465 140257265124928 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10470/att-01/035864.sst): first pass time = 0.70's, 192.707'MB/sec 2024/11/20-14:37:59.689490 140257265124928 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10470/att-01/035864.sst): old prealloc_size = 147639500, real_size = 40393744 2024/11/20-14:37:59.689604 140257265124928 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10470/att-01/035864.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129431 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.73 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1016.99 avg-zval = 310.11 2024/11/20-14:37:59.689660 140257265124928 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10470/att-01/035864.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-14:37:59.849547 140257265124928 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10470/att-01/035864.sst): second pass time = 0.53's, 247.312'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 261.134'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2511.058'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.277'MB/sec write SST data time = 0.04's, 967.265'MB/sec dict compress time = 140278.07's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 35071.447'MB/sec zip my value time = 0.53's, unzip length = 0.132'GB zip my value throughput = 247.312'MB/sec zip pipeline throughput = 247.312'MB/sec entries = 129431 avg-key = 20.00 avg-zkey = 1.73 avg-val = 1016.99 avg-zval = 310.11 usrkeys = 129431 avg-key = 12.00 avg-zkey = 1.73 avg-val = 1017.48 avg-zval = 310.11 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 9103 bytes = 30736 } seq expand size = 63721 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0418 GB } UnZip/Zip{ index = 6.9477 value = 3.2795 dict = 1.00 all = 3.2115 } Zip/UnZip{ index = 0.1439 value = 0.3049 dict = 1.00 all = 0.3114 } ---------------------------- total value len = 0.527833 GB avg = 1.020 KB (by entry num) total key len = 0.010354 GB avg = 0.020 KB total ukey len = 0.006213 GB avg = 0.012 KB total ukey num = 0.000517719 Billion total entry num = 0.000517719 Billion write speed all = 0.025606019 MB/sec (with seq num) write speed all = 0.025408962 MB/sec (without seq num) 2024/11/20-14:37:59.904161 140257265124928 [compaction_job.cc:1948] [default] [JOB 10470] Generated table #35864: 129431 keys, 41792521 bytes, temperature: kWarm 2024/11/20-14:37:59.904251 140257265124928 EVENT_LOG_v1 {"time_micros": 1732084679904207, "cf_name": "default", "job": 10470, "event": "table_file_creation", "file_number": 35864, "file_size": 41792521, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 646453044, "table_properties": {"data_size": 40137664, "index_size": 223552, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588620, "raw_average_key_size": 20, "raw_value_size": 131630054, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129431, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732084678, "oldest_key_time": 0, "file_creation_time": 1732084678, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "92E45FH6K6HCJOD41QCQ", "orig_file_number": 35864, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-14:37:59.965705 140257265124928 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10470/att-01/035865.sst) /dev/shm/ToplingTemp/Topling-373492-BndsHU 2024/11/20-14:38:00.686138 140257265124928 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10470/att-01/035865.sst): first pass time = 0.72's, 186.314'MB/sec 2024/11/20-14:38:02.551673 140257265124928 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10470/att-01/035865.sst): old prealloc_size = 147639500, real_size = 40389792 2024/11/20-14:38:02.551820 140257265124928 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10470/att-01/035865.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129433 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.73 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1016.97 avg-zval = 310.07 2024/11/20-14:38:02.551900 140257265124928 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10470/att-01/035865.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-14:38:02.970617 140257265124928 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10470/att-01/035865.sst): second pass time = 1.86's, 70.590'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.42's, 99.751'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1851.132'MB/sec (index lex order gen) rebuild zvType time = 0.30's, 0.108'MB/sec write SST data time = 0.12's, 349.278'MB/sec dict compress time = 140278.07's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 45326.494'MB/sec zip my value time = 1.86's, unzip length = 0.132'GB zip my value throughput = 70.590'MB/sec zip pipeline throughput = 373.460'MB/sec entries = 129433 avg-key = 20.00 avg-zkey = 1.73 avg-val = 1016.97 avg-zval = 310.07 usrkeys = 129433 avg-key = 12.00 avg-zkey = 1.73 avg-val = 1017.44 avg-zval = 310.07 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 8619 bytes = 29104 } seq expand size = 60333 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0418 GB } UnZip/Zip{ index = 6.9478 value = 3.2798 dict = 1.00 all = 3.2120 } Zip/UnZip{ index = 0.1439 value = 0.3049 dict = 1.00 all = 0.3113 } ---------------------------- total value len = 0.659523 GB avg = 1.019 KB (by entry num) total key len = 0.012943 GB avg = 0.020 KB total ukey len = 0.007766 GB avg = 0.012 KB total ukey num = 0.000647152 Billion total entry num = 0.000647152 Billion write speed all = 0.031990010 MB/sec (with seq num) write speed all = 0.031743724 MB/sec (without seq num) 2024/11/20-14:38:03.025250 140257265124928 [compaction_job.cc:1948] [default] [JOB 10470] Generated table #35865: 129433 keys, 41786999 bytes, temperature: kWarm 2024/11/20-14:38:03.025340 140257265124928 EVENT_LOG_v1 {"time_micros": 1732084683025295, "cf_name": "default", "job": 10470, "event": "table_file_creation", "file_number": 35865, "file_size": 41786999, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 646471982, "table_properties": {"data_size": 40133712, "index_size": 223552, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588660, "raw_average_key_size": 20, "raw_value_size": 131629642, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129433, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732084679, "oldest_key_time": 0, "file_creation_time": 1732084679, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "92E45FH6K6HCJOD41QCQ", "orig_file_number": 35865, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-14:38:03.075995 140257265124928 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10470/att-01/035866.sst) /dev/shm/ToplingTemp/Topling-373492-M5W2MV 2024/11/20-14:38:03.782125 140257265124928 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10470/att-01/035866.sst): first pass time = 0.71's, 190.098'MB/sec 2024/11/20-14:38:04.529521 140257265124928 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10470/att-01/035866.sst): old prealloc_size = 147639500, real_size = 40747328 2024/11/20-14:38:04.529645 140257265124928 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10470/att-01/035866.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129423 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.71 raw-val = 0.1316 GB zip-val = 0.0405 GB avg-val =1017.05 avg-zval = 312.88 2024/11/20-14:38:04.529754 140257265124928 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10470/att-01/035866.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-14:38:04.704615 140257265124928 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10470/att-01/035866.sst): second pass time = 0.75's, 176.294'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.18's, 241.870'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2314.295'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.275'MB/sec write SST data time = 0.06's, 740.245'MB/sec dict compress time = 140278.07's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 25732.998'MB/sec zip my value time = 0.75's, unzip length = 0.132'GB zip my value throughput = 176.294'MB/sec zip pipeline throughput = 242.077'MB/sec entries = 129423 avg-key = 20.00 avg-zkey = 1.71 avg-val = 1017.05 avg-zval = 312.88 usrkeys = 129423 avg-key = 12.00 avg-zkey = 1.71 avg-val = 1020.87 avg-zval = 312.88 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 70587 bytes = 238240 } seq expand size = 494109 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0405 GB dict = 1.38 MB all = 0.0424 GB } UnZip/Zip{ index = 7.0277 value = 3.2506 dict = 1.00 all = 3.1690 } Zip/UnZip{ index = 0.1423 value = 0.3076 dict = 1.00 all = 0.3156 } ---------------------------- total value len = 0.791647 GB avg = 1.019 KB (by entry num) total key len = 0.015532 GB avg = 0.020 KB total ukey len = 0.009319 GB avg = 0.012 KB total ukey num = 0.000776575 Billion total entry num = 0.000776575 Billion write speed all = 0.038395252 MB/sec (with seq num) write speed all = 0.038099735 MB/sec (without seq num) 2024/11/20-14:38:04.758631 140257265124928 [compaction_job.cc:1948] [default] [JOB 10470] Generated table #35866: 129423 keys, 42353400 bytes, temperature: kWarm 2024/11/20-14:38:04.758698 140257265124928 EVENT_LOG_v1 {"time_micros": 1732084684758668, "cf_name": "default", "job": 10470, "event": "table_file_creation", "file_number": 35866, "file_size": 42353400, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 646476790, "table_properties": {"data_size": 40493808, "index_size": 220992, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588460, "raw_average_key_size": 20, "raw_value_size": 131629440, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129423, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732084683, "oldest_key_time": 0, "file_creation_time": 1732084683, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "92E45FH6K6HCJOD41QCQ", "orig_file_number": 35866, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-14:38:04.842961 140257265124928 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10470/att-01/035867.sst) /dev/shm/ToplingTemp/Topling-373492-Mt3eST 2024/11/20-14:38:05.521384 140257265124928 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10470/att-01/035867.sst): first pass time = 0.68's, 197.857'MB/sec 2024/11/20-14:38:06.055622 140257265124928 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10470/att-01/035867.sst): old prealloc_size = 147639500, real_size = 40543632 2024/11/20-14:38:06.055759 140257265124928 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10470/att-01/035867.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129428 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.76 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1017.01 avg-zval = 311.24 2024/11/20-14:38:06.055846 140257265124928 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10470/att-01/035867.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-14:38:06.220365 140257265124928 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10470/att-01/035867.sst): second pass time = 0.53's, 246.735'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 255.126'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2137.152'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.279'MB/sec write SST data time = 0.05's, 863.352'MB/sec dict compress time = 140278.07's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 41738.529'MB/sec zip my value time = 0.53's, unzip length = 0.132'GB zip my value throughput = 246.735'MB/sec zip pipeline throughput = 246.735'MB/sec entries = 129428 avg-key = 20.00 avg-zkey = 1.76 avg-val = 1017.01 avg-zval = 311.24 usrkeys = 129428 avg-key = 12.00 avg-zkey = 1.76 avg-val = 1018.89 avg-zval = 311.24 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 34788 bytes = 117424 } seq expand size = 243516 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0420 GB } UnZip/Zip{ index = 6.8110 value = 3.2676 dict = 1.00 all = 3.1935 } Zip/UnZip{ index = 0.1468 value = 0.3060 dict = 1.00 all = 0.3131 } ---------------------------- total value len = 0.923520 GB avg = 1.019 KB (by entry num) total key len = 0.018120 GB avg = 0.020 KB total ukey len = 0.010872 GB avg = 0.012 KB total ukey num = 0.000906003 Billion total entry num = 0.000906003 Billion write speed all = 0.044788007 MB/sec (with seq num) write speed all = 0.044443263 MB/sec (without seq num) 2024/11/20-14:38:06.321109 140257265124928 [compaction_job.cc:1948] [default] [JOB 10470] Generated table #35867: 129428 keys, 42028960 bytes, temperature: kWarm 2024/11/20-14:38:06.321179 140257265124928 EVENT_LOG_v1 {"time_micros": 1732084686321147, "cf_name": "default", "job": 10470, "event": "table_file_creation", "file_number": 35867, "file_size": 42028960, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 646476792, "table_properties": {"data_size": 40283072, "index_size": 228032, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588560, "raw_average_key_size": 20, "raw_value_size": 131629858, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129428, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732084684, "oldest_key_time": 0, "file_creation_time": 1732084684, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "92E45FH6K6HCJOD41QCQ", "orig_file_number": 35867, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-14:38:06.360324 140257265124928 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10470/att-01/035868.sst) /dev/shm/ToplingTemp/Topling-373492-vuc2PU 2024/11/20-14:38:06.892074 140257265124928 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10470/att-01/035868.sst): first pass time = 0.53's, 252.439'MB/sec 2024/11/20-14:38:07.660124 140257265124928 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10470/att-01/035868.sst): old prealloc_size = 147639500, real_size = 40390832 2024/11/20-14:38:07.660270 140257265124928 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10470/att-01/035868.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129432 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.73 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1016.98 avg-zval = 310.08 2024/11/20-14:38:07.660338 140257265124928 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10470/att-01/035868.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-14:38:07.825858 140257265124928 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10470/att-01/035868.sst): second pass time = 0.77's, 171.587'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.17's, 252.122'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2074.291'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.268'MB/sec write SST data time = 0.04's, 933.516'MB/sec dict compress time = 140278.07's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 28448.681'MB/sec zip my value time = 0.77's, unzip length = 0.132'GB zip my value throughput = 171.587'MB/sec zip pipeline throughput = 332.415'MB/sec entries = 129432 avg-key = 20.00 avg-zkey = 1.73 avg-val = 1016.98 avg-zval = 310.08 usrkeys = 129432 avg-key = 12.00 avg-zkey = 1.73 avg-val = 1017.42 avg-zval = 310.08 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 8021 bytes = 27088 } seq expand size = 56147 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0418 GB } UnZip/Zip{ index = 6.9517 value = 3.2797 dict = 1.00 all = 3.2121 } Zip/UnZip{ index = 0.1438 value = 0.3049 dict = 1.00 all = 0.3113 } ---------------------------- total value len = 1.055206 GB avg = 1.019 KB (by entry num) total key len = 0.020709 GB avg = 0.020 KB total ukey len = 0.012425 GB avg = 0.012 KB total ukey num = 0.001035435 Billion total entry num = 0.001035435 Billion write speed all = 0.051170727 MB/sec (with seq num) write speed all = 0.050776763 MB/sec (without seq num) 2024/11/20-14:38:07.875744 140257265124928 [compaction_job.cc:1948] [default] [JOB 10470] Generated table #35868: 129432 keys, 41785726 bytes, temperature: kWarm 2024/11/20-14:38:07.875812 140257265124928 EVENT_LOG_v1 {"time_micros": 1732084687875781, "cf_name": "default", "job": 10470, "event": "table_file_creation", "file_number": 35868, "file_size": 41785726, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 646462984, "table_properties": {"data_size": 40134880, "index_size": 223424, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588640, "raw_average_key_size": 20, "raw_value_size": 131630104, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129432, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732084686, "oldest_key_time": 0, "file_creation_time": 1732084686, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "92E45FH6K6HCJOD41QCQ", "orig_file_number": 35868, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-14:38:07.915604 140257265124928 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10470/att-01/035869.sst) /dev/shm/ToplingTemp/Topling-373492-LEjT0U 2024/11/20-14:38:08.681642 140257265124928 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10470/att-01/035869.sst): first pass time = 0.77's, 175.222'MB/sec 2024/11/20-14:38:09.595021 140257265124928 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10470/att-01/035869.sst): old prealloc_size = 147639500, real_size = 40733136 2024/11/20-14:38:09.595193 140257265124928 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10470/att-01/035869.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129431 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.71 raw-val = 0.1316 GB zip-val = 0.0405 GB avg-val =1016.98 avg-zval = 312.75 2024/11/20-14:38:09.595335 140257265124928 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10470/att-01/035869.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-14:38:09.859983 140257265124928 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10470/att-01/035869.sst): second pass time = 0.91's, 144.298'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.26's, 159.865'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1631.724'MB/sec (index lex order gen) rebuild zvType time = 0.22's, 0.150'MB/sec write SST data time = 0.05's, 862.927'MB/sec dict compress time = 140278.07's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 35941.891'MB/sec zip my value time = 0.91's, unzip length = 0.132'GB zip my value throughput = 144.298'MB/sec zip pipeline throughput = 322.528'MB/sec entries = 129431 avg-key = 20.00 avg-zkey = 1.71 avg-val = 1016.98 avg-zval = 312.75 usrkeys = 129431 avg-key = 12.00 avg-zkey = 1.71 avg-val = 1021.10 avg-zval = 312.75 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 76178 bytes = 257120 } seq expand size = 533246 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0405 GB dict = 1.38 MB all = 0.0424 GB } UnZip/Zip{ index = 7.0343 value = 3.2517 dict = 1.00 all = 3.1687 } Zip/UnZip{ index = 0.1422 value = 0.3075 dict = 1.00 all = 0.3156 } ---------------------------- total value len = 1.187369 GB avg = 1.019 KB (by entry num) total key len = 0.023297 GB avg = 0.020 KB total ukey len = 0.013978 GB avg = 0.012 KB total ukey num = 0.001164866 Billion total entry num = 0.001164866 Billion write speed all = 0.057573947 MB/sec (with seq num) write speed all = 0.057130780 MB/sec (without seq num) 2024/11/20-14:38:09.910395 140257265124928 [compaction_job.cc:1948] [default] [JOB 10470] Generated table #35869: 129431 keys, 42358051 bytes, temperature: kWarm 2024/11/20-14:38:09.910457 140257265124928 EVENT_LOG_v1 {"time_micros": 1732084689910427, "cf_name": "default", "job": 10470, "event": "table_file_creation", "file_number": 35869, "file_size": 42358051, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 646476740, "table_properties": {"data_size": 40479808, "index_size": 220800, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588620, "raw_average_key_size": 20, "raw_value_size": 131629280, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129431, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732084687, "oldest_key_time": 0, "file_creation_time": 1732084687, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "92E45FH6K6HCJOD41QCQ", "orig_file_number": 35869, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-14:38:09.947902 140257265124928 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10470/att-01/035870.sst) /dev/shm/ToplingTemp/Topling-373492-dGz3hT 2024/11/20-14:38:09.955562 140257265124928 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10470/att-01/035870.sst): first pass time = 0.01's, 352.349'MB/sec 2024/11/20-14:38:09.985673 140257265124928 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10470/att-01/035870.sst): old prealloc_size = 147639500, real_size = 834728 2024/11/20-14:38:09.985705 140257265124928 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10470/att-01/035870.sst): index type = UintIndex_AllOne , store type = DictZipBlobStore usrkeys = 2592 prefix = 4 raw-key = 0.0000 GB zip-key = 0.0000 GB avg-key = 8.00 avg-zkey = 0.06 raw-val = 0.0026 GB zip-val = 0.0008 GB avg-val =1017.05 avg-zval = 321.65 2024/11/20-14:38:09.988766 140257265124928 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10470/att-01/035870.sst): second pass time = 0.03's, 88.840'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.00's, 282.439'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 9.460'MB/sec (index lex order gen) rebuild zvType time = 0.00's, 0.298'MB/sec write SST data time = 0.00's, 988.171'MB/sec dict compress time = 140278.07's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.033'MB, throughput = 1452.146'MB/sec zip my value time = 0.03's, unzip length = 0.003'GB zip my value throughput = 88.840'MB/sec zip pipeline throughput = 88.840'MB/sec entries = 2592 avg-key = 20.00 avg-zkey = 0.07 avg-val = 1017.05 avg-zval = 321.65 usrkeys = 2592 avg-key = 12.00 avg-zkey = 0.07 avg-val = 1017.08 avg-zval = 321.65 TagRS{ kinds = RS_Key0_TagN bytes = 520 } TagArray{ size = 14 bytes = 64 } seq expand size = 98 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0000 GB value = 0.0026 GB dict = 0.03 MB all = 0.0027 GB } __ZipSize{ index = 0.0000 GB value = 0.0008 GB dict = 0.03 MB all = 0.0009 GB } UnZip/Zip{ index = 162.0000 value = 3.1620 dict = 1.00 all = 3.0958 } Zip/UnZip{ index = 0.0062 value = 0.3163 dict = 1.00 all = 0.3230 } ---------------------------- total value len = 1.190005 GB avg = 1.019 KB (by entry num) total key len = 0.023349 GB avg = 0.020 KB total ukey len = 0.014009 GB avg = 0.012 KB total ukey num = 0.001167458 Billion total entry num = 0.001167458 Billion write speed all = 0.057701429 MB/sec (with seq num) write speed all = 0.057257279 MB/sec (without seq num) 2024/11/20-14:38:09.997101 140257265124928 [compaction_job.cc:1948] [default] [JOB 10470] Generated table #35870: 2592 keys, 868286 bytes, temperature: kWarm 2024/11/20-14:38:09.997143 140257265124928 EVENT_LOG_v1 {"time_micros": 1732084689997120, "cf_name": "default", "job": 10470, "event": "table_file_creation", "file_number": 35870, "file_size": 868286, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 645423485, "table_properties": {"data_size": 833712, "index_size": 192, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 51840, "raw_average_key_size": 20, "raw_value_size": 2636181, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 2592, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-UintIndex_AllOne-DictZipBlobStore", "creation_time": 1732084689, "oldest_key_time": 0, "file_creation_time": 1732084689, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "92E45FH6K6HCJOD41QCQ", "orig_file_number": 35870, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-14:38:10.004982 140257265124928 [compaction_job.cc:703] job-10470: subcompact[0], size: 0.379644 G, files: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10470/att-01 [035861,035862,035863,035864,035865,035866,035867,035868,035869,035870] 2024/11/20-14:38:10.066771 140257265124928 (Original Log Time 2024/11/20-14:37:53.408427) EVENT_LOG_v1 {"time_micros": 1732084673408386, "job": 10470, "event": "compaction_started", "compaction_reason": "FilesMarkedForCompaction", "files_L2": [35829], "files_L3": [35647, 35648, 35554, 35555, 35556, 35755, 35758, 35759, 35853], "score": 0.856674, "input_data_size": 445083569, "oldest_snapshot_seqno": 647602121} 2024/11/20-14:38:10.066775 140257265124928 (Original Log Time 2024/11/20-14:38:10.065852) [compaction_job.cc:2022] [default] [JOB 10470] Compacted 1@2 + 9@3 files to L3 => 379644114 bytes 2024/11/20-14:38:10.066776 140257265124928 (Original Log Time 2024/11/20-14:38:10.066707) [compaction_job.cc:1224] [default] compacted to: files[0 0 0 10 0 0 0] max score 0.01, MB/sec: 26.8 rd, 22.9 wr, level 3, files in(1, 9) out(10 +0 blob) MB in(63.3, 361.2 +0.0 blob) out(362.1 +0.0 blob), read-write-amplify(12.4) write-amplify(5.7) OK, records in: 1229586, records dropped: 62128 output_compression: Snappy 2024/11/20-14:38:10.066780 140257265124928 (Original Log Time 2024/11/20-14:38:10.066751) EVENT_LOG_v1 {"time_micros": 1732084690066729, "cf": "default", "job": 10470, "event": "compaction_finished", "compaction_time_micros": 16596557, "compaction_time_cpu_micros": 4196415, "output_level": 3, "num_output_files": 10, "total_output_size": 379644114, "num_input_records": 1229586, "num_output_records": 1167458, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "file_write_nanos": 323283085, "file_range_sync_nanos": 0, "file_fsync_nanos": 9373, "file_prepare_write_nanos": 23086, "lsm_state": [0, 0, 0, 10, 0, 0, 0]} 2024/11/20-14:38:10.202770 140257265124928 DEBG dcompact_worker.cpp:240: HttpPost: 200 OK: url = http://nlb-7zny4kaa1poal01o64.cn-shenzhen.nlb.aliyuncs.com:8443, body = {"instanceId":"nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137","labourId":"","dbId":"d89b4006-2803-486e-b7a2-759bcf348921","dbStarts":1732076400,"starts":1732084673,"executesMs":16812,"compactionJobId":10470,"attempt":1,"compactionInputRawBytes":1275075857,"compactionInputZipBytes":445083569,"compactionOutputRawBytes":0,"compactionOutputZipBytes":379644114,"headers":{"Accept":"*/*","Connection":"close","Host":"aliyun-topling-saas.topling.cn:18443","RemoteIp":"120.24.192.169","X-Forwarded-For":"120.24.192.169","region":"cn-shenzhen","token":"e6474c481bd4415abc537135cc03626b","instance-token":"e6474c481bd4415abc537135cc03626b","provider":"aliyun","CloudMarketInstanceId":"si-59c0ae5c955845588903","MeteringAssit":"","Transfer-Encoding":"chunked","traceparent":"00-35be981fdd607d21d093b68e6c0d420e-7a4e5c7a902066f3-00"}}, response = 2024/11/20-14:38:10.202843 140257265124928 INFO dcompact_worker.cpp:1464: finish /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-20T12.20.00/.rocksdb/job-10470/att-01: olev 3, work 16.812 s, result 6.115 ms, install 0.943 ms, input{raw 1.188 GiB zip 424.465 MiB}