2024/11/21-05:46:20.911927 140008400344640 DEBG dcompact_worker.cpp:2219: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07309/att-00: fork to child time = 0.010216 sec 2024/11/21-05:46:20.912474 140008400344640 DEBG dcompact_worker.cpp:1013: Beg SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07309/att-00 2024/11/21-05:46:20.919354 140008400344640 DEBG dcompact_worker.cpp:1033: End SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07309/att-00 2024/11/21-05:46:20.921171 140008400344640 TRAC dcompact_worker.cpp:1083: INFO_LOG_LEVEL: rpc = INFO_LEVEL, env_var = undefined 2024/11/21-05:46:20.921385 140008400344640 [WARN] [column_family.cc:386] multiple cf_paths/db_paths and level_compaction_dynamic_level_bytes can't be used together 2024/11/21-05:46:20.966365 140008400344640 [version_set.cc:6211] Recovering from manifest file: /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-21T00.56.43/.rocksdb/job-07309/att-00/MANIFEST-090329 2024/11/21-05:46:20.997872 140008400344640 [version_set.cc:6254] Recovered from manifest file:/worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-21T00.56.43/.rocksdb/job-07309/att-00/MANIFEST-090329 succeeded,manifest_file_number is 90329, next_file_number is 105895, last_sequence is 1582538786, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 105755 2024/11/21-05:46:20.997884 140008400344640 [version_set.cc:6269] Column family [default] (ID 0), log number is 0 2024/11/21-05:46:20.997976 140008400344640 [version_set.cc:5724] Creating manifest 105895 2024/11/21-05:46:21.031086 140008400344640 DEBG dcompact_worker.cpp:1225: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07309/att-00: bottommost_level: fake = 1, rpc = 0 2024/11/21-05:46:21.049325 140008400344640 [compaction_job.cc:2437] [default] [JOB 7309] Compacting 1@2 + 10@3 files to L3, score 1.00, subcompactions 1 : 1 2024/11/21-05:46:21.049345 140008400344640 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 5459 Base level 2, inputs: [105888(21MB)], [105848(37MB) 105849(38MB) 105850(38MB) 105851(37MB) 105852(37MB) 105853(36MB) 105854(36MB) 105855(19MB) 105803(36MB) 105804(31MB)] 2024/11/21-05:46:21.069432 140008400344640 [top_zip_table.cc:59] core git_version_hash_info_is:commit 81964c21ebbcc178d8e99dae0fbf61bded2729cc Author: rockeet Date: Mon Nov 11 21:28:46 2024 +0800 Makefile: fix gen git-version-*.cpp GIT_PATH_ARG = :!src/terark/fsa :!tools/fsa :!src/terark/zbs :!tools/zbs g++ (GCC) 12.2.1 20221121 (Red Hat 12.2.1-7) Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/zstd -Iboost-include DEFS = -DTOPLING_IO_WITH_URING=1 -DDIVSUFSORT_API= CXXFLAGS = -fPIC -time -fdiagnostics-color -mcx16 -fno-stack-protector WARNINGS = -Wno-class-memaccess -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -Wno-deprecated-declarations -Wstrict-aliasing=3 RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 LDFLAGS = -fPIC -rdynamic 2024/11/21-05:46:21.069459 140008400344640 [top_zip_table.cc:60] fsa git_version_hash_info_is:commit 5dfecb7d107196f044ff5bf78dc39d2e725b9d9b Author: leipeng Date: Thu Nov 7 15:22:45 2024 +0800 Makefile: fix for x86_64 CPU older than haswell GIT_PATH_ARG = src/terark/fsa tools/fsa g++ (GCC) 12.2.1 20221121 (Red Hat 12.2.1-7) Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/zstd -Iboost-include DEFS = -DTOPLING_IO_WITH_URING=1 -DDIVSUFSORT_API= CXXFLAGS = -fPIC -time -fdiagnostics-color -mcx16 -fno-stack-protector WARNINGS = -Wno-class-memaccess -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -Wno-deprecated-declarations -Wstrict-aliasing=3 RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 LDFLAGS = -fPIC -rdynamic 2024/11/21-05:46:21.069479 140008400344640 [top_zip_table.cc:61] zbs git_version_hash_info_is:commit d44dd5ff72707128fe3c916077b43d2093c01f7c Author: leipeng Date: Sun Oct 27 23:38:26 2024 +0800 Fix for msvc, when toplingdb on msvc GIT_PATH_ARG = src/terark/zbs tools/zbs g++ (GCC) 12.2.1 20221121 (Red Hat 12.2.1-7) Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/zstd -Iboost-include DEFS = -DTOPLING_IO_WITH_URING=1 -DDIVSUFSORT_API= CXXFLAGS = -fPIC -time -fdiagnostics-color -mcx16 -fno-stack-protector WARNINGS = -Wno-class-memaccess -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -Wno-deprecated-declarations -Wstrict-aliasing=3 RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 LDFLAGS = -fPIC -rdynamic 2024/11/21-05:46:21.069487 140008400344640 [top_zip_table.cc:62] topling-zip_table_reader: git_version_hash_info_is: commit 79614a7e7dc27362fc5151b0797eb7d83c674c7b Author: rockeet Date: Sun Nov 10 15:02:21 2024 +0800 cpu_has_bmi2.sh: detect by compile c++ code check __BMI2__ g++ (GCC) 12.2.1 20221121 (Red Hat 12.2.1-7) Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/21-05:46:21.069500 140008400344640 [top_zip_table.cc:64] topling-rocks git_version_hash_info_is: commit c46b65a52d9c74aa8b87aeb8438620ff2dbc669c Author: rockeet Date: Sun Nov 10 15:02:42 2024 +0800 cpu_has_bmi2.sh: detect by compile c++ code check __BMI2__ g++ (GCC) 12.2.1 20221121 (Red Hat 12.2.1-7) Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/21-05:46:21.608853 140008400344640 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07309/att-00/105896.sst) /dev/shm/ToplingTemp/Topling-1374954-PRGVXM 2024/11/21-05:46:22.191850 140008400344640 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07309/att-00/105896.sst): first pass time = 0.58's, 230.236'MB/sec 2024/11/21-05:46:23.471086 140008400344640 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07309/att-00/105896.sst): old prealloc_size = 147639500, real_size = 35869600 2024/11/21-05:46:23.471926 140008400344640 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07309/att-00/105896.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 930419 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.97 raw-val = 0.1082 GB zip-val = 0.0338 GB avg-val = 116.26 avg-zval = 36.34 2024/11/21-05:46:23.472630 140008400344640 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07309/att-00/105896.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/21-05:46:24.577062 140008400344640 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07309/att-00/105896.sst): second pass time = 1.28's, 84.617'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.11's, 35.228'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2269.247'MB/sec (index lex order gen) rebuild zvType time = 0.82's, 0.282'MB/sec write SST data time = 0.28's, 138.547'MB/sec dict compress time = 8389754632.49's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 30340.384'MB/sec zip my value time = 1.28's, unzip length = 0.108'GB zip my value throughput = 84.617'MB/sec zip pipeline throughput = 84.617'MB/sec entries = 930419 avg-key = 28.00 avg-zkey = 1.97 avg-val = 116.26 avg-zval = 36.34 usrkeys = 930419 avg-key = 20.00 avg-zkey = 1.97 avg-val = 120.45 avg-zval = 36.34 TagRS{ kinds = RS_Key0_TagN bytes = 145480 } TagArray{ size = 557225 bytes = 2089616 } seq expand size = 3900575 multi value expand size = 0 cnt WriteAppend = 25 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0338 GB dict = 1.08 MB all = 0.0390 GB } UnZip/Zip{ index = 10.1773 value = 3.1994 dict = 1.00 all = 3.4450 } Zip/UnZip{ index = 0.0983 value = 0.3126 dict = 1.00 all = 0.2903 } ---------------------------- total value len = 563.177799 GB avg = 0.331 KB (by entry num) total key len = 44.340458 GB avg = 0.026 KB total ukey len = 32.812750 GB avg = 0.014 KB total ukey num = 2.321944995 Billion total entry num = 1.701447017 Billion write speed all = 14.409064200 MB/sec (with seq num) write speed all = 14.086226043 MB/sec (without seq num) 2024/11/21-05:46:24.631624 140008400344640 [compaction_job.cc:1948] [default] [JOB 7309] Generated table #105896: 930419 keys, 38960466 bytes, temperature: kWarm 2024/11/21-05:46:24.631735 140008400344640 EVENT_LOG_v1 {"time_micros": 1732139184631681, "cf_name": "default", "job": 7309, "event": "table_file_creation", "file_number": 105896, "file_size": 38960466, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 1582513096, "table_properties": {"data_size": 33808400, "index_size": 1828416, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26051732, "raw_average_key_size": 28, "raw_value_size": 108166098, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 930419, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732139181, "oldest_key_time": 0, "file_creation_time": 1732139181, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "MNFBDNZRMES7C6T09KKW", "orig_file_number": 105896, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/21-05:46:24.680267 140008400344640 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07309/att-00/105897.sst) /dev/shm/ToplingTemp/Topling-1374954-muWJzN 2024/11/21-05:46:25.613304 140008400344640 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07309/att-00/105897.sst): first pass time = 0.93's, 143.858'MB/sec 2024/11/21-05:46:26.948108 140008400344640 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07309/att-00/105897.sst): old prealloc_size = 147639500, real_size = 37249088 2024/11/21-05:46:26.948847 140008400344640 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07309/att-00/105897.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 924507 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.94 raw-val = 0.1083 GB zip-val = 0.0352 GB avg-val = 117.18 avg-zval = 38.10 2024/11/21-05:46:26.949487 140008400344640 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07309/att-00/105897.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/21-05:46:28.061220 140008400344640 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07309/att-00/105897.sst): second pass time = 1.33's, 81.210'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.11's, 36.178'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2554.451'MB/sec (index lex order gen) rebuild zvType time = 0.92's, 0.251'MB/sec write SST data time = 0.19's, 210.575'MB/sec dict compress time = 8389754632.49's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 32566.903'MB/sec zip my value time = 1.33's, unzip length = 0.108'GB zip my value throughput = 81.210'MB/sec zip pipeline throughput = 123.707'MB/sec entries = 924507 avg-key = 28.00 avg-zkey = 1.94 avg-val = 117.18 avg-zval = 38.10 usrkeys = 924507 avg-key = 20.00 avg-zkey = 1.94 avg-val = 121.39 avg-zval = 38.10 TagRS{ kinds = RS_Key0_TagN bytes = 144560 } TagArray{ size = 556329 bytes = 2016704 } seq expand size = 3894303 multi value expand size = 0 cnt WriteAppend = 18 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0352 GB dict = 1.08 MB all = 0.0403 GB } UnZip/Zip{ index = 10.3086 value = 3.0755 dict = 1.00 all = 3.3329 } Zip/UnZip{ index = 0.0970 value = 0.3252 dict = 1.00 all = 0.3000 } ---------------------------- total value len = 563.290025 GB avg = 0.331 KB (by entry num) total key len = 44.366344 GB avg = 0.026 KB total ukey len = 32.831240 GB avg = 0.014 KB total ukey num = 2.322869502 Billion total entry num = 1.702371524 Billion write speed all = 14.411149026 MB/sec (with seq num) write speed all = 14.088162141 MB/sec (without seq num) 2024/11/21-05:46:28.112712 140008400344640 [compaction_job.cc:1948] [default] [JOB 7309] Generated table #105897: 924507 keys, 40270136 bytes, temperature: kWarm 2024/11/21-05:46:28.112781 140008400344640 EVENT_LOG_v1 {"time_micros": 1732139188112748, "cf_name": "default", "job": 7309, "event": "table_file_creation", "file_number": 105897, "file_size": 40270136, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 1323177126, "table_properties": {"data_size": 35224112, "index_size": 1793664, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25886196, "raw_average_key_size": 28, "raw_value_size": 108331550, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 924507, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732139184, "oldest_key_time": 0, "file_creation_time": 1732139184, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "MNFBDNZRMES7C6T09KKW", "orig_file_number": 105897, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/21-05:46:28.153362 140008400344640 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07309/att-00/105898.sst) /dev/shm/ToplingTemp/Topling-1374954-8Y2v7J 2024/11/21-05:46:29.126223 140008400344640 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07309/att-00/105898.sst): first pass time = 0.97's, 137.971'MB/sec 2024/11/21-05:46:30.399576 140008400344640 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07309/att-00/105898.sst): old prealloc_size = 147639500, real_size = 35762208 2024/11/21-05:46:30.400215 140008400344640 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07309/att-00/105898.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 925200 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0338 GB avg-val = 117.07 avg-zval = 36.50 2024/11/21-05:46:30.402314 140008400344640 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07309/att-00/105898.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/21-05:46:31.423489 140008400344640 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07309/att-00/105898.sst): second pass time = 1.27's, 85.109'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.02's, 39.043'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2844.309'MB/sec (index lex order gen) rebuild zvType time = 0.89's, 0.260'MB/sec write SST data time = 0.13's, 297.918'MB/sec dict compress time = 8389754632.49's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 19046.498'MB/sec zip my value time = 1.27's, unzip length = 0.108'GB zip my value throughput = 85.109'MB/sec zip pipeline throughput = 85.110'MB/sec entries = 925200 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.07 avg-zval = 36.50 usrkeys = 925200 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.07 avg-zval = 36.50 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 925200 bytes = 3353872 } seq expand size = 6476400 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0338 GB dict = 1.08 MB all = 0.0400 GB } UnZip/Zip{ index = 10.5117 value = 3.2073 dict = 1.00 all = 3.3575 } Zip/UnZip{ index = 0.0951 value = 0.3118 dict = 1.00 all = 0.2978 } ---------------------------- total value len = 563.404813 GB avg = 0.331 KB (by entry num) total key len = 44.392250 GB avg = 0.026 KB total ukey len = 32.849744 GB avg = 0.014 KB total ukey num = 2.323794702 Billion total entry num = 1.703296724 Billion write speed all = 14.413336411 MB/sec (with seq num) write speed all = 14.090199757 MB/sec (without seq num) 2024/11/21-05:46:31.472970 140008400344640 [compaction_job.cc:1948] [default] [JOB 7309] Generated table #105898: 925200 keys, 39975336 bytes, temperature: kWarm 2024/11/21-05:46:31.473036 140008400344640 EVENT_LOG_v1 {"time_micros": 1732139191473004, "cf_name": "default", "job": 7309, "event": "table_file_creation", "file_number": 105898, "file_size": 39975336, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1052132503, "largest_seqno": 1375095823, "table_properties": {"data_size": 33770384, "index_size": 1760320, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25905600, "raw_average_key_size": 28, "raw_value_size": 108312140, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 925200, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732139188, "oldest_key_time": 0, "file_creation_time": 1732139188, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "MNFBDNZRMES7C6T09KKW", "orig_file_number": 105898, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/21-05:46:31.513486 140008400344640 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07309/att-00/105899.sst) /dev/shm/ToplingTemp/Topling-1374954-m6ZzgL 2024/11/21-05:46:32.671858 140008400344640 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07309/att-00/105899.sst): first pass time = 1.16's, 115.872'MB/sec 2024/11/21-05:46:34.203492 140008400344640 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07309/att-00/105899.sst): old prealloc_size = 147639500, real_size = 35552512 2024/11/21-05:46:34.204093 140008400344640 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07309/att-00/105899.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 929397 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1082 GB zip-val = 0.0335 GB avg-val = 116.41 avg-zval = 36.09 2024/11/21-05:46:34.206201 140008400344640 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07309/att-00/105899.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/21-05:46:35.187368 140008400344640 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07309/att-00/105899.sst): second pass time = 1.53's, 70.677'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.98's, 40.308'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3064.566'MB/sec (index lex order gen) rebuild zvType time = 0.85's, 0.274'MB/sec write SST data time = 0.14's, 292.665'MB/sec dict compress time = 8389754632.49's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 30686.947'MB/sec zip my value time = 1.53's, unzip length = 0.108'GB zip my value throughput = 70.677'MB/sec zip pipeline throughput = 124.545'MB/sec entries = 929397 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.41 avg-zval = 36.09 usrkeys = 929397 avg-key = 20.00 avg-zkey = 1.91 avg-val = 123.41 avg-zval = 36.09 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 929397 bytes = 3252912 } seq expand size = 6505779 multi value expand size = 0 cnt WriteAppend = 15 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0335 GB dict = 1.08 MB all = 0.0397 GB } UnZip/Zip{ index = 10.4455 value = 3.2258 dict = 1.00 all = 3.3844 } Zip/UnZip{ index = 0.0957 value = 0.3100 dict = 1.00 all = 0.2955 } ---------------------------- total value len = 563.519514 GB avg = 0.331 KB (by entry num) total key len = 44.418273 GB avg = 0.026 KB total ukey len = 32.868332 GB avg = 0.014 KB total ukey num = 2.324724099 Billion total entry num = 1.704226121 Billion write speed all = 14.415386864 MB/sec (with seq num) write speed all = 14.092102746 MB/sec (without seq num) 2024/11/21-05:46:35.236402 140008400344640 [compaction_job.cc:1948] [default] [JOB 7309] Generated table #105899: 929397 keys, 39658248 bytes, temperature: kWarm 2024/11/21-05:46:35.236470 140008400344640 EVENT_LOG_v1 {"time_micros": 1732139195236440, "cf_name": "default", "job": 7309, "event": "table_file_creation", "file_number": 105899, "file_size": 39658248, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1225434517, "largest_seqno": 1375096319, "table_properties": {"data_size": 33540464, "index_size": 1779520, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26023116, "raw_average_key_size": 28, "raw_value_size": 108194674, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 929397, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732139191, "oldest_key_time": 0, "file_creation_time": 1732139191, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "MNFBDNZRMES7C6T09KKW", "orig_file_number": 105899, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/21-05:46:35.275230 140008400344640 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07309/att-00/105900.sst) /dev/shm/ToplingTemp/Topling-1374954-dXP61L 2024/11/21-05:46:36.178150 140008400344640 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07309/att-00/105900.sst): first pass time = 0.90's, 148.655'MB/sec 2024/11/21-05:46:37.425605 140008400344640 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07309/att-00/105900.sst): old prealloc_size = 147639500, real_size = 35280480 2024/11/21-05:46:37.426303 140008400344640 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07309/att-00/105900.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 924784 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.95 raw-val = 0.1083 GB zip-val = 0.0332 GB avg-val = 117.13 avg-zval = 35.95 2024/11/21-05:46:37.427146 140008400344640 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07309/att-00/105900.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/21-05:46:38.304462 140008400344640 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07309/att-00/105900.sst): second pass time = 1.25's, 86.892'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.88's, 45.069'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2713.077'MB/sec (index lex order gen) rebuild zvType time = 0.75's, 0.308'MB/sec write SST data time = 0.13's, 311.364'MB/sec dict compress time = 8389754632.49's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 19290.130'MB/sec zip my value time = 1.25's, unzip length = 0.108'GB zip my value throughput = 86.892'MB/sec zip pipeline throughput = 86.892'MB/sec entries = 924784 avg-key = 28.00 avg-zkey = 1.95 avg-val = 117.13 avg-zval = 35.95 usrkeys = 924784 avg-key = 20.00 avg-zkey = 1.95 avg-val = 124.13 avg-zval = 35.95 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 924784 bytes = 3467952 } seq expand size = 6473488 multi value expand size = 0 cnt WriteAppend = 29 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0332 GB dict = 1.08 MB all = 0.0396 GB } UnZip/Zip{ index = 10.2397 value = 3.2586 dict = 1.00 all = 3.3886 } Zip/UnZip{ index = 0.0977 value = 0.3069 dict = 1.00 all = 0.2951 } ---------------------------- total value len = 563.634311 GB avg = 0.331 KB (by entry num) total key len = 44.444167 GB avg = 0.026 KB total ukey len = 32.886828 GB avg = 0.014 KB total ukey num = 2.325648883 Billion total entry num = 1.705150905 Billion write speed all = 14.417657285 MB/sec (with seq num) write speed all = 14.094221647 MB/sec (without seq num) 2024/11/21-05:46:38.352897 140008400344640 [compaction_job.cc:1948] [default] [JOB 7309] Generated table #105900: 924784 keys, 39609120 bytes, temperature: kWarm 2024/11/21-05:46:38.352968 140008400344640 EVENT_LOG_v1 {"time_micros": 1732139198352936, "cf_name": "default", "job": 7309, "event": "table_file_creation", "file_number": 105900, "file_size": 39609120, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 958816147, "largest_seqno": 1582513113, "table_properties": {"data_size": 33242832, "index_size": 1806272, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25893952, "raw_average_key_size": 28, "raw_value_size": 108323776, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 924784, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732139195, "oldest_key_time": 0, "file_creation_time": 1732139195, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "MNFBDNZRMES7C6T09KKW", "orig_file_number": 105900, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/21-05:46:38.392354 140008400344640 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07309/att-00/105901.sst) /dev/shm/ToplingTemp/Topling-1374954-5hyXyM 2024/11/21-05:46:39.363396 140008400344640 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07309/att-00/105901.sst): first pass time = 0.97's, 138.226'MB/sec 2024/11/21-05:46:40.579732 140008400344640 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07309/att-00/105901.sst): old prealloc_size = 147639500, real_size = 34160320 2024/11/21-05:46:40.580411 140008400344640 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07309/att-00/105901.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 928038 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.93 raw-val = 0.1082 GB zip-val = 0.0321 GB avg-val = 116.63 avg-zval = 34.63 2024/11/21-05:46:40.581260 140008400344640 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07309/att-00/105901.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/21-05:46:41.494653 140008400344640 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07309/att-00/105901.sst): second pass time = 1.22's, 89.040'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.91's, 41.567'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2715.176'MB/sec (index lex order gen) rebuild zvType time = 0.79's, 0.295'MB/sec write SST data time = 0.13's, 298.860'MB/sec dict compress time = 8389754632.49's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 28739.692'MB/sec zip my value time = 1.22's, unzip length = 0.108'GB zip my value throughput = 89.040'MB/sec zip pipeline throughput = 89.040'MB/sec entries = 928038 avg-key = 28.00 avg-zkey = 1.93 avg-val = 116.63 avg-zval = 34.63 usrkeys = 928038 avg-key = 20.00 avg-zkey = 1.93 avg-val = 123.63 avg-zval = 34.63 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 928038 bytes = 3016144 } seq expand size = 6496266 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0321 GB dict = 1.08 MB all = 0.0380 GB } UnZip/Zip{ index = 10.3757 value = 3.3676 dict = 1.00 all = 3.5293 } Zip/UnZip{ index = 0.0964 value = 0.2969 dict = 1.00 all = 0.2833 } ---------------------------- total value len = 563.749040 GB avg = 0.330 KB (by entry num) total key len = 44.470152 GB avg = 0.026 KB total ukey len = 32.905389 GB avg = 0.014 KB total ukey num = 2.326576921 Billion total entry num = 1.706078943 Billion write speed all = 14.419902919 MB/sec (with seq num) write speed all = 14.096315725 MB/sec (without seq num) 2024/11/21-05:46:41.541327 140008400344640 [compaction_job.cc:1948] [default] [JOB 7309] Generated table #105901: 928038 keys, 38029824 bytes, temperature: kWarm 2024/11/21-05:46:41.541392 140008400344640 EVENT_LOG_v1 {"time_micros": 1732139201541361, "cf_name": "default", "job": 7309, "event": "table_file_creation", "file_number": 105901, "file_size": 38029824, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1521892217, "largest_seqno": 1582513324, "table_properties": {"data_size": 32139248, "index_size": 1788864, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25985064, "raw_average_key_size": 28, "raw_value_size": 108232696, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 928038, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732139198, "oldest_key_time": 0, "file_creation_time": 1732139198, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "MNFBDNZRMES7C6T09KKW", "orig_file_number": 105901, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/21-05:46:41.618145 140008400344640 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07309/att-00/105902.sst) /dev/shm/ToplingTemp/Topling-1374954-cPWWmM 2024/11/21-05:46:42.485853 140008400344640 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07309/att-00/105902.sst): first pass time = 0.87's, 154.686'MB/sec 2024/11/21-05:46:43.620591 140008400344640 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07309/att-00/105902.sst): old prealloc_size = 147639500, real_size = 34039296 2024/11/21-05:46:43.621165 140008400344640 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07309/att-00/105902.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 925038 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1083 GB zip-val = 0.0320 GB avg-val = 117.09 avg-zval = 34.63 2024/11/21-05:46:43.622006 140008400344640 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07309/att-00/105902.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/21-05:46:44.540059 140008400344640 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07309/att-00/105902.sst): second pass time = 1.13's, 95.525'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.92's, 41.474'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3206.714'MB/sec (index lex order gen) rebuild zvType time = 0.79's, 0.292'MB/sec write SST data time = 0.13's, 300.074'MB/sec dict compress time = 8389754632.49's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 18598.661'MB/sec zip my value time = 1.13's, unzip length = 0.108'GB zip my value throughput = 95.525'MB/sec zip pipeline throughput = 95.525'MB/sec entries = 925038 avg-key = 28.00 avg-zkey = 1.91 avg-val = 117.09 avg-zval = 34.63 usrkeys = 925038 avg-key = 20.00 avg-zkey = 1.91 avg-val = 124.09 avg-zval = 34.63 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 925038 bytes = 3237648 } seq expand size = 6475266 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0320 GB dict = 1.08 MB all = 0.0381 GB } UnZip/Zip{ index = 10.4446 value = 3.3810 dict = 1.00 all = 3.5198 } Zip/UnZip{ index = 0.0957 value = 0.2958 dict = 1.00 all = 0.2841 } ---------------------------- total value len = 563.863832 GB avg = 0.330 KB (by entry num) total key len = 44.496053 GB avg = 0.026 KB total ukey len = 32.923889 GB avg = 0.014 KB total ukey num = 2.327501959 Billion total entry num = 1.707003981 Billion write speed all = 14.422197223 MB/sec (with seq num) write speed all = 14.098457954 MB/sec (without seq num) 2024/11/21-05:46:44.586070 140008400344640 [compaction_job.cc:1948] [default] [JOB 7309] Generated table #105902: 925038 keys, 38132482 bytes, temperature: kWarm 2024/11/21-05:46:44.586142 140008400344640 EVENT_LOG_v1 {"time_micros": 1732139204586103, "cf_name": "default", "job": 7309, "event": "table_file_creation", "file_number": 105902, "file_size": 38132482, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1437274220, "largest_seqno": 1582513179, "table_properties": {"data_size": 32036528, "index_size": 1771328, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25901064, "raw_average_key_size": 28, "raw_value_size": 108316700, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 925038, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732139201, "oldest_key_time": 0, "file_creation_time": 1732139201, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "MNFBDNZRMES7C6T09KKW", "orig_file_number": 105902, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/21-05:46:44.624933 140008400344640 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07309/att-00/105903.sst) /dev/shm/ToplingTemp/Topling-1374954-85y0GN 2024/11/21-05:46:45.749323 140008400344640 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07309/att-00/105903.sst): first pass time = 1.12's, 119.372'MB/sec 2024/11/21-05:46:46.937178 140008400344640 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07309/att-00/105903.sst): old prealloc_size = 147639500, real_size = 33984320 2024/11/21-05:46:46.937838 140008400344640 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07309/att-00/105903.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927268 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0320 GB avg-val = 116.75 avg-zval = 34.50 2024/11/21-05:46:46.938656 140008400344640 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07309/att-00/105903.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/21-05:46:47.917696 140008400344640 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07309/att-00/105903.sst): second pass time = 1.19's, 91.185'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.98's, 38.841'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2763.504'MB/sec (index lex order gen) rebuild zvType time = 0.85's, 0.272'MB/sec write SST data time = 0.13's, 299.339'MB/sec dict compress time = 8389754632.49's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 36093.421'MB/sec zip my value time = 1.19's, unzip length = 0.108'GB zip my value throughput = 91.185'MB/sec zip pipeline throughput = 91.185'MB/sec entries = 927268 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.75 avg-zval = 34.50 usrkeys = 927268 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.75 avg-zval = 34.50 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 927268 bytes = 3245456 } seq expand size = 6490876 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0320 GB dict = 1.08 MB all = 0.0381 GB } UnZip/Zip{ index = 10.5119 value = 3.3842 dict = 1.00 all = 3.5243 } Zip/UnZip{ index = 0.0951 value = 0.2955 dict = 1.00 all = 0.2837 } ---------------------------- total value len = 563.978577 GB avg = 0.330 KB (by entry num) total key len = 44.522017 GB avg = 0.026 KB total ukey len = 32.942435 GB avg = 0.014 KB total ukey num = 2.328429227 Billion total entry num = 1.707931249 Billion write speed all = 14.424377955 MB/sec (with seq num) write speed all = 14.100488761 MB/sec (without seq num) 2024/11/21-05:46:47.966272 140008400344640 [compaction_job.cc:1948] [default] [JOB 7309] Generated table #105903: 927268 keys, 38084032 bytes, temperature: kWarm 2024/11/21-05:46:47.966325 140008400344640 EVENT_LOG_v1 {"time_micros": 1732139207966296, "cf_name": "default", "job": 7309, "event": "table_file_creation", "file_number": 105903, "file_size": 38084032, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1416043075, "largest_seqno": 1582513217, "table_properties": {"data_size": 31988080, "index_size": 1764224, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25963504, "raw_average_key_size": 28, "raw_value_size": 108254300, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927268, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732139204, "oldest_key_time": 0, "file_creation_time": 1732139204, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "MNFBDNZRMES7C6T09KKW", "orig_file_number": 105903, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/21-05:46:48.001592 140008400344640 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07309/att-00/105904.sst) /dev/shm/ToplingTemp/Topling-1374954-2yviWJ 2024/11/21-05:46:48.816385 140008400344640 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07309/att-00/105904.sst): first pass time = 0.81's, 164.734'MB/sec 2024/11/21-05:46:50.064058 140008400344640 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07309/att-00/105904.sst): old prealloc_size = 147639500, real_size = 34365728 2024/11/21-05:46:50.064689 140008400344640 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07309/att-00/105904.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 928574 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0324 GB avg-val = 116.54 avg-zval = 34.86 2024/11/21-05:46:50.065507 140008400344640 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07309/att-00/105904.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/21-05:46:51.036803 140008400344640 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07309/att-00/105904.sst): second pass time = 1.25's, 86.790'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.97's, 39.547'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2910.121'MB/sec (index lex order gen) rebuild zvType time = 0.84's, 0.275'MB/sec write SST data time = 0.13's, 297.526'MB/sec dict compress time = 8389754632.49's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 37344.540'MB/sec zip my value time = 1.25's, unzip length = 0.108'GB zip my value throughput = 86.790'MB/sec zip pipeline throughput = 86.790'MB/sec entries = 928574 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.54 avg-zval = 34.86 usrkeys = 928574 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.54 avg-zval = 34.86 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 928574 bytes = 3250016 } seq expand size = 6500018 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0324 GB dict = 1.08 MB all = 0.0385 GB } UnZip/Zip{ index = 10.5141 value = 3.3435 dict = 1.00 all = 3.4890 } Zip/UnZip{ index = 0.0951 value = 0.2991 dict = 1.00 all = 0.2866 } ---------------------------- total value len = 564.093295 GB avg = 0.330 KB (by entry num) total key len = 44.548017 GB avg = 0.026 KB total ukey len = 32.961006 GB avg = 0.014 KB total ukey num = 2.329357801 Billion total entry num = 1.708859823 Billion write speed all = 14.426646966 MB/sec (with seq num) write speed all = 14.102605637 MB/sec (without seq num) 2024/11/21-05:46:51.083737 140008400344640 [compaction_job.cc:1948] [default] [JOB 7309] Generated table #105904: 928574 keys, 38469060 bytes, temperature: kWarm 2024/11/21-05:46:51.083795 140008400344640 EVENT_LOG_v1 {"time_micros": 1732139211083765, "cf_name": "default", "job": 7309, "event": "table_file_creation", "file_number": 105904, "file_size": 38469060, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1440301839, "largest_seqno": 1582513245, "table_properties": {"data_size": 32367056, "index_size": 1766336, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26000072, "raw_average_key_size": 28, "raw_value_size": 108217680, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 928574, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732139207, "oldest_key_time": 0, "file_creation_time": 1732139207, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "MNFBDNZRMES7C6T09KKW", "orig_file_number": 105904, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/21-05:46:51.120251 140008400344640 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07309/att-00/105905.sst) /dev/shm/ToplingTemp/Topling-1374954-tb9AzJ 2024/11/21-05:46:51.400685 140008400344640 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07309/att-00/105905.sst): first pass time = 0.28's, 246.593'MB/sec 2024/11/21-05:46:52.034493 140008400344640 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07309/att-00/105905.sst): old prealloc_size = 147639500, real_size = 17514848 2024/11/21-05:46:52.034923 140008400344640 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07309/att-00/105905.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 477089 prefix = 4 raw-key = 0.0076 GB zip-key = 0.0009 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.0558 GB zip-val = 0.0165 GB avg-val = 116.93 avg-zval = 34.55 2024/11/21-05:46:52.035430 140008400344640 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07309/att-00/105905.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0011 GB, waited 0.000 sec, Key+Value = 0.069 GB 2024/11/21-05:46:52.517775 140008400344640 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07309/att-00/105905.sst): second pass time = 0.63's, 88.146'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.48's, 40.490'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2189.103'MB/sec (index lex order gen) rebuild zvType time = 0.40's, 0.297'MB/sec write SST data time = 0.08's, 241.582'MB/sec dict compress time = 8389754632.49's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.559'MB, throughput = 19848.006'MB/sec zip my value time = 0.63's, unzip length = 0.056'GB zip my value throughput = 88.146'MB/sec zip pipeline throughput = 88.146'MB/sec entries = 477089 avg-key = 28.00 avg-zkey = 1.92 avg-val = 116.93 avg-zval = 34.55 usrkeys = 477089 avg-key = 20.00 avg-zkey = 1.92 avg-val = 123.93 avg-zval = 34.55 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 477089 bytes = 1610192 } seq expand size = 3339623 multi value expand size = 0 cnt WriteAppend = 11 UnZipSize{ index = 0.0095 GB value = 0.0558 GB dict = 0.56 MB all = 0.0691 GB } __ZipSize{ index = 0.0009 GB value = 0.0165 GB dict = 0.56 MB all = 0.0196 GB } UnZip/Zip{ index = 10.4376 value = 3.3849 dict = 1.00 all = 3.5337 } Zip/UnZip{ index = 0.0958 value = 0.2954 dict = 1.00 all = 0.2830 } ---------------------------- total value len = 564.152421 GB avg = 0.330 KB (by entry num) total key len = 44.561375 GB avg = 0.026 KB total ukey len = 32.970548 GB avg = 0.014 KB total ukey num = 2.329834890 Billion total entry num = 1.709336912 Billion write speed all = 14.427858618 MB/sec (with seq num) write speed all = 14.103738199 MB/sec (without seq num) 2024/11/21-05:46:52.547304 140008400344640 [compaction_job.cc:1948] [default] [JOB 7309] Generated table #105905: 477089 keys, 19567299 bytes, temperature: kWarm 2024/11/21-05:46:52.547362 140008400344640 EVENT_LOG_v1 {"time_micros": 1732139212547333, "cf_name": "default", "job": 7309, "event": "table_file_creation", "file_number": 105905, "file_size": 19567299, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1453169979, "largest_seqno": 1582513261, "table_properties": {"data_size": 16481232, "index_size": 914176, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 13358492, "raw_average_key_size": 28, "raw_value_size": 55787010, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 477089, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732139211, "oldest_key_time": 0, "file_creation_time": 1732139211, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "MNFBDNZRMES7C6T09KKW", "orig_file_number": 105905, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/21-05:46:52.575210 140008400344640 [compaction_job.cc:703] job-07309: subcompact[0], size: 0.370756 G, files: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-07309/att-00 [105896,105897,105898,105899,105900,105901,105902,105903,105904,105905] 2024/11/21-05:46:52.649068 140008400344640 (Original Log Time 2024/11/21-05:46:21.049412) EVENT_LOG_v1 {"time_micros": 1732139181049365, "job": 7309, "event": "compaction_started", "compaction_reason": "FilesMarkedForCompaction", "files_L2": [105888], "files_L3": [105848, 105849, 105850, 105851, 105852, 105853, 105854, 105855, 105803, 105804], "score": 0.99517, "input_data_size": 389299759, "oldest_snapshot_seqno": 1582538745} 2024/11/21-05:46:52.649073 140008400344640 (Original Log Time 2024/11/21-05:46:52.648140) [compaction_job.cc:2022] [default] [JOB 7309] Compacted 1@2 + 10@3 files to L3 => 370756003 bytes 2024/11/21-05:46:52.649074 140008400344640 (Original Log Time 2024/11/21-05:46:52.648978) [compaction_job.cc:1224] [default] compacted to: files[0 0 0 10 0 0 0] max score 0.01, MB/sec: 12.3 rd, 11.8 wr, level 3, files in(1, 10) out(10 +0 blob) MB in(21.3, 350.0 +0.0 blob) out(353.6 +0.0 blob), read-write-amplify(34.1) write-amplify(16.6) OK, records in: 8903805, records dropped: 83491 output_compression: Snappy 2024/11/21-05:46:52.649079 140008400344640 (Original Log Time 2024/11/21-05:46:52.649025) EVENT_LOG_v1 {"time_micros": 1732139212649001, "cf": "default", "job": 7309, "event": "compaction_finished", "compaction_time_micros": 31525805, "compaction_time_cpu_micros": 14710058, "output_level": 3, "num_output_files": 10, "total_output_size": 370756003, "num_input_records": 8903805, "num_output_records": 8820314, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "file_write_nanos": 299483275, "file_range_sync_nanos": 0, "file_fsync_nanos": 8933, "file_prepare_write_nanos": 35469, "lsm_state": [0, 0, 0, 10, 0, 0, 0]} 2024/11/21-05:46:52.801741 140008400344640 DEBG dcompact_worker.cpp:240: HttpPost: 200 OK: url = http://nlb-7zny4kaa1poal01o64.cn-shenzhen.nlb.aliyuncs.com:8443, body = {"instanceId":"nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137","labourId":"","dbId":"d89b4006-2803-486e-b7a2-759bcf348921","dbStarts":1732121803,"starts":1732139180,"executesMs":31728,"compactionJobId":7309,"attempt":0,"compactionInputRawBytes":1288961138,"compactionInputZipBytes":389299759,"compactionOutputRawBytes":0,"compactionOutputZipBytes":370756003,"headers":{"Accept":"*/*","Connection":"close","Host":"aliyun-topling-saas.topling.cn:18443","RemoteIp":"120.24.192.169","X-Forwarded-For":"120.24.192.169","region":"cn-shenzhen","token":"e6474c481bd4415abc537135cc03626b","instance-token":"e6474c481bd4415abc537135cc03626b","provider":"aliyun","CloudMarketInstanceId":"si-59c0ae5c955845588903","MeteringAssit":"","Transfer-Encoding":"chunked","traceparent":"00-1551325282750a87fbfdf0af3881171f-adb03b033365c5f1-00"}}, response = 2024/11/21-05:46:52.801829 140008400344640 INFO dcompact_worker.cpp:1464: finish /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-21T00.56.43/.rocksdb/job-07309/att-00: olev 3, work 31.728 s, result 7.925 ms, install 0.953 ms, input{raw 1.200 GiB zip 371.265 MiB}