2024/11/23-03:06:17.578130 140025196639808 DEBG dcompact_worker.cpp:2214: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17988/att-00: fork to child time = 0.009202 sec 2024/11/23-03:06:17.578922 140025196639808 DEBG dcompact_worker.cpp:1013: Beg SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17988/att-00 2024/11/23-03:06:17.586040 140025196639808 DEBG dcompact_worker.cpp:1033: End SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17988/att-00 2024/11/23-03:06:17.587161 140025196639808 TRAC dcompact_worker.cpp:1083: INFO_LOG_LEVEL: rpc = INFO_LEVEL, env_var = undefined 2024/11/23-03:06:17.587408 140025196639808 [WARN] [column_family.cc:386] multiple cf_paths/db_paths and level_compaction_dynamic_level_bytes can't be used together 2024/11/23-03:06:17.637839 140025196639808 [version_set.cc:6208] Recovering from manifest file: /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-17988/att-00/MANIFEST-206347 2024/11/23-03:06:17.652358 140025196639808 [version_set.cc:6251] Recovered from manifest file:/worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-17988/att-00/MANIFEST-206347 succeeded,manifest_file_number is 206347, next_file_number is 241982, last_sequence is 3750344601, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 241832 2024/11/23-03:06:17.652368 140025196639808 [version_set.cc:6266] Column family [default] (ID 0), log number is 0 2024/11/23-03:06:17.652532 140025196639808 [version_set.cc:5721] Creating manifest 241982 2024/11/23-03:06:17.693853 140025196639808 DEBG dcompact_worker.cpp:1218: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17988/att-00: bottommost_level: fake = 1, rpc = 0 2024/11/23-03:06:17.713378 140025196639808 [compaction_job.cc:2437] [default] [JOB 17988] Compacting 1@2 + 14@3 files to L3, score 1.00, subcompactions 1 : 1 2024/11/23-03:06:17.713401 140025196639808 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 13435 Base level 2, inputs: [241980(27MB)], [241936(34MB) 241937(34MB) 241938(36MB) 241939(33MB) 241940(35MB) 241941(36MB) 241942(35MB) 241943(35MB) 241944(35MB) 241945(21MB) 241925(35MB) 241926(35MB) 241927(36MB) 241928(36MB)] 2024/11/23-03:06:17.720387 140025196639808 [top_zip_table.cc:59] core git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-03:06:17.720420 140025196639808 [top_zip_table.cc:60] fsa git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-03:06:17.720445 140025196639808 [top_zip_table.cc:61] zbs git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-03:06:17.720451 140025196639808 [top_zip_table.cc:62] topling-zip_table_reader: git_version_hash_info_is: commit a4a382006cb82713acf5b3425835f22711877681 Author: leipeng Date: 2024-04-11 19:44:14 +0800 fixed_len_hole_index.cc: Add env bool FixedLenHoleIndexUseAVX512 for ut & debug 1. FixedLenHoleIndexUseAVX512 is only in unit tests or debug 2. In release mode, use avx512 by compile options(-march=) g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/23-03:06:17.720460 140025196639808 [top_zip_table.cc:64] topling-rocks git_version_hash_info_is: commit feab587e468621ba0204d47b4ffacc52e7c4290d Author: leipeng Date: 2024-03-22 13:35:06 +0800 ToplingZipTableBuilder::Add: immediately return after error This function returns void, and caller does not check builder->status() after calling this function and graceful abandon. So immediately return after error, and return error status in Finish(). g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/23-03:06:18.162873 140025196639808 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17988/att-00/241983.sst) /dev/shm/ToplingTemp/Topling-389673-U93MHp 2024/11/23-03:06:18.946822 140025196639808 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17988/att-00/241983.sst): first pass time = 0.78's, 171.216'MB/sec 2024/11/23-03:06:20.517214 140025196639808 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17988/att-00/241983.sst): old prealloc_size = 147639500, real_size = 32268608 2024/11/23-03:06:20.517915 140025196639808 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17988/att-00/241983.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927448 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0303 GB avg-val = 116.72 avg-zval = 32.64 2024/11/23-03:06:20.518722 140025196639808 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17988/att-00/241983.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-03:06:21.864762 140025196639808 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17988/att-00/241983.sst): second pass time = 1.57's, 68.967'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.35's, 26.903'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2593.455'MB/sec (index lex order gen) rebuild zvType time = 1.16's, 0.200'MB/sec write SST data time = 0.19's, 190.499'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 27567.419'MB/sec zip my value time = 1.57's, unzip length = 0.108'GB zip my value throughput = 68.967'MB/sec zip pipeline throughput = 68.967'MB/sec entries = 927448 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.72 avg-zval = 32.64 usrkeys = 927448 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.72 avg-zval = 32.64 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 927448 bytes = 3130144 } seq expand size = 6492136 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0303 GB dict = 1.08 MB all = 0.0363 GB } UnZip/Zip{ index = 10.5139 value = 3.5758 dict = 1.00 all = 3.7022 } Zip/UnZip{ index = 0.0951 value = 0.2797 dict = 1.00 all = 0.2701 } ---------------------------- total value len = 0.114741 GB avg = 0.124 KB (by entry num) total key len = 0.025969 GB avg = 0.028 KB total ukey len = 0.018549 GB avg = 0.020 KB total ukey num = 0.000927448 Billion total entry num = 0.000927448 Billion write speed all = 0.002143702 MB/sec (with seq num) write speed all = 0.002030665 MB/sec (without seq num) 2024/11/23-03:06:21.901028 140025196639808 [compaction_job.cc:1948] [default] [JOB 17988] Generated table #241983: 927448 keys, 36253064 bytes, temperature: kWarm 2024/11/23-03:06:21.901141 140025196639808 EVENT_LOG_v1 {"time_micros": 1732302381901072, "cf_name": "default", "job": 17988, "event": "table_file_creation", "file_number": 241983, "file_size": 36253064, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3621075956, "largest_seqno": 3750324829, "table_properties": {"data_size": 30272368, "index_size": 1764224, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25968544, "raw_average_key_size": 28, "raw_value_size": 108249252, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927448, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732302378, "oldest_key_time": 0, "file_creation_time": 1732302378, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 241983, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-03:06:21.971818 140025196639808 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17988/att-00/241984.sst) /dev/shm/ToplingTemp/Topling-389673-obql7p 2024/11/23-03:06:23.283227 140025196639808 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17988/att-00/241984.sst): first pass time = 1.31's, 102.350'MB/sec 2024/11/23-03:06:25.024133 140025196639808 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17988/att-00/241984.sst): old prealloc_size = 147639500, real_size = 32269088 2024/11/23-03:06:25.024723 140025196639808 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17988/att-00/241984.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927129 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0303 GB avg-val = 116.77 avg-zval = 32.65 2024/11/23-03:06:25.025526 140025196639808 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17988/att-00/241984.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-03:06:26.266039 140025196639808 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17988/att-00/241984.sst): second pass time = 1.74's, 62.207'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.24's, 29.379'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3075.120'MB/sec (index lex order gen) rebuild zvType time = 1.01's, 0.230'MB/sec write SST data time = 0.23's, 156.851'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 37117.875'MB/sec zip my value time = 1.74's, unzip length = 0.108'GB zip my value throughput = 62.207'MB/sec zip pipeline throughput = 62.207'MB/sec entries = 927129 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.77 avg-zval = 32.65 usrkeys = 927129 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.77 avg-zval = 32.65 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 927129 bytes = 3360864 } seq expand size = 6489903 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0303 GB dict = 1.08 MB all = 0.0365 GB } UnZip/Zip{ index = 10.5145 value = 3.5760 dict = 1.00 all = 3.6788 } Zip/UnZip{ index = 0.0951 value = 0.2796 dict = 1.00 all = 0.2718 } ---------------------------- total value len = 0.229489 GB avg = 0.124 KB (by entry num) total key len = 0.051928 GB avg = 0.028 KB total ukey len = 0.037092 GB avg = 0.020 KB total ukey num = 0.001854577 Billion total entry num = 0.001854577 Billion write speed all = 0.004287081 MB/sec (with seq num) write speed all = 0.004061062 MB/sec (without seq num) 2024/11/23-03:06:26.301557 140025196639808 [compaction_job.cc:1948] [default] [JOB 17988] Generated table #241984: 927129 keys, 36484374 bytes, temperature: kWarm 2024/11/23-03:06:26.301636 140025196639808 EVENT_LOG_v1 {"time_micros": 1732302386301594, "cf_name": "default", "job": 17988, "event": "table_file_creation", "file_number": 241984, "file_size": 36484374, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3376774746, "largest_seqno": 3750325860, "table_properties": {"data_size": 30273616, "index_size": 1763520, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25959612, "raw_average_key_size": 28, "raw_value_size": 108258122, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927129, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732302381, "oldest_key_time": 0, "file_creation_time": 1732302381, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 241984, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-03:06:26.384657 140025196639808 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17988/att-00/241985.sst) /dev/shm/ToplingTemp/Topling-389673-nYpMXs 2024/11/23-03:06:27.786545 140025196639808 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17988/att-00/241985.sst): first pass time = 1.40's, 95.744'MB/sec 2024/11/23-03:06:29.350088 140025196639808 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17988/att-00/241985.sst): old prealloc_size = 147639500, real_size = 33509264 2024/11/23-03:06:29.350634 140025196639808 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17988/att-00/241985.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 934546 prefix = 4 raw-key = 0.0150 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1081 GB zip-val = 0.0315 GB avg-val = 115.62 avg-zval = 33.70 2024/11/23-03:06:29.351417 140025196639808 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17988/att-00/241985.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-03:06:30.444991 140025196639808 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17988/att-00/241985.sst): second pass time = 1.56's, 69.134'MB/sec, value only(80.5% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.09's, 34.369'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3395.179'MB/sec (index lex order gen) rebuild zvType time = 0.96's, 0.244'MB/sec write SST data time = 0.14's, 276.795'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 36580.978'MB/sec zip my value time = 1.56's, unzip length = 0.108'GB zip my value throughput = 69.134'MB/sec zip pipeline throughput = 69.134'MB/sec entries = 934546 avg-key = 28.00 avg-zkey = 1.90 avg-val = 115.62 avg-zval = 33.70 usrkeys = 934546 avg-key = 20.00 avg-zkey = 1.90 avg-val = 122.62 avg-zval = 33.70 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 934546 bytes = 3270928 } seq expand size = 6541822 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0187 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0315 GB dict = 1.08 MB all = 0.0376 GB } UnZip/Zip{ index = 10.5151 value = 3.4304 dict = 1.00 all = 3.5667 } Zip/UnZip{ index = 0.0951 value = 0.2915 dict = 1.00 all = 0.2804 } ---------------------------- total value len = 0.344082 GB avg = 0.123 KB (by entry num) total key len = 0.078095 GB avg = 0.028 KB total ukey len = 0.055782 GB avg = 0.020 KB total ukey num = 0.002789123 Billion total entry num = 0.002789123 Billion write speed all = 0.006430987 MB/sec (with seq num) write speed all = 0.006091095 MB/sec (without seq num) 2024/11/23-03:06:30.479719 140025196639808 [compaction_job.cc:1948] [default] [JOB 17988] Generated table #241985: 934546 keys, 37630542 bytes, temperature: kWarm 2024/11/23-03:06:30.479786 140025196639808 EVENT_LOG_v1 {"time_micros": 1732302390479748, "cf_name": "default", "job": 17988, "event": "table_file_creation", "file_number": 241985, "file_size": 37630542, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3504428200, "largest_seqno": 3750325892, "table_properties": {"data_size": 31497920, "index_size": 1777536, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26167288, "raw_average_key_size": 28, "raw_value_size": 108050544, "raw_average_value_size": 115, "num_data_blocks": 1, "num_entries": 934546, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732302386, "oldest_key_time": 0, "file_creation_time": 1732302386, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 241985, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-03:06:30.515184 140025196639808 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17988/att-00/241986.sst) /dev/shm/ToplingTemp/Topling-389673-mRYSip 2024/11/23-03:06:31.444005 140025196639808 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17988/att-00/241986.sst): first pass time = 0.93's, 144.509'MB/sec 2024/11/23-03:06:32.766435 140025196639808 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17988/att-00/241986.sst): old prealloc_size = 147639500, real_size = 30707776 2024/11/23-03:06:32.767018 140025196639808 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17988/att-00/241986.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 926097 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1083 GB zip-val = 0.0287 GB avg-val = 116.93 avg-zval = 30.99 2024/11/23-03:06:32.767770 140025196639808 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17988/att-00/241986.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-03:06:33.615331 140025196639808 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17988/att-00/241986.sst): second pass time = 1.32's, 81.935'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.85's, 40.998'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3229.052'MB/sec (index lex order gen) rebuild zvType time = 0.72's, 0.321'MB/sec write SST data time = 0.13's, 272.757'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 31707.487'MB/sec zip my value time = 1.32's, unzip length = 0.108'GB zip my value throughput = 81.935'MB/sec zip pipeline throughput = 81.935'MB/sec entries = 926097 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.93 avg-zval = 30.99 usrkeys = 926097 avg-key = 20.00 avg-zkey = 1.91 avg-val = 123.93 avg-zval = 30.99 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 926097 bytes = 3241360 } seq expand size = 6482679 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0287 GB dict = 1.08 MB all = 0.0348 GB } UnZip/Zip{ index = 10.4486 value = 3.7726 dict = 1.00 all = 3.8566 } Zip/UnZip{ index = 0.0957 value = 0.2651 dict = 1.00 all = 0.2593 } ---------------------------- total value len = 0.458852 GB avg = 0.124 KB (by entry num) total key len = 0.104026 GB avg = 0.028 KB total ukey len = 0.074304 GB avg = 0.020 KB total ukey num = 0.003715220 Billion total entry num = 0.003715220 Billion write speed all = 0.008573850 MB/sec (with seq num) write speed all = 0.008121123 MB/sec (without seq num) 2024/11/23-03:06:33.649354 140025196639808 [compaction_job.cc:1948] [default] [JOB 17988] Generated table #241986: 926097 keys, 34802334 bytes, temperature: kWarm 2024/11/23-03:06:33.649442 140025196639808 EVENT_LOG_v1 {"time_micros": 1732302393649386, "cf_name": "default", "job": 17988, "event": "table_file_creation", "file_number": 241986, "file_size": 34802334, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3613883419, "largest_seqno": 3750325902, "table_properties": {"data_size": 28703408, "index_size": 1772672, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25930716, "raw_average_key_size": 28, "raw_value_size": 108287082, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 926097, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732302390, "oldest_key_time": 0, "file_creation_time": 1732302390, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 241986, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-03:06:33.682744 140025196639808 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17988/att-00/241987.sst) /dev/shm/ToplingTemp/Topling-389673-QWwSFs 2024/11/23-03:06:34.565282 140025196639808 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17988/att-00/241987.sst): first pass time = 0.88's, 152.087'MB/sec 2024/11/23-03:06:35.926764 140025196639808 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17988/att-00/241987.sst): old prealloc_size = 147639500, real_size = 35253200 2024/11/23-03:06:35.927451 140025196639808 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17988/att-00/241987.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 1082156 prefix = 4 raw-key = 0.0173 GB zip-key = 0.0021 GB avg-key = 16.00 avg-zkey = 1.93 raw-val = 0.1039 GB zip-val = 0.0329 GB avg-val = 96.03 avg-zval = 30.40 2024/11/23-03:06:35.927802 140025196639808 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17988/att-00/241987.sst: sumWaitingMem = 0.003 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0028 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-03:06:36.618334 140025196639808 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17988/att-00/241987.sst): second pass time = 1.36's, 76.364'MB/sec, value only(77.4% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.69's, 53.638'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3193.463'MB/sec (index lex order gen) rebuild zvType time = 0.55's, 0.493'MB/sec write SST data time = 0.14's, 261.439'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.037'MB, throughput = 32927.734'MB/sec zip my value time = 1.36's, unzip length = 0.104'GB zip my value throughput = 76.364'MB/sec zip pipeline throughput = 76.364'MB/sec entries = 1082156 avg-key = 28.00 avg-zkey = 1.93 avg-val = 96.03 avg-zval = 30.40 usrkeys = 1082156 avg-key = 20.00 avg-zkey = 1.93 avg-val = 97.68 avg-zval = 30.40 TagRS{ kinds = RS_Key0_TagN bytes = 169200 } TagArray{ size = 255312 bytes = 893600 } seq expand size = 1787184 multi value expand size = 0 cnt WriteAppend = 18 UnZipSize{ index = 0.0216 GB value = 0.1039 GB dict = 1.04 MB all = 0.1342 GB } __ZipSize{ index = 0.0021 GB value = 0.0329 GB dict = 1.04 MB all = 0.0371 GB } UnZip/Zip{ index = 10.3792 value = 3.1589 dict = 1.00 all = 3.6184 } Zip/UnZip{ index = 0.0963 value = 0.3166 dict = 1.00 all = 0.2764 } ---------------------------- total value len = 0.564556 GB avg = 0.118 KB (by entry num) total key len = 0.134327 GB avg = 0.028 KB total ukey len = 0.095948 GB avg = 0.020 KB total ukey num = 0.004797376 Billion total entry num = 0.004797376 Billion write speed all = 0.010645015 MB/sec (with seq num) write speed all = 0.010060446 MB/sec (without seq num) 2024/11/23-03:06:36.653458 140025196639808 [compaction_job.cc:1948] [default] [JOB 17988] Generated table #241987: 1082156 keys, 37093125 bytes, temperature: kWarm 2024/11/23-03:06:36.653518 140025196639808 EVENT_LOG_v1 {"time_micros": 1732302396653487, "cf_name": "default", "job": 17988, "event": "table_file_creation", "file_number": 241987, "file_size": 37093125, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3750326019, "table_properties": {"data_size": 32897216, "index_size": 2085248, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 30300368, "raw_average_key_size": 28, "raw_value_size": 103917469, "raw_average_value_size": 96, "num_data_blocks": 1, "num_entries": 1082156, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732302393, "oldest_key_time": 0, "file_creation_time": 1732302393, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 241987, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-03:06:36.688506 140025196639808 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17988/att-00/241988.sst) /dev/shm/ToplingTemp/Topling-389673-OqrYaq 2024/11/23-03:06:37.449942 140025196639808 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17988/att-00/241988.sst): first pass time = 0.76's, 176.278'MB/sec 2024/11/23-03:06:38.858077 140025196639808 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17988/att-00/241988.sst): old prealloc_size = 147639500, real_size = 36219664 2024/11/23-03:06:38.858671 140025196639808 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17988/att-00/241988.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 923917 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1083 GB zip-val = 0.0342 GB avg-val = 117.27 avg-zval = 37.04 2024/11/23-03:06:38.859092 140025196639808 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17988/att-00/241988.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-03:06:39.611859 140025196639808 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17988/att-00/241988.sst): second pass time = 1.41's, 77.015'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.75's, 51.128'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3074.771'MB/sec (index lex order gen) rebuild zvType time = 0.62's, 0.370'MB/sec write SST data time = 0.13's, 300.099'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.082'MB, throughput = 35554.964'MB/sec zip my value time = 1.41's, unzip length = 0.108'GB zip my value throughput = 77.015'MB/sec zip pipeline throughput = 77.015'MB/sec entries = 923917 avg-key = 28.00 avg-zkey = 1.91 avg-val = 117.27 avg-zval = 37.04 usrkeys = 923917 avg-key = 20.00 avg-zkey = 1.91 avg-val = 120.02 avg-zval = 37.04 TagRS{ kinds = RS_Key0_TagN bytes = 144480 } TagArray{ size = 362358 bytes = 1313568 } seq expand size = 2536506 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0342 GB dict = 1.08 MB all = 0.0385 GB } UnZip/Zip{ index = 10.4451 value = 3.1663 dict = 1.00 all = 3.4827 } Zip/UnZip{ index = 0.0957 value = 0.3158 dict = 1.00 all = 0.2871 } ---------------------------- total value len = 0.675441 GB avg = 0.118 KB (by entry num) total key len = 0.160196 GB avg = 0.028 KB total ukey len = 0.114426 GB avg = 0.020 KB total ukey num = 0.005721293 Billion total entry num = 0.005721293 Billion write speed all = 0.012727405 MB/sec (with seq num) write speed all = 0.012030287 MB/sec (without seq num) 2024/11/23-03:06:39.650591 140025196639808 [compaction_job.cc:1948] [default] [JOB 17988] Generated table #241988: 923917 keys, 38538493 bytes, temperature: kWarm 2024/11/23-03:06:39.650651 140025196639808 EVENT_LOG_v1 {"time_micros": 1732302399650620, "cf_name": "default", "job": 17988, "event": "table_file_creation", "file_number": 241988, "file_size": 38538493, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3680049425, "table_properties": {"data_size": 34219392, "index_size": 1769088, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25869676, "raw_average_key_size": 28, "raw_value_size": 108348186, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 923917, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732302396, "oldest_key_time": 0, "file_creation_time": 1732302396, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 241988, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-03:06:39.685206 140025196639808 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17988/att-00/241989.sst) /dev/shm/ToplingTemp/Topling-389673-cGBenq 2024/11/23-03:06:40.593481 140025196639808 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17988/att-00/241989.sst): first pass time = 0.91's, 147.777'MB/sec 2024/11/23-03:06:41.924442 140025196639808 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17988/att-00/241989.sst): old prealloc_size = 147639500, real_size = 32950256 2024/11/23-03:06:41.924980 140025196639808 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17988/att-00/241989.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927125 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0310 GB avg-val = 116.77 avg-zval = 33.39 2024/11/23-03:06:41.925729 140025196639808 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17988/att-00/241989.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-03:06:42.849980 140025196639808 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17988/att-00/241989.sst): second pass time = 1.33's, 81.382'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.93's, 40.031'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3411.610'MB/sec (index lex order gen) rebuild zvType time = 0.80's, 0.291'MB/sec write SST data time = 0.13's, 286.261'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 33348.293'MB/sec zip my value time = 1.33's, unzip length = 0.108'GB zip my value throughput = 81.382'MB/sec zip pipeline throughput = 81.382'MB/sec entries = 927125 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.77 avg-zval = 33.39 usrkeys = 927125 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.77 avg-zval = 33.39 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 927125 bytes = 3244960 } seq expand size = 6489875 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0310 GB dict = 1.08 MB all = 0.0370 GB } UnZip/Zip{ index = 10.5126 value = 3.4973 dict = 1.00 all = 3.6226 } Zip/UnZip{ index = 0.0951 value = 0.2859 dict = 1.00 all = 0.2760 } ---------------------------- total value len = 0.790189 GB avg = 0.119 KB (by entry num) total key len = 0.186156 GB avg = 0.028 KB total ukey len = 0.132968 GB avg = 0.020 KB total ukey num = 0.006648418 Billion total entry num = 0.006648418 Billion write speed all = 0.014869760 MB/sec (with seq num) write speed all = 0.014059716 MB/sec (without seq num) 2024/11/23-03:06:42.884525 140025196639808 [compaction_job.cc:1948] [default] [JOB 17988] Generated table #241989: 927125 keys, 37049714 bytes, temperature: kWarm 2024/11/23-03:06:42.884588 140025196639808 EVENT_LOG_v1 {"time_micros": 1732302402884555, "cf_name": "default", "job": 17988, "event": "table_file_creation", "file_number": 241989, "file_size": 37049714, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3487497056, "largest_seqno": 3750324849, "table_properties": {"data_size": 30954464, "index_size": 1763840, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25959500, "raw_average_key_size": 28, "raw_value_size": 108258342, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927125, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732302399, "oldest_key_time": 0, "file_creation_time": 1732302399, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 241989, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-03:06:42.919712 140025196639808 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17988/att-00/241990.sst) /dev/shm/ToplingTemp/Topling-389673-oJ7ROs 2024/11/23-03:06:43.753222 140025196639808 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17988/att-00/241990.sst): first pass time = 0.83's, 161.034'MB/sec 2024/11/23-03:06:45.067355 140025196639808 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17988/att-00/241990.sst): old prealloc_size = 147639500, real_size = 32625680 2024/11/23-03:06:45.067874 140025196639808 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17988/att-00/241990.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927159 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0306 GB avg-val = 116.76 avg-zval = 33.04 2024/11/23-03:06:45.068643 140025196639808 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17988/att-00/241990.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-03:06:45.977341 140025196639808 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17988/att-00/241990.sst): second pass time = 1.31's, 82.459'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.91's, 40.486'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3554.667'MB/sec (index lex order gen) rebuild zvType time = 0.78's, 0.297'MB/sec write SST data time = 0.13's, 284.905'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 34804.857'MB/sec zip my value time = 1.31's, unzip length = 0.108'GB zip my value throughput = 82.459'MB/sec zip pipeline throughput = 82.459'MB/sec entries = 927159 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.76 avg-zval = 33.04 usrkeys = 927159 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.76 avg-zval = 33.04 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 927159 bytes = 3360960 } seq expand size = 6490113 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0306 GB dict = 1.08 MB all = 0.0368 GB } UnZip/Zip{ index = 10.5126 value = 3.5344 dict = 1.00 all = 3.6431 } Zip/UnZip{ index = 0.0951 value = 0.2829 dict = 1.00 all = 0.2745 } ---------------------------- total value len = 0.904937 GB avg = 0.119 KB (by entry num) total key len = 0.212116 GB avg = 0.028 KB total ukey len = 0.151512 GB avg = 0.020 KB total ukey num = 0.007575577 Billion total entry num = 0.007575577 Billion write speed all = 0.017011936 MB/sec (with seq num) write speed all = 0.016088970 MB/sec (without seq num) 2024/11/23-03:06:46.010700 140025196639808 [compaction_job.cc:1948] [default] [JOB 17988] Generated table #241990: 927159 keys, 36841376 bytes, temperature: kWarm 2024/11/23-03:06:46.010762 140025196639808 EVENT_LOG_v1 {"time_micros": 1732302406010729, "cf_name": "default", "job": 17988, "event": "table_file_creation", "file_number": 241990, "file_size": 36841376, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3375334738, "largest_seqno": 3750325980, "table_properties": {"data_size": 30629824, "index_size": 1763904, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25960452, "raw_average_key_size": 28, "raw_value_size": 108257350, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927159, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732302402, "oldest_key_time": 0, "file_creation_time": 1732302402, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 241990, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-03:06:46.053047 140025196639808 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17988/att-00/241991.sst) /dev/shm/ToplingTemp/Topling-389673-Ts4Kyr 2024/11/23-03:06:46.945948 140025196639808 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17988/att-00/241991.sst): first pass time = 0.89's, 150.322'MB/sec 2024/11/23-03:06:48.296700 140025196639808 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17988/att-00/241991.sst): old prealloc_size = 147639500, real_size = 33441728 2024/11/23-03:06:48.297288 140025196639808 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17988/att-00/241991.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927151 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1083 GB zip-val = 0.0314 GB avg-val = 116.76 avg-zval = 33.90 2024/11/23-03:06:48.298065 140025196639808 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17988/att-00/241991.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-03:06:49.250240 140025196639808 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17988/att-00/241991.sst): second pass time = 1.35's, 80.231'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.95's, 39.493'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3140.224'MB/sec (index lex order gen) rebuild zvType time = 0.82's, 0.281'MB/sec write SST data time = 0.13's, 290.712'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 33365.408'MB/sec zip my value time = 1.35's, unzip length = 0.108'GB zip my value throughput = 80.231'MB/sec zip pipeline throughput = 80.231'MB/sec entries = 927151 avg-key = 28.00 avg-zkey = 1.92 avg-val = 116.76 avg-zval = 33.90 usrkeys = 927151 avg-key = 20.00 avg-zkey = 1.92 avg-val = 123.76 avg-zval = 33.90 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 927151 bytes = 3360944 } seq expand size = 6490057 multi value expand size = 0 cnt WriteAppend = 15 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0314 GB dict = 1.08 MB all = 0.0377 GB } UnZip/Zip{ index = 10.4416 value = 3.4440 dict = 1.00 all = 3.5642 } Zip/UnZip{ index = 0.0958 value = 0.2904 dict = 1.00 all = 0.2806 } ---------------------------- total value len = 1.019684 GB avg = 0.120 KB (by entry num) total key len = 0.238076 GB avg = 0.028 KB total ukey len = 0.170055 GB avg = 0.020 KB total ukey num = 0.008502728 Billion total entry num = 0.008502728 Billion write speed all = 0.019153864 MB/sec (with seq num) write speed all = 0.018117990 MB/sec (without seq num) 2024/11/23-03:06:49.287722 140025196639808 [compaction_job.cc:1948] [default] [JOB 17988] Generated table #241991: 927151 keys, 37657256 bytes, temperature: kWarm 2024/11/23-03:06:49.287790 140025196639808 EVENT_LOG_v1 {"time_micros": 1732302409287753, "cf_name": "default", "job": 17988, "event": "table_file_creation", "file_number": 241991, "file_size": 37657256, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3273701103, "largest_seqno": 3750324880, "table_properties": {"data_size": 31433904, "index_size": 1775872, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25960228, "raw_average_key_size": 28, "raw_value_size": 108257570, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927151, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732302406, "oldest_key_time": 0, "file_creation_time": 1732302406, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 241991, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-03:06:49.321414 140025196639808 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17988/att-00/241992.sst) /dev/shm/ToplingTemp/Topling-389673-B5QVLp 2024/11/23-03:06:50.311378 140025196639808 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17988/att-00/241992.sst): first pass time = 0.99's, 135.584'MB/sec 2024/11/23-03:06:51.642664 140025196639808 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17988/att-00/241992.sst): old prealloc_size = 147639500, real_size = 32291824 2024/11/23-03:06:51.643261 140025196639808 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17988/att-00/241992.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 934018 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1081 GB zip-val = 0.0303 GB avg-val = 115.70 avg-zval = 32.42 2024/11/23-03:06:51.643988 140025196639808 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17988/att-00/241992.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-03:06:52.590432 140025196639808 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17988/att-00/241992.sst): second pass time = 1.33's, 81.219'MB/sec, value only(80.5% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.95's, 38.296'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3100.940'MB/sec (index lex order gen) rebuild zvType time = 0.82's, 0.285'MB/sec write SST data time = 0.13's, 282.470'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 30532.729'MB/sec zip my value time = 1.33's, unzip length = 0.108'GB zip my value throughput = 81.219'MB/sec zip pipeline throughput = 81.219'MB/sec entries = 934018 avg-key = 28.00 avg-zkey = 1.90 avg-val = 115.70 avg-zval = 32.42 usrkeys = 934018 avg-key = 20.00 avg-zkey = 1.90 avg-val = 122.70 avg-zval = 32.42 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 934018 bytes = 3152320 } seq expand size = 6538126 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0187 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0303 GB dict = 1.08 MB all = 0.0363 GB } UnZip/Zip{ index = 10.5114 value = 3.5688 dict = 1.00 all = 3.6980 } Zip/UnZip{ index = 0.0951 value = 0.2802 dict = 1.00 all = 0.2704 } ---------------------------- total value len = 1.134288 GB avg = 0.120 KB (by entry num) total key len = 0.264229 GB avg = 0.028 KB total ukey len = 0.188735 GB avg = 0.020 KB total ukey num = 0.009436746 Billion total entry num = 0.009436746 Billion write speed all = 0.021296289 MB/sec (with seq num) write speed all = 0.020146684 MB/sec (without seq num) 2024/11/23-03:06:52.621415 140025196639808 [compaction_job.cc:1948] [default] [JOB 17988] Generated table #241992: 934018 keys, 36294550 bytes, temperature: kWarm 2024/11/23-03:06:52.621479 140025196639808 EVENT_LOG_v1 {"time_micros": 1732302412621446, "cf_name": "default", "job": 17988, "event": "table_file_creation", "file_number": 241992, "file_size": 36294550, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3680980241, "largest_seqno": 3750325056, "table_properties": {"data_size": 30280992, "index_size": 1777152, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26152504, "raw_average_key_size": 28, "raw_value_size": 108065336, "raw_average_value_size": 115, "num_data_blocks": 1, "num_entries": 934018, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732302409, "oldest_key_time": 0, "file_creation_time": 1732302409, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 241992, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-03:06:52.658495 140025196639808 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17988/att-00/241993.sst) /dev/shm/ToplingTemp/Topling-389673-nvEXAq 2024/11/23-03:06:53.526633 140025196639808 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17988/att-00/241993.sst): first pass time = 0.87's, 154.611'MB/sec 2024/11/23-03:06:54.836139 140025196639808 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17988/att-00/241993.sst): old prealloc_size = 147639500, real_size = 31431680 2024/11/23-03:06:54.836682 140025196639808 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17988/att-00/241993.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 926809 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0294 GB avg-val = 116.82 avg-zval = 31.76 2024/11/23-03:06:54.837485 140025196639808 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17988/att-00/241993.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-03:06:55.713529 140025196639808 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17988/att-00/241993.sst): second pass time = 1.31's, 82.717'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.88's, 40.628'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3403.356'MB/sec (index lex order gen) rebuild zvType time = 0.75's, 0.310'MB/sec write SST data time = 0.13's, 277.033'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 30311.599'MB/sec zip my value time = 1.31's, unzip length = 0.108'GB zip my value throughput = 82.717'MB/sec zip pipeline throughput = 82.717'MB/sec entries = 926809 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.82 avg-zval = 31.76 usrkeys = 926809 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.82 avg-zval = 31.76 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 926809 bytes = 3359696 } seq expand size = 6487663 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0294 GB dict = 1.08 MB all = 0.0356 GB } UnZip/Zip{ index = 10.5132 value = 3.6780 dict = 1.00 all = 3.7653 } Zip/UnZip{ index = 0.0951 value = 0.2719 dict = 1.00 all = 0.2656 } ---------------------------- total value len = 1.249043 GB avg = 0.121 KB (by entry num) total key len = 0.290180 GB avg = 0.028 KB total ukey len = 0.207271 GB avg = 0.020 KB total ukey num = 0.010363555 Billion total entry num = 0.010363555 Billion write speed all = 0.023437806 MB/sec (with seq num) write speed all = 0.022175355 MB/sec (without seq num) 2024/11/23-03:06:55.748352 140025196639808 [compaction_job.cc:1948] [default] [JOB 17988] Generated table #241993: 926809 keys, 35645886 bytes, temperature: kWarm 2024/11/23-03:06:55.748415 140025196639808 EVENT_LOG_v1 {"time_micros": 1732302415748383, "cf_name": "default", "job": 17988, "event": "table_file_creation", "file_number": 241993, "file_size": 35645886, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3369194706, "largest_seqno": 3750326080, "table_properties": {"data_size": 29436656, "index_size": 1763136, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25950652, "raw_average_key_size": 28, "raw_value_size": 108267214, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 926809, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732302412, "oldest_key_time": 0, "file_creation_time": 1732302412, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 241993, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-03:06:55.783808 140025196639808 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17988/att-00/241994.sst) /dev/shm/ToplingTemp/Topling-389673-MukAPr 2024/11/23-03:06:56.656305 140025196639808 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17988/att-00/241994.sst): first pass time = 0.87's, 153.838'MB/sec 2024/11/23-03:06:57.979890 140025196639808 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17988/att-00/241994.sst): old prealloc_size = 147639500, real_size = 33130720 2024/11/23-03:06:57.980468 140025196639808 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17988/att-00/241994.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 933347 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.93 raw-val = 0.1081 GB zip-val = 0.0311 GB avg-val = 115.80 avg-zval = 33.32 2024/11/23-03:06:57.981264 140025196639808 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17988/att-00/241994.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-03:06:58.909805 140025196639808 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17988/att-00/241994.sst): second pass time = 1.32's, 81.746'MB/sec, value only(80.5% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.93's, 40.182'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3228.141'MB/sec (index lex order gen) rebuild zvType time = 0.80's, 0.292'MB/sec write SST data time = 0.13's, 289.229'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 33803.217'MB/sec zip my value time = 1.32's, unzip length = 0.108'GB zip my value throughput = 81.746'MB/sec zip pipeline throughput = 81.746'MB/sec entries = 933347 avg-key = 28.00 avg-zkey = 1.93 avg-val = 115.80 avg-zval = 33.32 usrkeys = 933347 avg-key = 20.00 avg-zkey = 1.93 avg-val = 122.80 avg-zval = 33.32 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 933347 bytes = 3383392 } seq expand size = 6533429 multi value expand size = 0 cnt WriteAppend = 17 UnZipSize{ index = 0.0187 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0311 GB dict = 1.08 MB all = 0.0374 GB } UnZip/Zip{ index = 10.3738 value = 3.4756 dict = 1.00 all = 3.5921 } Zip/UnZip{ index = 0.0964 value = 0.2877 dict = 1.00 all = 0.2784 } ---------------------------- total value len = 1.363660 GB avg = 0.121 KB (by entry num) total key len = 0.316313 GB avg = 0.028 KB total ukey len = 0.225938 GB avg = 0.020 KB total ukey num = 0.011296902 Billion total entry num = 0.011296902 Billion write speed all = 0.025579787 MB/sec (with seq num) write speed all = 0.024203706 MB/sec (without seq num) 2024/11/23-03:06:58.943729 140025196639808 [compaction_job.cc:1948] [default] [JOB 17988] Generated table #241994: 933347 keys, 37364694 bytes, temperature: kWarm 2024/11/23-03:06:58.943798 140025196639808 EVENT_LOG_v1 {"time_micros": 1732302418943758, "cf_name": "default", "job": 17988, "event": "table_file_creation", "file_number": 241994, "file_size": 37364694, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3339428666, "largest_seqno": 3750325038, "table_properties": {"data_size": 31097744, "index_size": 1799424, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26133716, "raw_average_key_size": 28, "raw_value_size": 108084086, "raw_average_value_size": 115, "num_data_blocks": 1, "num_entries": 933347, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732302415, "oldest_key_time": 0, "file_creation_time": 1732302415, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 241994, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-03:06:58.989369 140025196639808 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17988/att-00/241995.sst) /dev/shm/ToplingTemp/Topling-389673-QH1ans 2024/11/23-03:06:59.789181 140025196639808 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17988/att-00/241995.sst): first pass time = 0.80's, 167.819'MB/sec 2024/11/23-03:07:01.132239 140025196639808 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17988/att-00/241995.sst): old prealloc_size = 147639500, real_size = 34150576 2024/11/23-03:07:01.132808 140025196639808 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17988/att-00/241995.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 928240 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1082 GB zip-val = 0.0321 GB avg-val = 116.59 avg-zval = 34.63 2024/11/23-03:07:01.133595 140025196639808 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17988/att-00/241995.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-03:07:02.056122 140025196639808 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17988/att-00/241995.sst): second pass time = 1.34's, 80.622'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.92's, 41.531'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3245.743'MB/sec (index lex order gen) rebuild zvType time = 0.79's, 0.293'MB/sec write SST data time = 0.13's, 295.088'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 24174.832'MB/sec zip my value time = 1.34's, unzip length = 0.108'GB zip my value throughput = 80.622'MB/sec zip pipeline throughput = 80.622'MB/sec entries = 928240 avg-key = 28.00 avg-zkey = 1.92 avg-val = 116.59 avg-zval = 34.63 usrkeys = 928240 avg-key = 20.00 avg-zkey = 1.92 avg-val = 123.59 avg-zval = 34.63 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 928240 bytes = 3364880 } seq expand size = 6497680 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0321 GB dict = 1.08 MB all = 0.0384 GB } UnZip/Zip{ index = 10.4422 value = 3.3673 dict = 1.00 all = 3.4981 } Zip/UnZip{ index = 0.0958 value = 0.2970 dict = 1.00 all = 0.2859 } ---------------------------- total value len = 1.478385 GB avg = 0.121 KB (by entry num) total key len = 0.342304 GB avg = 0.028 KB total ukey len = 0.244503 GB avg = 0.020 KB total ukey num = 0.012225142 Billion total entry num = 0.012225142 Billion write speed all = 0.027721035 MB/sec (with seq num) write speed all = 0.026231956 MB/sec (without seq num) 2024/11/23-03:07:02.097258 140025196639808 [compaction_job.cc:1948] [default] [JOB 17988] Generated table #241995: 928240 keys, 38368880 bytes, temperature: kWarm 2024/11/23-03:07:02.097322 140025196639808 EVENT_LOG_v1 {"time_micros": 1732302422097290, "cf_name": "default", "job": 17988, "event": "table_file_creation", "file_number": 241995, "file_size": 38368880, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3369353416, "largest_seqno": 3750326256, "table_properties": {"data_size": 32140448, "index_size": 1777856, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25990720, "raw_average_key_size": 28, "raw_value_size": 108227036, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 928240, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732302418, "oldest_key_time": 0, "file_creation_time": 1732302418, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 241995, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-03:07:02.137749 140025196639808 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17988/att-00/241996.sst) /dev/shm/ToplingTemp/Topling-389673-S8H7Wp 2024/11/23-03:07:02.539305 140025196639808 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17988/att-00/241996.sst): first pass time = 0.40's, 253.981'MB/sec 2024/11/23-03:07:03.547297 140025196639808 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17988/att-00/241996.sst): old prealloc_size = 147639500, real_size = 26658784 2024/11/23-03:07:03.547718 140025196639808 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17988/att-00/241996.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 707742 prefix = 4 raw-key = 0.0113 GB zip-key = 0.0014 GB avg-key = 16.00 avg-zkey = 1.93 raw-val = 0.0822 GB zip-val = 0.0251 GB avg-val = 116.09 avg-zval = 35.49 2024/11/23-03:07:03.548235 140025196639808 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17988/att-00/241996.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0018 GB, waited 0.000 sec, Key+Value = 0.102 GB 2024/11/23-03:07:04.201828 140025196639808 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17988/att-00/241996.sst): second pass time = 1.01's, 81.560'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.65's, 44.808'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3421.947'MB/sec (index lex order gen) rebuild zvType time = 0.55's, 0.319'MB/sec write SST data time = 0.10's, 292.412'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.825'MB, throughput = 25925.200'MB/sec zip my value time = 1.01's, unzip length = 0.082'GB zip my value throughput = 81.560'MB/sec zip pipeline throughput = 81.560'MB/sec entries = 707742 avg-key = 28.00 avg-zkey = 1.93 avg-val = 116.09 avg-zval = 35.49 usrkeys = 707742 avg-key = 20.00 avg-zkey = 1.93 avg-val = 121.28 avg-zval = 35.49 TagRS{ kinds = RS_Key0_TagN bytes = 110680 } TagArray{ size = 524745 bytes = 1902208 } seq expand size = 3673215 multi value expand size = 0 cnt WriteAppend = 18 UnZipSize{ index = 0.0142 GB value = 0.0822 GB dict = 0.82 MB all = 0.1020 GB } __ZipSize{ index = 0.0014 GB value = 0.0251 GB dict = 0.82 MB all = 0.0293 GB } UnZip/Zip{ index = 10.3757 value = 3.2710 dict = 1.00 all = 3.4772 } Zip/UnZip{ index = 0.0964 value = 0.3057 dict = 1.00 all = 0.2876 } ---------------------------- total value len = 1.564218 GB avg = 0.121 KB (by entry num) total key len = 0.362121 GB avg = 0.028 KB total ukey len = 0.258658 GB avg = 0.020 KB total ukey num = 0.012932884 Billion total entry num = 0.012932884 Billion write speed all = 0.029328652 MB/sec (with seq num) write speed all = 0.027753419 MB/sec (without seq num) 2024/11/23-03:07:04.228995 140025196639808 [compaction_job.cc:1948] [default] [JOB 17988] Generated table #241996: 707742 keys, 29327239 bytes, temperature: kWarm 2024/11/23-03:07:04.229063 140025196639808 EVENT_LOG_v1 {"time_micros": 1732302424229024, "cf_name": "default", "job": 17988, "event": "table_file_creation", "file_number": 241996, "file_size": 29327239, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3748827384, "table_properties": {"data_size": 25117456, "index_size": 1364224, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 19816776, "raw_average_key_size": 28, "raw_value_size": 82159584, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 707742, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732302422, "oldest_key_time": 0, "file_creation_time": 1732302422, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 241996, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-03:07:04.253633 140025196639808 [compaction_job.cc:703] job-17988: subcompact[0], size: 0.509352 G, files: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17988/att-00 [241983,241984,241985,241986,241987,241988,241989,241990,241991,241992,241993,241994,241995,241996] 2024/11/23-03:07:04.341012 140025196639808 (Original Log Time 2024/11/23-03:06:17.713466) EVENT_LOG_v1 {"time_micros": 1732302377713419, "job": 17988, "event": "compaction_started", "compaction_reason": "FilesMarkedForCompaction", "files_L2": [241980], "files_L3": [241936, 241937, 241938, 241939, 241940, 241941, 241942, 241943, 241944, 241945, 241925, 241926, 241927, 241928], "score": 0.999252, "input_data_size": 535523579, "oldest_snapshot_seqno": 3750344549} 2024/11/23-03:07:04.341015 140025196639808 (Original Log Time 2024/11/23-03:07:04.340294) [compaction_job.cc:2022] [default] [JOB 17988] Compacted 1@2 + 14@3 files to L3 => 509351527 bytes 2024/11/23-03:07:04.341017 140025196639808 (Original Log Time 2024/11/23-03:07:04.340948) [compaction_job.cc:1224] [default] compacted to: files[0 0 0 14 0 0 0] max score 0.02, MB/sec: 11.5 rd, 10.9 wr, level 3, files in(1, 14) out(14 +0 blob) MB in(27.1, 483.6 +0.0 blob) out(485.8 +0.0 blob), read-write-amplify(36.7) write-amplify(17.9) OK, records in: 13000343, records dropped: 67459 output_compression: Snappy 2024/11/23-03:07:04.341022 140025196639808 (Original Log Time 2024/11/23-03:07:04.340992) EVENT_LOG_v1 {"time_micros": 1732302424340972, "cf": "default", "job": 17988, "event": "compaction_finished", "compaction_time_micros": 46540175, "compaction_time_cpu_micros": 21487628, "output_level": 3, "num_output_files": 14, "total_output_size": 509351527, "num_input_records": 13000343, "num_output_records": 12932884, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "file_write_nanos": 334346177, "file_range_sync_nanos": 0, "file_fsync_nanos": 13581, "file_prepare_write_nanos": 35537, "lsm_state": [0, 0, 0, 14, 0, 0, 0]} 2024/11/23-03:07:04.490472 140025196639808 DEBG dcompact_worker.cpp:240: HttpPost: 200 OK: url = http://nlb-7zny4kaa1poal01o64.cn-shenzhen.nlb.aliyuncs.com:8443, body = {"instanceId":"nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137","labourId":"","dbId":"d89b4006-2803-486e-b7a2-759bcf348921","dbStarts":1732256054,"starts":1732302377,"executesMs":46755,"compactionJobId":17988,"attempt":0,"compactionInputRawBytes":1856387103,"compactionInputZipBytes":535523579,"compactionOutputRawBytes":0,"compactionOutputZipBytes":509351527,"headers":{"Accept":"*/*","Connection":"close","Host":"aliyun-topling-saas.topling.cn:18443","RemoteIp":"120.24.192.169","X-Forwarded-For":"120.24.192.169","region":"cn-shenzhen","token":"e6474c481bd4415abc537135cc03626b","instance-token":"e6474c481bd4415abc537135cc03626b","provider":"aliyun","CloudMarketInstanceId":"si-59c0ae5c955845588903","MeteringAssit":"","Transfer-Encoding":"chunked","traceparent":"00-10f67341e4e433aa9a55c2bf372b4264-b56a54a24d40e863-00"}}, response = 2024/11/23-03:07:04.490553 140025196639808 INFO dcompact_worker.cpp:1459: finish /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-17988/att-00: olev 3, work 46.756 s, result 6.358 ms, install 0.759 ms, input{raw 1.729 GiB zip 510.715 MiB}