2024/11/22-17:00:10.492327 140024827360832 DEBG dcompact_worker.cpp:2214: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05363/att-00: fork to child time = 0.009620 sec 2024/11/22-17:00:10.493176 140024827360832 DEBG dcompact_worker.cpp:1013: Beg SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05363/att-00 2024/11/22-17:00:10.500646 140024827360832 DEBG dcompact_worker.cpp:1033: End SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05363/att-00 2024/11/22-17:00:10.501793 140024827360832 TRAC dcompact_worker.cpp:1083: INFO_LOG_LEVEL: rpc = INFO_LEVEL, env_var = undefined 2024/11/22-17:00:10.502172 140024827360832 [WARN] [column_family.cc:386] multiple cf_paths/db_paths and level_compaction_dynamic_level_bytes can't be used together 2024/11/22-17:00:10.559455 140024827360832 [version_set.cc:6208] Recovering from manifest file: /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-05363/att-00/MANIFEST-206347 2024/11/22-17:00:10.584841 140024827360832 [version_set.cc:6251] Recovered from manifest file:/worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-05363/att-00/MANIFEST-206347 succeeded,manifest_file_number is 206347, next_file_number is 216212, last_sequence is 3402978288, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 216089 2024/11/22-17:00:10.584849 140024827360832 [version_set.cc:6266] Column family [default] (ID 0), log number is 0 2024/11/22-17:00:10.584978 140024827360832 [version_set.cc:5721] Creating manifest 216212 2024/11/22-17:00:10.621479 140024827360832 DEBG dcompact_worker.cpp:1218: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05363/att-00: bottommost_level: fake = 1, rpc = 0 2024/11/22-17:00:10.645761 140024827360832 [compaction_job.cc:2437] [default] [JOB 5363] Compacting 1@2 + 14@3 files to L3, score 1.00, subcompactions 1 : 1 2024/11/22-17:00:10.645785 140024827360832 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 4150 Base level 2, inputs: [216156(27MB)], [216189(35MB) 216190(2981KB) 216098(35MB) 216099(38MB) 216100(38MB) 216101(38MB) 216102(35MB) 216103(35MB) 216104(36MB) 216105(36MB) 216109(37MB) 216110(35MB) 216111(37MB) 216201(35MB)] 2024/11/22-17:00:10.651807 140024827360832 [top_zip_table.cc:59] core git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/22-17:00:10.651837 140024827360832 [top_zip_table.cc:60] fsa git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/22-17:00:10.651857 140024827360832 [top_zip_table.cc:61] zbs git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/22-17:00:10.651862 140024827360832 [top_zip_table.cc:62] topling-zip_table_reader: git_version_hash_info_is: commit a4a382006cb82713acf5b3425835f22711877681 Author: leipeng Date: 2024-04-11 19:44:14 +0800 fixed_len_hole_index.cc: Add env bool FixedLenHoleIndexUseAVX512 for ut & debug 1. FixedLenHoleIndexUseAVX512 is only in unit tests or debug 2. In release mode, use avx512 by compile options(-march=) g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/22-17:00:10.651873 140024827360832 [top_zip_table.cc:64] topling-rocks git_version_hash_info_is: commit feab587e468621ba0204d47b4ffacc52e7c4290d Author: leipeng Date: 2024-03-22 13:35:06 +0800 ToplingZipTableBuilder::Add: immediately return after error This function returns void, and caller does not check builder->status() after calling this function and graceful abandon. So immediately return after error, and return error status in Finish(). g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/22-17:00:11.147698 140024827360832 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05363/att-00/216213.sst) /dev/shm/ToplingTemp/Topling-210205-4K9swW 2024/11/22-17:00:11.690471 140024827360832 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05363/att-00/216213.sst): first pass time = 0.54's, 247.302'MB/sec 2024/11/22-17:00:13.001500 140024827360832 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05363/att-00/216213.sst): old prealloc_size = 147639500, real_size = 33266704 2024/11/22-17:00:13.002096 140024827360832 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05363/att-00/216213.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 923710 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1084 GB zip-val = 0.0313 GB avg-val = 117.30 avg-zval = 33.86 2024/11/22-17:00:13.002869 140024827360832 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05363/att-00/216213.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-17:00:13.916893 140024827360832 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05363/att-00/216213.sst): second pass time = 1.31's, 82.723'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.92's, 40.684'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3054.403'MB/sec (index lex order gen) rebuild zvType time = 0.79's, 0.294'MB/sec write SST data time = 0.13's, 288.711'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.082'MB, throughput = 33662.593'MB/sec zip my value time = 1.31's, unzip length = 0.108'GB zip my value throughput = 82.723'MB/sec zip pipeline throughput = 82.723'MB/sec entries = 923710 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.30 avg-zval = 33.86 usrkeys = 923710 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.30 avg-zval = 33.86 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 923710 bytes = 3117536 } seq expand size = 6465970 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0313 GB dict = 1.08 MB all = 0.0372 GB } UnZip/Zip{ index = 10.5108 value = 3.4642 dict = 1.00 all = 3.6040 } Zip/UnZip{ index = 0.0951 value = 0.2887 dict = 1.00 all = 0.2775 } ---------------------------- total value len = 0.114820 GB avg = 0.124 KB (by entry num) total key len = 0.025864 GB avg = 0.028 KB total ukey len = 0.018474 GB avg = 0.020 KB total ukey num = 0.000923710 Billion total entry num = 0.000923710 Billion write speed all = 0.004806280 MB/sec (with seq num) write speed all = 0.004553821 MB/sec (without seq num) 2024/11/22-17:00:13.949316 140024827360832 [compaction_job.cc:1948] [default] [JOB 5363] Generated table #216213: 923710 keys, 37241608 bytes, temperature: kWarm 2024/11/22-17:00:13.949411 140024827360832 EVENT_LOG_v1 {"time_micros": 1732266013949353, "cf_name": "default", "job": 5363, "event": "table_file_creation", "file_number": 216213, "file_size": 37241608, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3273702634, "largest_seqno": 3402256982, "table_properties": {"data_size": 31277952, "index_size": 1757632, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25863880, "raw_average_key_size": 28, "raw_value_size": 108353900, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 923710, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732266011, "oldest_key_time": 0, "file_creation_time": 1732266011, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 216213, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-17:00:13.989540 140024827360832 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05363/att-00/216214.sst) /dev/shm/ToplingTemp/Topling-210205-S4NtzS 2024/11/22-17:00:14.807062 140024827360832 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05363/att-00/216214.sst): first pass time = 0.82's, 164.185'MB/sec 2024/11/22-17:00:16.134735 140024827360832 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05363/att-00/216214.sst): old prealloc_size = 147639500, real_size = 33351056 2024/11/22-17:00:16.135273 140024827360832 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05363/att-00/216214.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 921467 prefix = 4 raw-key = 0.0147 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1084 GB zip-val = 0.0314 GB avg-val = 117.66 avg-zval = 34.03 2024/11/22-17:00:16.136041 140024827360832 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05363/att-00/216214.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-17:00:17.031012 140024827360832 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05363/att-00/216214.sst): second pass time = 1.33's, 81.723'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.90's, 41.640'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3412.861'MB/sec (index lex order gen) rebuild zvType time = 0.77's, 0.300'MB/sec write SST data time = 0.13's, 294.604'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.084'MB, throughput = 34195.444'MB/sec zip my value time = 1.33's, unzip length = 0.108'GB zip my value throughput = 81.723'MB/sec zip pipeline throughput = 81.723'MB/sec entries = 921467 avg-key = 28.00 avg-zkey = 1.92 avg-val = 117.66 avg-zval = 34.03 usrkeys = 921467 avg-key = 20.00 avg-zkey = 1.92 avg-val = 124.66 avg-zval = 34.03 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 921467 bytes = 3109968 } seq expand size = 6450269 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0184 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0314 GB dict = 1.08 MB all = 0.0373 GB } UnZip/Zip{ index = 10.4431 value = 3.4576 dict = 1.00 all = 3.5964 } Zip/UnZip{ index = 0.0958 value = 0.2892 dict = 1.00 all = 0.2781 } ---------------------------- total value len = 0.229687 GB avg = 0.124 KB (by entry num) total key len = 0.051665 GB avg = 0.028 KB total ukey len = 0.036904 GB avg = 0.020 KB total ukey num = 0.001845177 Billion total entry num = 0.001845177 Billion write speed all = 0.009610999 MB/sec (with seq num) write speed all = 0.009106748 MB/sec (without seq num) 2024/11/22-17:00:17.062286 140024827360832 [compaction_job.cc:1948] [default] [JOB 5363] Generated table #216214: 921467 keys, 37320218 bytes, temperature: kWarm 2024/11/22-17:00:17.062347 140024827360832 EVENT_LOG_v1 {"time_micros": 1732266017062316, "cf_name": "default", "job": 5363, "event": "table_file_creation", "file_number": 216214, "file_size": 37320218, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3273702661, "largest_seqno": 3402256992, "table_properties": {"data_size": 31355776, "index_size": 1764736, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25801076, "raw_average_key_size": 28, "raw_value_size": 108416666, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 921467, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732266013, "oldest_key_time": 0, "file_creation_time": 1732266013, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 216214, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-17:00:17.109761 140024827360832 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05363/att-00/216215.sst) /dev/shm/ToplingTemp/Topling-210205-2qnzIT 2024/11/22-17:00:18.061097 140024827360832 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05363/att-00/216215.sst): first pass time = 0.95's, 141.091'MB/sec 2024/11/22-17:00:19.465934 140024827360832 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05363/att-00/216215.sst): old prealloc_size = 147639500, real_size = 35619264 2024/11/22-17:00:19.466492 140024827360832 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05363/att-00/216215.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 923141 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1084 GB zip-val = 0.0336 GB avg-val = 117.39 avg-zval = 36.43 2024/11/22-17:00:19.467242 140024827360832 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05363/att-00/216215.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-17:00:20.363486 140024827360832 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05363/att-00/216215.sst): second pass time = 1.40's, 77.178'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.90's, 44.246'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3263.353'MB/sec (index lex order gen) rebuild zvType time = 0.77's, 0.299'MB/sec write SST data time = 0.12's, 317.726'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.083'MB, throughput = 33670.999'MB/sec zip my value time = 1.40's, unzip length = 0.108'GB zip my value throughput = 77.178'MB/sec zip pipeline throughput = 77.178'MB/sec entries = 923141 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.39 avg-zval = 36.43 usrkeys = 923141 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.39 avg-zval = 36.43 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 923141 bytes = 3231008 } seq expand size = 6461987 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0336 GB dict = 1.08 MB all = 0.0397 GB } UnZip/Zip{ index = 10.5113 value = 3.2222 dict = 1.00 all = 3.3798 } Zip/UnZip{ index = 0.0951 value = 0.3103 dict = 1.00 all = 0.2959 } ---------------------------- total value len = 0.344519 GB avg = 0.124 KB (by entry num) total key len = 0.077513 GB avg = 0.028 KB total ukey len = 0.055366 GB avg = 0.020 KB total ukey num = 0.002768318 Billion total entry num = 0.002768318 Billion write speed all = 0.014414990 MB/sec (with seq num) write speed all = 0.013658548 MB/sec (without seq num) 2024/11/22-17:00:20.398404 140024827360832 [compaction_job.cc:1948] [default] [JOB 5363] Generated table #216215: 923141 keys, 39712002 bytes, temperature: kWarm 2024/11/22-17:00:20.398470 140024827360832 EVENT_LOG_v1 {"time_micros": 1732266020398436, "cf_name": "default", "job": 5363, "event": "table_file_creation", "file_number": 216215, "file_size": 39712002, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237868609, "largest_seqno": 3402257002, "table_properties": {"data_size": 33631792, "index_size": 1756480, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25847948, "raw_average_key_size": 28, "raw_value_size": 108369818, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 923141, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732266017, "oldest_key_time": 0, "file_creation_time": 1732266017, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 216215, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-17:00:20.437045 140024827360832 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05363/att-00/216216.sst) /dev/shm/ToplingTemp/Topling-210205-DZ8YZT 2024/11/22-17:00:21.274423 140024827360832 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05363/att-00/216216.sst): first pass time = 0.84's, 160.291'MB/sec 2024/11/22-17:00:22.625491 140024827360832 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05363/att-00/216216.sst): old prealloc_size = 147639500, real_size = 36543936 2024/11/22-17:00:22.626040 140024827360832 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05363/att-00/216216.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 922495 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1084 GB zip-val = 0.0346 GB avg-val = 117.49 avg-zval = 37.46 2024/11/22-17:00:22.626791 140024827360832 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05363/att-00/216216.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-17:00:23.463648 140024827360832 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05363/att-00/216216.sst): second pass time = 1.35's, 80.264'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.84's, 48.262'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3314.491'MB/sec (index lex order gen) rebuild zvType time = 0.71's, 0.325'MB/sec write SST data time = 0.13's, 314.593'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.083'MB, throughput = 33831.256'MB/sec zip my value time = 1.35's, unzip length = 0.108'GB zip my value throughput = 80.264'MB/sec zip pipeline throughput = 80.264'MB/sec entries = 922495 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.49 avg-zval = 37.46 usrkeys = 922495 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.27 avg-zval = 37.46 TagRS{ kinds = RS_Key0_TagN bytes = 144240 } TagArray{ size = 893457 bytes = 2903744 } seq expand size = 6254199 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0184 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0346 GB dict = 1.08 MB all = 0.0405 GB } UnZip/Zip{ index = 10.5146 value = 3.1364 dict = 1.00 all = 3.3181 } Zip/UnZip{ index = 0.0951 value = 0.3188 dict = 1.00 all = 0.3014 } ---------------------------- total value len = 0.459161 GB avg = 0.124 KB (by entry num) total key len = 0.103343 GB avg = 0.028 KB total ukey len = 0.073816 GB avg = 0.020 KB total ukey num = 0.003690813 Billion total entry num = 0.003690813 Billion write speed all = 0.019210943 MB/sec (with seq num) write speed all = 0.018202537 MB/sec (without seq num) 2024/11/22-17:00:23.500878 140024827360832 [compaction_job.cc:1948] [default] [JOB 5363] Generated table #216216: 922495 keys, 40450160 bytes, temperature: kWarm 2024/11/22-17:00:23.500941 140024827360832 EVENT_LOG_v1 {"time_micros": 1732266023500909, "cf_name": "default", "job": 5363, "event": "table_file_creation", "file_number": 216216, "file_size": 40450160, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3273699965, "table_properties": {"data_size": 34558448, "index_size": 1754688, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25829860, "raw_average_key_size": 28, "raw_value_size": 108387910, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 922495, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732266020, "oldest_key_time": 0, "file_creation_time": 1732266020, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 216216, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-17:00:23.538479 140024827360832 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05363/att-00/216217.sst) /dev/shm/ToplingTemp/Topling-210205-vBXPbX 2024/11/22-17:00:24.415639 140024827360832 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05363/att-00/216217.sst): first pass time = 0.88's, 153.021'MB/sec 2024/11/22-17:00:25.777701 140024827360832 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05363/att-00/216217.sst): old prealloc_size = 147639500, real_size = 36339776 2024/11/22-17:00:25.778272 140024827360832 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05363/att-00/216217.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 922940 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0017 GB avg-key = 16.00 avg-zkey = 1.89 raw-val = 0.1084 GB zip-val = 0.0344 GB avg-val = 117.42 avg-zval = 37.23 2024/11/22-17:00:25.778957 140024827360832 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05363/att-00/216217.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-17:00:26.603116 140024827360832 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05363/att-00/216217.sst): second pass time = 1.36's, 79.603'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.83's, 48.484'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3185.734'MB/sec (index lex order gen) rebuild zvType time = 0.70's, 0.332'MB/sec write SST data time = 0.13's, 309.989'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.083'MB, throughput = 35003.492'MB/sec zip my value time = 1.36's, unzip length = 0.108'GB zip my value throughput = 79.603'MB/sec zip pipeline throughput = 79.603'MB/sec entries = 922940 avg-key = 28.00 avg-zkey = 1.89 avg-val = 117.42 avg-zval = 37.23 usrkeys = 922940 avg-key = 20.00 avg-zkey = 1.89 avg-val = 123.66 avg-zval = 37.23 TagRS{ kinds = RS_Key0_TagN bytes = 144320 } TagArray{ size = 822615 bytes = 2673520 } seq expand size = 5758305 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0017 GB value = 0.0344 GB dict = 1.08 MB all = 0.0400 GB } UnZip/Zip{ index = 10.5826 value = 3.1537 dict = 1.00 all = 3.3539 } Zip/UnZip{ index = 0.0945 value = 0.3171 dict = 1.00 all = 0.2982 } ---------------------------- total value len = 0.573294 GB avg = 0.124 KB (by entry num) total key len = 0.129185 GB avg = 0.028 KB total ukey len = 0.092275 GB avg = 0.020 KB total ukey num = 0.004613753 Billion total entry num = 0.004613753 Billion write speed all = 0.023988914 MB/sec (with seq num) write speed all = 0.022728477 MB/sec (without seq num) 2024/11/22-17:00:26.637802 140024827360832 [compaction_job.cc:1948] [default] [JOB 5363] Generated table #216217: 922940 keys, 40018924 bytes, temperature: kWarm 2024/11/22-17:00:26.637864 140024827360832 EVENT_LOG_v1 {"time_micros": 1732266026637834, "cf_name": "default", "job": 5363, "event": "table_file_creation", "file_number": 216217, "file_size": 40018924, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3273700833, "table_properties": {"data_size": 34364592, "index_size": 1744256, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25842320, "raw_average_key_size": 28, "raw_value_size": 108375420, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 922940, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732266023, "oldest_key_time": 0, "file_creation_time": 1732266023, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 216217, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-17:00:26.674655 140024827360832 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05363/att-00/216218.sst) /dev/shm/ToplingTemp/Topling-210205-df2M6S 2024/11/22-17:00:27.427229 140024827360832 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05363/att-00/216218.sst): first pass time = 0.75's, 178.358'MB/sec 2024/11/22-17:00:28.981573 140024827360832 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05363/att-00/216218.sst): old prealloc_size = 147639500, real_size = 36388464 2024/11/22-17:00:28.982164 140024827360832 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05363/att-00/216218.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 926895 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.89 raw-val = 0.1083 GB zip-val = 0.0344 GB avg-val = 116.80 avg-zval = 37.12 2024/11/22-17:00:28.982205 140024827360832 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05363/att-00/216218.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-17:00:29.623840 140024827360832 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05363/att-00/216218.sst): second pass time = 1.55's, 69.684'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.64's, 57.993'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3081.617'MB/sec (index lex order gen) rebuild zvType time = 0.52's, 0.447'MB/sec write SST data time = 0.12's, 302.455'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 32725.708'MB/sec zip my value time = 1.55's, unzip length = 0.108'GB zip my value throughput = 69.684'MB/sec zip pipeline throughput = 69.684'MB/sec entries = 926895 avg-key = 28.00 avg-zkey = 1.89 avg-val = 116.80 avg-zval = 37.12 usrkeys = 926895 avg-key = 20.00 avg-zkey = 1.89 avg-val = 116.80 avg-zval = 37.12 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0344 GB dict = 1.08 MB all = 0.0372 GB } UnZip/Zip{ index = 10.5833 value = 3.1468 dict = 1.00 all = 3.6035 } Zip/UnZip{ index = 0.0945 value = 0.3178 dict = 1.00 all = 0.2775 } ---------------------------- total value len = 0.681559 GB avg = 0.123 KB (by entry num) total key len = 0.155138 GB avg = 0.028 KB total ukey len = 0.110813 GB avg = 0.020 KB total ukey num = 0.005540648 Billion total entry num = 0.005540648 Billion write speed all = 0.028569361 MB/sec (with seq num) write speed all = 0.027055860 MB/sec (without seq num) 2024/11/22-17:00:29.658330 140024827360832 [compaction_job.cc:1948] [default] [JOB 5363] Generated table #216218: 926895 keys, 37246386 bytes, temperature: kWarm 2024/11/22-17:00:29.658396 140024827360832 EVENT_LOG_v1 {"time_micros": 1732266029658364, "cf_name": "default", "job": 5363, "event": "table_file_creation", "file_number": 216218, "file_size": 37246386, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 34404960, "index_size": 1751616, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25953060, "raw_average_key_size": 28, "raw_value_size": 108264790, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 926895, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732266026, "oldest_key_time": 0, "file_creation_time": 1732266026, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 216218, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-17:00:29.697900 140024827360832 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05363/att-00/216219.sst) /dev/shm/ToplingTemp/Topling-210205-je5c0V 2024/11/22-17:00:30.426907 140024827360832 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05363/att-00/216219.sst): first pass time = 0.73's, 184.121'MB/sec 2024/11/22-17:00:31.962644 140024827360832 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05363/att-00/216219.sst): old prealloc_size = 147639500, real_size = 36446528 2024/11/22-17:00:31.963223 140024827360832 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05363/att-00/216219.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927074 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0345 GB avg-val = 116.78 avg-zval = 37.16 2024/11/22-17:00:31.963270 140024827360832 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05363/att-00/216219.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-17:00:32.604171 140024827360832 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05363/att-00/216219.sst): second pass time = 1.53's, 70.548'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.64's, 58.150'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3145.393'MB/sec (index lex order gen) rebuild zvType time = 0.52's, 0.448'MB/sec write SST data time = 0.12's, 301.585'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 35275.523'MB/sec zip my value time = 1.53's, unzip length = 0.108'GB zip my value throughput = 70.548'MB/sec zip pipeline throughput = 70.548'MB/sec entries = 927074 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.78 avg-zval = 37.16 usrkeys = 927074 avg-key = 20.00 avg-zkey = 1.90 avg-val = 116.78 avg-zval = 37.16 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0345 GB dict = 1.08 MB all = 0.0373 GB } UnZip/Zip{ index = 10.5124 value = 3.1424 dict = 1.00 all = 3.5979 } Zip/UnZip{ index = 0.0951 value = 0.3182 dict = 1.00 all = 0.2779 } ---------------------------- total value len = 0.789819 GB avg = 0.122 KB (by entry num) total key len = 0.181096 GB avg = 0.028 KB total ukey len = 0.129354 GB avg = 0.020 KB total ukey num = 0.006467722 Billion total entry num = 0.006467722 Billion write speed all = 0.033148905 MB/sec (with seq num) write speed all = 0.031382342 MB/sec (without seq num) 2024/11/22-17:00:32.637103 140024827360832 [compaction_job.cc:1948] [default] [JOB 5363] Generated table #216219: 927074 keys, 37304712 bytes, temperature: kWarm 2024/11/22-17:00:32.637206 140024827360832 EVENT_LOG_v1 {"time_micros": 1732266032637134, "cf_name": "default", "job": 5363, "event": "table_file_creation", "file_number": 216219, "file_size": 37304712, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 34450800, "index_size": 1763776, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25958072, "raw_average_key_size": 28, "raw_value_size": 108259684, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927074, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732266029, "oldest_key_time": 0, "file_creation_time": 1732266029, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 216219, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-17:00:32.674734 140024827360832 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05363/att-00/216220.sst) /dev/shm/ToplingTemp/Topling-210205-5ac7LU 2024/11/22-17:00:33.473343 140024827360832 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05363/att-00/216220.sst): first pass time = 0.80's, 168.073'MB/sec 2024/11/22-17:00:34.831254 140024827360832 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05363/att-00/216220.sst): old prealloc_size = 147639500, real_size = 34936112 2024/11/22-17:00:34.831805 140024827360832 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05363/att-00/216220.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 923979 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0017 GB avg-key = 16.00 avg-zkey = 1.89 raw-val = 0.1083 GB zip-val = 0.0330 GB avg-val = 117.26 avg-zval = 35.67 2024/11/22-17:00:34.832377 140024827360832 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05363/att-00/216220.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-17:00:35.680067 140024827360832 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05363/att-00/216220.sst): second pass time = 1.36's, 79.828'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.85's, 44.881'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3301.445'MB/sec (index lex order gen) rebuild zvType time = 0.72's, 0.321'MB/sec write SST data time = 0.13's, 296.923'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.082'MB, throughput = 32806.391'MB/sec zip my value time = 1.36's, unzip length = 0.108'GB zip my value throughput = 79.828'MB/sec zip pipeline throughput = 79.828'MB/sec entries = 923979 avg-key = 28.00 avg-zkey = 1.89 avg-val = 117.26 avg-zval = 35.67 usrkeys = 923979 avg-key = 20.00 avg-zkey = 1.89 avg-val = 122.09 avg-zval = 35.67 TagRS{ kinds = RS_Key0_TagN bytes = 144480 } TagArray{ size = 638067 bytes = 2153488 } seq expand size = 4466469 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0017 GB value = 0.0330 GB dict = 1.08 MB all = 0.0381 GB } UnZip/Zip{ index = 10.5806 value = 3.2874 dict = 1.00 all = 3.5233 } Zip/UnZip{ index = 0.0945 value = 0.3042 dict = 1.00 all = 0.2838 } ---------------------------- total value len = 0.902632 GB avg = 0.122 KB (by entry num) total key len = 0.206968 GB avg = 0.028 KB total ukey len = 0.147834 GB avg = 0.020 KB total ukey num = 0.007391701 Billion total entry num = 0.007391701 Billion write speed all = 0.037879877 MB/sec (with seq num) write speed all = 0.035861154 MB/sec (without seq num) 2024/11/22-17:00:35.714449 140024827360832 [compaction_job.cc:1948] [default] [JOB 5363] Generated table #216220: 923979 keys, 38094710 bytes, temperature: kWarm 2024/11/22-17:00:35.714512 140024827360832 EVENT_LOG_v1 {"time_micros": 1732266035714481, "cf_name": "default", "job": 5363, "event": "table_file_creation", "file_number": 216220, "file_size": 38094710, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3402256740, "table_properties": {"data_size": 32958368, "index_size": 1746560, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25871412, "raw_average_key_size": 28, "raw_value_size": 108346454, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 923979, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732266032, "oldest_key_time": 0, "file_creation_time": 1732266032, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 216220, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-17:00:35.752522 140024827360832 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05363/att-00/216221.sst) /dev/shm/ToplingTemp/Topling-210205-GI3YzU 2024/11/22-17:00:36.637534 140024827360832 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05363/att-00/216221.sst): first pass time = 0.88's, 151.665'MB/sec 2024/11/22-17:00:37.971322 140024827360832 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05363/att-00/216221.sst): old prealloc_size = 147639500, real_size = 34430848 2024/11/22-17:00:37.971886 140024827360832 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05363/att-00/216221.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 923734 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1084 GB zip-val = 0.0324 GB avg-val = 117.30 avg-zval = 35.11 2024/11/22-17:00:37.972624 140024827360832 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05363/att-00/216221.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-17:00:38.874627 140024827360832 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05363/att-00/216221.sst): second pass time = 1.33's, 81.314'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.90's, 42.517'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3251.932'MB/sec (index lex order gen) rebuild zvType time = 0.78's, 0.298'MB/sec write SST data time = 0.13's, 301.686'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.082'MB, throughput = 34524.324'MB/sec zip my value time = 1.33's, unzip length = 0.108'GB zip my value throughput = 81.314'MB/sec zip pipeline throughput = 81.314'MB/sec entries = 923734 avg-key = 28.00 avg-zkey = 1.92 avg-val = 117.30 avg-zval = 35.11 usrkeys = 923734 avg-key = 20.00 avg-zkey = 1.92 avg-val = 124.30 avg-zval = 35.11 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 923734 bytes = 3117616 } seq expand size = 6466138 multi value expand size = 0 cnt WriteAppend = 15 UnZipSize{ index = 0.0185 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0324 GB dict = 1.08 MB all = 0.0384 GB } UnZip/Zip{ index = 10.4427 value = 3.3411 dict = 1.00 all = 3.4948 } Zip/UnZip{ index = 0.0958 value = 0.2993 dict = 1.00 all = 0.2861 } ---------------------------- total value len = 1.017451 GB avg = 0.122 KB (by entry num) total key len = 0.232832 GB avg = 0.028 KB total ukey len = 0.166309 GB avg = 0.020 KB total ukey num = 0.008315435 Billion total entry num = 0.008315435 Billion write speed all = 0.042677938 MB/sec (with seq num) write speed all = 0.040407185 MB/sec (without seq num) 2024/11/22-17:00:38.909573 140024827360832 [compaction_job.cc:1948] [default] [JOB 5363] Generated table #216221: 923734 keys, 38405514 bytes, temperature: kWarm 2024/11/22-17:00:38.909641 140024827360832 EVENT_LOG_v1 {"time_micros": 1732266038909608, "cf_name": "default", "job": 5363, "event": "table_file_creation", "file_number": 216221, "file_size": 38405514, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3273701386, "largest_seqno": 3402256763, "table_properties": {"data_size": 32430576, "index_size": 1769152, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25864552, "raw_average_key_size": 28, "raw_value_size": 108353276, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 923734, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732266035, "oldest_key_time": 0, "file_creation_time": 1732266035, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 216221, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-17:00:38.947614 140024827360832 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05363/att-00/216222.sst) /dev/shm/ToplingTemp/Topling-210205-tq9yyU 2024/11/22-17:00:39.791634 140024827360832 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05363/att-00/216222.sst): first pass time = 0.84's, 159.030'MB/sec 2024/11/22-17:00:41.106315 140024827360832 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05363/att-00/216222.sst): old prealloc_size = 147639500, real_size = 35717664 2024/11/22-17:00:41.106878 140024827360832 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05363/att-00/216222.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 930072 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0337 GB avg-val = 116.31 avg-zval = 36.25 2024/11/22-17:00:41.107603 140024827360832 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05363/att-00/216222.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-17:00:41.960924 140024827360832 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05363/att-00/216222.sst): second pass time = 1.31's, 82.327'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.85's, 46.193'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3273.731'MB/sec (index lex order gen) rebuild zvType time = 0.73's, 0.320'MB/sec write SST data time = 0.13's, 309.896'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 32546.381'MB/sec zip my value time = 1.31's, unzip length = 0.108'GB zip my value throughput = 82.327'MB/sec zip pipeline throughput = 82.327'MB/sec entries = 930072 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.31 avg-zval = 36.25 usrkeys = 930072 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.31 avg-zval = 36.25 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 930072 bytes = 2906496 } seq expand size = 6510504 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0337 GB dict = 1.08 MB all = 0.0395 GB } UnZip/Zip{ index = 10.5139 value = 3.2085 dict = 1.00 all = 3.4000 } Zip/UnZip{ index = 0.0951 value = 0.3117 dict = 1.00 all = 0.2941 } ---------------------------- total value len = 1.132138 GB avg = 0.122 KB (by entry num) total key len = 0.258874 GB avg = 0.028 KB total ukey len = 0.184910 GB avg = 0.020 KB total ukey num = 0.009245507 Billion total entry num = 0.009245507 Billion write speed all = 0.047476642 MB/sec (with seq num) write speed all = 0.044952174 MB/sec (without seq num) 2024/11/22-17:00:41.996413 140024827360832 [compaction_job.cc:1948] [default] [JOB 5363] Generated table #216222: 930072 keys, 39476336 bytes, temperature: kWarm 2024/11/22-17:00:41.996489 140024827360832 EVENT_LOG_v1 {"time_micros": 1732266041996446, "cf_name": "default", "job": 5363, "event": "table_file_creation", "file_number": 216222, "file_size": 39476336, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3376774735, "largest_seqno": 3402256834, "table_properties": {"data_size": 33715728, "index_size": 1769216, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26042016, "raw_average_key_size": 28, "raw_value_size": 108175772, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 930072, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732266038, "oldest_key_time": 0, "file_creation_time": 1732266038, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 216222, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-17:00:42.037873 140024827360832 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05363/att-00/216223.sst) /dev/shm/ToplingTemp/Topling-210205-fKH2NS 2024/11/22-17:00:42.850749 140024827360832 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05363/att-00/216223.sst): first pass time = 0.81's, 165.124'MB/sec 2024/11/22-17:00:44.274152 140024827360832 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05363/att-00/216223.sst): old prealloc_size = 147639500, real_size = 36380720 2024/11/22-17:00:44.274700 140024827360832 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05363/att-00/216223.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 928703 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1082 GB zip-val = 0.0344 GB avg-val = 116.52 avg-zval = 37.01 2024/11/22-17:00:44.275130 140024827360832 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05363/att-00/216223.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-17:00:45.032258 140024827360832 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05363/att-00/216223.sst): second pass time = 1.42's, 76.058'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.76's, 51.145'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3362.345'MB/sec (index lex order gen) rebuild zvType time = 0.63's, 0.369'MB/sec write SST data time = 0.13's, 303.698'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 33493.906'MB/sec zip my value time = 1.42's, unzip length = 0.108'GB zip my value throughput = 76.058'MB/sec zip pipeline throughput = 76.058'MB/sec entries = 928703 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.52 avg-zval = 37.01 usrkeys = 928703 avg-key = 20.00 avg-zkey = 1.91 avg-val = 119.87 avg-zval = 37.01 TagRS{ kinds = RS_Key0_TagN bytes = 145200 } TagArray{ size = 444513 bytes = 1389120 } seq expand size = 3111591 multi value expand size = 0 cnt WriteAppend = 18 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0344 GB dict = 1.08 MB all = 0.0388 GB } UnZip/Zip{ index = 10.4456 value = 3.1485 dict = 1.00 all = 3.4617 } Zip/UnZip{ index = 0.0957 value = 0.3176 dict = 1.00 all = 0.2889 } ---------------------------- total value len = 1.243463 GB avg = 0.122 KB (by entry num) total key len = 0.284878 GB avg = 0.028 KB total ukey len = 0.203484 GB avg = 0.020 KB total ukey num = 0.010174210 Billion total entry num = 0.010174210 Billion write speed all = 0.052158367 MB/sec (with seq num) write speed all = 0.049380610 MB/sec (without seq num) 2024/11/22-17:00:45.065707 140024827360832 [compaction_job.cc:1948] [default] [JOB 5363] Generated table #216223: 928703 keys, 38772375 bytes, temperature: kWarm 2024/11/22-17:00:45.065770 140024827360832 EVENT_LOG_v1 {"time_micros": 1732266045065740, "cf_name": "default", "job": 5363, "event": "table_file_creation", "file_number": 216223, "file_size": 38772375, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3402256861, "table_properties": {"data_size": 34370208, "index_size": 1778176, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26003684, "raw_average_key_size": 28, "raw_value_size": 108214154, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 928703, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732266042, "oldest_key_time": 0, "file_creation_time": 1732266042, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 216223, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-17:00:45.104370 140024827360832 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05363/att-00/216224.sst) /dev/shm/ToplingTemp/Topling-210205-oqhfOT 2024/11/22-17:00:45.918631 140024827360832 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05363/att-00/216224.sst): first pass time = 0.81's, 164.842'MB/sec 2024/11/22-17:00:47.259212 140024827360832 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05363/att-00/216224.sst): old prealloc_size = 147639500, real_size = 35488224 2024/11/22-17:00:47.259855 140024827360832 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05363/att-00/216224.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 1081213 prefix = 4 raw-key = 0.0173 GB zip-key = 0.0021 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1039 GB zip-val = 0.0331 GB avg-val = 96.14 avg-zval = 30.66 2024/11/22-17:00:47.260119 140024827360832 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05363/att-00/216224.sst: sumWaitingMem = 0.003 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0028 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-17:00:47.917452 140024827360832 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05363/att-00/216224.sst): second pass time = 1.34's, 77.572'MB/sec, value only(77.4% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.66's, 56.243'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3348.916'MB/sec (index lex order gen) rebuild zvType time = 0.52's, 0.521'MB/sec write SST data time = 0.14's, 267.210'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.025'MB, throughput = 24094.076'MB/sec zip my value time = 1.34's, unzip length = 0.104'GB zip my value throughput = 77.572'MB/sec zip pipeline throughput = 77.572'MB/sec entries = 1081213 avg-key = 28.00 avg-zkey = 1.91 avg-val = 96.14 avg-zval = 30.66 usrkeys = 1081213 avg-key = 20.00 avg-zkey = 1.91 avg-val = 97.28 avg-zval = 30.66 TagRS{ kinds = RS_Key0_TagN bytes = 169040 } TagArray{ size = 177000 bytes = 597392 } seq expand size = 1239000 multi value expand size = 0 cnt WriteAppend = 15 UnZipSize{ index = 0.0216 GB value = 0.1039 GB dict = 1.02 MB all = 0.1342 GB } __ZipSize{ index = 0.0021 GB value = 0.0331 GB dict = 1.02 MB all = 0.0370 GB } UnZip/Zip{ index = 10.4471 value = 3.1358 dict = 1.00 all = 3.6255 } Zip/UnZip{ index = 0.0957 value = 0.3189 dict = 1.00 all = 0.2758 } ---------------------------- total value len = 1.348646 GB avg = 0.120 KB (by entry num) total key len = 0.315152 GB avg = 0.028 KB total ukey len = 0.225108 GB avg = 0.020 KB total ukey num = 0.011255423 Billion total entry num = 0.011255423 Billion write speed all = 0.056775571 MB/sec (with seq num) write speed all = 0.053702923 MB/sec (without seq num) 2024/11/22-17:00:47.952924 140024827360832 [compaction_job.cc:1948] [default] [JOB 5363] Generated table #216224: 1081213 keys, 37020625 bytes, temperature: kWarm 2024/11/22-17:00:47.952988 140024827360832 EVENT_LOG_v1 {"time_micros": 1732266047952956, "cf_name": "default", "job": 5363, "event": "table_file_creation", "file_number": 216224, "file_size": 37020625, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3402256376, "table_properties": {"data_size": 33147856, "index_size": 2069888, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 30273964, "raw_average_key_size": 28, "raw_value_size": 103943835, "raw_average_value_size": 96, "num_data_blocks": 1, "num_entries": 1081213, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732266045, "oldest_key_time": 0, "file_creation_time": 1732266045, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 216224, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-17:00:47.987714 140024827360832 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05363/att-00/216225.sst) /dev/shm/ToplingTemp/Topling-210205-XEuPYT 2024/11/22-17:00:48.911900 140024827360832 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05363/att-00/216225.sst): first pass time = 0.92's, 145.234'MB/sec 2024/11/22-17:00:50.215734 140024827360832 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05363/att-00/216225.sst): old prealloc_size = 147639500, real_size = 34163488 2024/11/22-17:00:50.216272 140024827360832 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05363/att-00/216225.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 922765 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1084 GB zip-val = 0.0322 GB avg-val = 117.45 avg-zval = 34.87 2024/11/22-17:00:50.217030 140024827360832 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05363/att-00/216225.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-17:00:51.132499 140024827360832 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05363/att-00/216225.sst): second pass time = 1.30's, 83.166'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.92's, 41.599'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3409.239'MB/sec (index lex order gen) rebuild zvType time = 0.79's, 0.292'MB/sec write SST data time = 0.13's, 301.344'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.083'MB, throughput = 31726.407'MB/sec zip my value time = 1.30's, unzip length = 0.108'GB zip my value throughput = 83.166'MB/sec zip pipeline throughput = 83.166'MB/sec entries = 922765 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.45 avg-zval = 34.87 usrkeys = 922765 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.45 avg-zval = 34.87 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 922765 bytes = 3114352 } seq expand size = 6459355 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0185 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0322 GB dict = 1.08 MB all = 0.0381 GB } UnZip/Zip{ index = 10.5108 value = 3.3683 dict = 1.00 all = 3.5195 } Zip/UnZip{ index = 0.0951 value = 0.2969 dict = 1.00 all = 0.2841 } ---------------------------- total value len = 1.463486 GB avg = 0.120 KB (by entry num) total key len = 0.340989 GB avg = 0.028 KB total ukey len = 0.243564 GB avg = 0.020 KB total ukey num = 0.012178188 Billion total entry num = 0.012178188 Billion write speed all = 0.061569293 MB/sec (with seq num) write speed all = 0.058245102 MB/sec (without seq num) 2024/11/22-17:00:51.164589 140024827360832 [compaction_job.cc:1948] [default] [JOB 5363] Generated table #216225: 922765 keys, 38135798 bytes, temperature: kWarm 2024/11/22-17:00:51.164656 140024827360832 EVENT_LOG_v1 {"time_micros": 1732266051164623, "cf_name": "default", "job": 5363, "event": "table_file_creation", "file_number": 216225, "file_size": 38135798, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3273701103, "largest_seqno": 3402256695, "table_properties": {"data_size": 32176784, "index_size": 1755840, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25837420, "raw_average_key_size": 28, "raw_value_size": 108380358, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 922765, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732266047, "oldest_key_time": 0, "file_creation_time": 1732266047, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 216225, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-17:00:51.201677 140024827360832 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05363/att-00/216226.sst) /dev/shm/ToplingTemp/Topling-210205-P4DOwW 2024/11/22-17:00:51.320084 140024827360832 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05363/att-00/216226.sst): first pass time = 0.12's, 242.654'MB/sec 2024/11/22-17:00:51.581232 140024827360832 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05363/att-00/216226.sst): old prealloc_size = 147639500, real_size = 8157264 2024/11/22-17:00:51.581412 140024827360832 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05363/att-00/216226.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 199099 prefix = 4 raw-key = 0.0032 GB zip-key = 0.0004 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.0231 GB zip-val = 0.0077 GB avg-val = 116.26 avg-zval = 38.80 2024/11/22-17:00:51.581606 140024827360832 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05363/att-00/216226.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0004 GB, waited 0.000 sec, Key+Value = 0.029 GB 2024/11/22-17:00:51.766635 140024827360832 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05363/att-00/216226.sst): second pass time = 0.26's, 88.833'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.19's, 48.672'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2435.115'MB/sec (index lex order gen) rebuild zvType time = 0.16's, 0.316'MB/sec write SST data time = 0.03's, 324.484'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.242'MB, throughput = 8169.823'MB/sec zip my value time = 0.26's, unzip length = 0.023'GB zip my value throughput = 88.833'MB/sec zip pipeline throughput = 88.833'MB/sec entries = 199099 avg-key = 28.00 avg-zkey = 1.92 avg-val = 116.26 avg-zval = 38.80 usrkeys = 199099 avg-key = 20.00 avg-zkey = 1.92 avg-val = 123.26 avg-zval = 38.80 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 199099 bytes = 671968 } seq expand size = 1393693 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0040 GB value = 0.0231 GB dict = 0.24 MB all = 0.0287 GB } __ZipSize{ index = 0.0004 GB value = 0.0077 GB dict = 0.24 MB all = 0.0090 GB } UnZip/Zip{ index = 10.4114 value = 2.9964 dict = 1.00 all = 3.1831 } Zip/UnZip{ index = 0.0960 value = 0.3337 dict = 1.00 all = 0.3142 } ---------------------------- total value len = 1.488026 GB avg = 0.120 KB (by entry num) total key len = 0.346564 GB avg = 0.028 KB total ukey len = 0.247546 GB avg = 0.020 KB total ukey num = 0.012377287 Billion total entry num = 0.012377287 Billion write speed all = 0.062595484 MB/sec (with seq num) write speed all = 0.059217020 MB/sec (without seq num) 2024/11/22-17:00:51.784472 140024827360832 [compaction_job.cc:1948] [default] [JOB 5363] Generated table #216226: 199099 keys, 9023245 bytes, temperature: kWarm 2024/11/22-17:00:51.784534 140024827360832 EVENT_LOG_v1 {"time_micros": 1732266051784501, "cf_name": "default", "job": 5363, "event": "table_file_creation", "file_number": 216226, "file_size": 9023245, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3273701122, "largest_seqno": 3402256408, "table_properties": {"data_size": 7724864, "index_size": 382464, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5574772, "raw_average_key_size": 28, "raw_value_size": 23146878, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 199099, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732266051, "oldest_key_time": 0, "file_creation_time": 1732266051, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 216226, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-17:00:51.797858 140024827360832 [compaction_job.cc:703] job-05363: subcompact[0], size: 0.508223 G, files: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05363/att-00 [216213,216214,216215,216216,216217,216218,216219,216220,216221,216222,216223,216224,216225,216226] 2024/11/22-17:00:51.883331 140024827360832 (Original Log Time 2024/11/22-17:00:10.645832) EVENT_LOG_v1 {"time_micros": 1732266010645797, "job": 5363, "event": "compaction_started", "compaction_reason": "FilesMarkedForCompaction", "files_L2": [216156], "files_L3": [216189, 216190, 216098, 216099, 216100, 216101, 216102, 216103, 216104, 216105, 216109, 216110, 216111, 216201], "score": 0.999794, "input_data_size": 531356008, "oldest_snapshot_seqno": 3402978222} 2024/11/22-17:00:51.883336 140024827360832 (Original Log Time 2024/11/22-17:00:51.882601) [compaction_job.cc:2022] [default] [JOB 5363] Compacted 1@2 + 14@3 files to L3 => 508222613 bytes 2024/11/22-17:00:51.883338 140024827360832 (Original Log Time 2024/11/22-17:00:51.883254) [compaction_job.cc:1224] [default] compacted to: files[0 0 0 14 0 0 0] max score 0.02, MB/sec: 12.9 rd, 12.3 wr, level 3, files in(1, 14) out(14 +0 blob) MB in(27.1, 479.6 +0.0 blob) out(484.7 +0.0 blob), read-write-amplify(36.5) write-amplify(17.9) OK, records in: 12474176, records dropped: 96889 output_compression: Snappy 2024/11/22-17:00:51.883344 140024827360832 (Original Log Time 2024/11/22-17:00:51.883298) EVENT_LOG_v1 {"time_micros": 1732266051883276, "cf": "default", "job": 5363, "event": "compaction_finished", "compaction_time_micros": 41152034, "compaction_time_cpu_micros": 17951772, "output_level": 3, "num_output_files": 14, "total_output_size": 508222613, "num_input_records": 12474176, "num_output_records": 12377287, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "file_write_nanos": 314867464, "file_range_sync_nanos": 0, "file_fsync_nanos": 12993, "file_prepare_write_nanos": 31269, "lsm_state": [0, 0, 0, 14, 0, 0, 0]} 2024/11/22-17:00:52.005608 140024827360832 DEBG dcompact_worker.cpp:240: HttpPost: 200 OK: url = http://nlb-7zny4kaa1poal01o64.cn-shenzhen.nlb.aliyuncs.com:8443, body = {"instanceId":"nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137","labourId":"","dbId":"d89b4006-2803-486e-b7a2-759bcf348921","dbStarts":1732256054,"starts":1732266010,"executesMs":41385,"compactionJobId":5363,"attempt":0,"compactionInputRawBytes":1787311189,"compactionInputZipBytes":531356008,"compactionOutputRawBytes":0,"compactionOutputZipBytes":508222613,"headers":{"Accept":"*/*","Connection":"close","Host":"aliyun-topling-saas.topling.cn:18443","RemoteIp":"120.24.192.169","X-Forwarded-For":"120.24.192.169","region":"cn-shenzhen","token":"e6474c481bd4415abc537135cc03626b","instance-token":"e6474c481bd4415abc537135cc03626b","provider":"aliyun","CloudMarketInstanceId":"si-59c0ae5c955845588903","MeteringAssit":"","Transfer-Encoding":"chunked","traceparent":"00-e62a27ca3f90ba358a7be45a5edeac35-cee2b01f375bbfa7-00"}}, response = 2024/11/22-17:00:52.005681 140024827360832 INFO dcompact_worker.cpp:1459: finish /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-05363/att-00: olev 3, work 41.385 s, result 4.879 ms, install 0.762 ms, input{raw 1.665 GiB zip 506.741 MiB}