2024/11/22-15:56:25.061400 140025179854400 DEBG dcompact_worker.cpp:2214: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-03699/att-00: fork to child time = 0.024037 sec 2024/11/22-15:56:25.062472 140025179854400 DEBG dcompact_worker.cpp:1013: Beg SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-03699/att-00 2024/11/22-15:56:25.070686 140025179854400 DEBG dcompact_worker.cpp:1033: End SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-03699/att-00 2024/11/22-15:56:25.072119 140025179854400 TRAC dcompact_worker.cpp:1083: INFO_LOG_LEVEL: rpc = INFO_LEVEL, env_var = undefined 2024/11/22-15:56:25.072482 140025179854400 [WARN] [column_family.cc:386] multiple cf_paths/db_paths and level_compaction_dynamic_level_bytes can't be used together 2024/11/22-15:56:25.118834 140025179854400 [version_set.cc:6208] Recovering from manifest file: /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-03699/att-00/MANIFEST-206347 2024/11/22-15:56:25.132658 140025179854400 [version_set.cc:6251] Recovered from manifest file:/worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-03699/att-00/MANIFEST-206347 succeeded,manifest_file_number is 206347, next_file_number is 212874, last_sequence is 3355554719, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 212730 2024/11/22-15:56:25.132670 140025179854400 [version_set.cc:6266] Column family [default] (ID 0), log number is 0 2024/11/22-15:56:25.132997 140025179854400 [version_set.cc:5721] Creating manifest 212874 2024/11/22-15:56:25.163728 140025179854400 DEBG dcompact_worker.cpp:1218: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-03699/att-00: bottommost_level: fake = 1, rpc = 0 2024/11/22-15:56:25.183517 140025179854400 [compaction_job.cc:2437] [default] [JOB 3699] Compacting 1@2 + 13@3 files to L3, score 0.87, subcompactions 1 : 1 2024/11/22-15:56:25.183544 140025179854400 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 2930 Base level 2, inputs: [212868(27MB)], [212805(36MB) 212806(37MB) 212807(37MB) 212808(37MB) 212809(38MB) 212810(38MB) 212811(38MB) 212812(36MB) 212813(35MB) 212814(36MB) 212815(36MB) 212836(36MB) 212837(36MB)] 2024/11/22-15:56:25.191570 140025179854400 [top_zip_table.cc:59] core git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/22-15:56:25.191615 140025179854400 [top_zip_table.cc:60] fsa git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/22-15:56:25.191644 140025179854400 [top_zip_table.cc:61] zbs git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/22-15:56:25.191653 140025179854400 [top_zip_table.cc:62] topling-zip_table_reader: git_version_hash_info_is: commit a4a382006cb82713acf5b3425835f22711877681 Author: leipeng Date: 2024-04-11 19:44:14 +0800 fixed_len_hole_index.cc: Add env bool FixedLenHoleIndexUseAVX512 for ut & debug 1. FixedLenHoleIndexUseAVX512 is only in unit tests or debug 2. In release mode, use avx512 by compile options(-march=) g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/22-15:56:25.191668 140025179854400 [top_zip_table.cc:64] topling-rocks git_version_hash_info_is: commit feab587e468621ba0204d47b4ffacc52e7c4290d Author: leipeng Date: 2024-03-22 13:35:06 +0800 ToplingZipTableBuilder::Add: immediately return after error This function returns void, and caller does not check builder->status() after calling this function and graceful abandon. So immediately return after error, and return error status in Finish(). g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/22-15:56:25.674238 140025179854400 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-03699/att-00/212875.sst) /dev/shm/ToplingTemp/Topling-186804-zdOxZq 2024/11/22-15:56:26.419082 140025179854400 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-03699/att-00/212875.sst): first pass time = 0.74's, 180.210'MB/sec 2024/11/22-15:56:28.804616 140025179854400 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-03699/att-00/212875.sst): old prealloc_size = 147639500, real_size = 34701552 2024/11/22-15:56:28.805213 140025179854400 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-03699/att-00/212875.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 922382 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1084 GB zip-val = 0.0327 GB avg-val = 117.51 avg-zval = 35.46 2024/11/22-15:56:28.805976 140025179854400 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-03699/att-00/212875.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-15:56:30.206874 140025179854400 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-03699/att-00/212875.sst): second pass time = 2.38's, 45.451'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.40's, 27.579'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3046.815'MB/sec (index lex order gen) rebuild zvType time = 1.15's, 0.200'MB/sec write SST data time = 0.25's, 156.104'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.084'MB, throughput = 27269.876'MB/sec zip my value time = 2.38's, unzip length = 0.108'GB zip my value throughput = 45.451'MB/sec zip pipeline throughput = 111.452'MB/sec entries = 922382 avg-key = 28.00 avg-zkey = 1.91 avg-val = 117.51 avg-zval = 35.46 usrkeys = 922382 avg-key = 20.00 avg-zkey = 1.91 avg-val = 124.51 avg-zval = 35.46 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 922382 bytes = 3113056 } seq expand size = 6456674 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0184 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0327 GB dict = 1.08 MB all = 0.0387 GB } UnZip/Zip{ index = 10.4444 value = 3.3143 dict = 1.00 all = 3.4706 } Zip/UnZip{ index = 0.0957 value = 0.3017 dict = 1.00 all = 0.2881 } ---------------------------- total value len = 0.114848 GB avg = 0.125 KB (by entry num) total key len = 0.025827 GB avg = 0.028 KB total ukey len = 0.018448 GB avg = 0.020 KB total ukey num = 0.000922382 Billion total entry num = 0.000922382 Billion write speed all = 0.005528114 MB/sec (with seq num) write speed all = 0.005238138 MB/sec (without seq num) 2024/11/22-15:56:30.241155 140025179854400 [compaction_job.cc:1948] [default] [JOB 3699] Generated table #212875: 922382 keys, 38673354 bytes, temperature: kWarm 2024/11/22-15:56:30.241242 140025179854400 EVENT_LOG_v1 {"time_micros": 1732262190241189, "cf_name": "default", "job": 3699, "event": "table_file_creation", "file_number": 212875, "file_size": 38673354, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3273702550, "largest_seqno": 3355521087, "table_properties": {"data_size": 32704480, "index_size": 1766272, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25826696, "raw_average_key_size": 28, "raw_value_size": 108391156, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 922382, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732262185, "oldest_key_time": 0, "file_creation_time": 1732262185, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 212875, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-15:56:30.284880 140025179854400 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-03699/att-00/212876.sst) /dev/shm/ToplingTemp/Topling-186804-EK6hMs 2024/11/22-15:56:31.505892 140025179854400 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-03699/att-00/212876.sst): first pass time = 1.22's, 109.927'MB/sec 2024/11/22-15:56:33.510879 140025179854400 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-03699/att-00/212876.sst): old prealloc_size = 147639500, real_size = 34821936 2024/11/22-15:56:33.511489 140025179854400 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-03699/att-00/212876.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 922335 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1084 GB zip-val = 0.0328 GB avg-val = 117.52 avg-zval = 35.60 2024/11/22-15:56:33.512306 140025179854400 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-03699/att-00/212876.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-15:56:34.651309 140025179854400 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-03699/att-00/212876.sst): second pass time = 2.00's, 54.203'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.14's, 34.017'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2979.987'MB/sec (index lex order gen) rebuild zvType time = 0.98's, 0.236'MB/sec write SST data time = 0.16's, 240.550'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.084'MB, throughput = 37618.095'MB/sec zip my value time = 2.00's, unzip length = 0.108'GB zip my value throughput = 54.203'MB/sec zip pipeline throughput = 107.349'MB/sec entries = 922335 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.52 avg-zval = 35.60 usrkeys = 922335 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.52 avg-zval = 35.60 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 922335 bytes = 3112896 } seq expand size = 6456345 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0184 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0328 GB dict = 1.08 MB all = 0.0388 GB } UnZip/Zip{ index = 10.5128 value = 3.3010 dict = 1.00 all = 3.4598 } Zip/UnZip{ index = 0.0951 value = 0.3029 dict = 1.00 all = 0.2890 } ---------------------------- total value len = 0.229697 GB avg = 0.125 KB (by entry num) total key len = 0.051652 GB avg = 0.028 KB total ukey len = 0.036894 GB avg = 0.020 KB total ukey num = 0.001844717 Billion total entry num = 0.001844717 Billion write speed all = 0.011054280 MB/sec (with seq num) write speed all = 0.010474444 MB/sec (without seq num) 2024/11/22-15:56:34.687154 140025179854400 [compaction_job.cc:1948] [default] [JOB 3699] Generated table #212876: 922335 keys, 38793674 bytes, temperature: kWarm 2024/11/22-15:56:34.687207 140025179854400 EVENT_LOG_v1 {"time_micros": 1732262194687177, "cf_name": "default", "job": 3699, "event": "table_file_creation", "file_number": 212876, "file_size": 38793674, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3273702575, "largest_seqno": 3355521494, "table_properties": {"data_size": 32836512, "index_size": 1754688, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25825380, "raw_average_key_size": 28, "raw_value_size": 108392378, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 922335, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732262190, "oldest_key_time": 0, "file_creation_time": 1732262190, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 212876, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-15:56:34.728617 140025179854400 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-03699/att-00/212877.sst) /dev/shm/ToplingTemp/Topling-186804-RS02tt 2024/11/22-15:56:35.886093 140025179854400 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-03699/att-00/212877.sst): first pass time = 1.16's, 115.961'MB/sec 2024/11/22-15:56:39.659505 140025179854400 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-03699/att-00/212877.sst): old prealloc_size = 147639500, real_size = 35020000 2024/11/22-15:56:39.660106 140025179854400 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-03699/att-00/212877.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 922201 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1084 GB zip-val = 0.0330 GB avg-val = 117.54 avg-zval = 35.82 2024/11/22-15:56:39.660895 140025179854400 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-03699/att-00/212877.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-15:56:40.911386 140025179854400 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-03699/att-00/212877.sst): second pass time = 3.77's, 28.734'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.25's, 31.147'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2992.062'MB/sec (index lex order gen) rebuild zvType time = 1.01's, 0.228'MB/sec write SST data time = 0.24's, 162.838'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.083'MB, throughput = 33734.533'MB/sec zip my value time = 3.77's, unzip length = 0.108'GB zip my value throughput = 28.734'MB/sec zip pipeline throughput = 124.226'MB/sec entries = 922201 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.54 avg-zval = 35.82 usrkeys = 922201 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.54 avg-zval = 35.82 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 922201 bytes = 3112448 } seq expand size = 6455407 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0184 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0330 GB dict = 1.08 MB all = 0.0390 GB } UnZip/Zip{ index = 10.5140 value = 3.2813 dict = 1.00 all = 3.4423 } Zip/UnZip{ index = 0.0951 value = 0.3048 dict = 1.00 all = 0.2905 } ---------------------------- total value len = 0.344548 GB avg = 0.125 KB (by entry num) total key len = 0.077474 GB avg = 0.028 KB total ukey len = 0.055338 GB avg = 0.020 KB total ukey num = 0.002766918 Billion total entry num = 0.002766918 Billion write speed all = 0.016577301 MB/sec (with seq num) write speed all = 0.015707810 MB/sec (without seq num) 2024/11/22-15:56:40.950094 140025179854400 [compaction_job.cc:1948] [default] [JOB 3699] Generated table #212877: 922201 keys, 38991180 bytes, temperature: kWarm 2024/11/22-15:56:40.950175 140025179854400 EVENT_LOG_v1 {"time_micros": 1732262200950133, "cf_name": "default", "job": 3699, "event": "table_file_creation", "file_number": 212877, "file_size": 38991180, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3273702604, "largest_seqno": 3355521152, "table_properties": {"data_size": 33035024, "index_size": 1754240, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25821628, "raw_average_key_size": 28, "raw_value_size": 108396194, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 922201, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732262194, "oldest_key_time": 0, "file_creation_time": 1732262194, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 212877, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-15:56:41.019487 140025179854400 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-03699/att-00/212878.sst) /dev/shm/ToplingTemp/Topling-186804-DqVeOs 2024/11/22-15:56:42.493919 140025179854400 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-03699/att-00/212878.sst): first pass time = 1.47's, 91.033'MB/sec 2024/11/22-15:56:44.456814 140025179854400 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-03699/att-00/212878.sst): old prealloc_size = 147639500, real_size = 35047744 2024/11/22-15:56:44.457392 140025179854400 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-03699/att-00/212878.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 922276 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1084 GB zip-val = 0.0331 GB avg-val = 117.53 avg-zval = 35.84 2024/11/22-15:56:44.458136 140025179854400 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-03699/att-00/212878.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-15:56:45.480486 140025179854400 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-03699/att-00/212878.sst): second pass time = 1.96's, 55.241'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.02's, 38.117'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3167.095'MB/sec (index lex order gen) rebuild zvType time = 0.87's, 0.265'MB/sec write SST data time = 0.15's, 254.108'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.083'MB, throughput = 25808.013'MB/sec zip my value time = 1.96's, unzip length = 0.108'GB zip my value throughput = 55.241'MB/sec zip pipeline throughput = 84.757'MB/sec entries = 922276 avg-key = 28.00 avg-zkey = 1.92 avg-val = 117.53 avg-zval = 35.84 usrkeys = 922276 avg-key = 20.00 avg-zkey = 1.92 avg-val = 124.53 avg-zval = 35.84 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 922276 bytes = 3112704 } seq expand size = 6455932 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0184 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0331 GB dict = 1.08 MB all = 0.0390 GB } UnZip/Zip{ index = 10.4409 value = 3.2797 dict = 1.00 all = 3.4398 } Zip/UnZip{ index = 0.0958 value = 0.3049 dict = 1.00 all = 0.2907 } ---------------------------- total value len = 0.459398 GB avg = 0.125 KB (by entry num) total key len = 0.103297 GB avg = 0.028 KB total ukey len = 0.073784 GB avg = 0.020 KB total ukey num = 0.003689194 Billion total entry num = 0.003689194 Billion write speed all = 0.022099092 MB/sec (with seq num) write speed all = 0.020939988 MB/sec (without seq num) 2024/11/22-15:56:45.512991 140025179854400 [compaction_job.cc:1948] [default] [JOB 3699] Generated table #212878: 922276 keys, 39019232 bytes, temperature: kWarm 2024/11/22-15:56:45.513055 140025179854400 EVENT_LOG_v1 {"time_micros": 1732262205513024, "cf_name": "default", "job": 3699, "event": "table_file_creation", "file_number": 212878, "file_size": 39019232, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3273702634, "largest_seqno": 3355521618, "table_properties": {"data_size": 33050352, "index_size": 1766656, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25823728, "raw_average_key_size": 28, "raw_value_size": 108394052, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 922276, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732262201, "oldest_key_time": 0, "file_creation_time": 1732262201, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 212878, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-15:56:45.550327 140025179854400 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-03699/att-00/212879.sst) /dev/shm/ToplingTemp/Topling-186804-9Swcus 2024/11/22-15:56:46.773485 140025179854400 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-03699/att-00/212879.sst): first pass time = 1.22's, 109.734'MB/sec 2024/11/22-15:56:48.227546 140025179854400 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-03699/att-00/212879.sst): old prealloc_size = 147639500, real_size = 35389120 2024/11/22-15:56:48.228222 140025179854400 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-03699/att-00/212879.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 922681 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1084 GB zip-val = 0.0334 GB avg-val = 117.46 avg-zval = 36.20 2024/11/22-15:56:48.229052 140025179854400 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-03699/att-00/212879.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-15:56:49.404214 140025179854400 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-03699/att-00/212879.sst): second pass time = 1.45's, 74.594'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.18's, 33.456'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2687.754'MB/sec (index lex order gen) rebuild zvType time = 0.93's, 0.247'MB/sec write SST data time = 0.24's, 162.104'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.083'MB, throughput = 34958.505'MB/sec zip my value time = 1.45's, unzip length = 0.108'GB zip my value throughput = 74.594'MB/sec zip pipeline throughput = 74.594'MB/sec entries = 922681 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.46 avg-zval = 36.20 usrkeys = 922681 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.46 avg-zval = 36.20 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 922681 bytes = 3114064 } seq expand size = 6458767 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0185 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0334 GB dict = 1.08 MB all = 0.0394 GB } UnZip/Zip{ index = 10.5118 value = 3.2447 dict = 1.00 all = 3.4095 } Zip/UnZip{ index = 0.0951 value = 0.3082 dict = 1.00 all = 0.2933 } ---------------------------- total value len = 0.574240 GB avg = 0.125 KB (by entry num) total key len = 0.129133 GB avg = 0.028 KB total ukey len = 0.092238 GB avg = 0.020 KB total ukey num = 0.004611875 Billion total entry num = 0.004611875 Billion write speed all = 0.027619712 MB/sec (with seq num) write speed all = 0.026170935 MB/sec (without seq num) 2024/11/22-15:56:49.443004 140025179854400 [compaction_job.cc:1948] [default] [JOB 3699] Generated table #212879: 922681 keys, 39365306 bytes, temperature: kWarm 2024/11/22-15:56:49.443083 140025179854400 EVENT_LOG_v1 {"time_micros": 1732262209443041, "cf_name": "default", "job": 3699, "event": "table_file_creation", "file_number": 212879, "file_size": 39365306, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237868609, "largest_seqno": 3355521215, "table_properties": {"data_size": 33402736, "index_size": 1755520, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25835068, "raw_average_key_size": 28, "raw_value_size": 108382682, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 922681, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732262205, "oldest_key_time": 0, "file_creation_time": 1732262205, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 212879, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-15:56:49.504483 140025179854400 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-03699/att-00/212880.sst) /dev/shm/ToplingTemp/Topling-186804-yabgiq 2024/11/22-15:56:50.528006 140025179854400 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-03699/att-00/212880.sst): first pass time = 1.02's, 131.140'MB/sec 2024/11/22-15:56:51.914413 140025179854400 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-03699/att-00/212880.sst): old prealloc_size = 147639500, real_size = 36578384 2024/11/22-15:56:51.915004 140025179854400 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-03699/att-00/212880.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 922906 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1084 GB zip-val = 0.0346 GB avg-val = 117.43 avg-zval = 37.48 2024/11/22-15:56:51.915730 140025179854400 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-03699/att-00/212880.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-15:56:52.762107 140025179854400 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-03699/att-00/212880.sst): second pass time = 1.39's, 78.209'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.85's, 47.842'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3071.138'MB/sec (index lex order gen) rebuild zvType time = 0.72's, 0.321'MB/sec write SST data time = 0.13's, 314.949'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.083'MB, throughput = 26430.886'MB/sec zip my value time = 1.39's, unzip length = 0.108'GB zip my value throughput = 78.209'MB/sec zip pipeline throughput = 78.209'MB/sec entries = 922906 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.43 avg-zval = 37.48 usrkeys = 922906 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.37 avg-zval = 37.48 TagRS{ kinds = RS_Key0_TagN bytes = 144320 } TagArray{ size = 914953 bytes = 2973616 } seq expand size = 6404671 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0346 GB dict = 1.08 MB all = 0.0406 GB } UnZip/Zip{ index = 10.5124 value = 3.1330 dict = 1.00 all = 3.3096 } Zip/UnZip{ index = 0.0951 value = 0.3192 dict = 1.00 all = 0.3022 } ---------------------------- total value len = 0.689021 GB avg = 0.124 KB (by entry num) total key len = 0.154974 GB avg = 0.028 KB total ukey len = 0.110696 GB avg = 0.020 KB total ukey num = 0.005534781 Billion total entry num = 0.005534781 Billion write speed all = 0.033137245 MB/sec (with seq num) write speed all = 0.031398775 MB/sec (without seq num) 2024/11/22-15:56:52.797857 140025179854400 [compaction_job.cc:1948] [default] [JOB 3699] Generated table #212880: 922906 keys, 40554408 bytes, temperature: kWarm 2024/11/22-15:56:52.797919 140025179854400 EVENT_LOG_v1 {"time_micros": 1732262212797887, "cf_name": "default", "job": 3699, "event": "table_file_creation", "file_number": 212880, "file_size": 40554408, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3273700579, "table_properties": {"data_size": 34591616, "index_size": 1755840, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25841368, "raw_average_key_size": 28, "raw_value_size": 108376444, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 922906, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732262209, "oldest_key_time": 0, "file_creation_time": 1732262209, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 212880, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-15:56:52.834421 140025179854400 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-03699/att-00/212881.sst) /dev/shm/ToplingTemp/Topling-186804-yKuF4q 2024/11/22-15:56:53.891389 140025179854400 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-03699/att-00/212881.sst): first pass time = 1.06's, 126.989'MB/sec 2024/11/22-15:56:55.295667 140025179854400 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-03699/att-00/212881.sst): old prealloc_size = 147639500, real_size = 36349456 2024/11/22-15:56:55.296240 140025179854400 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-03699/att-00/212881.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 922694 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1084 GB zip-val = 0.0344 GB avg-val = 117.46 avg-zval = 37.24 2024/11/22-15:56:55.296934 140025179854400 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-03699/att-00/212881.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-15:56:56.232179 140025179854400 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-03699/att-00/212881.sst): second pass time = 1.40's, 77.246'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.94's, 42.798'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3210.411'MB/sec (index lex order gen) rebuild zvType time = 0.70's, 0.328'MB/sec write SST data time = 0.23's, 172.895'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.083'MB, throughput = 35449.118'MB/sec zip my value time = 1.40's, unzip length = 0.108'GB zip my value throughput = 77.246'MB/sec zip pipeline throughput = 77.246'MB/sec entries = 922694 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.46 avg-zval = 37.24 usrkeys = 922694 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.83 avg-zval = 37.24 TagRS{ kinds = RS_Key0_TagN bytes = 144280 } TagArray{ size = 839174 bytes = 2727328 } seq expand size = 5874218 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0185 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0344 GB dict = 1.08 MB all = 0.0401 GB } UnZip/Zip{ index = 10.5127 value = 3.1540 dict = 1.00 all = 3.3488 } Zip/UnZip{ index = 0.0951 value = 0.3171 dict = 1.00 all = 0.2986 } ---------------------------- total value len = 0.803277 GB avg = 0.124 KB (by entry num) total key len = 0.180809 GB avg = 0.028 KB total ukey len = 0.129150 GB avg = 0.020 KB total ukey num = 0.006457475 Billion total entry num = 0.006457475 Billion write speed all = 0.038632327 MB/sec (with seq num) write speed all = 0.036604316 MB/sec (without seq num) 2024/11/22-15:56:56.271505 140025179854400 [compaction_job.cc:1948] [default] [JOB 3699] Generated table #212881: 922694 keys, 40079246 bytes, temperature: kWarm 2024/11/22-15:56:56.271585 140025179854400 EVENT_LOG_v1 {"time_micros": 1732262216271542, "cf_name": "default", "job": 3699, "event": "table_file_creation", "file_number": 212881, "file_size": 40079246, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3273700489, "table_properties": {"data_size": 34363200, "index_size": 1755392, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25835432, "raw_average_key_size": 28, "raw_value_size": 108382312, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 922694, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732262212, "oldest_key_time": 0, "file_creation_time": 1732262212, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 212881, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-15:56:56.308411 140025179854400 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-03699/att-00/212882.sst) /dev/shm/ToplingTemp/Topling-186804-DZAiXs 2024/11/22-15:56:57.188506 140025179854400 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-03699/att-00/212882.sst): first pass time = 0.88's, 152.511'MB/sec 2024/11/22-15:56:58.678383 140025179854400 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-03699/att-00/212882.sst): old prealloc_size = 147639500, real_size = 36614432 2024/11/22-15:56:58.678950 140025179854400 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-03699/att-00/212882.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 925902 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0346 GB avg-val = 116.96 avg-zval = 37.39 2024/11/22-15:56:58.679221 140025179854400 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-03699/att-00/212882.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-15:56:59.375511 140025179854400 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-03699/att-00/212882.sst): second pass time = 1.49's, 72.723'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.70's, 54.963'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3239.615'MB/sec (index lex order gen) rebuild zvType time = 0.57's, 0.405'MB/sec write SST data time = 0.12's, 307.788'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 34244.835'MB/sec zip my value time = 1.49's, unzip length = 0.108'GB zip my value throughput = 72.723'MB/sec zip pipeline throughput = 72.723'MB/sec entries = 925902 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.96 avg-zval = 37.39 usrkeys = 925902 avg-key = 20.00 avg-zkey = 1.90 avg-val = 118.58 avg-zval = 37.39 TagRS{ kinds = RS_Key0_TagN bytes = 144760 } TagArray{ size = 214717 bytes = 697840 } seq expand size = 1503019 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0346 GB dict = 1.08 MB all = 0.0383 GB } UnZip/Zip{ index = 10.5147 value = 3.1279 dict = 1.00 all = 3.5029 } Zip/UnZip{ index = 0.0951 value = 0.3197 dict = 1.00 all = 0.2855 } ---------------------------- total value len = 0.913073 GB avg = 0.124 KB (by entry num) total key len = 0.206735 GB avg = 0.028 KB total ukey len = 0.147668 GB avg = 0.020 KB total ukey num = 0.007383377 Billion total entry num = 0.007383377 Billion write speed all = 0.043954900 MB/sec (with seq num) write speed all = 0.041636390 MB/sec (without seq num) 2024/11/22-15:56:59.409925 140025179854400 [compaction_job.cc:1948] [default] [JOB 3699] Generated table #212882: 925902 keys, 38315717 bytes, temperature: kWarm 2024/11/22-15:56:59.409986 140025179854400 EVENT_LOG_v1 {"time_micros": 1732262219409956, "cf_name": "default", "job": 3699, "event": "table_file_creation", "file_number": 212882, "file_size": 38315717, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3273700833, "table_properties": {"data_size": 34621648, "index_size": 1761152, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25925256, "raw_average_key_size": 28, "raw_value_size": 108292512, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 925902, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732262216, "oldest_key_time": 0, "file_creation_time": 1732262216, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 212882, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-15:56:59.444513 140025179854400 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-03699/att-00/212883.sst) /dev/shm/ToplingTemp/Topling-186804-X2i0gr 2024/11/22-15:57:00.291209 140025179854400 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-03699/att-00/212883.sst): first pass time = 0.85's, 158.527'MB/sec 2024/11/22-15:57:01.863415 140025179854400 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-03699/att-00/212883.sst): old prealloc_size = 147639500, real_size = 36474560 2024/11/22-15:57:01.863983 140025179854400 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-03699/att-00/212883.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927052 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0345 GB avg-val = 116.78 avg-zval = 37.19 2024/11/22-15:57:01.864029 140025179854400 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-03699/att-00/212883.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-15:57:02.506827 140025179854400 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-03699/att-00/212883.sst): second pass time = 1.57's, 68.887'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.64's, 58.024'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3223.375'MB/sec (index lex order gen) rebuild zvType time = 0.52's, 0.447'MB/sec write SST data time = 0.12's, 299.421'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 34786.140'MB/sec zip my value time = 1.57's, unzip length = 0.108'GB zip my value throughput = 68.887'MB/sec zip pipeline throughput = 68.887'MB/sec entries = 927052 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.78 avg-zval = 37.19 usrkeys = 927052 avg-key = 20.00 avg-zkey = 1.90 avg-val = 116.78 avg-zval = 37.19 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0345 GB dict = 1.08 MB all = 0.0373 GB } UnZip/Zip{ index = 10.5121 value = 3.1399 dict = 1.00 all = 3.5952 } Zip/UnZip{ index = 0.0951 value = 0.3185 dict = 1.00 all = 0.2781 } ---------------------------- total value len = 1.021333 GB avg = 0.123 KB (by entry num) total key len = 0.232692 GB avg = 0.028 KB total ukey len = 0.166209 GB avg = 0.020 KB total ukey num = 0.008310429 Billion total entry num = 0.008310429 Billion write speed all = 0.049217195 MB/sec (with seq num) write speed all = 0.046607895 MB/sec (without seq num) 2024/11/22-15:57:02.541467 140025179854400 [compaction_job.cc:1948] [default] [JOB 3699] Generated table #212883: 927052 keys, 37332440 bytes, temperature: kWarm 2024/11/22-15:57:02.541528 140025179854400 EVENT_LOG_v1 {"time_micros": 1732262222541496, "cf_name": "default", "job": 3699, "event": "table_file_creation", "file_number": 212883, "file_size": 37332440, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 34478832, "index_size": 1763776, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25957456, "raw_average_key_size": 28, "raw_value_size": 108260352, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927052, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732262219, "oldest_key_time": 0, "file_creation_time": 1732262219, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 212883, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-15:57:02.576810 140025179854400 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-03699/att-00/212884.sst) /dev/shm/ToplingTemp/Topling-186804-cs11Bq 2024/11/22-15:57:03.460120 140025179854400 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-03699/att-00/212884.sst): first pass time = 0.88's, 151.955'MB/sec 2024/11/22-15:57:04.871803 140025179854400 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-03699/att-00/212884.sst): old prealloc_size = 147639500, real_size = 36094960 2024/11/22-15:57:04.872351 140025179854400 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-03699/att-00/212884.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 923760 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1084 GB zip-val = 0.0341 GB avg-val = 117.30 avg-zval = 36.92 2024/11/22-15:57:04.872767 140025179854400 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-03699/att-00/212884.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-15:57:05.634509 140025179854400 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-03699/att-00/212884.sst): second pass time = 1.41's, 76.786'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.76's, 50.344'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3336.330'MB/sec (index lex order gen) rebuild zvType time = 0.64's, 0.363'MB/sec write SST data time = 0.13's, 305.147'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.082'MB, throughput = 34390.837'MB/sec zip my value time = 1.41's, unzip length = 0.108'GB zip my value throughput = 76.786'MB/sec zip pipeline throughput = 76.786'MB/sec entries = 923760 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.30 avg-zval = 36.92 usrkeys = 923760 avg-key = 20.00 avg-zkey = 1.90 avg-val = 120.21 avg-zval = 36.92 TagRS{ kinds = RS_Key0_TagN bytes = 144440 } TagArray{ size = 384226 bytes = 1296784 } seq expand size = 2689582 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0185 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0341 GB dict = 1.08 MB all = 0.0384 GB } UnZip/Zip{ index = 10.5114 value = 3.1769 dict = 1.00 all = 3.4955 } Zip/UnZip{ index = 0.0951 value = 0.3148 dict = 1.00 all = 0.2861 } ---------------------------- total value len = 1.132375 GB avg = 0.123 KB (by entry num) total key len = 0.258557 GB avg = 0.028 KB total ukey len = 0.184684 GB avg = 0.020 KB total ukey num = 0.009234189 Billion total entry num = 0.009234189 Billion write speed all = 0.054583751 MB/sec (with seq num) write speed all = 0.051684766 MB/sec (without seq num) 2024/11/22-15:57:05.667484 140025179854400 [compaction_job.cc:1948] [default] [JOB 3699] Generated table #212884: 923760 keys, 38397253 bytes, temperature: kWarm 2024/11/22-15:57:05.667547 140025179854400 EVENT_LOG_v1 {"time_micros": 1732262225667516, "cf_name": "default", "job": 3699, "event": "table_file_creation", "file_number": 212884, "file_size": 38397253, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3352367196, "table_properties": {"data_size": 34106208, "index_size": 1757632, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25865280, "raw_average_key_size": 28, "raw_value_size": 108352552, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 923760, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732262222, "oldest_key_time": 0, "file_creation_time": 1732262222, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 212884, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-15:57:05.702763 140025179854400 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-03699/att-00/212885.sst) /dev/shm/ToplingTemp/Topling-186804-hnCU9r 2024/11/22-15:57:06.567291 140025179854400 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-03699/att-00/212885.sst): first pass time = 0.86's, 155.257'MB/sec 2024/11/22-15:57:07.874486 140025179854400 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-03699/att-00/212885.sst): old prealloc_size = 147639500, real_size = 34502944 2024/11/22-15:57:07.875069 140025179854400 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-03699/att-00/212885.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 922318 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1084 GB zip-val = 0.0325 GB avg-val = 117.52 avg-zval = 35.26 2024/11/22-15:57:07.877009 140025179854400 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-03699/att-00/212885.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-15:57:08.787285 140025179854400 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-03699/att-00/212885.sst): second pass time = 1.31's, 82.961'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.91's, 42.151'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3129.494'MB/sec (index lex order gen) rebuild zvType time = 0.78's, 0.294'MB/sec write SST data time = 0.13's, 298.160'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.083'MB, throughput = 32270.412'MB/sec zip my value time = 1.31's, unzip length = 0.108'GB zip my value throughput = 82.961'MB/sec zip pipeline throughput = 82.961'MB/sec entries = 922318 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.52 avg-zval = 35.26 usrkeys = 922318 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.52 avg-zval = 35.26 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 922318 bytes = 3112832 } seq expand size = 6456226 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0184 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0325 GB dict = 1.08 MB all = 0.0385 GB } UnZip/Zip{ index = 10.5134 value = 3.3334 dict = 1.00 all = 3.4885 } Zip/UnZip{ index = 0.0951 value = 0.3000 dict = 1.00 all = 0.2867 } ---------------------------- total value len = 1.247224 GB avg = 0.123 KB (by entry num) total key len = 0.284382 GB avg = 0.028 KB total ukey len = 0.203130 GB avg = 0.020 KB total ukey num = 0.010156507 Billion total entry num = 0.010156507 Billion write speed all = 0.060096724 MB/sec (with seq num) write speed all = 0.056908579 MB/sec (without seq num) 2024/11/22-15:57:08.819539 140025179854400 [compaction_job.cc:1948] [default] [JOB 3699] Generated table #212885: 922318 keys, 38474406 bytes, temperature: kWarm 2024/11/22-15:57:08.819605 140025179854400 EVENT_LOG_v1 {"time_micros": 1732262228819567, "cf_name": "default", "job": 3699, "event": "table_file_creation", "file_number": 212885, "file_size": 38474406, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3273701362, "largest_seqno": 3355521257, "table_properties": {"data_size": 32517648, "index_size": 1754560, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25824904, "raw_average_key_size": 28, "raw_value_size": 108392868, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 922318, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732262225, "oldest_key_time": 0, "file_creation_time": 1732262225, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 212885, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-15:57:08.857397 140025179854400 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-03699/att-00/212886.sst) /dev/shm/ToplingTemp/Topling-186804-EPhMUq 2024/11/22-15:57:09.738166 140025179854400 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-03699/att-00/212886.sst): first pass time = 0.88's, 152.394'MB/sec 2024/11/22-15:57:11.060917 140025179854400 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-03699/att-00/212886.sst): old prealloc_size = 147639500, real_size = 34447184 2024/11/22-15:57:11.061445 140025179854400 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-03699/att-00/212886.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 922484 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1084 GB zip-val = 0.0324 GB avg-val = 117.50 avg-zval = 35.18 2024/11/22-15:57:11.062194 140025179854400 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-03699/att-00/212886.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-15:57:11.969194 140025179854400 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-03699/att-00/212886.sst): second pass time = 1.32's, 81.981'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.91's, 42.300'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3512.363'MB/sec (index lex order gen) rebuild zvType time = 0.78's, 0.296'MB/sec write SST data time = 0.13's, 301.755'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.083'MB, throughput = 34250.759'MB/sec zip my value time = 1.32's, unzip length = 0.108'GB zip my value throughput = 81.981'MB/sec zip pipeline throughput = 81.981'MB/sec entries = 922484 avg-key = 28.00 avg-zkey = 1.92 avg-val = 117.50 avg-zval = 35.18 usrkeys = 922484 avg-key = 20.00 avg-zkey = 1.92 avg-val = 124.50 avg-zval = 35.18 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 922484 bytes = 3113392 } seq expand size = 6457388 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0184 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0324 GB dict = 1.08 MB all = 0.0384 GB } UnZip/Zip{ index = 10.4437 value = 3.3402 dict = 1.00 all = 3.4935 } Zip/UnZip{ index = 0.0958 value = 0.2994 dict = 1.00 all = 0.2862 } ---------------------------- total value len = 1.362070 GB avg = 0.123 KB (by entry num) total key len = 0.310212 GB avg = 0.028 KB total ukey len = 0.221580 GB avg = 0.020 KB total ukey num = 0.011078991 Billion total entry num = 0.011078991 Billion write speed all = 0.065608301 MB/sec (with seq num) write speed all = 0.062131022 MB/sec (without seq num) 2024/11/22-15:57:12.002964 140025179854400 [compaction_job.cc:1948] [default] [JOB 3699] Generated table #212886: 922484 keys, 38419180 bytes, temperature: kWarm 2024/11/22-15:57:12.003026 140025179854400 EVENT_LOG_v1 {"time_micros": 1732262232002995, "cf_name": "default", "job": 3699, "event": "table_file_creation", "file_number": 212886, "file_size": 38419180, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3273701386, "largest_seqno": 3355520873, "table_properties": {"data_size": 32449792, "index_size": 1766592, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25829552, "raw_average_key_size": 28, "raw_value_size": 108388180, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 922484, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732262228, "oldest_key_time": 0, "file_creation_time": 1732262228, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 212886, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-15:57:12.042868 140025179854400 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-03699/att-00/212887.sst) /dev/shm/ToplingTemp/Topling-186804-waRzXr 2024/11/22-15:57:12.904279 140025179854400 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-03699/att-00/212887.sst): first pass time = 0.86's, 155.819'MB/sec 2024/11/22-15:57:14.242055 140025179854400 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-03699/att-00/212887.sst): old prealloc_size = 147639500, real_size = 34420496 2024/11/22-15:57:14.242606 140025179854400 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-03699/att-00/212887.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 923056 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1084 GB zip-val = 0.0324 GB avg-val = 117.41 avg-zval = 35.14 2024/11/22-15:57:14.243369 140025179854400 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-03699/att-00/212887.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-15:57:15.154835 140025179854400 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-03699/att-00/212887.sst): second pass time = 1.34's, 81.046'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.91's, 42.063'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3308.042'MB/sec (index lex order gen) rebuild zvType time = 0.78's, 0.295'MB/sec write SST data time = 0.13's, 297.649'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.083'MB, throughput = 30963.689'MB/sec zip my value time = 1.34's, unzip length = 0.108'GB zip my value throughput = 81.046'MB/sec zip pipeline throughput = 81.046'MB/sec entries = 923056 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.41 avg-zval = 35.14 usrkeys = 923056 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.41 avg-zval = 35.14 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 923056 bytes = 3115328 } seq expand size = 6461392 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0324 GB dict = 1.08 MB all = 0.0384 GB } UnZip/Zip{ index = 10.5111 value = 3.3414 dict = 1.00 all = 3.4958 } Zip/UnZip{ index = 0.0951 value = 0.2993 dict = 1.00 all = 0.2861 } ---------------------------- total value len = 1.476903 GB avg = 0.123 KB (by entry num) total key len = 0.336057 GB avg = 0.028 KB total ukey len = 0.240041 GB avg = 0.020 KB total ukey num = 0.012002047 Billion total entry num = 0.012002047 Billion write speed all = 0.071118649 MB/sec (with seq num) write speed all = 0.067352128 MB/sec (without seq num) 2024/11/22-15:57:15.188029 140025179854400 [compaction_job.cc:1948] [default] [JOB 3699] Generated table #212887: 923056 keys, 38393914 bytes, temperature: kWarm 2024/11/22-15:57:15.188091 140025179854400 EVENT_LOG_v1 {"time_micros": 1732262235188059, "cf_name": "default", "job": 3699, "event": "table_file_creation", "file_number": 212887, "file_size": 38393914, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3273701413, "largest_seqno": 3355520834, "table_properties": {"data_size": 32433216, "index_size": 1756352, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25845568, "raw_average_key_size": 28, "raw_value_size": 108372160, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 923056, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732262232, "oldest_key_time": 0, "file_creation_time": 1732262232, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 212887, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-15:57:15.222515 140025179854400 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-03699/att-00/212888.sst) /dev/shm/ToplingTemp/Topling-186804-ju14Op 2024/11/22-15:57:15.297475 140025179854400 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-03699/att-00/212888.sst): first pass time = 0.07's, 240.150'MB/sec 2024/11/22-15:57:15.455338 140025179854400 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-03699/att-00/212888.sst): old prealloc_size = 147639500, real_size = 5484784 2024/11/22-15:57:15.455463 140025179854400 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-03699/att-00/212888.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 123979 prefix = 4 raw-key = 0.0020 GB zip-key = 0.0002 GB avg-key = 16.00 avg-zkey = 1.93 raw-val = 0.0145 GB zip-val = 0.0052 GB avg-val = 117.13 avg-zval = 42.06 2024/11/22-15:57:15.455607 140025179854400 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-03699/att-00/212888.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.018 GB 2024/11/22-15:57:15.563789 140025179854400 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-03699/att-00/212888.sst): second pass time = 0.16's, 92.345'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.11's, 55.579'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2430.240'MB/sec (index lex order gen) rebuild zvType time = 0.09's, 0.345'MB/sec write SST data time = 0.02's, 324.782'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.152'MB, throughput = 6027.121'MB/sec zip my value time = 0.16's, unzip length = 0.015'GB zip my value throughput = 92.345'MB/sec zip pipeline throughput = 92.345'MB/sec entries = 123979 avg-key = 28.00 avg-zkey = 1.93 avg-val = 117.13 avg-zval = 42.06 usrkeys = 123979 avg-key = 20.00 avg-zkey = 1.93 avg-val = 124.13 avg-zval = 42.06 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 123979 bytes = 418448 } seq expand size = 867853 multi value expand size = 0 cnt WriteAppend = 15 UnZipSize{ index = 0.0025 GB value = 0.0145 GB dict = 0.15 MB all = 0.0180 GB } __ZipSize{ index = 0.0002 GB value = 0.0052 GB dict = 0.15 MB all = 0.0060 GB } UnZip/Zip{ index = 10.3870 value = 2.7845 dict = 1.00 all = 2.9856 } Zip/UnZip{ index = 0.0963 value = 0.3591 dict = 1.00 all = 0.3349 } ---------------------------- total value len = 1.492292 GB avg = 0.123 KB (by entry num) total key len = 0.339529 GB avg = 0.028 KB total ukey len = 0.242521 GB avg = 0.020 KB total ukey num = 0.012126026 Billion total entry num = 0.012126026 Billion write speed all = 0.071857348 MB/sec (with seq num) write speed all = 0.068051981 MB/sec (without seq num) 2024/11/22-15:57:15.575761 140025179854400 [compaction_job.cc:1948] [default] [JOB 3699] Generated table #212888: 123979 keys, 6026513 bytes, temperature: kWarm 2024/11/22-15:57:15.575823 140025179854400 EVENT_LOG_v1 {"time_micros": 1732262235575793, "cf_name": "default", "job": 3699, "event": "table_file_creation", "file_number": 212888, "file_size": 6026513, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3273701445, "largest_seqno": 3354002337, "table_properties": {"data_size": 5214880, "index_size": 238720, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 3471412, "raw_average_key_size": 28, "raw_value_size": 14521086, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 123979, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732262235, "oldest_key_time": 0, "file_creation_time": 1732262235, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 212888, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-15:57:15.585722 140025179854400 [compaction_job.cc:703] job-03699: subcompact[0], size: 0.510836 G, files: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-03699/att-00 [212875,212876,212877,212878,212879,212880,212881,212882,212883,212884,212885,212886,212887,212888] 2024/11/22-15:57:15.674916 140025179854400 (Original Log Time 2024/11/22-15:56:25.183625) EVENT_LOG_v1 {"time_micros": 1732262185183564, "job": 3699, "event": "compaction_started", "compaction_reason": "FilesMarkedForCompaction", "files_L2": [212868], "files_L3": [212805, 212806, 212807, 212808, 212809, 212810, 212811, 212812, 212813, 212814, 212815, 212836, 212837], "score": 0.871368, "input_data_size": 534567080, "oldest_snapshot_seqno": 3355554719} 2024/11/22-15:57:15.674920 140025179854400 (Original Log Time 2024/11/22-15:57:15.674202) [compaction_job.cc:2022] [default] [JOB 3699] Compacted 1@2 + 13@3 files to L3 => 510835823 bytes 2024/11/22-15:57:15.674921 140025179854400 (Original Log Time 2024/11/22-15:57:15.674856) [compaction_job.cc:1224] [default] compacted to: files[0 0 0 14 0 0 0] max score 0.02, MB/sec: 10.6 rd, 10.1 wr, level 3, files in(1, 13) out(14 +0 blob) MB in(27.1, 482.7 +0.0 blob) out(487.2 +0.0 blob), read-write-amplify(36.7) write-amplify(18.0) OK, records in: 12235616, records dropped: 109590 output_compression: Snappy 2024/11/22-15:57:15.674927 140025179854400 (Original Log Time 2024/11/22-15:57:15.674898) EVENT_LOG_v1 {"time_micros": 1732262235674879, "cf": "default", "job": 3699, "event": "compaction_finished", "compaction_time_micros": 50402100, "compaction_time_cpu_micros": 21228180, "output_level": 3, "num_output_files": 14, "total_output_size": 510835823, "num_input_records": 12235616, "num_output_records": 12126026, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "file_write_nanos": 368594807, "file_range_sync_nanos": 0, "file_fsync_nanos": 21530, "file_prepare_write_nanos": 33528, "lsm_state": [0, 0, 0, 14, 0, 0, 0]} 2024/11/22-15:57:15.805464 140025179854400 DEBG dcompact_worker.cpp:240: HttpPost: 200 OK: url = http://nlb-7zny4kaa1poal01o64.cn-shenzhen.nlb.aliyuncs.com:8443, body = {"instanceId":"nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137","labourId":"","dbId":"d89b4006-2803-486e-b7a2-759bcf348921","dbStarts":1732256054,"starts":1732262185,"executesMs":50606,"compactionJobId":3699,"attempt":0,"compactionInputRawBytes":1778385436,"compactionInputZipBytes":534567080,"compactionOutputRawBytes":0,"compactionOutputZipBytes":510835823,"headers":{"Accept":"*/*","Connection":"close","Host":"aliyun-topling-saas.topling.cn:18443","RemoteIp":"120.24.192.169","X-Forwarded-For":"120.24.192.169","region":"cn-shenzhen","token":"e6474c481bd4415abc537135cc03626b","instance-token":"e6474c481bd4415abc537135cc03626b","provider":"aliyun","CloudMarketInstanceId":"si-59c0ae5c955845588903","MeteringAssit":"","Transfer-Encoding":"chunked","traceparent":"00-ecbc52a5c48c8759a55a086aaf4512e9-8aa319b86c0d55e4-00"}}, response = 2024/11/22-15:57:15.805549 140025179854400 INFO dcompact_worker.cpp:1459: finish /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-03699/att-00: olev 3, work 50.606 s, result 6.317 ms, install 0.744 ms, input{raw 1.656 GiB zip 509.803 MiB}