2024/11/23-21:07:12.376290 139957164807744 DEBG dcompact_worker.cpp:2214: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00: fork to child time = 0.008134 sec 2024/11/23-21:07:12.377094 139957164807744 DEBG dcompact_worker.cpp:1013: Beg SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00 2024/11/23-21:07:12.386368 139957164807744 DEBG dcompact_worker.cpp:1033: End SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00 2024/11/23-21:07:12.387289 139957164807744 TRAC dcompact_worker.cpp:1083: INFO_LOG_LEVEL: rpc = INFO_LEVEL, env_var = undefined 2024/11/23-21:07:12.387527 139957164807744 [WARN] [column_family.cc:386] multiple cf_paths/db_paths and level_compaction_dynamic_level_bytes can't be used together 2024/11/23-21:07:12.451728 139957164807744 [version_set.cc:6208] Recovering from manifest file: /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-35807/att-00/MANIFEST-206347 2024/11/23-21:07:12.467360 139957164807744 [version_set.cc:6251] Recovered from manifest file:/worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-35807/att-00/MANIFEST-206347 succeeded,manifest_file_number is 206347, next_file_number is 280721, last_sequence is 4262775119, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 280558 2024/11/23-21:07:12.467367 139957164807744 [version_set.cc:6266] Column family [default] (ID 0), log number is 0 2024/11/23-21:07:12.467623 139957164807744 [version_set.cc:5721] Creating manifest 280721 2024/11/23-21:07:12.503214 139957164807744 DEBG dcompact_worker.cpp:1218: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00: bottommost_level: fake = 1, rpc = 0 2024/11/23-21:07:12.528230 139957164807744 [compaction_job.cc:2437] [default] [JOB 35807] Compacting 16@3 + 100@4 files to L4, score -1.00, subcompactions 1 : 1 2024/11/23-21:07:12.528292 139957164807744 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 26800 Base level 3, inputs: [280707(38MB) 280708(37MB) 280709(35MB) 280710(34MB) 280711(35MB) 280712(35MB) 280713(36MB) 280714(33MB) 280715(37MB) 280716(37MB) 280717(36MB) 280718(36MB) 280719(9532KB) 280602(36MB) 280603(37MB) 280604(35MB)], [280640(65MB) 280641(64MB) 280642(64MB) 280643(65MB) 280644(65MB) 280645(64MB) 280646(64MB) 280647(72MB) 280648(66MB) 280649(66MB) 280650(65MB) 280651(66MB) 269340(33MB) 272194(46MB) 273704(64MB) 273705(1708B) 276312(63MB) 280233(59MB) 201775(9171KB) 201782(17MB) 201761(12MB) 201838(9173KB) 201829(9238KB) 201823(9238KB) 201824(3395KB) 231340(33MB) 201995(9169KB) 239581(56MB) 257953(54MB) 257954(16MB) 230765(26MB) 246883(54MB) 256911(50MB) 237632(28MB) 260330(54MB) 260331(49MB) 240003(20MB) 260548(54MB) 260549(37MB) 227336(30MB) 251597(54MB) 262846(44MB) 243186(23MB) 246734(54MB) 255953(55MB) 235890(26MB) 249930(54MB) 261504(51MB) 240379(23MB) 253021(54MB) 262996(42MB) 243529(54MB) 256305(51MB) 233631(30MB) 279361(53MB) 279362(58MB) 279363(20MB) 259741(1707KB) 233286(2176KB) 202069(4914KB) 202167(17MB) 202168(9231KB) 202139(2187KB) 202245(31MB) 202311(18MB) 202393(17MB) 202391(24MB) 202459(9178KB) 202452(9244KB) 202441(7930KB) 245129(70MB) 245130(52MB) 218007(14MB) 202676(9175KB) 202686(17MB) 202685(8514KB) 202760(17MB) 202736(7883KB) 223811(29MB) 202810(8568KB) 202889(9177KB) 202907(9236KB) 202903(6654KB) 202990(9166KB) 202975(9236KB) 202985(26MB) 202974(1753KB) 278925(60MB) 278926(59MB) 278927(15MB) 277087(59MB) 277633(59MB) 277634(43MB) 277419(59MB) 280431(59MB) 280432(53MB) 278065(56MB) 278066(24MB) 278474(58MB) 278475(59MB)] 2024/11/23-21:07:12.536604 139957164807744 [top_zip_table.cc:59] core git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-21:07:12.536635 139957164807744 [top_zip_table.cc:60] fsa git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-21:07:12.536659 139957164807744 [top_zip_table.cc:61] zbs git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-21:07:12.536671 139957164807744 [top_zip_table.cc:62] topling-zip_table_reader: git_version_hash_info_is: commit a4a382006cb82713acf5b3425835f22711877681 Author: leipeng Date: 2024-04-11 19:44:14 +0800 fixed_len_hole_index.cc: Add env bool FixedLenHoleIndexUseAVX512 for ut & debug 1. FixedLenHoleIndexUseAVX512 is only in unit tests or debug 2. In release mode, use avx512 by compile options(-march=) g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/23-21:07:12.536676 139957164807744 [top_zip_table.cc:64] topling-rocks git_version_hash_info_is: commit feab587e468621ba0204d47b4ffacc52e7c4290d Author: leipeng Date: 2024-03-22 13:35:06 +0800 ToplingZipTableBuilder::Add: immediately return after error This function returns void, and caller does not check builder->status() after calling this function and graceful abandon. So immediately return after error, and return error status in Finish(). g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/23-21:07:13.556967 139957164807744 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280722.sst) /dev/shm/ToplingTemp/Topling-189103-4tJTZf 2024/11/23-21:07:14.710028 139957164807744 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280722.sst): first pass time = 1.15's, 232.815'MB/sec 2024/11/23-21:07:17.405720 139957164807744 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280722.sst): old prealloc_size = 295279001, real_size = 60208384 2024/11/23-21:07:17.406783 139957164807744 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280722.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 1843263 prefix = 4 raw-key = 0.0295 GB zip-key = 0.0035 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.2168 GB zip-val = 0.0562 GB avg-val = 117.63 avg-zval = 30.51 2024/11/23-21:07:17.409426 139957164807744 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280722.sst: sumWaitingMem = 0.005 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0048 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:07:19.231377 139957164807744 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280722.sst): second pass time = 2.69's, 80.720'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.83's, 37.450'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3359.726'MB/sec (index lex order gen) rebuild zvType time = 1.47's, 0.313'MB/sec write SST data time = 0.35's, 194.337'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 2.160'MB, throughput = 68837.295'MB/sec zip my value time = 2.69's, unzip length = 0.217'GB zip my value throughput = 80.720'MB/sec zip pipeline throughput = 80.720'MB/sec entries = 1843263 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.63 avg-zval = 30.51 usrkeys = 1843263 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.63 avg-zval = 30.51 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 1843263 bytes = 6451440 } seq expand size = 12902841 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0369 GB value = 0.2168 GB dict = 2.16 MB all = 0.2684 GB } __ZipSize{ index = 0.0035 GB value = 0.0562 GB dict = 2.16 MB all = 0.0684 GB } UnZip/Zip{ index = 10.5176 value = 3.8552 dict = 1.00 all = 3.9262 } Zip/UnZip{ index = 0.0951 value = 0.2594 dict = 1.00 all = 0.2547 } ---------------------------- total value len = 9.078347 GB avg = 0.167 KB (by entry num) total key len = 1.492432 GB avg = 0.028 KB total ukey len = 1.034743 GB avg = 0.015 KB total ukey num = 0.067393698 Billion total entry num = 0.054201427 Billion write speed all = 0.240644140 MB/sec (with seq num) write speed all = 0.230772962 MB/sec (without seq num) 2024/11/23-21:07:19.311427 139957164807744 [compaction_job.cc:1948] [default] [JOB 35807] Generated table #280722: 1843263 keys, 68369678 bytes, temperature: kWarm 2024/11/23-21:07:19.311525 139957164807744 EVENT_LOG_v1 {"time_micros": 1732367239311465, "cf_name": "default", "job": 35807, "event": "table_file_creation", "file_number": 280722, "file_size": 68369678, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4012777827, "largest_seqno": 4261173474, "table_properties": {"data_size": 56242288, "index_size": 3505088, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 51611364, "raw_average_key_size": 28, "raw_value_size": 216824094, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 1843263, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367233, "oldest_key_time": 0, "file_creation_time": 1732367233, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 280722, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:07:19.368002 139957164807744 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280723.sst) /dev/shm/ToplingTemp/Topling-189103-D3hHZf 2024/11/23-21:07:21.210716 139957164807744 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280723.sst): first pass time = 1.84's, 145.678'MB/sec 2024/11/23-21:07:23.710200 139957164807744 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280723.sst): old prealloc_size = 295279001, real_size = 58621328 2024/11/23-21:07:23.711303 139957164807744 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280723.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 1847468 prefix = 4 raw-key = 0.0296 GB zip-key = 0.0035 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.2167 GB zip-val = 0.0546 GB avg-val = 117.30 avg-zval = 29.58 2024/11/23-21:07:23.712839 139957164807744 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280723.sst: sumWaitingMem = 0.005 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0048 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:07:25.652493 139957164807744 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280723.sst): second pass time = 2.50's, 86.746'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.94's, 34.390'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3259.013'MB/sec (index lex order gen) rebuild zvType time = 1.64's, 0.282'MB/sec write SST data time = 0.30's, 222.030'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 2.159'MB, throughput = 56544.621'MB/sec zip my value time = 2.50's, unzip length = 0.217'GB zip my value throughput = 86.746'MB/sec zip pipeline throughput = 86.746'MB/sec entries = 1847468 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.30 avg-zval = 29.58 usrkeys = 1847468 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.30 avg-zval = 29.58 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 1847468 bytes = 6466160 } seq expand size = 12932276 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0369 GB value = 0.2167 GB dict = 2.16 MB all = 0.2684 GB } __ZipSize{ index = 0.0035 GB value = 0.0546 GB dict = 2.16 MB all = 0.0668 GB } UnZip/Zip{ index = 10.5188 value = 3.9656 dict = 1.00 all = 4.0188 } Zip/UnZip{ index = 0.0951 value = 0.2522 dict = 1.00 all = 0.2488 } ---------------------------- total value len = 9.307985 GB avg = 0.166 KB (by entry num) total key len = 1.544162 GB avg = 0.028 KB total ukey len = 1.071693 GB avg = 0.015 KB total ukey num = 0.069241166 Billion total entry num = 0.056048895 Billion write speed all = 0.247013379 MB/sec (with seq num) write speed all = 0.236807231 MB/sec (without seq num) 2024/11/23-21:07:25.742445 139957164807744 [compaction_job.cc:1948] [default] [JOB 35807] Generated table #280723: 1847468 keys, 66795376 bytes, temperature: kWarm 2024/11/23-21:07:25.742510 139957164807744 EVENT_LOG_v1 {"time_micros": 1732367245742475, "cf_name": "default", "job": 35807, "event": "table_file_creation", "file_number": 280723, "file_size": 66795376, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4012777845, "largest_seqno": 4261176400, "table_properties": {"data_size": 54646592, "index_size": 3512704, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 51729104, "raw_average_key_size": 28, "raw_value_size": 216706372, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 1847468, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367239, "oldest_key_time": 0, "file_creation_time": 1732367239, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 280723, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:07:25.800365 139957164807744 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280724.sst) /dev/shm/ToplingTemp/Topling-189103-UlNt0f 2024/11/23-21:07:27.676328 139957164807744 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280724.sst): first pass time = 1.88's, 143.094'MB/sec 2024/11/23-21:07:30.473551 139957164807744 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280724.sst): old prealloc_size = 295279001, real_size = 59066816 2024/11/23-21:07:30.474553 139957164807744 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280724.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 1842855 prefix = 4 raw-key = 0.0295 GB zip-key = 0.0035 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.2168 GB zip-val = 0.0551 GB avg-val = 117.66 avg-zval = 29.90 2024/11/23-21:07:30.476098 139957164807744 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280724.sst: sumWaitingMem = 0.005 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0048 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:07:32.237813 139957164807744 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280724.sst): second pass time = 2.80's, 77.559'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.76's, 38.105'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3558.119'MB/sec (index lex order gen) rebuild zvType time = 1.50's, 0.307'MB/sec write SST data time = 0.26's, 257.314'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 2.160'MB, throughput = 67117.442'MB/sec zip my value time = 2.80's, unzip length = 0.217'GB zip my value throughput = 77.559'MB/sec zip pipeline throughput = 77.559'MB/sec entries = 1842855 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.66 avg-zval = 29.90 usrkeys = 1842855 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.66 avg-zval = 29.90 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 1842855 bytes = 6450000 } seq expand size = 12899985 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0369 GB value = 0.2168 GB dict = 2.16 MB all = 0.2684 GB } __ZipSize{ index = 0.0035 GB value = 0.0551 GB dict = 2.16 MB all = 0.0672 GB } UnZip/Zip{ index = 10.5176 value = 3.9352 dict = 1.00 all = 3.9930 } Zip/UnZip{ index = 0.0951 value = 0.2541 dict = 1.00 all = 0.2504 } ---------------------------- total value len = 9.537721 GB avg = 0.165 KB (by entry num) total key len = 1.595761 GB avg = 0.028 KB total ukey len = 1.108550 GB avg = 0.016 KB total ukey num = 0.071084021 Billion total entry num = 0.057891750 Billion write speed all = 0.253379076 MB/sec (with seq num) write speed all = 0.242838936 MB/sec (without seq num) 2024/11/23-21:07:32.319356 139957164807744 [compaction_job.cc:1948] [default] [JOB 35807] Generated table #280724: 1842855 keys, 67226820 bytes, temperature: kWarm 2024/11/23-21:07:32.319427 139957164807744 EVENT_LOG_v1 {"time_micros": 1732367252319391, "cf_name": "default", "job": 35807, "event": "table_file_creation", "file_number": 280724, "file_size": 67226820, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4012777868, "largest_seqno": 4261175645, "table_properties": {"data_size": 55101616, "index_size": 3504320, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 51599940, "raw_average_key_size": 28, "raw_value_size": 216835610, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 1842855, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367245, "oldest_key_time": 0, "file_creation_time": 1732367245, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 280724, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:07:32.372877 139957164807744 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280725.sst) /dev/shm/ToplingTemp/Topling-189103-WEo5gi 2024/11/23-21:07:34.276590 139957164807744 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280725.sst): first pass time = 1.90's, 141.008'MB/sec 2024/11/23-21:07:36.943751 139957164807744 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280725.sst): old prealloc_size = 295279001, real_size = 60433136 2024/11/23-21:07:36.945074 139957164807744 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280725.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 1842919 prefix = 4 raw-key = 0.0295 GB zip-key = 0.0035 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.2168 GB zip-val = 0.0565 GB avg-val = 117.66 avg-zval = 30.64 2024/11/23-21:07:36.946665 139957164807744 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280725.sst: sumWaitingMem = 0.005 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0048 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:07:38.745896 139957164807744 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280725.sst): second pass time = 2.67's, 81.338'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.80's, 38.062'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2698.001'MB/sec (index lex order gen) rebuild zvType time = 1.50's, 0.307'MB/sec write SST data time = 0.30's, 228.686'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 2.160'MB, throughput = 69242.076'MB/sec zip my value time = 2.67's, unzip length = 0.217'GB zip my value throughput = 81.338'MB/sec zip pipeline throughput = 81.338'MB/sec entries = 1842919 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.66 avg-zval = 30.64 usrkeys = 1842919 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.66 avg-zval = 30.64 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 1842919 bytes = 6450224 } seq expand size = 12900433 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0369 GB value = 0.2168 GB dict = 2.16 MB all = 0.2684 GB } __ZipSize{ index = 0.0035 GB value = 0.0565 GB dict = 2.16 MB all = 0.0686 GB } UnZip/Zip{ index = 10.5180 value = 3.8399 dict = 1.00 all = 3.9134 } Zip/UnZip{ index = 0.0951 value = 0.2604 dict = 1.00 all = 0.2555 } ---------------------------- total value len = 9.767455 GB avg = 0.164 KB (by entry num) total key len = 1.647363 GB avg = 0.028 KB total ukey len = 1.145408 GB avg = 0.016 KB total ukey num = 0.072926940 Billion total entry num = 0.059734669 Billion write speed all = 0.259743330 MB/sec (with seq num) write speed all = 0.248869267 MB/sec (without seq num) 2024/11/23-21:07:38.827017 139957164807744 [compaction_job.cc:1948] [default] [JOB 35807] Generated table #280725: 1842919 keys, 68593464 bytes, temperature: kWarm 2024/11/23-21:07:38.827096 139957164807744 EVENT_LOG_v1 {"time_micros": 1732367258827061, "cf_name": "default", "job": 35807, "event": "table_file_creation", "file_number": 280725, "file_size": 68593464, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4012777888, "largest_seqno": 4261175236, "table_properties": {"data_size": 56467872, "index_size": 3504320, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 51601732, "raw_average_key_size": 28, "raw_value_size": 216833730, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 1842919, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367252, "oldest_key_time": 0, "file_creation_time": 1732367252, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 280725, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:07:38.881874 139957164807744 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280726.sst) /dev/shm/ToplingTemp/Topling-189103-Z1ndpf 2024/11/23-21:07:40.899305 139957164807744 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280726.sst): first pass time = 2.02's, 133.061'MB/sec 2024/11/23-21:07:43.573693 139957164807744 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280726.sst): old prealloc_size = 295279001, real_size = 60822048 2024/11/23-21:07:43.575076 139957164807744 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280726.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 1843110 prefix = 4 raw-key = 0.0295 GB zip-key = 0.0035 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.2168 GB zip-val = 0.0569 GB avg-val = 117.64 avg-zval = 30.85 2024/11/23-21:07:43.576695 139957164807744 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280726.sst: sumWaitingMem = 0.005 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0048 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:07:45.431618 139957164807744 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280726.sst): second pass time = 2.67's, 81.150'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.86's, 37.129'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2572.630'MB/sec (index lex order gen) rebuild zvType time = 1.38's, 0.333'MB/sec write SST data time = 0.47's, 145.302'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 2.160'MB, throughput = 79340.580'MB/sec zip my value time = 2.67's, unzip length = 0.217'GB zip my value throughput = 81.150'MB/sec zip pipeline throughput = 81.150'MB/sec entries = 1843110 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.64 avg-zval = 30.85 usrkeys = 1843110 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.64 avg-zval = 30.85 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 1843110 bytes = 6450896 } seq expand size = 12901770 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0369 GB value = 0.2168 GB dict = 2.16 MB all = 0.2684 GB } __ZipSize{ index = 0.0035 GB value = 0.0569 GB dict = 2.16 MB all = 0.0690 GB } UnZip/Zip{ index = 10.5198 value = 3.8136 dict = 1.00 all = 3.8913 } Zip/UnZip{ index = 0.0951 value = 0.2622 dict = 1.00 all = 0.2570 } ---------------------------- total value len = 9.997185 GB avg = 0.162 KB (by entry num) total key len = 1.698970 GB avg = 0.028 KB total ukey len = 1.182270 GB avg = 0.016 KB total ukey num = 0.074770050 Billion total entry num = 0.061577779 Billion write speed all = 0.266104655 MB/sec (with seq num) write speed all = 0.254896779 MB/sec (without seq num) 2024/11/23-21:07:45.518725 139957164807744 [compaction_job.cc:1948] [default] [JOB 35807] Generated table #280726: 1843110 keys, 68983054 bytes, temperature: kWarm 2024/11/23-21:07:45.518802 139957164807744 EVENT_LOG_v1 {"time_micros": 1732367265518761, "cf_name": "default", "job": 35807, "event": "table_file_creation", "file_number": 280726, "file_size": 68983054, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4012777899, "largest_seqno": 4261175848, "table_properties": {"data_size": 56857040, "index_size": 3504064, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 51607080, "raw_average_key_size": 28, "raw_value_size": 216828444, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 1843110, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367258, "oldest_key_time": 0, "file_creation_time": 1732367258, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 280726, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:07:45.573011 139957164807744 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280727.sst) /dev/shm/ToplingTemp/Topling-189103-SBMCei 2024/11/23-21:07:47.622218 139957164807744 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280727.sst): first pass time = 2.05's, 130.997'MB/sec 2024/11/23-21:07:50.199228 139957164807744 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280727.sst): old prealloc_size = 295279001, real_size = 60301344 2024/11/23-21:07:50.200576 139957164807744 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280727.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 1842949 prefix = 4 raw-key = 0.0295 GB zip-key = 0.0035 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.2168 GB zip-val = 0.0563 GB avg-val = 117.66 avg-zval = 30.56 2024/11/23-21:07:50.202218 139957164807744 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280727.sst: sumWaitingMem = 0.005 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0048 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:07:52.202579 139957164807744 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280727.sst): second pass time = 2.58's, 84.198'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 2.00's, 34.174'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2665.021'MB/sec (index lex order gen) rebuild zvType time = 1.57's, 0.293'MB/sec write SST data time = 0.43's, 158.538'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 2.160'MB, throughput = 68078.213'MB/sec zip my value time = 2.58's, unzip length = 0.217'GB zip my value throughput = 84.198'MB/sec zip pipeline throughput = 84.198'MB/sec entries = 1842949 avg-key = 28.00 avg-zkey = 1.91 avg-val = 117.66 avg-zval = 30.56 usrkeys = 1842949 avg-key = 20.00 avg-zkey = 1.91 avg-val = 124.66 avg-zval = 30.56 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 1842949 bytes = 6450336 } seq expand size = 12900643 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0369 GB value = 0.2168 GB dict = 2.16 MB all = 0.2684 GB } __ZipSize{ index = 0.0035 GB value = 0.0563 GB dict = 2.16 MB all = 0.0685 GB } UnZip/Zip{ index = 10.4493 value = 3.8505 dict = 1.00 all = 3.9210 } Zip/UnZip{ index = 0.0957 value = 0.2597 dict = 1.00 all = 0.2550 } ---------------------------- total value len = 10.226919 GB avg = 0.161 KB (by entry num) total key len = 1.750573 GB avg = 0.028 KB total ukey len = 1.219129 GB avg = 0.016 KB total ukey num = 0.076612999 Billion total entry num = 0.063420728 Billion write speed all = 0.272463492 MB/sec (with seq num) write speed all = 0.260921955 MB/sec (without seq num) 2024/11/23-21:07:52.281460 139957164807744 [compaction_job.cc:1948] [default] [JOB 35807] Generated table #280727: 1842949 keys, 68461788 bytes, temperature: kWarm 2024/11/23-21:07:52.281530 139957164807744 EVENT_LOG_v1 {"time_micros": 1732367272281493, "cf_name": "default", "job": 35807, "event": "table_file_creation", "file_number": 280727, "file_size": 68461788, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4012777911, "largest_seqno": 4261175963, "table_properties": {"data_size": 56312976, "index_size": 3527424, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 51602572, "raw_average_key_size": 28, "raw_value_size": 216832958, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 1842949, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367265, "oldest_key_time": 0, "file_creation_time": 1732367265, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 280727, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:07:52.337209 139957164807744 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280728.sst) /dev/shm/ToplingTemp/Topling-189103-QrhqIg 2024/11/23-21:07:54.311180 139957164807744 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280728.sst): first pass time = 1.97's, 135.990'MB/sec 2024/11/23-21:07:56.876965 139957164807744 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280728.sst): old prealloc_size = 295279001, real_size = 58710576 2024/11/23-21:07:56.878021 139957164807744 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280728.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 1847792 prefix = 4 raw-key = 0.0296 GB zip-key = 0.0035 GB avg-key = 16.00 avg-zkey = 1.89 raw-val = 0.2167 GB zip-val = 0.0548 GB avg-val = 117.27 avg-zval = 29.63 2024/11/23-21:07:56.879550 139957164807744 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280728.sst: sumWaitingMem = 0.005 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0049 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:07:58.686854 139957164807744 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280728.sst): second pass time = 2.56's, 84.496'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.81's, 37.024'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3420.682'MB/sec (index lex order gen) rebuild zvType time = 1.51's, 0.305'MB/sec write SST data time = 0.30's, 227.013'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 2.159'MB, throughput = 71268.029'MB/sec zip my value time = 2.56's, unzip length = 0.217'GB zip my value throughput = 84.496'MB/sec zip pipeline throughput = 94.340'MB/sec entries = 1847792 avg-key = 28.00 avg-zkey = 1.89 avg-val = 117.27 avg-zval = 29.63 usrkeys = 1847792 avg-key = 20.00 avg-zkey = 1.89 avg-val = 124.09 avg-zval = 29.63 TagRS{ kinds = RS_Key0_TagN bytes = 288800 } TagArray{ size = 1798309 bytes = 6294096 } seq expand size = 12588163 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0370 GB value = 0.2167 GB dict = 2.16 MB all = 0.2684 GB } __ZipSize{ index = 0.0035 GB value = 0.0548 GB dict = 2.16 MB all = 0.0670 GB } UnZip/Zip{ index = 10.5874 value = 3.9574 dict = 1.00 all = 4.0060 } Zip/UnZip{ index = 0.0945 value = 0.2527 dict = 1.00 all = 0.2496 } ---------------------------- total value len = 10.456205 GB avg = 0.160 KB (by entry num) total key len = 1.802311 GB avg = 0.028 KB total ukey len = 1.256085 GB avg = 0.016 KB total ukey num = 0.078460791 Billion total entry num = 0.065268520 Billion write speed all = 0.278815082 MB/sec (with seq num) write speed all = 0.266939029 MB/sec (without seq num) 2024/11/23-21:07:58.775927 139957164807744 [compaction_job.cc:1948] [default] [JOB 35807] Generated table #280728: 1847792 keys, 67008712 bytes, temperature: kWarm 2024/11/23-21:07:58.776030 139957164807744 EVENT_LOG_v1 {"time_micros": 1732367278775968, "cf_name": "default", "job": 35807, "event": "table_file_creation", "file_number": 280728, "file_size": 67008712, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4261176190, "table_properties": {"data_size": 54757856, "index_size": 3490560, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 51738176, "raw_average_key_size": 28, "raw_value_size": 216697408, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 1847792, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367272, "oldest_key_time": 0, "file_creation_time": 1732367272, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 280728, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:07:58.851929 139957164807744 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280729.sst) /dev/shm/ToplingTemp/Topling-189103-FsEGKf 2024/11/23-21:08:00.969835 139957164807744 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280729.sst): first pass time = 2.12's, 126.750'MB/sec 2024/11/23-21:08:03.974774 139957164807744 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280729.sst): old prealloc_size = 295279001, real_size = 72653632 2024/11/23-21:08:03.975853 139957164807744 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280729.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 1851601 prefix = 4 raw-key = 0.0296 GB zip-key = 0.0035 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.2166 GB zip-val = 0.0687 GB avg-val = 116.97 avg-zval = 37.09 2024/11/23-21:08:03.976351 139957164807744 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280729.sst: sumWaitingMem = 0.005 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0049 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:08:05.403576 139957164807744 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280729.sst): second pass time = 3.00's, 72.110'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.43's, 52.990'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3385.817'MB/sec (index lex order gen) rebuild zvType time = 1.18's, 0.392'MB/sec write SST data time = 0.25's, 305.566'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 2.158'MB, throughput = 60642.223'MB/sec zip my value time = 3.00's, unzip length = 0.217'GB zip my value throughput = 72.110'MB/sec zip pipeline throughput = 72.110'MB/sec entries = 1851601 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.97 avg-zval = 37.09 usrkeys = 1851601 avg-key = 20.00 avg-zkey = 1.90 avg-val = 118.04 avg-zval = 37.09 TagRS{ kinds = RS_Key0_TagN bytes = 289400 } TagArray{ size = 281154 bytes = 1054336 } seq expand size = 1968078 multi value expand size = 0 cnt WriteAppend = 16 UnZipSize{ index = 0.0370 GB value = 0.2166 GB dict = 2.16 MB all = 0.2684 GB } __ZipSize{ index = 0.0035 GB value = 0.0687 GB dict = 2.16 MB all = 0.0757 GB } UnZip/Zip{ index = 10.5168 value = 3.1541 dict = 1.00 all = 3.5455 } Zip/UnZip{ index = 0.0951 value = 0.3170 dict = 1.00 all = 0.2820 } ---------------------------- total value len = 10.674763 GB avg = 0.159 KB (by entry num) total key len = 1.854156 GB avg = 0.028 KB total ukey len = 1.293117 GB avg = 0.016 KB total ukey num = 0.080312392 Billion total entry num = 0.067120121 Billion write speed all = 0.284921777 MB/sec (with seq num) write speed all = 0.272710678 MB/sec (without seq num) 2024/11/23-21:08:05.490063 139957164807744 [compaction_job.cc:1948] [default] [JOB 35807] Generated table #280729: 1851601 keys, 75710779 bytes, temperature: kWarm 2024/11/23-21:08:05.490142 139957164807744 EVENT_LOG_v1 {"time_micros": 1732367285490103, "cf_name": "default", "job": 35807, "event": "table_file_creation", "file_number": 280729, "file_size": 75710779, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3955935659, "table_properties": {"data_size": 68669360, "index_size": 3521216, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 51844828, "raw_average_key_size": 28, "raw_value_size": 216590674, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 1851601, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367278, "oldest_key_time": 0, "file_creation_time": 1732367278, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 280729, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:08:05.541833 139957164807744 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280730.sst) /dev/shm/ToplingTemp/Topling-189103-BOqGhj 2024/11/23-21:08:07.388806 139957164807744 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280730.sst): first pass time = 1.85's, 145.341'MB/sec 2024/11/23-21:08:09.734616 139957164807744 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280730.sst): old prealloc_size = 295279001, real_size = 60539680 2024/11/23-21:08:09.735617 139957164807744 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280730.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 1862415 prefix = 4 raw-key = 0.0298 GB zip-key = 0.0035 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.2163 GB zip-val = 0.0565 GB avg-val = 116.13 avg-zval = 30.35 2024/11/23-21:08:09.738555 139957164807744 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280730.sst: sumWaitingMem = 0.005 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0049 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:08:11.372340 139957164807744 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280730.sst): second pass time = 2.34's, 92.252'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.64's, 42.127'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3626.158'MB/sec (index lex order gen) rebuild zvType time = 1.38's, 0.337'MB/sec write SST data time = 0.26's, 268.728'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 2.156'MB, throughput = 64899.145'MB/sec zip my value time = 2.34's, unzip length = 0.216'GB zip my value throughput = 92.252'MB/sec zip pipeline throughput = 92.252'MB/sec entries = 1862415 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.13 avg-zval = 30.35 usrkeys = 1862415 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.13 avg-zval = 30.35 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 1862415 bytes = 6751264 } seq expand size = 13036905 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0372 GB value = 0.2163 GB dict = 2.16 MB all = 0.2684 GB } __ZipSize{ index = 0.0035 GB value = 0.0565 GB dict = 2.16 MB all = 0.0690 GB } UnZip/Zip{ index = 10.5184 value = 3.8259 dict = 1.00 all = 3.8908 } Zip/UnZip{ index = 0.0951 value = 0.2614 dict = 1.00 all = 0.2570 } ---------------------------- total value len = 10.904088 GB avg = 0.158 KB (by entry num) total key len = 1.906303 GB avg = 0.028 KB total ukey len = 1.330365 GB avg = 0.016 KB total ukey num = 0.082174807 Billion total entry num = 0.068982536 Billion write speed all = 0.291283239 MB/sec (with seq num) write speed all = 0.278735016 MB/sec (without seq num) 2024/11/23-21:08:11.451793 139957164807744 [compaction_job.cc:1948] [default] [JOB 35807] Generated table #280730: 1862415 keys, 68991484 bytes, temperature: kWarm 2024/11/23-21:08:11.451868 139957164807744 EVENT_LOG_v1 {"time_micros": 1732367291451830, "cf_name": "default", "job": 35807, "event": "table_file_creation", "file_number": 280730, "file_size": 68991484, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3509327862, "largest_seqno": 4012776072, "table_properties": {"data_size": 56532624, "index_size": 3541248, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 52147620, "raw_average_key_size": 28, "raw_value_size": 216287842, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 1862415, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367285, "oldest_key_time": 0, "file_creation_time": 1732367285, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 280730, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:08:11.502460 139957164807744 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280731.sst) /dev/shm/ToplingTemp/Topling-189103-Bopoij 2024/11/23-21:08:13.339542 139957164807744 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280731.sst): first pass time = 1.84's, 146.123'MB/sec 2024/11/23-21:08:15.683857 139957164807744 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280731.sst): old prealloc_size = 295279001, real_size = 62654928 2024/11/23-21:08:15.684895 139957164807744 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280731.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 1852312 prefix = 4 raw-key = 0.0296 GB zip-key = 0.0035 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.2166 GB zip-val = 0.0586 GB avg-val = 116.92 avg-zval = 31.66 2024/11/23-21:08:15.687098 139957164807744 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280731.sst: sumWaitingMem = 0.005 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0049 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:08:17.326485 139957164807744 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280731.sst): second pass time = 2.34's, 92.431'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.64's, 42.657'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3491.451'MB/sec (index lex order gen) rebuild zvType time = 1.38's, 0.335'MB/sec write SST data time = 0.26's, 271.654'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 2.159'MB, throughput = 63223.416'MB/sec zip my value time = 2.34's, unzip length = 0.217'GB zip my value throughput = 92.431'MB/sec zip pipeline throughput = 92.431'MB/sec entries = 1852312 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.92 avg-zval = 31.66 usrkeys = 1852312 avg-key = 20.00 avg-zkey = 1.91 avg-val = 122.57 avg-zval = 31.66 TagRS{ kinds = RS_Key0_TagN bytes = 289520 } TagArray{ size = 1494463 bytes = 5417440 } seq expand size = 10461241 multi value expand size = 0 cnt WriteAppend = 17 UnZipSize{ index = 0.0370 GB value = 0.2166 GB dict = 2.16 MB all = 0.2684 GB } __ZipSize{ index = 0.0035 GB value = 0.0586 GB dict = 2.16 MB all = 0.0701 GB } UnZip/Zip{ index = 10.4496 value = 3.6928 dict = 1.00 all = 3.8311 } Zip/UnZip{ index = 0.0957 value = 0.2708 dict = 1.00 all = 0.2610 } ---------------------------- total value len = 11.131120 GB avg = 0.157 KB (by entry num) total key len = 1.958168 GB avg = 0.028 KB total ukey len = 1.367412 GB avg = 0.016 KB total ukey num = 0.084027119 Billion total entry num = 0.070834848 Billion write speed all = 0.297584517 MB/sec (with seq num) write speed all = 0.284701095 MB/sec (without seq num) 2024/11/23-21:08:17.405671 139957164807744 [compaction_job.cc:1948] [default] [JOB 35807] Generated table #280731: 1852312 keys, 70068028 bytes, temperature: kWarm 2024/11/23-21:08:17.405743 139957164807744 EVENT_LOG_v1 {"time_micros": 1732367297405706, "cf_name": "default", "job": 35807, "event": "table_file_creation", "file_number": 280731, "file_size": 70068028, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4012776108, "table_properties": {"data_size": 58646464, "index_size": 3545216, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 51864736, "raw_average_key_size": 28, "raw_value_size": 216570780, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 1852312, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367291, "oldest_key_time": 0, "file_creation_time": 1732367291, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 280731, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:08:17.464915 139957164807744 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280732.sst) /dev/shm/ToplingTemp/Topling-189103-9b69zh 2024/11/23-21:08:19.279661 139957164807744 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280732.sst): first pass time = 1.81's, 147.922'MB/sec 2024/11/23-21:08:21.631918 139957164807744 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280732.sst): old prealloc_size = 295279001, real_size = 59866336 2024/11/23-21:08:21.632946 139957164807744 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280732.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 1862993 prefix = 4 raw-key = 0.0298 GB zip-key = 0.0036 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.2163 GB zip-val = 0.0558 GB avg-val = 116.09 avg-zval = 29.97 2024/11/23-21:08:21.635473 139957164807744 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280732.sst: sumWaitingMem = 0.005 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0049 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:08:23.229492 139957164807744 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280732.sst): second pass time = 2.35's, 91.989'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.60's, 42.514'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3552.268'MB/sec (index lex order gen) rebuild zvType time = 1.34's, 0.348'MB/sec write SST data time = 0.26's, 263.215'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 2.155'MB, throughput = 53645.185'MB/sec zip my value time = 2.35's, unzip length = 0.216'GB zip my value throughput = 91.989'MB/sec zip pipeline throughput = 91.989'MB/sec entries = 1862993 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.09 avg-zval = 29.97 usrkeys = 1862993 avg-key = 20.00 avg-zkey = 1.91 avg-val = 122.16 avg-zval = 29.97 TagRS{ kinds = RS_Key0_TagN bytes = 291200 } TagArray{ size = 1616412 bytes = 6061552 } seq expand size = 11314884 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0373 GB value = 0.2163 GB dict = 2.16 MB all = 0.2684 GB } __ZipSize{ index = 0.0036 GB value = 0.0558 GB dict = 2.16 MB all = 0.0679 GB } UnZip/Zip{ index = 10.4507 value = 3.8734 dict = 1.00 all = 3.9523 } Zip/UnZip{ index = 0.0957 value = 0.2582 dict = 1.00 all = 0.2530 } ---------------------------- total value len = 11.358707 GB avg = 0.156 KB (by entry num) total key len = 2.010332 GB avg = 0.028 KB total ukey len = 1.404672 GB avg = 0.016 KB total ukey num = 0.085890112 Billion total entry num = 0.072697841 Billion write speed all = 0.303903847 MB/sec (with seq num) write speed all = 0.290683357 MB/sec (without seq num) 2024/11/23-21:08:23.306850 139957164807744 [compaction_job.cc:1948] [default] [JOB 35807] Generated table #280732: 1862993 keys, 67918882 bytes, temperature: kWarm 2024/11/23-21:08:23.306921 139957164807744 EVENT_LOG_v1 {"time_micros": 1732367303306883, "cf_name": "default", "job": 35807, "event": "table_file_creation", "file_number": 280732, "file_size": 67918882, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4012776133, "table_properties": {"data_size": 55835088, "index_size": 3565312, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 52163804, "raw_average_key_size": 28, "raw_value_size": 216271662, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 1862993, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367297, "oldest_key_time": 0, "file_creation_time": 1732367297, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 280732, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:08:23.365626 139957164807744 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280733.sst) /dev/shm/ToplingTemp/Topling-189103-1a7stf 2024/11/23-21:08:25.071678 139957164807744 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280733.sst): first pass time = 1.71's, 157.347'MB/sec 2024/11/23-21:08:27.452497 139957164807744 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280733.sst): old prealloc_size = 295279001, real_size = 62003648 2024/11/23-21:08:27.453535 139957164807744 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280733.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 1859694 prefix = 4 raw-key = 0.0298 GB zip-key = 0.0036 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.2164 GB zip-val = 0.0580 GB avg-val = 116.34 avg-zval = 31.18 2024/11/23-21:08:27.455850 139957164807744 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280733.sst: sumWaitingMem = 0.005 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0049 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:08:29.137293 139957164807744 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280733.sst): second pass time = 2.38's, 90.928'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.68's, 41.337'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3514.704'MB/sec (index lex order gen) rebuild zvType time = 1.42's, 0.327'MB/sec write SST data time = 0.26's, 266.229'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 2.158'MB, throughput = 61553.692'MB/sec zip my value time = 2.38's, unzip length = 0.216'GB zip my value throughput = 90.928'MB/sec zip pipeline throughput = 90.928'MB/sec entries = 1859694 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.34 avg-zval = 31.18 usrkeys = 1859694 avg-key = 20.00 avg-zkey = 1.91 avg-val = 122.21 avg-zval = 31.18 TagRS{ kinds = RS_Key0_TagN bytes = 290680 } TagArray{ size = 1557463 bytes = 5645824 } seq expand size = 10902241 multi value expand size = 0 cnt WriteAppend = 17 UnZipSize{ index = 0.0372 GB value = 0.2164 GB dict = 2.16 MB all = 0.2684 GB } __ZipSize{ index = 0.0036 GB value = 0.0580 GB dict = 2.16 MB all = 0.0696 GB } UnZip/Zip{ index = 10.4492 value = 3.7318 dict = 1.00 all = 3.8544 } Zip/UnZip{ index = 0.0957 value = 0.2680 dict = 1.00 all = 0.2594 } ---------------------------- total value len = 11.585973 GB avg = 0.155 KB (by entry num) total key len = 2.062403 GB avg = 0.028 KB total ukey len = 1.441865 GB avg = 0.016 KB total ukey num = 0.087749806 Billion total entry num = 0.074557535 Billion write speed all = 0.310212068 MB/sec (with seq num) write speed all = 0.296655204 MB/sec (without seq num) 2024/11/23-21:08:29.220559 139957164807744 [compaction_job.cc:1948] [default] [JOB 35807] Generated table #280733: 1859694 keys, 69643294 bytes, temperature: kWarm 2024/11/23-21:08:29.220628 139957164807744 EVENT_LOG_v1 {"time_micros": 1732367309220593, "cf_name": "default", "job": 35807, "event": "table_file_creation", "file_number": 280733, "file_size": 69643294, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4012776165, "table_properties": {"data_size": 57979056, "index_size": 3559488, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 52071432, "raw_average_key_size": 28, "raw_value_size": 216364052, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 1859694, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367303, "oldest_key_time": 0, "file_creation_time": 1732367303, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 280733, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:08:29.273931 139957164807744 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280734.sst) /dev/shm/ToplingTemp/Topling-189103-W6LLBg 2024/11/23-21:08:31.221196 139957164807744 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280734.sst): first pass time = 1.95's, 137.855'MB/sec 2024/11/23-21:08:33.745322 139957164807744 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280734.sst): old prealloc_size = 295279001, real_size = 63733072 2024/11/23-21:08:33.746466 139957164807744 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280734.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 2016552 prefix = 4 raw-key = 0.0323 GB zip-key = 0.0039 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.2120 GB zip-val = 0.0594 GB avg-val = 105.12 avg-zval = 29.44 2024/11/23-21:08:33.747508 139957164807744 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280734.sst: sumWaitingMem = 0.005 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0053 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:08:35.295840 139957164807744 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280734.sst): second pass time = 2.52's, 84.018'MB/sec, value only(79.0% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.55's, 44.909'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3434.755'MB/sec (index lex order gen) rebuild zvType time = 1.28's, 0.394'MB/sec write SST data time = 0.27's, 257.174'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 2.116'MB, throughput = 59029.967'MB/sec zip my value time = 2.52's, unzip length = 0.212'GB zip my value throughput = 84.018'MB/sec zip pipeline throughput = 84.018'MB/sec entries = 2016552 avg-key = 28.00 avg-zkey = 1.91 avg-val = 105.12 avg-zval = 29.44 usrkeys = 2016552 avg-key = 20.00 avg-zkey = 1.91 avg-val = 109.04 avg-zval = 29.44 TagRS{ kinds = RS_Key0_TagN bytes = 315200 } TagArray{ size = 1129342 bytes = 3952704 } seq expand size = 7905394 multi value expand size = 0 cnt WriteAppend = 18 UnZipSize{ index = 0.0403 GB value = 0.2120 GB dict = 2.12 MB all = 0.2684 GB } __ZipSize{ index = 0.0039 GB value = 0.0594 GB dict = 2.12 MB all = 0.0696 GB } UnZip/Zip{ index = 10.4503 value = 3.5704 dict = 1.00 all = 3.8551 } Zip/UnZip{ index = 0.0957 value = 0.2801 dict = 1.00 all = 0.2594 } ---------------------------- total value len = 11.805850 GB avg = 0.154 KB (by entry num) total key len = 2.118867 GB avg = 0.028 KB total ukey len = 1.482196 GB avg = 0.017 KB total ukey num = 0.089766358 Billion total entry num = 0.076574087 Billion write speed all = 0.316448688 MB/sec (with seq num) write speed all = 0.302527102 MB/sec (without seq num) 2024/11/23-21:08:35.409820 139957164807744 [compaction_job.cc:1948] [default] [JOB 35807] Generated table #280734: 2016552 keys, 69631753 bytes, temperature: kWarm 2024/11/23-21:08:35.409889 139957164807744 EVENT_LOG_v1 {"time_micros": 1732367315409853, "cf_name": "default", "job": 35807, "event": "table_file_creation", "file_number": 280734, "file_size": 69631753, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4012776192, "table_properties": {"data_size": 59369408, "index_size": 3859328, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 56463456, "raw_average_key_size": 28, "raw_value_size": 211972121, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 2016552, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367309, "oldest_key_time": 0, "file_creation_time": 1732367309, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 280734, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:08:35.462822 139957164807744 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280735.sst) /dev/shm/ToplingTemp/Topling-189103-YJ6fNi 2024/11/23-21:08:37.232955 139957164807744 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280735.sst): first pass time = 1.77's, 151.650'MB/sec 2024/11/23-21:08:40.070343 139957164807744 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280735.sst): old prealloc_size = 295279001, real_size = 66750240 2024/11/23-21:08:40.071449 139957164807744 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280735.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 1854188 prefix = 4 raw-key = 0.0297 GB zip-key = 0.0035 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.2165 GB zip-val = 0.0627 GB avg-val = 116.77 avg-zval = 33.84 2024/11/23-21:08:40.072385 139957164807744 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280735.sst: sumWaitingMem = 0.005 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0049 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:08:41.591482 139957164807744 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280735.sst): second pass time = 2.84's, 76.345'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.52's, 47.521'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3283.679'MB/sec (index lex order gen) rebuild zvType time = 1.27's, 0.366'MB/sec write SST data time = 0.25's, 284.907'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 2.158'MB, throughput = 70603.880'MB/sec zip my value time = 2.84's, unzip length = 0.217'GB zip my value throughput = 76.345'MB/sec zip pipeline throughput = 76.345'MB/sec entries = 1854188 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.77 avg-zval = 33.84 usrkeys = 1854188 avg-key = 20.00 avg-zkey = 1.91 avg-val = 120.33 avg-zval = 33.84 TagRS{ kinds = RS_Key0_TagN bytes = 289800 } TagArray{ size = 941725 bytes = 3531488 } seq expand size = 6592075 multi value expand size = 0 cnt WriteAppend = 15 UnZipSize{ index = 0.0371 GB value = 0.2165 GB dict = 2.16 MB all = 0.2684 GB } __ZipSize{ index = 0.0035 GB value = 0.0627 GB dict = 2.16 MB all = 0.0723 GB } UnZip/Zip{ index = 10.4508 value = 3.4511 dict = 1.00 all = 3.7136 } Zip/UnZip{ index = 0.0957 value = 0.2898 dict = 1.00 all = 0.2693 } ---------------------------- total value len = 12.028961 GB avg = 0.153 KB (by entry num) total key len = 2.170784 GB avg = 0.028 KB total ukey len = 1.519280 GB avg = 0.017 KB total ukey num = 0.091620546 Billion total entry num = 0.078428275 Billion write speed all = 0.322652715 MB/sec (with seq num) write speed all = 0.308396067 MB/sec (without seq num) 2024/11/23-21:08:41.674649 139957164807744 [compaction_job.cc:1948] [default] [JOB 35807] Generated table #280735: 1854188 keys, 72284132 bytes, temperature: kWarm 2024/11/23-21:08:41.674721 139957164807744 EVENT_LOG_v1 {"time_micros": 1732367321674684, "cf_name": "default", "job": 35807, "event": "table_file_creation", "file_number": 280735, "file_size": 72284132, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4012775885, "table_properties": {"data_size": 62738064, "index_size": 3548416, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 51917264, "raw_average_key_size": 28, "raw_value_size": 216518260, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 1854188, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367315, "oldest_key_time": 0, "file_creation_time": 1732367315, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 280735, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:08:41.731263 139957164807744 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280736.sst) /dev/shm/ToplingTemp/Topling-189103-JCAWli 2024/11/23-21:08:43.562454 139957164807744 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280736.sst): first pass time = 1.83's, 146.594'MB/sec 2024/11/23-21:08:45.928937 139957164807744 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280736.sst): old prealloc_size = 295279001, real_size = 62262208 2024/11/23-21:08:45.930013 139957164807744 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280736.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 1856762 prefix = 4 raw-key = 0.0297 GB zip-key = 0.0035 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.2164 GB zip-val = 0.0583 GB avg-val = 116.57 avg-zval = 31.38 2024/11/23-21:08:45.932989 139957164807744 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280736.sst: sumWaitingMem = 0.005 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0049 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:08:47.566109 139957164807744 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280736.sst): second pass time = 2.37's, 91.514'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.64's, 43.183'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3429.082'MB/sec (index lex order gen) rebuild zvType time = 1.38's, 0.337'MB/sec write SST data time = 0.26's, 273.596'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 2.158'MB, throughput = 67215.427'MB/sec zip my value time = 2.37's, unzip length = 0.216'GB zip my value throughput = 91.514'MB/sec zip pipeline throughput = 91.514'MB/sec entries = 1856762 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.57 avg-zval = 31.38 usrkeys = 1856762 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.57 avg-zval = 31.38 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 1856762 bytes = 6730784 } seq expand size = 12997334 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0371 GB value = 0.2164 GB dict = 2.16 MB all = 0.2684 GB } __ZipSize{ index = 0.0035 GB value = 0.0583 GB dict = 2.16 MB all = 0.0707 GB } UnZip/Zip{ index = 10.5180 value = 3.7147 dict = 1.00 all = 3.7970 } Zip/UnZip{ index = 0.0951 value = 0.2692 dict = 1.00 all = 0.2634 } ---------------------------- total value len = 12.258404 GB avg = 0.153 KB (by entry num) total key len = 2.222774 GB avg = 0.028 KB total ukey len = 1.556415 GB avg = 0.017 KB total ukey num = 0.093477308 Billion total entry num = 0.080285037 Billion write speed all = 0.329002889 MB/sec (with seq num) write speed all = 0.314410700 MB/sec (without seq num) 2024/11/23-21:08:47.646246 139957164807744 [compaction_job.cc:1948] [default] [JOB 35807] Generated table #280736: 1856762 keys, 70696830 bytes, temperature: kWarm 2024/11/23-21:08:47.646317 139957164807744 EVENT_LOG_v1 {"time_micros": 1732367327646281, "cf_name": "default", "job": 35807, "event": "table_file_creation", "file_number": 280736, "file_size": 70696830, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3487497056, "largest_seqno": 4012775935, "table_properties": {"data_size": 58267184, "index_size": 3530624, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 51989336, "raw_average_key_size": 28, "raw_value_size": 216446188, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 1856762, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367321, "oldest_key_time": 0, "file_creation_time": 1732367321, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 280736, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:08:47.700322 139957164807744 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280737.sst) /dev/shm/ToplingTemp/Topling-189103-Luifbh 2024/11/23-21:08:49.964940 139957164807744 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280737.sst): first pass time = 2.26's, 118.537'MB/sec 2024/11/23-21:08:52.373896 139957164807744 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280737.sst): old prealloc_size = 295279001, real_size = 63443968 2024/11/23-21:08:52.375048 139957164807744 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280737.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 1856031 prefix = 4 raw-key = 0.0297 GB zip-key = 0.0036 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.2165 GB zip-val = 0.0594 GB avg-val = 116.63 avg-zval = 32.02 2024/11/23-21:08:52.375990 139957164807744 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280737.sst: sumWaitingMem = 0.005 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0049 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:08:53.981095 139957164807744 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280737.sst): second pass time = 2.41's, 89.910'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.61's, 42.863'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3149.806'MB/sec (index lex order gen) rebuild zvType time = 1.35's, 0.344'MB/sec write SST data time = 0.26's, 267.795'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 2.157'MB, throughput = 63406.630'MB/sec zip my value time = 2.41's, unzip length = 0.216'GB zip my value throughput = 89.910'MB/sec zip pipeline throughput = 89.910'MB/sec entries = 1856031 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.63 avg-zval = 32.02 usrkeys = 1856031 avg-key = 20.00 avg-zkey = 1.91 avg-val = 120.22 avg-zval = 32.02 TagRS{ kinds = RS_Key0_TagN bytes = 290120 } TagArray{ size = 951670 bytes = 3449824 } seq expand size = 6661690 multi value expand size = 0 cnt WriteAppend = 16 UnZipSize{ index = 0.0371 GB value = 0.2165 GB dict = 2.16 MB all = 0.2684 GB } __ZipSize{ index = 0.0036 GB value = 0.0594 GB dict = 2.16 MB all = 0.0689 GB } UnZip/Zip{ index = 10.4486 value = 3.6426 dict = 1.00 all = 3.8967 } Zip/UnZip{ index = 0.0957 value = 0.2745 dict = 1.00 all = 0.2566 } ---------------------------- total value len = 12.481533 GB avg = 0.152 KB (by entry num) total key len = 2.274742 GB avg = 0.028 KB total ukey len = 1.593536 GB avg = 0.017 KB total ukey num = 0.095333339 Billion total entry num = 0.082141068 Billion write speed all = 0.335204063 MB/sec (with seq num) write speed all = 0.320276708 MB/sec (without seq num) 2024/11/23-21:08:54.060746 139957164807744 [compaction_job.cc:1948] [default] [JOB 35807] Generated table #280737: 1856031 keys, 68887860 bytes, temperature: kWarm 2024/11/23-21:08:54.060816 139957164807744 EVENT_LOG_v1 {"time_micros": 1732367334060780, "cf_name": "default", "job": 35807, "event": "table_file_creation", "file_number": 280737, "file_size": 68887860, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4012775967, "table_properties": {"data_size": 59427056, "index_size": 3552704, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 51968868, "raw_average_key_size": 28, "raw_value_size": 216466630, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 1856031, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367327, "oldest_key_time": 0, "file_creation_time": 1732367327, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 280737, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:08:54.113464 139957164807744 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280738.sst) /dev/shm/ToplingTemp/Topling-189103-jRRI6i 2024/11/23-21:08:55.277427 139957164807744 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280738.sst): first pass time = 1.16's, 230.628'MB/sec 2024/11/23-21:08:57.572940 139957164807744 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280738.sst): old prealloc_size = 295279001, real_size = 57790944 2024/11/23-21:08:57.573973 139957164807744 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280738.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 1840598 prefix = 4 raw-key = 0.0294 GB zip-key = 0.0035 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.2169 GB zip-val = 0.0538 GB avg-val = 117.84 avg-zval = 29.23 2024/11/23-21:08:57.574452 139957164807744 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280738.sst: sumWaitingMem = 0.005 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0048 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:08:59.143161 139957164807744 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280738.sst): second pass time = 2.29's, 94.540'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.57's, 38.899'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3533.366'MB/sec (index lex order gen) rebuild zvType time = 1.32's, 0.350'MB/sec write SST data time = 0.25's, 241.286'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 2.161'MB, throughput = 67705.317'MB/sec zip my value time = 2.29's, unzip length = 0.217'GB zip my value throughput = 94.540'MB/sec zip pipeline throughput = 94.540'MB/sec entries = 1840598 avg-key = 28.00 avg-zkey = 1.91 avg-val = 117.84 avg-zval = 29.23 usrkeys = 1840598 avg-key = 20.00 avg-zkey = 1.91 avg-val = 119.15 avg-zval = 29.23 TagRS{ kinds = RS_Key0_TagN bytes = 287680 } TagArray{ size = 343557 bytes = 1288352 } seq expand size = 2404899 multi value expand size = 0 cnt WriteAppend = 15 UnZipSize{ index = 0.0368 GB value = 0.2169 GB dict = 2.16 MB all = 0.2684 GB } __ZipSize{ index = 0.0035 GB value = 0.0538 GB dict = 2.16 MB all = 0.0611 GB } UnZip/Zip{ index = 10.4498 value = 4.0310 dict = 1.00 all = 4.3949 } Zip/UnZip{ index = 0.0957 value = 0.2481 dict = 1.00 all = 0.2275 } ---------------------------- total value len = 12.700836 GB avg = 0.151 KB (by entry num) total key len = 2.326279 GB avg = 0.028 KB total ukey len = 1.630348 GB avg = 0.017 KB total ukey num = 0.097173937 Billion total entry num = 0.083981666 Billion write speed all = 0.341316461 MB/sec (with seq num) write speed all = 0.326056406 MB/sec (without seq num) 2024/11/23-21:08:59.221634 139957164807744 [compaction_job.cc:1948] [default] [JOB 35807] Generated table #280738: 1840598 keys, 61078351 bytes, temperature: kWarm 2024/11/23-21:08:59.221702 139957164807744 EVENT_LOG_v1 {"time_micros": 1732367339221667, "cf_name": "default", "job": 35807, "event": "table_file_creation", "file_number": 280738, "file_size": 61078351, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4012775229, "table_properties": {"data_size": 53807888, "index_size": 3522752, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 51536744, "raw_average_key_size": 28, "raw_value_size": 216898820, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 1840598, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367334, "oldest_key_time": 0, "file_creation_time": 1732367334, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 280738, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:08:59.280761 139957164807744 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280739.sst) /dev/shm/ToplingTemp/Topling-189103-GhRxvh 2024/11/23-21:09:00.898560 139957164807744 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280739.sst): first pass time = 1.62's, 165.930'MB/sec 2024/11/23-21:09:04.028829 139957164807744 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280739.sst): old prealloc_size = 295279001, real_size = 72535536 2024/11/23-21:09:04.029879 139957164807744 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280739.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 1854195 prefix = 4 raw-key = 0.0297 GB zip-key = 0.0035 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.2165 GB zip-val = 0.0685 GB avg-val = 116.77 avg-zval = 36.96 2024/11/23-21:09:04.030208 139957164807744 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280739.sst: sumWaitingMem = 0.005 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0049 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:09:05.445387 139957164807744 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280739.sst): second pass time = 3.13's, 69.197'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.42's, 52.928'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3451.638'MB/sec (index lex order gen) rebuild zvType time = 1.16's, 0.398'MB/sec write SST data time = 0.25's, 298.814'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 2.158'MB, throughput = 66492.744'MB/sec zip my value time = 3.13's, unzip length = 0.217'GB zip my value throughput = 69.197'MB/sec zip pipeline throughput = 69.197'MB/sec entries = 1854195 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.77 avg-zval = 36.96 usrkeys = 1854195 avg-key = 20.00 avg-zkey = 1.91 avg-val = 117.23 avg-zval = 36.96 TagRS{ kinds = RS_Key0_TagN bytes = 289800 } TagArray{ size = 120479 bytes = 436752 } seq expand size = 843353 multi value expand size = 0 cnt WriteAppend = 15 UnZipSize{ index = 0.0371 GB value = 0.2165 GB dict = 2.16 MB all = 0.2684 GB } __ZipSize{ index = 0.0035 GB value = 0.0685 GB dict = 2.16 MB all = 0.0750 GB } UnZip/Zip{ index = 10.4474 value = 3.1598 dict = 1.00 all = 3.5804 } Zip/UnZip{ index = 0.0957 value = 0.3165 dict = 1.00 all = 0.2793 } ---------------------------- total value len = 12.918198 GB avg = 0.150 KB (by entry num) total key len = 2.378197 GB avg = 0.028 KB total ukey len = 1.667432 GB avg = 0.017 KB total ukey num = 0.099028132 Billion total entry num = 0.085835861 Billion write speed all = 0.347382965 MB/sec (with seq num) write speed all = 0.331788223 MB/sec (without seq num) 2024/11/23-21:09:05.535779 139957164807744 [compaction_job.cc:1948] [default] [JOB 35807] Generated table #280739: 1854195 keys, 74974551 bytes, temperature: kWarm 2024/11/23-21:09:05.535848 139957164807744 EVENT_LOG_v1 {"time_micros": 1732367345535813, "cf_name": "default", "job": 35807, "event": "table_file_creation", "file_number": 280739, "file_size": 74974551, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4012772693, "table_properties": {"data_size": 68522208, "index_size": 3549568, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 51917460, "raw_average_key_size": 28, "raw_value_size": 216518018, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 1854195, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367339, "oldest_key_time": 0, "file_creation_time": 1732367339, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 280739, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:09:05.589727 139957164807744 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280740.sst) /dev/shm/ToplingTemp/Topling-189103-bowMSj 2024/11/23-21:09:07.897962 139957164807744 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280740.sst): first pass time = 2.31's, 116.297'MB/sec 2024/11/23-21:09:11.099263 139957164807744 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280740.sst): old prealloc_size = 295279001, real_size = 72054672 2024/11/23-21:09:11.100392 139957164807744 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280740.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 1850809 prefix = 4 raw-key = 0.0296 GB zip-key = 0.0035 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.2166 GB zip-val = 0.0681 GB avg-val = 117.04 avg-zval = 36.78 2024/11/23-21:09:11.100646 139957164807744 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280740.sst: sumWaitingMem = 0.005 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0049 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:09:12.548217 139957164807744 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280740.sst): second pass time = 3.20's, 67.702'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.45's, 51.279'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3229.174'MB/sec (index lex order gen) rebuild zvType time = 1.20's, 0.386'MB/sec write SST data time = 0.25's, 297.214'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 2.159'MB, throughput = 63246.104'MB/sec zip my value time = 3.20's, unzip length = 0.217'GB zip my value throughput = 67.702'MB/sec zip pipeline throughput = 67.702'MB/sec entries = 1850809 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.04 avg-zval = 36.78 usrkeys = 1850809 avg-key = 20.00 avg-zkey = 1.90 avg-val = 117.34 avg-zval = 36.78 TagRS{ kinds = RS_Key0_TagN bytes = 289280 } TagArray{ size = 80380 bytes = 241152 } seq expand size = 562660 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0370 GB value = 0.2166 GB dict = 2.16 MB all = 0.2684 GB } __ZipSize{ index = 0.0035 GB value = 0.0681 GB dict = 2.16 MB all = 0.0743 GB } UnZip/Zip{ index = 10.5171 value = 3.1821 dict = 1.00 all = 3.6129 } Zip/UnZip{ index = 0.0951 value = 0.3143 dict = 1.00 all = 0.2768 } ---------------------------- total value len = 13.135373 GB avg = 0.150 KB (by entry num) total key len = 2.430019 GB avg = 0.028 KB total ukey len = 1.704448 GB avg = 0.017 KB total ukey num = 0.100878941 Billion total entry num = 0.087686670 Billion write speed all = 0.353434935 MB/sec (with seq num) write speed all = 0.337506505 MB/sec (without seq num) 2024/11/23-21:09:12.634422 139957164807744 [compaction_job.cc:1948] [default] [JOB 35807] Generated table #280740: 1850809 keys, 74299463 bytes, temperature: kWarm 2024/11/23-21:09:12.634492 139957164807744 EVENT_LOG_v1 {"time_micros": 1732367352634458, "cf_name": "default", "job": 35807, "event": "table_file_creation", "file_number": 280740, "file_size": 74299463, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3289124829, "table_properties": {"data_size": 68072192, "index_size": 3519616, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 51822652, "raw_average_key_size": 28, "raw_value_size": 216612850, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 1850809, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367345, "oldest_key_time": 0, "file_creation_time": 1732367345, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 280740, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:09:12.691779 139957164807744 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280741.sst) /dev/shm/ToplingTemp/Topling-189103-MAeYej 2024/11/23-21:09:14.425261 139957164807744 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280741.sst): first pass time = 1.73's, 154.858'MB/sec 2024/11/23-21:09:16.734144 139957164807744 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280741.sst): old prealloc_size = 295279001, real_size = 55298080 2024/11/23-21:09:16.735237 139957164807744 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280741.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 1838600 prefix = 4 raw-key = 0.0294 GB zip-key = 0.0035 GB avg-key = 16.00 avg-zkey = 1.93 raw-val = 0.2170 GB zip-val = 0.0513 GB avg-val = 118.00 avg-zval = 27.90 2024/11/23-21:09:16.735440 139957164807744 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280741.sst: sumWaitingMem = 0.005 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0048 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:09:18.335680 139957164807744 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280741.sst): second pass time = 2.31's, 94.019'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.60's, 35.779'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3348.432'MB/sec (index lex order gen) rebuild zvType time = 1.35's, 0.340'MB/sec write SST data time = 0.25's, 230.475'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 2.162'MB, throughput = 66589.634'MB/sec zip my value time = 2.31's, unzip length = 0.217'GB zip my value throughput = 94.019'MB/sec zip pipeline throughput = 94.019'MB/sec entries = 1838600 avg-key = 28.00 avg-zkey = 1.93 avg-val = 118.00 avg-zval = 27.90 usrkeys = 1838600 avg-key = 20.00 avg-zkey = 1.93 avg-val = 118.01 avg-zval = 27.90 TagRS{ kinds = RS_Key0_TagN bytes = 287400 } TagArray{ size = 2017 bytes = 4800 } seq expand size = 14119 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0368 GB value = 0.2170 GB dict = 2.16 MB all = 0.2684 GB } __ZipSize{ index = 0.0035 GB value = 0.0513 GB dict = 2.16 MB all = 0.0573 GB } UnZip/Zip{ index = 10.3824 value = 4.2294 dict = 1.00 all = 4.6848 } Zip/UnZip{ index = 0.0963 value = 0.2364 dict = 1.00 all = 0.2135 } ---------------------------- total value len = 13.352342 GB avg = 0.149 KB (by entry num) total key len = 2.481500 GB avg = 0.028 KB total ukey len = 1.741220 GB avg = 0.017 KB total ukey num = 0.102717541 Billion total entry num = 0.089525270 Billion write speed all = 0.359483236 MB/sec (with seq num) write speed all = 0.343222959 MB/sec (without seq num) 2024/11/23-21:09:18.402894 139957164807744 [compaction_job.cc:1948] [default] [JOB 35807] Generated table #280741: 1838600 keys, 57299545 bytes, temperature: kWarm 2024/11/23-21:09:18.402965 139957164807744 EVENT_LOG_v1 {"time_micros": 1732367358402929, "cf_name": "default", "job": 35807, "event": "table_file_creation", "file_number": 280741, "file_size": 57299545, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3586575499, "table_properties": {"data_size": 51296464, "index_size": 3541760, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 51480800, "raw_average_key_size": 28, "raw_value_size": 216954800, "raw_average_value_size": 118, "num_data_blocks": 1, "num_entries": 1838600, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 118, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367352, "oldest_key_time": 0, "file_creation_time": 1732367352, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 280741, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:09:18.461804 139957164807744 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280742.sst) /dev/shm/ToplingTemp/Topling-189103-bjp2Dj 2024/11/23-21:09:19.729614 139957164807744 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280742.sst): first pass time = 1.27's, 211.737'MB/sec 2024/11/23-21:09:21.996857 139957164807744 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280742.sst): old prealloc_size = 295279001, real_size = 55105840 2024/11/23-21:09:21.997923 139957164807744 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280742.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 1844000 prefix = 4 raw-key = 0.0295 GB zip-key = 0.0035 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.2168 GB zip-val = 0.0511 GB avg-val = 117.57 avg-zval = 27.72 2024/11/23-21:09:21.998458 139957164807744 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280742.sst: sumWaitingMem = 0.005 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0048 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:09:23.494631 139957164807744 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280742.sst): second pass time = 2.27's, 95.678'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.50's, 39.127'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3383.175'MB/sec (index lex order gen) rebuild zvType time = 1.24's, 0.371'MB/sec write SST data time = 0.25's, 230.235'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 2.160'MB, throughput = 69094.271'MB/sec zip my value time = 2.27's, unzip length = 0.217'GB zip my value throughput = 95.678'MB/sec zip pipeline throughput = 95.678'MB/sec entries = 1844000 avg-key = 28.00 avg-zkey = 1.91 avg-val = 117.57 avg-zval = 27.72 usrkeys = 1844000 avg-key = 20.00 avg-zkey = 1.91 avg-val = 119.15 avg-zval = 27.72 TagRS{ kinds = RS_Key0_TagN bytes = 288240 } TagArray{ size = 414329 bytes = 1501952 } seq expand size = 2900303 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0369 GB value = 0.2168 GB dict = 2.16 MB all = 0.2684 GB } __ZipSize{ index = 0.0035 GB value = 0.0511 GB dict = 2.16 MB all = 0.0586 GB } UnZip/Zip{ index = 10.4501 value = 4.2414 dict = 1.00 all = 4.5807 } Zip/UnZip{ index = 0.0957 value = 0.2358 dict = 1.00 all = 0.2183 } ---------------------------- total value len = 13.572046 GB avg = 0.149 KB (by entry num) total key len = 2.533132 GB avg = 0.028 KB total ukey len = 1.778100 GB avg = 0.017 KB total ukey num = 0.104561541 Billion total entry num = 0.091369270 Billion write speed all = 0.365600681 MB/sec (with seq num) write speed all = 0.349007425 MB/sec (without seq num) 2024/11/23-21:09:23.564930 139957164807744 [compaction_job.cc:1948] [default] [JOB 35807] Generated table #280742: 1844000 keys, 58601701 bytes, temperature: kWarm 2024/11/23-21:09:23.565015 139957164807744 EVENT_LOG_v1 {"time_micros": 1732367363564963, "cf_name": "default", "job": 35807, "event": "table_file_creation", "file_number": 280742, "file_size": 58601701, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4012776210, "table_properties": {"data_size": 51115488, "index_size": 3529152, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 51632000, "raw_average_key_size": 28, "raw_value_size": 216803528, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 1844000, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367358, "oldest_key_time": 0, "file_creation_time": 1732367358, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 280742, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:09:23.631087 139957164807744 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280743.sst) /dev/shm/ToplingTemp/Topling-189103-JFgpUf 2024/11/23-21:09:25.728618 139957164807744 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280743.sst): first pass time = 2.10's, 127.979'MB/sec 2024/11/23-21:09:28.065186 139957164807744 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280743.sst): old prealloc_size = 295279001, real_size = 58353440 2024/11/23-21:09:28.066290 139957164807744 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280743.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 1845483 prefix = 4 raw-key = 0.0295 GB zip-key = 0.0035 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.2168 GB zip-val = 0.0544 GB avg-val = 117.46 avg-zval = 29.47 2024/11/23-21:09:28.066709 139957164807744 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280743.sst: sumWaitingMem = 0.005 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0048 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:09:29.630350 139957164807744 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280743.sst): second pass time = 2.34's, 92.818'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.57's, 39.166'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3248.191'MB/sec (index lex order gen) rebuild zvType time = 1.31's, 0.353'MB/sec write SST data time = 0.26's, 239.993'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 2.160'MB, throughput = 67197.050'MB/sec zip my value time = 2.34's, unzip length = 0.217'GB zip my value throughput = 92.818'MB/sec zip pipeline throughput = 92.818'MB/sec entries = 1845483 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.46 avg-zval = 29.47 usrkeys = 1845483 avg-key = 20.00 avg-zkey = 1.90 avg-val = 118.45 avg-zval = 29.47 TagRS{ kinds = RS_Key0_TagN bytes = 288440 } TagArray{ size = 262169 bytes = 950384 } seq expand size = 1835183 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0369 GB value = 0.2168 GB dict = 2.16 MB all = 0.2684 GB } __ZipSize{ index = 0.0035 GB value = 0.0544 GB dict = 2.16 MB all = 0.0613 GB } UnZip/Zip{ index = 10.5184 value = 3.9859 dict = 1.00 all = 4.3790 } Zip/UnZip{ index = 0.0951 value = 0.2509 dict = 1.00 all = 0.2284 } ---------------------------- total value len = 13.790643 GB avg = 0.148 KB (by entry num) total key len = 2.584806 GB avg = 0.028 KB total ukey len = 1.815010 GB avg = 0.017 KB total ukey num = 0.106407024 Billion total entry num = 0.093214753 Billion write speed all = 0.371684277 MB/sec (with seq num) write speed all = 0.354758227 MB/sec (without seq num) 2024/11/23-21:09:29.701454 139957164807744 [compaction_job.cc:1948] [default] [JOB 35807] Generated table #280743: 1845483 keys, 61300911 bytes, temperature: kWarm 2024/11/23-21:09:29.701521 139957164807744 EVENT_LOG_v1 {"time_micros": 1732367369701488, "cf_name": "default", "job": 35807, "event": "table_file_creation", "file_number": 280743, "file_size": 61300911, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4012774685, "table_properties": {"data_size": 54382800, "index_size": 3509056, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 51673524, "raw_average_key_size": 28, "raw_value_size": 216762034, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 1845483, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367363, "oldest_key_time": 0, "file_creation_time": 1732367363, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 280743, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:09:29.760270 139957164807744 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280744.sst) /dev/shm/ToplingTemp/Topling-189103-9kB9Nj 2024/11/23-21:09:31.433879 139957164807744 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280744.sst): first pass time = 1.67's, 160.397'MB/sec 2024/11/23-21:09:33.733690 139957164807744 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280744.sst): old prealloc_size = 295279001, real_size = 55544448 2024/11/23-21:09:33.734731 139957164807744 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280744.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 1838600 prefix = 4 raw-key = 0.0294 GB zip-key = 0.0035 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.2170 GB zip-val = 0.0516 GB avg-val = 118.00 avg-zval = 28.05 2024/11/23-21:09:33.734965 139957164807744 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280744.sst: sumWaitingMem = 0.005 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0048 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:09:35.270941 139957164807744 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280744.sst): second pass time = 2.30's, 94.391'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.54's, 37.496'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3469.716'MB/sec (index lex order gen) rebuild zvType time = 1.29's, 0.358'MB/sec write SST data time = 0.25's, 229.479'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 2.162'MB, throughput = 63617.512'MB/sec zip my value time = 2.30's, unzip length = 0.217'GB zip my value throughput = 94.391'MB/sec zip pipeline throughput = 94.391'MB/sec entries = 1838600 avg-key = 28.00 avg-zkey = 1.91 avg-val = 118.00 avg-zval = 28.05 usrkeys = 1838600 avg-key = 20.00 avg-zkey = 1.91 avg-val = 118.13 avg-zval = 28.05 TagRS{ kinds = RS_Key0_TagN bytes = 287400 } TagArray{ size = 34335 bytes = 98736 } seq expand size = 240345 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0368 GB value = 0.2170 GB dict = 2.16 MB all = 0.2684 GB } __ZipSize{ index = 0.0035 GB value = 0.0516 GB dict = 2.16 MB all = 0.0576 GB } UnZip/Zip{ index = 10.4489 value = 4.2074 dict = 1.00 all = 4.6571 } Zip/UnZip{ index = 0.0957 value = 0.2377 dict = 1.00 all = 0.2147 } ---------------------------- total value len = 14.007838 GB avg = 0.147 KB (by entry num) total key len = 2.636286 GB avg = 0.028 KB total ukey len = 1.851782 GB avg = 0.017 KB total ukey num = 0.108245624 Billion total entry num = 0.095053353 Billion write speed all = 0.377734230 MB/sec (with seq num) write speed all = 0.360476534 MB/sec (without seq num) 2024/11/23-21:09:35.338292 139957164807744 [compaction_job.cc:1948] [default] [JOB 35807] Generated table #280744: 1838600 keys, 57639897 bytes, temperature: kWarm 2024/11/23-21:09:35.338363 139957164807744 EVENT_LOG_v1 {"time_micros": 1732367375338326, "cf_name": "default", "job": 35807, "event": "table_file_creation", "file_number": 280744, "file_size": 57639897, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3819948056, "table_properties": {"data_size": 51565360, "index_size": 3519232, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 51480800, "raw_average_key_size": 28, "raw_value_size": 216954800, "raw_average_value_size": 118, "num_data_blocks": 1, "num_entries": 1838600, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 118, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367369, "oldest_key_time": 0, "file_creation_time": 1732367369, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 280744, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:09:35.402753 139957164807744 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280745.sst) /dev/shm/ToplingTemp/Topling-189103-yOKlFi 2024/11/23-21:09:37.389017 139957164807744 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280745.sst): first pass time = 1.99's, 135.148'MB/sec 2024/11/23-21:09:39.737942 139957164807744 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280745.sst): old prealloc_size = 295279001, real_size = 60469184 2024/11/23-21:09:39.739047 139957164807744 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280745.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 1850992 prefix = 4 raw-key = 0.0296 GB zip-key = 0.0035 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.2166 GB zip-val = 0.0565 GB avg-val = 117.02 avg-zval = 30.52 2024/11/23-21:09:39.739856 139957164807744 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280745.sst: sumWaitingMem = 0.005 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0049 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:09:41.345263 139957164807744 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280745.sst): second pass time = 2.35's, 92.262'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.61's, 40.594'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3322.447'MB/sec (index lex order gen) rebuild zvType time = 1.35's, 0.344'MB/sec write SST data time = 0.26's, 251.641'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 2.159'MB, throughput = 49237.459'MB/sec zip my value time = 2.35's, unzip length = 0.217'GB zip my value throughput = 92.262'MB/sec zip pipeline throughput = 92.262'MB/sec entries = 1850992 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.02 avg-zval = 30.52 usrkeys = 1850992 avg-key = 20.00 avg-zkey = 1.90 avg-val = 120.14 avg-zval = 30.52 TagRS{ kinds = RS_Key0_TagN bytes = 289320 } TagArray{ size = 823786 bytes = 2780288 } seq expand size = 5766502 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0370 GB value = 0.2166 GB dict = 2.16 MB all = 0.2684 GB } __ZipSize{ index = 0.0035 GB value = 0.0565 GB dict = 2.16 MB all = 0.0652 GB } UnZip/Zip{ index = 10.5178 value = 3.8347 dict = 1.00 all = 4.1142 } Zip/UnZip{ index = 0.0951 value = 0.2608 dict = 1.00 all = 0.2431 } ---------------------------- total value len = 14.230213 GB avg = 0.147 KB (by entry num) total key len = 2.688114 GB avg = 0.028 KB total ukey len = 1.888802 GB avg = 0.017 KB total ukey num = 0.110096616 Billion total entry num = 0.096904345 Billion write speed all = 0.383904255 MB/sec (with seq num) write speed all = 0.366312921 MB/sec (without seq num) 2024/11/23-21:09:41.432264 139957164807744 [compaction_job.cc:1948] [default] [JOB 35807] Generated table #280745: 1850992 keys, 65245840 bytes, temperature: kWarm 2024/11/23-21:09:41.432331 139957164807744 EVENT_LOG_v1 {"time_micros": 1732367381432296, "cf_name": "default", "job": 35807, "event": "table_file_creation", "file_number": 280745, "file_size": 65245840, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4012776228, "table_properties": {"data_size": 56486512, "index_size": 3519744, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 51827776, "raw_average_key_size": 28, "raw_value_size": 216607808, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 1850992, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367375, "oldest_key_time": 0, "file_creation_time": 1732367375, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 280745, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:09:41.486417 139957164807744 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280746.sst) /dev/shm/ToplingTemp/Topling-189103-DsI9gj 2024/11/23-21:09:43.207661 139957164807744 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280746.sst): first pass time = 1.72's, 155.958'MB/sec 2024/11/23-21:09:45.501590 139957164807744 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280746.sst): old prealloc_size = 295279001, real_size = 55134928 2024/11/23-21:09:45.502648 139957164807744 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280746.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 1838600 prefix = 4 raw-key = 0.0294 GB zip-key = 0.0035 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.2170 GB zip-val = 0.0512 GB avg-val = 118.00 avg-zval = 27.82 2024/11/23-21:09:45.502984 139957164807744 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280746.sst: sumWaitingMem = 0.005 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0048 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:09:47.119880 139957164807744 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280746.sst): second pass time = 2.29's, 94.633'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.62's, 35.648'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3400.958'MB/sec (index lex order gen) rebuild zvType time = 1.37's, 0.336'MB/sec write SST data time = 0.25's, 231.352'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 2.162'MB, throughput = 59066.080'MB/sec zip my value time = 2.29's, unzip length = 0.217'GB zip my value throughput = 94.633'MB/sec zip pipeline throughput = 94.633'MB/sec entries = 1838600 avg-key = 28.00 avg-zkey = 1.91 avg-val = 118.00 avg-zval = 27.82 usrkeys = 1838600 avg-key = 20.00 avg-zkey = 1.91 avg-val = 118.61 avg-zval = 27.82 TagRS{ kinds = RS_Key0_TagN bytes = 287400 } TagArray{ size = 158909 bytes = 556192 } seq expand size = 1112363 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0368 GB value = 0.2170 GB dict = 2.16 MB all = 0.2684 GB } __ZipSize{ index = 0.0035 GB value = 0.0512 GB dict = 2.16 MB all = 0.0577 GB } UnZip/Zip{ index = 10.4493 value = 4.2410 dict = 1.00 all = 4.6532 } Zip/UnZip{ index = 0.0957 value = 0.2358 dict = 1.00 all = 0.2149 } ---------------------------- total value len = 14.448280 GB avg = 0.146 KB (by entry num) total key len = 2.739595 GB avg = 0.028 KB total ukey len = 1.925574 GB avg = 0.017 KB total ukey num = 0.111935216 Billion total entry num = 0.098742945 Billion write speed all = 0.389969635 MB/sec (with seq num) write speed all = 0.372046884 MB/sec (without seq num) 2024/11/23-21:09:47.195054 139957164807744 [compaction_job.cc:1948] [default] [JOB 35807] Generated table #280746: 1838600 keys, 57687833 bytes, temperature: kWarm 2024/11/23-21:09:47.195125 139957164807744 EVENT_LOG_v1 {"time_micros": 1732367387195088, "cf_name": "default", "job": 35807, "event": "table_file_creation", "file_number": 280746, "file_size": 57687833, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3723020055, "table_properties": {"data_size": 51155968, "index_size": 3519104, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 51480800, "raw_average_key_size": 28, "raw_value_size": 216954800, "raw_average_value_size": 118, "num_data_blocks": 1, "num_entries": 1838600, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 118, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367381, "oldest_key_time": 0, "file_creation_time": 1732367381, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 280746, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:09:47.256174 139957164807744 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280747.sst) /dev/shm/ToplingTemp/Topling-189103-7eYEgf 2024/11/23-21:09:49.292196 139957164807744 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280747.sst): first pass time = 2.04's, 131.846'MB/sec 2024/11/23-21:09:51.629328 139957164807744 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280747.sst): old prealloc_size = 295279001, real_size = 58743904 2024/11/23-21:09:51.630378 139957164807744 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280747.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 1850692 prefix = 4 raw-key = 0.0296 GB zip-key = 0.0035 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.2166 GB zip-val = 0.0548 GB avg-val = 117.05 avg-zval = 29.59 2024/11/23-21:09:51.630895 139957164807744 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280747.sst: sumWaitingMem = 0.005 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0049 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:09:53.155688 139957164807744 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280747.sst): second pass time = 2.34's, 92.736'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.53's, 40.773'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3425.768'MB/sec (index lex order gen) rebuild zvType time = 1.27's, 0.366'MB/sec write SST data time = 0.26's, 239.311'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 2.159'MB, throughput = 66348.350'MB/sec zip my value time = 2.34's, unzip length = 0.217'GB zip my value throughput = 92.736'MB/sec zip pipeline throughput = 92.736'MB/sec entries = 1850692 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.05 avg-zval = 29.59 usrkeys = 1850692 avg-key = 20.00 avg-zkey = 1.90 avg-val = 118.78 avg-zval = 29.59 TagRS{ kinds = RS_Key0_TagN bytes = 289280 } TagArray{ size = 459248 bytes = 1492576 } seq expand size = 3214736 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0370 GB value = 0.2166 GB dict = 2.16 MB all = 0.2684 GB } __ZipSize{ index = 0.0035 GB value = 0.0548 GB dict = 2.16 MB all = 0.0622 GB } UnZip/Zip{ index = 10.5172 value = 3.9556 dict = 1.00 all = 4.3134 } Zip/UnZip{ index = 0.0951 value = 0.2528 dict = 1.00 all = 0.2318 } ---------------------------- total value len = 14.668111 GB avg = 0.146 KB (by entry num) total key len = 2.791414 GB avg = 0.028 KB total ukey len = 1.962587 GB avg = 0.017 KB total ukey num = 0.113785908 Billion total entry num = 0.100593637 Billion write speed all = 0.396078772 MB/sec (with seq num) write speed all = 0.377822603 MB/sec (without seq num) 2024/11/23-21:09:53.236062 139957164807744 [compaction_job.cc:1948] [default] [JOB 35807] Generated table #280747: 1850692 keys, 62232597 bytes, temperature: kWarm 2024/11/23-21:09:53.236134 139957164807744 EVENT_LOG_v1 {"time_micros": 1732367393236096, "cf_name": "default", "job": 35807, "event": "table_file_creation", "file_number": 280747, "file_size": 62232597, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4012776248, "table_properties": {"data_size": 54761680, "index_size": 3519360, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 51819376, "raw_average_key_size": 28, "raw_value_size": 216616180, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 1850692, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367387, "oldest_key_time": 0, "file_creation_time": 1732367387, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 280747, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:09:53.293278 139957164807744 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280748.sst) /dev/shm/ToplingTemp/Topling-189103-J6ks3h 2024/11/23-21:09:55.217271 139957164807744 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280748.sst): first pass time = 1.92's, 139.523'MB/sec 2024/11/23-21:09:57.586064 139957164807744 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280748.sst): old prealloc_size = 295279001, real_size = 55379168 2024/11/23-21:09:57.587056 139957164807744 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280748.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 1838600 prefix = 4 raw-key = 0.0294 GB zip-key = 0.0035 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.2170 GB zip-val = 0.0514 GB avg-val = 118.00 avg-zval = 27.96 2024/11/23-21:09:57.587301 139957164807744 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280748.sst: sumWaitingMem = 0.005 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0048 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:09:59.185952 139957164807744 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280748.sst): second pass time = 2.37's, 91.652'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.60's, 35.944'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3636.602'MB/sec (index lex order gen) rebuild zvType time = 1.35's, 0.341'MB/sec write SST data time = 0.25's, 229.028'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 2.162'MB, throughput = 67382.343'MB/sec zip my value time = 2.37's, unzip length = 0.217'GB zip my value throughput = 91.652'MB/sec zip pipeline throughput = 91.652'MB/sec entries = 1838600 avg-key = 28.00 avg-zkey = 1.91 avg-val = 118.00 avg-zval = 27.96 usrkeys = 1838600 avg-key = 20.00 avg-zkey = 1.91 avg-val = 118.17 avg-zval = 27.96 TagRS{ kinds = RS_Key0_TagN bytes = 287400 } TagArray{ size = 43431 bytes = 130304 } seq expand size = 304017 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0368 GB value = 0.2170 GB dict = 2.16 MB all = 0.2684 GB } __ZipSize{ index = 0.0035 GB value = 0.0514 GB dict = 2.16 MB all = 0.0575 GB } UnZip/Zip{ index = 10.4506 value = 4.2209 dict = 1.00 all = 4.6679 } Zip/UnZip{ index = 0.0957 value = 0.2369 dict = 1.00 all = 0.2142 } ---------------------------- total value len = 14.885369 GB avg = 0.145 KB (by entry num) total key len = 2.842895 GB avg = 0.028 KB total ukey len = 1.999359 GB avg = 0.017 KB total ukey num = 0.115624508 Billion total entry num = 0.102432237 Billion write speed all = 0.402120266 MB/sec (with seq num) write speed all = 0.383532963 MB/sec (without seq num) 2024/11/23-21:09:59.256606 139957164807744 [compaction_job.cc:1948] [default] [JOB 35807] Generated table #280748: 1838600 keys, 57506137 bytes, temperature: kWarm 2024/11/23-21:09:59.256678 139957164807744 EVENT_LOG_v1 {"time_micros": 1732367399256642, "cf_name": "default", "job": 35807, "event": "table_file_creation", "file_number": 280748, "file_size": 57506137, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3613003557, "table_properties": {"data_size": 51400656, "index_size": 3518656, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 51480800, "raw_average_key_size": 28, "raw_value_size": 216954800, "raw_average_value_size": 118, "num_data_blocks": 1, "num_entries": 1838600, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 118, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367393, "oldest_key_time": 0, "file_creation_time": 1732367393, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 280748, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:09:59.314270 139957164807744 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280749.sst) /dev/shm/ToplingTemp/Topling-189103-5WSLuf 2024/11/23-21:10:00.820197 139957164807744 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280749.sst): first pass time = 1.51's, 178.256'MB/sec 2024/11/23-21:10:03.141839 139957164807744 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280749.sst): old prealloc_size = 295279001, real_size = 55094256 2024/11/23-21:10:03.142898 139957164807744 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280749.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 1843655 prefix = 4 raw-key = 0.0295 GB zip-key = 0.0036 GB avg-key = 16.00 avg-zkey = 1.93 raw-val = 0.2168 GB zip-val = 0.0511 GB avg-val = 117.60 avg-zval = 27.71 2024/11/23-21:10:03.143237 139957164807744 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280749.sst: sumWaitingMem = 0.005 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0048 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:10:04.672407 139957164807744 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280749.sst): second pass time = 2.32's, 93.440'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.53's, 37.652'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3432.367'MB/sec (index lex order gen) rebuild zvType time = 1.27's, 0.363'MB/sec write SST data time = 0.26's, 221.960'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 2.160'MB, throughput = 66720.393'MB/sec zip my value time = 2.32's, unzip length = 0.217'GB zip my value throughput = 93.440'MB/sec zip pipeline throughput = 93.440'MB/sec entries = 1843655 avg-key = 28.00 avg-zkey = 1.93 avg-val = 117.60 avg-zval = 27.71 usrkeys = 1843655 avg-key = 20.00 avg-zkey = 1.93 avg-val = 118.18 avg-zval = 27.71 TagRS{ kinds = RS_Key0_TagN bytes = 288160 } TagArray{ size = 154066 bytes = 539248 } seq expand size = 1078462 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0369 GB value = 0.2168 GB dict = 2.16 MB all = 0.2684 GB } __ZipSize{ index = 0.0036 GB value = 0.0511 GB dict = 2.16 MB all = 0.0576 GB } UnZip/Zip{ index = 10.3808 value = 4.2445 dict = 1.00 all = 4.6581 } Zip/UnZip{ index = 0.0963 value = 0.2356 dict = 1.00 all = 0.2147 } ---------------------------- total value len = 15.103261 GB avg = 0.145 KB (by entry num) total key len = 2.894517 GB avg = 0.028 KB total ukey len = 2.036233 GB avg = 0.017 KB total ukey num = 0.117468163 Billion total entry num = 0.104275892 Billion write speed all = 0.408182705 MB/sec (with seq num) write speed all = 0.389263207 MB/sec (without seq num) 2024/11/23-21:10:04.744829 139957164807744 [compaction_job.cc:1948] [default] [JOB 35807] Generated table #280749: 1843655 keys, 57627543 bytes, temperature: kWarm 2024/11/23-21:10:04.744884 139957164807744 EVENT_LOG_v1 {"time_micros": 1732367404744853, "cf_name": "default", "job": 35807, "event": "table_file_creation", "file_number": 280749, "file_size": 57627543, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4012776268, "table_properties": {"data_size": 51081120, "index_size": 3552064, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 51622340, "raw_average_key_size": 28, "raw_value_size": 216813254, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 1843655, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367399, "oldest_key_time": 0, "file_creation_time": 1732367399, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 280749, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:10:04.812612 139957164807744 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280750.sst) /dev/shm/ToplingTemp/Topling-189103-mzvWxi 2024/11/23-21:10:06.782074 139957164807744 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280750.sst): first pass time = 1.97's, 136.301'MB/sec 2024/11/23-21:10:09.769608 139957164807744 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280750.sst): old prealloc_size = 295279001, real_size = 58295216 2024/11/23-21:10:09.770730 139957164807744 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280750.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 1845754 prefix = 4 raw-key = 0.0295 GB zip-key = 0.0035 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.2168 GB zip-val = 0.0543 GB avg-val = 117.43 avg-zval = 29.43 2024/11/23-21:10:09.771205 139957164807744 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280750.sst: sumWaitingMem = 0.005 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0048 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:10:11.713589 139957164807744 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280750.sst): second pass time = 2.99's, 72.584'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.94's, 31.393'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3211.029'MB/sec (index lex order gen) rebuild zvType time = 1.64's, 0.282'MB/sec write SST data time = 0.31's, 199.002'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 2.160'MB, throughput = 65690.604'MB/sec zip my value time = 2.99's, unzip length = 0.217'GB zip my value throughput = 72.584'MB/sec zip pipeline throughput = 75.035'MB/sec entries = 1845754 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.43 avg-zval = 29.43 usrkeys = 1845754 avg-key = 20.00 avg-zkey = 1.90 avg-val = 118.20 avg-zval = 29.43 TagRS{ kinds = RS_Key0_TagN bytes = 288480 } TagArray{ size = 202759 bytes = 735024 } seq expand size = 1419313 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0369 GB value = 0.2168 GB dict = 2.16 MB all = 0.2684 GB } __ZipSize{ index = 0.0035 GB value = 0.0543 GB dict = 2.16 MB all = 0.0610 GB } UnZip/Zip{ index = 10.5180 value = 3.9900 dict = 1.00 all = 4.3986 } Zip/UnZip{ index = 0.0951 value = 0.2506 dict = 1.00 all = 0.2273 } ---------------------------- total value len = 15.321435 GB avg = 0.144 KB (by entry num) total key len = 2.946199 GB avg = 0.028 KB total ukey len = 2.073148 GB avg = 0.017 KB total ukey num = 0.119313917 Billion total entry num = 0.106121646 Billion write speed all = 0.414236757 MB/sec (with seq num) write speed all = 0.394985446 MB/sec (without seq num) 2024/11/23-21:10:11.792060 139957164807744 [compaction_job.cc:1948] [default] [JOB 35807] Generated table #280750: 1845754 keys, 61027439 bytes, temperature: kWarm 2024/11/23-21:10:11.792128 139957164807744 EVENT_LOG_v1 {"time_micros": 1732367411792093, "cf_name": "default", "job": 35807, "event": "table_file_creation", "file_number": 280750, "file_size": 61027439, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4012771596, "table_properties": {"data_size": 54323872, "index_size": 3509696, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 51681112, "raw_average_key_size": 28, "raw_value_size": 216754344, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 1845754, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367404, "oldest_key_time": 0, "file_creation_time": 1732367404, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 280750, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:10:11.849318 139957164807744 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280751.sst) /dev/shm/ToplingTemp/Topling-189103-YN2oVg 2024/11/23-21:10:13.941478 139957164807744 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280751.sst): first pass time = 2.09's, 128.308'MB/sec 2024/11/23-21:10:16.993905 139957164807744 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280751.sst): old prealloc_size = 295279001, real_size = 55520192 2024/11/23-21:10:16.994993 139957164807744 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280751.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 1838600 prefix = 4 raw-key = 0.0294 GB zip-key = 0.0035 GB avg-key = 16.00 avg-zkey = 1.93 raw-val = 0.2170 GB zip-val = 0.0515 GB avg-val = 118.00 avg-zval = 28.02 2024/11/23-21:10:16.995545 139957164807744 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280751.sst: sumWaitingMem = 0.005 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0048 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:10:18.804842 139957164807744 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280751.sst): second pass time = 3.05's, 71.103'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.81's, 32.100'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3343.224'MB/sec (index lex order gen) rebuild zvType time = 1.54's, 0.298'MB/sec write SST data time = 0.27's, 216.110'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 2.162'MB, throughput = 58462.404'MB/sec zip my value time = 3.05's, unzip length = 0.217'GB zip my value throughput = 71.103'MB/sec zip pipeline throughput = 96.501'MB/sec entries = 1838600 avg-key = 28.00 avg-zkey = 1.93 avg-val = 118.00 avg-zval = 28.02 usrkeys = 1838600 avg-key = 20.00 avg-zkey = 1.93 avg-val = 118.72 avg-zval = 28.02 TagRS{ kinds = RS_Key0_TagN bytes = 287400 } TagArray{ size = 188974 bytes = 614176 } seq expand size = 1322818 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0368 GB value = 0.2170 GB dict = 2.16 MB all = 0.2684 GB } __ZipSize{ index = 0.0035 GB value = 0.0515 GB dict = 2.16 MB all = 0.0581 GB } UnZip/Zip{ index = 10.3820 value = 4.2112 dict = 1.00 all = 4.6178 } Zip/UnZip{ index = 0.0963 value = 0.2375 dict = 1.00 all = 0.2166 } ---------------------------- total value len = 15.539712 GB avg = 0.144 KB (by entry num) total key len = 2.997679 GB avg = 0.028 KB total ukey len = 2.109920 GB avg = 0.017 KB total ukey num = 0.121152517 Billion total entry num = 0.107960246 Billion write speed all = 0.420286215 MB/sec (with seq num) write speed all = 0.400704516 MB/sec (without seq num) 2024/11/23-21:10:18.876921 139957164807744 [compaction_job.cc:1948] [default] [JOB 35807] Generated table #280751: 1838600 keys, 58131097 bytes, temperature: kWarm 2024/11/23-21:10:18.877004 139957164807744 EVENT_LOG_v1 {"time_micros": 1732367418876954, "cf_name": "default", "job": 35807, "event": "table_file_creation", "file_number": 280751, "file_size": 58131097, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3910276813, "table_properties": {"data_size": 51518448, "index_size": 3541888, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 51480800, "raw_average_key_size": 28, "raw_value_size": 216954800, "raw_average_value_size": 118, "num_data_blocks": 1, "num_entries": 1838600, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 118, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367411, "oldest_key_time": 0, "file_creation_time": 1732367411, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 280751, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:10:18.927806 139957164807744 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280752.sst) /dev/shm/ToplingTemp/Topling-189103-1tOQFf 2024/11/23-21:10:21.095730 139957164807744 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280752.sst): first pass time = 2.17's, 123.823'MB/sec 2024/11/23-21:10:23.757374 139957164807744 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280752.sst): old prealloc_size = 295279001, real_size = 60557888 2024/11/23-21:10:23.758415 139957164807744 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280752.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 1850581 prefix = 4 raw-key = 0.0296 GB zip-key = 0.0035 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.2166 GB zip-val = 0.0566 GB avg-val = 117.05 avg-zval = 30.57 2024/11/23-21:10:23.758721 139957164807744 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280752.sst: sumWaitingMem = 0.005 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0049 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:10:25.547667 139957164807744 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280752.sst): second pass time = 2.66's, 81.425'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.79's, 35.249'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3444.521'MB/sec (index lex order gen) rebuild zvType time = 1.54's, 0.301'MB/sec write SST data time = 0.25's, 249.696'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 2.159'MB, throughput = 60666.498'MB/sec zip my value time = 2.66's, unzip length = 0.217'GB zip my value throughput = 81.425'MB/sec zip pipeline throughput = 81.425'MB/sec entries = 1850581 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.05 avg-zval = 30.57 usrkeys = 1850581 avg-key = 20.00 avg-zkey = 1.90 avg-val = 117.61 avg-zval = 30.57 TagRS{ kinds = RS_Key0_TagN bytes = 289240 } TagArray{ size = 146699 bytes = 550144 } seq expand size = 1026893 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0370 GB value = 0.2166 GB dict = 2.16 MB all = 0.2684 GB } __ZipSize{ index = 0.0035 GB value = 0.0566 GB dict = 2.16 MB all = 0.0631 GB } UnZip/Zip{ index = 10.5175 value = 3.8288 dict = 1.00 all = 4.2538 } Zip/UnZip{ index = 0.0951 value = 0.2612 dict = 1.00 all = 0.2351 } ---------------------------- total value len = 15.757359 GB avg = 0.143 KB (by entry num) total key len = 3.049496 GB avg = 0.028 KB total ukey len = 2.146931 GB avg = 0.017 KB total ukey num = 0.123003098 Billion total entry num = 0.109810827 Billion write speed all = 0.426330387 MB/sec (with seq num) write speed all = 0.406416076 MB/sec (without seq num) 2024/11/23-21:10:25.618655 139957164807744 [compaction_job.cc:1948] [default] [JOB 35807] Generated table #280752: 1850581 keys, 63104165 bytes, temperature: kWarm 2024/11/23-21:10:25.618717 139957164807744 EVENT_LOG_v1 {"time_micros": 1732367425618684, "cf_name": "default", "job": 35807, "event": "table_file_creation", "file_number": 280752, "file_size": 63104165, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4012774796, "table_properties": {"data_size": 56576048, "index_size": 3519040, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 51816268, "raw_average_key_size": 28, "raw_value_size": 216619310, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 1850581, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367418, "oldest_key_time": 0, "file_creation_time": 1732367418, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 280752, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:10:25.671527 139957164807744 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280753.sst) /dev/shm/ToplingTemp/Topling-189103-qNkgxj 2024/11/23-21:10:27.494308 139957164807744 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280753.sst): first pass time = 1.82's, 147.270'MB/sec 2024/11/23-21:10:30.114383 139957164807744 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280753.sst): old prealloc_size = 295279001, real_size = 55312944 2024/11/23-21:10:30.115688 139957164807744 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280753.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 1838600 prefix = 4 raw-key = 0.0294 GB zip-key = 0.0035 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.2170 GB zip-val = 0.0513 GB avg-val = 118.00 avg-zval = 27.92 2024/11/23-21:10:30.115740 139957164807744 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280753.sst: sumWaitingMem = 0.005 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0048 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:10:32.006158 139957164807744 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280753.sst): second pass time = 2.62's, 82.859'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.89's, 30.142'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2731.029'MB/sec (index lex order gen) rebuild zvType time = 1.41's, 0.325'MB/sec write SST data time = 0.48's, 119.233'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 2.162'MB, throughput = 63596.929'MB/sec zip my value time = 2.62's, unzip length = 0.217'GB zip my value throughput = 82.859'MB/sec zip pipeline throughput = 82.859'MB/sec entries = 1838600 avg-key = 28.00 avg-zkey = 1.91 avg-val = 118.00 avg-zval = 27.92 usrkeys = 1838600 avg-key = 20.00 avg-zkey = 1.91 avg-val = 118.00 avg-zval = 27.92 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0368 GB value = 0.2170 GB dict = 2.16 MB all = 0.2684 GB } __ZipSize{ index = 0.0035 GB value = 0.0513 GB dict = 2.16 MB all = 0.0570 GB } UnZip/Zip{ index = 10.4498 value = 4.2263 dict = 1.00 all = 4.7076 } Zip/UnZip{ index = 0.0957 value = 0.2366 dict = 1.00 all = 0.2124 } ---------------------------- total value len = 15.974313 GB avg = 0.143 KB (by entry num) total key len = 3.100976 GB avg = 0.028 KB total ukey len = 2.183703 GB avg = 0.017 KB total ukey num = 0.124841698 Billion total entry num = 0.111649427 Billion write speed all = 0.432352223 MB/sec (with seq num) write speed all = 0.412107444 MB/sec (without seq num) 2024/11/23-21:10:32.072239 139957164807744 [compaction_job.cc:1948] [default] [JOB 35807] Generated table #280753: 1838600 keys, 57022220 bytes, temperature: kWarm 2024/11/23-21:10:32.072294 139957164807744 EVENT_LOG_v1 {"time_micros": 1732367432072263, "cf_name": "default", "job": 35807, "event": "table_file_creation", "file_number": 280753, "file_size": 57022220, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 51334176, "index_size": 3518912, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 51480800, "raw_average_key_size": 28, "raw_value_size": 216954800, "raw_average_value_size": 118, "num_data_blocks": 1, "num_entries": 1838600, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 118, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367425, "oldest_key_time": 0, "file_creation_time": 1732367425, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 280753, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:10:32.126139 139957164807744 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280754.sst) /dev/shm/ToplingTemp/Topling-189103-CgUHTf 2024/11/23-21:10:34.010108 139957164807744 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280754.sst): first pass time = 1.88's, 142.487'MB/sec 2024/11/23-21:10:36.858147 139957164807744 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280754.sst): old prealloc_size = 295279001, real_size = 58724416 2024/11/23-21:10:36.859243 139957164807744 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280754.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 1850542 prefix = 4 raw-key = 0.0296 GB zip-key = 0.0035 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.2166 GB zip-val = 0.0547 GB avg-val = 117.06 avg-zval = 29.57 2024/11/23-21:10:36.860128 139957164807744 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280754.sst: sumWaitingMem = 0.005 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0049 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:10:38.586725 139957164807744 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280754.sst): second pass time = 2.85's, 76.094'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.73's, 37.013'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3302.293'MB/sec (index lex order gen) rebuild zvType time = 1.46's, 0.317'MB/sec write SST data time = 0.27's, 240.304'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 2.159'MB, throughput = 57668.456'MB/sec zip my value time = 2.85's, unzip length = 0.217'GB zip my value throughput = 76.094'MB/sec zip pipeline throughput = 121.138'MB/sec entries = 1850542 avg-key = 28.00 avg-zkey = 1.91 avg-val = 117.06 avg-zval = 29.57 usrkeys = 1850542 avg-key = 20.00 avg-zkey = 1.91 avg-val = 120.58 avg-zval = 29.57 TagRS{ kinds = RS_Key0_TagN bytes = 289240 } TagArray{ size = 931071 bytes = 3258768 } seq expand size = 6517497 multi value expand size = 0 cnt WriteAppend = 15 UnZipSize{ index = 0.0370 GB value = 0.2166 GB dict = 2.16 MB all = 0.2684 GB } __ZipSize{ index = 0.0035 GB value = 0.0547 GB dict = 2.16 MB all = 0.0640 GB } UnZip/Zip{ index = 10.4495 value = 3.9587 dict = 1.00 all = 4.1957 } Zip/UnZip{ index = 0.0957 value = 0.2526 dict = 1.00 all = 0.2383 } ---------------------------- total value len = 16.197451 GB avg = 0.143 KB (by entry num) total key len = 3.152792 GB avg = 0.028 KB total ukey len = 2.220714 GB avg = 0.018 KB total ukey num = 0.126692240 Billion total entry num = 0.113499969 Billion write speed all = 0.438518783 MB/sec (with seq num) write speed all = 0.417941524 MB/sec (without seq num) 2024/11/23-21:10:38.665359 139957164807744 [compaction_job.cc:1948] [default] [JOB 35807] Generated table #280754: 1850542 keys, 63979240 bytes, temperature: kWarm 2024/11/23-21:10:38.665430 139957164807744 EVENT_LOG_v1 {"time_micros": 1732367438665394, "cf_name": "default", "job": 35807, "event": "table_file_creation", "file_number": 280754, "file_size": 63979240, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4012776300, "table_properties": {"data_size": 54719728, "index_size": 3541888, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 51815176, "raw_average_key_size": 28, "raw_value_size": 216620372, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 1850542, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367432, "oldest_key_time": 0, "file_creation_time": 1732367432, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 280754, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:10:38.719328 139957164807744 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280755.sst) /dev/shm/ToplingTemp/Topling-189103-7KL5eh 2024/11/23-21:10:40.946547 139957164807744 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280755.sst): first pass time = 2.23's, 120.527'MB/sec 2024/11/23-21:10:43.691477 139957164807744 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280755.sst): old prealloc_size = 295279001, real_size = 55323888 2024/11/23-21:10:43.692548 139957164807744 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280755.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 1838600 prefix = 4 raw-key = 0.0294 GB zip-key = 0.0035 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.2170 GB zip-val = 0.0513 GB avg-val = 118.00 avg-zval = 27.93 2024/11/23-21:10:43.692766 139957164807744 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280755.sst: sumWaitingMem = 0.005 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0048 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:10:45.449951 139957164807744 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280755.sst): second pass time = 2.74's, 79.081'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.76's, 32.613'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3362.034'MB/sec (index lex order gen) rebuild zvType time = 1.50's, 0.306'MB/sec write SST data time = 0.25's, 225.663'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 2.162'MB, throughput = 70853.360'MB/sec zip my value time = 2.74's, unzip length = 0.217'GB zip my value throughput = 79.081'MB/sec zip pipeline throughput = 97.660'MB/sec entries = 1838600 avg-key = 28.00 avg-zkey = 1.91 avg-val = 118.00 avg-zval = 27.93 usrkeys = 1838600 avg-key = 20.00 avg-zkey = 1.91 avg-val = 118.04 avg-zval = 27.93 TagRS{ kinds = RS_Key0_TagN bytes = 287400 } TagArray{ size = 10484 bytes = 28848 } seq expand size = 73388 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0368 GB value = 0.2170 GB dict = 2.16 MB all = 0.2684 GB } __ZipSize{ index = 0.0035 GB value = 0.0513 GB dict = 2.16 MB all = 0.0573 GB } UnZip/Zip{ index = 10.4487 value = 4.2255 dict = 1.00 all = 4.6807 } Zip/UnZip{ index = 0.0957 value = 0.2367 dict = 1.00 all = 0.2136 } ---------------------------- total value len = 16.414480 GB avg = 0.142 KB (by entry num) total key len = 3.204272 GB avg = 0.028 KB total ukey len = 2.257486 GB avg = 0.018 KB total ukey num = 0.128530840 Billion total entry num = 0.115338569 Billion write speed all = 0.444534642 MB/sec (with seq num) write speed all = 0.423627302 MB/sec (without seq num) 2024/11/23-21:10:45.516853 139957164807744 [compaction_job.cc:1948] [default] [JOB 35807] Generated table #280755: 1838600 keys, 57349465 bytes, temperature: kWarm 2024/11/23-21:10:45.516920 139957164807744 EVENT_LOG_v1 {"time_micros": 1732367445516887, "cf_name": "default", "job": 35807, "event": "table_file_creation", "file_number": 280755, "file_size": 57349465, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3528009812, "table_properties": {"data_size": 51344736, "index_size": 3519296, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 51480800, "raw_average_key_size": 28, "raw_value_size": 216954800, "raw_average_value_size": 118, "num_data_blocks": 1, "num_entries": 1838600, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 118, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367438, "oldest_key_time": 0, "file_creation_time": 1732367438, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 280755, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:10:45.598376 139957164807744 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280756.sst) /dev/shm/ToplingTemp/Topling-189103-Lufxyg 2024/11/23-21:10:47.478163 139957164807744 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280756.sst): first pass time = 1.88's, 142.805'MB/sec 2024/11/23-21:10:49.836147 139957164807744 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280756.sst): old prealloc_size = 295279001, real_size = 55129440 2024/11/23-21:10:49.837217 139957164807744 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280756.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 1843997 prefix = 4 raw-key = 0.0295 GB zip-key = 0.0035 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.2168 GB zip-val = 0.0511 GB avg-val = 117.57 avg-zval = 27.73 2024/11/23-21:10:49.838109 139957164807744 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280756.sst: sumWaitingMem = 0.005 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0048 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:10:51.690645 139957164807744 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280756.sst): second pass time = 2.36's, 91.997'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.85's, 31.396'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3364.030'MB/sec (index lex order gen) rebuild zvType time = 1.59's, 0.291'MB/sec write SST data time = 0.27's, 217.543'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 2.160'MB, throughput = 44588.906'MB/sec zip my value time = 2.36's, unzip length = 0.217'GB zip my value throughput = 91.997'MB/sec zip pipeline throughput = 91.997'MB/sec entries = 1843997 avg-key = 28.00 avg-zkey = 1.91 avg-val = 117.57 avg-zval = 27.73 usrkeys = 1843997 avg-key = 20.00 avg-zkey = 1.91 avg-val = 118.77 avg-zval = 27.73 TagRS{ kinds = RS_Key0_TagN bytes = 288240 } TagArray{ size = 314342 bytes = 1100208 } seq expand size = 2200394 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0369 GB value = 0.2168 GB dict = 2.16 MB all = 0.2684 GB } __ZipSize{ index = 0.0035 GB value = 0.0511 GB dict = 2.16 MB all = 0.0582 GB } UnZip/Zip{ index = 10.4474 value = 4.2396 dict = 1.00 all = 4.6104 } Zip/UnZip{ index = 0.0957 value = 0.2359 dict = 1.00 all = 0.2169 } ---------------------------- total value len = 16.633484 GB avg = 0.142 KB (by entry num) total key len = 3.255904 GB avg = 0.028 KB total ukey len = 2.294366 GB avg = 0.018 KB total ukey num = 0.130374837 Billion total entry num = 0.117182566 Billion write speed all = 0.450603173 MB/sec (with seq num) write speed all = 0.429364576 MB/sec (without seq num) 2024/11/23-21:10:51.761353 139957164807744 [compaction_job.cc:1948] [default] [JOB 35807] Generated table #280756: 1843997 keys, 58223411 bytes, temperature: kWarm 2024/11/23-21:10:51.761422 139957164807744 EVENT_LOG_v1 {"time_micros": 1732367451761387, "cf_name": "default", "job": 35807, "event": "table_file_creation", "file_number": 280756, "file_size": 58223411, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4012776316, "table_properties": {"data_size": 51138192, "index_size": 3530048, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 51631916, "raw_average_key_size": 28, "raw_value_size": 216803650, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 1843997, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367445, "oldest_key_time": 0, "file_creation_time": 1732367445, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 280756, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:10:51.820237 139957164807744 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280757.sst) /dev/shm/ToplingTemp/Topling-189103-A5nL9h 2024/11/23-21:10:54.067093 139957164807744 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280757.sst): first pass time = 2.25's, 119.474'MB/sec 2024/11/23-21:10:56.596183 139957164807744 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280757.sst): old prealloc_size = 295279001, real_size = 58401584 2024/11/23-21:10:56.597208 139957164807744 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280757.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 1845393 prefix = 4 raw-key = 0.0295 GB zip-key = 0.0035 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.2168 GB zip-val = 0.0544 GB avg-val = 117.46 avg-zval = 29.50 2024/11/23-21:10:56.597469 139957164807744 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280757.sst: sumWaitingMem = 0.005 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0048 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:10:58.259087 139957164807744 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280757.sst): second pass time = 2.53's, 85.755'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.66's, 36.490'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3524.993'MB/sec (index lex order gen) rebuild zvType time = 1.41's, 0.327'MB/sec write SST data time = 0.25's, 243.088'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 2.160'MB, throughput = 68399.747'MB/sec zip my value time = 2.53's, unzip length = 0.217'GB zip my value throughput = 85.755'MB/sec zip pipeline throughput = 85.755'MB/sec entries = 1845393 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.46 avg-zval = 29.50 usrkeys = 1845393 avg-key = 20.00 avg-zkey = 1.90 avg-val = 117.82 avg-zval = 29.50 TagRS{ kinds = RS_Key0_TagN bytes = 288440 } TagArray{ size = 93120 bytes = 279376 } seq expand size = 651840 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0369 GB value = 0.2168 GB dict = 2.16 MB all = 0.2684 GB } __ZipSize{ index = 0.0035 GB value = 0.0544 GB dict = 2.16 MB all = 0.0607 GB } UnZip/Zip{ index = 10.5177 value = 3.9824 dict = 1.00 all = 4.4239 } Zip/UnZip{ index = 0.0951 value = 0.2511 dict = 1.00 all = 0.2260 } ---------------------------- total value len = 16.850900 GB avg = 0.142 KB (by entry num) total key len = 3.307575 GB avg = 0.028 KB total ukey len = 2.331274 GB avg = 0.018 KB total ukey num = 0.132220230 Billion total entry num = 0.119027959 Billion write speed all = 0.456631518 MB/sec (with seq num) write speed all = 0.435061666 MB/sec (without seq num) 2024/11/23-21:10:58.329152 139957164807744 [compaction_job.cc:1948] [default] [JOB 35807] Generated table #280757: 1845393 keys, 60678267 bytes, temperature: kWarm 2024/11/23-21:10:58.329222 139957164807744 EVENT_LOG_v1 {"time_micros": 1732367458329180, "cf_name": "default", "job": 35807, "event": "table_file_creation", "file_number": 280757, "file_size": 60678267, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4012773557, "table_properties": {"data_size": 54430944, "index_size": 3509120, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 51671004, "raw_average_key_size": 28, "raw_value_size": 216764534, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 1845393, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367451, "oldest_key_time": 0, "file_creation_time": 1732367451, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 280757, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:10:58.387747 139957164807744 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280758.sst) /dev/shm/ToplingTemp/Topling-189103-K9qhug 2024/11/23-21:11:00.351940 139957164807744 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280758.sst): first pass time = 1.96's, 136.667'MB/sec 2024/11/23-21:11:02.647430 139957164807744 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280758.sst): old prealloc_size = 295279001, real_size = 55520016 2024/11/23-21:11:02.648468 139957164807744 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280758.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 1838600 prefix = 4 raw-key = 0.0294 GB zip-key = 0.0035 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.2170 GB zip-val = 0.0515 GB avg-val = 118.00 avg-zval = 28.03 2024/11/23-21:11:02.648922 139957164807744 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280758.sst: sumWaitingMem = 0.005 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0048 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:11:04.184922 139957164807744 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280758.sst): second pass time = 2.29's, 94.561'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.54's, 38.047'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3469.677'MB/sec (index lex order gen) rebuild zvType time = 1.28's, 0.358'MB/sec write SST data time = 0.25's, 231.939'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 2.162'MB, throughput = 68329.920'MB/sec zip my value time = 2.29's, unzip length = 0.217'GB zip my value throughput = 94.561'MB/sec zip pipeline throughput = 94.561'MB/sec entries = 1838600 avg-key = 28.00 avg-zkey = 1.91 avg-val = 118.00 avg-zval = 28.03 usrkeys = 1838600 avg-key = 20.00 avg-zkey = 1.91 avg-val = 119.03 avg-zval = 28.03 TagRS{ kinds = RS_Key0_TagN bytes = 287400 } TagArray{ size = 270371 bytes = 980112 } seq expand size = 1892597 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0368 GB value = 0.2170 GB dict = 2.16 MB all = 0.2684 GB } __ZipSize{ index = 0.0035 GB value = 0.0515 GB dict = 2.16 MB all = 0.0585 GB } UnZip/Zip{ index = 10.4474 value = 4.2094 dict = 1.00 all = 4.5889 } Zip/UnZip{ index = 0.0957 value = 0.2376 dict = 1.00 all = 0.2179 } ---------------------------- total value len = 17.069747 GB avg = 0.141 KB (by entry num) total key len = 3.359056 GB avg = 0.028 KB total ukey len = 2.368046 GB avg = 0.018 KB total ukey num = 0.134058830 Billion total entry num = 0.120866559 Billion write speed all = 0.462692907 MB/sec (with seq num) write speed all = 0.440792810 MB/sec (without seq num) 2024/11/23-21:11:04.252183 139957164807744 [compaction_job.cc:1948] [default] [JOB 35807] Generated table #280758: 1838600 keys, 58496857 bytes, temperature: kWarm 2024/11/23-21:11:04.252263 139957164807744 EVENT_LOG_v1 {"time_micros": 1732367464252226, "cf_name": "default", "job": 35807, "event": "table_file_creation", "file_number": 280758, "file_size": 58496857, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3912454559, "table_properties": {"data_size": 51540416, "index_size": 3519744, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 51480800, "raw_average_key_size": 28, "raw_value_size": 216954800, "raw_average_value_size": 118, "num_data_blocks": 1, "num_entries": 1838600, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 118, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367458, "oldest_key_time": 0, "file_creation_time": 1732367458, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 280758, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:11:04.307567 139957164807744 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280759.sst) /dev/shm/ToplingTemp/Topling-189103-QmQCIj 2024/11/23-21:11:06.072285 139957164807744 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280759.sst): first pass time = 1.76's, 152.115'MB/sec 2024/11/23-21:11:08.411114 139957164807744 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280759.sst): old prealloc_size = 295279001, real_size = 60586784 2024/11/23-21:11:08.412154 139957164807744 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280759.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 1850830 prefix = 4 raw-key = 0.0296 GB zip-key = 0.0035 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.2166 GB zip-val = 0.0566 GB avg-val = 117.04 avg-zval = 30.57 2024/11/23-21:11:08.412477 139957164807744 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280759.sst: sumWaitingMem = 0.005 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0049 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:11:10.003165 139957164807744 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280759.sst): second pass time = 2.34's, 92.668'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.59's, 39.601'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3473.648'MB/sec (index lex order gen) rebuild zvType time = 1.34's, 0.345'MB/sec write SST data time = 0.25's, 252.857'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 2.159'MB, throughput = 66607.051'MB/sec zip my value time = 2.34's, unzip length = 0.217'GB zip my value throughput = 92.668'MB/sec zip pipeline throughput = 92.668'MB/sec entries = 1850830 avg-key = 28.00 avg-zkey = 1.91 avg-val = 117.04 avg-zval = 30.57 usrkeys = 1850830 avg-key = 20.00 avg-zkey = 1.91 avg-val = 117.50 avg-zval = 30.57 TagRS{ kinds = RS_Key0_TagN bytes = 289280 } TagArray{ size = 123281 bytes = 462320 } seq expand size = 862967 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0370 GB value = 0.2166 GB dict = 2.16 MB all = 0.2684 GB } __ZipSize{ index = 0.0035 GB value = 0.0566 GB dict = 2.16 MB all = 0.0630 GB } UnZip/Zip{ index = 10.4498 value = 3.8283 dict = 1.00 all = 4.2578 } Zip/UnZip{ index = 0.0957 value = 0.2612 dict = 1.00 all = 0.2349 } ---------------------------- total value len = 17.287223 GB avg = 0.141 KB (by entry num) total key len = 3.410879 GB avg = 0.028 KB total ukey len = 2.405063 GB avg = 0.018 KB total ukey num = 0.135909660 Billion total entry num = 0.122717389 Billion write speed all = 0.468730495 MB/sec (with seq num) write speed all = 0.446497970 MB/sec (without seq num) 2024/11/23-21:11:10.076579 139957164807744 [compaction_job.cc:1948] [default] [JOB 35807] Generated table #280759: 1850830 keys, 63045431 bytes, temperature: kWarm 2024/11/23-21:11:10.076656 139957164807744 EVENT_LOG_v1 {"time_micros": 1732367470076621, "cf_name": "default", "job": 35807, "event": "table_file_creation", "file_number": 280759, "file_size": 63045431, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4012775712, "table_properties": {"data_size": 56581584, "index_size": 3542336, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 51823240, "raw_average_key_size": 28, "raw_value_size": 216612356, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 1850830, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367464, "oldest_key_time": 0, "file_creation_time": 1732367464, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 280759, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:11:10.133606 139957164807744 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280760.sst) /dev/shm/ToplingTemp/Topling-189103-NMbqdj 2024/11/23-21:11:11.837591 139957164807744 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280760.sst): first pass time = 1.70's, 157.538'MB/sec 2024/11/23-21:11:14.130302 139957164807744 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280760.sst): old prealloc_size = 295279001, real_size = 55127392 2024/11/23-21:11:14.131309 139957164807744 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280760.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 1838600 prefix = 4 raw-key = 0.0294 GB zip-key = 0.0035 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.2170 GB zip-val = 0.0511 GB avg-val = 118.00 avg-zval = 27.82 2024/11/23-21:11:14.131530 139957164807744 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280760.sst: sumWaitingMem = 0.005 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0048 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:11:15.742997 139957164807744 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280760.sst): second pass time = 2.29's, 94.682'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.61's, 35.449'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3575.191'MB/sec (index lex order gen) rebuild zvType time = 1.36's, 0.337'MB/sec write SST data time = 0.25's, 230.404'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 2.162'MB, throughput = 53589.571'MB/sec zip my value time = 2.29's, unzip length = 0.217'GB zip my value throughput = 94.682'MB/sec zip pipeline throughput = 94.682'MB/sec entries = 1838600 avg-key = 28.00 avg-zkey = 1.91 avg-val = 118.00 avg-zval = 27.82 usrkeys = 1838600 avg-key = 20.00 avg-zkey = 1.91 avg-val = 118.06 avg-zval = 27.82 TagRS{ kinds = RS_Key0_TagN bytes = 287400 } TagArray{ size = 15752 bytes = 43328 } seq expand size = 110264 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0368 GB value = 0.2170 GB dict = 2.16 MB all = 0.2684 GB } __ZipSize{ index = 0.0035 GB value = 0.0511 GB dict = 2.16 MB all = 0.0572 GB } UnZip/Zip{ index = 10.4487 value = 4.2417 dict = 1.00 all = 4.6956 } Zip/UnZip{ index = 0.0957 value = 0.2358 dict = 1.00 all = 0.2130 } ---------------------------- total value len = 17.504288 GB avg = 0.141 KB (by entry num) total key len = 3.462360 GB avg = 0.028 KB total ukey len = 2.441835 GB avg = 0.018 KB total ukey num = 0.137748260 Billion total entry num = 0.124555989 Billion write speed all = 0.474750291 MB/sec (with seq num) write speed all = 0.452187603 MB/sec (without seq num) 2024/11/23-21:11:15.810288 139957164807744 [compaction_job.cc:1948] [default] [JOB 35807] Generated table #280760: 1838600 keys, 57167385 bytes, temperature: kWarm 2024/11/23-21:11:15.810359 139957164807744 EVENT_LOG_v1 {"time_micros": 1732367475810322, "cf_name": "default", "job": 35807, "event": "table_file_creation", "file_number": 280760, "file_size": 57167385, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3772658215, "table_properties": {"data_size": 51148240, "index_size": 3519296, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 51480800, "raw_average_key_size": 28, "raw_value_size": 216954800, "raw_average_value_size": 118, "num_data_blocks": 1, "num_entries": 1838600, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 118, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367470, "oldest_key_time": 0, "file_creation_time": 1732367470, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 280760, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:11:15.866778 139957164807744 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280761.sst) /dev/shm/ToplingTemp/Topling-189103-7l2Hrg 2024/11/23-21:11:17.797589 139957164807744 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280761.sst): first pass time = 1.93's, 139.030'MB/sec 2024/11/23-21:11:20.124906 139957164807744 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280761.sst): old prealloc_size = 295279001, real_size = 58822656 2024/11/23-21:11:20.125942 139957164807744 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280761.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 1850382 prefix = 4 raw-key = 0.0296 GB zip-key = 0.0035 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.2166 GB zip-val = 0.0548 GB avg-val = 117.07 avg-zval = 29.64 2024/11/23-21:11:20.126770 139957164807744 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280761.sst: sumWaitingMem = 0.005 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0049 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:11:21.657014 139957164807744 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280761.sst): second pass time = 2.33's, 93.130'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.53's, 41.546'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3480.183'MB/sec (index lex order gen) rebuild zvType time = 1.27's, 0.363'MB/sec write SST data time = 0.26's, 248.070'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 2.159'MB, throughput = 65644.755'MB/sec zip my value time = 2.33's, unzip length = 0.217'GB zip my value throughput = 93.130'MB/sec zip pipeline throughput = 93.130'MB/sec entries = 1850382 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.07 avg-zval = 29.64 usrkeys = 1850382 avg-key = 20.00 avg-zkey = 1.90 avg-val = 120.25 avg-zval = 29.64 TagRS{ kinds = RS_Key0_TagN bytes = 289240 } TagArray{ size = 839207 bytes = 2832336 } seq expand size = 5874449 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0370 GB value = 0.2166 GB dict = 2.16 MB all = 0.2684 GB } __ZipSize{ index = 0.0035 GB value = 0.0548 GB dict = 2.16 MB all = 0.0637 GB } UnZip/Zip{ index = 10.5185 value = 3.9500 dict = 1.00 all = 4.2173 } Zip/UnZip{ index = 0.0951 value = 0.2532 dict = 1.00 all = 0.2371 } ---------------------------- total value len = 17.726787 GB avg = 0.140 KB (by entry num) total key len = 3.514171 GB avg = 0.028 KB total ukey len = 2.478842 GB avg = 0.018 KB total ukey num = 0.139598642 Billion total entry num = 0.126406371 Billion write speed all = 0.480897126 MB/sec (with seq num) write speed all = 0.458002316 MB/sec (without seq num) 2024/11/23-21:11:21.731477 139957164807744 [compaction_job.cc:1948] [default] [JOB 35807] Generated table #280761: 1850382 keys, 63651106 bytes, temperature: kWarm 2024/11/23-21:11:21.731546 139957164807744 EVENT_LOG_v1 {"time_micros": 1732367481731511, "cf_name": "default", "job": 35807, "event": "table_file_creation", "file_number": 280761, "file_size": 63651106, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4012776344, "table_properties": {"data_size": 54841520, "index_size": 3518336, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 51810696, "raw_average_key_size": 28, "raw_value_size": 216624804, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 1850382, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367475, "oldest_key_time": 0, "file_creation_time": 1732367475, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 280761, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:11:21.792320 139957164807744 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280762.sst) /dev/shm/ToplingTemp/Topling-189103-weFrHf 2024/11/23-21:11:23.573702 139957164807744 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280762.sst): first pass time = 1.78's, 150.692'MB/sec 2024/11/23-21:11:25.859935 139957164807744 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280762.sst): old prealloc_size = 295279001, real_size = 55453248 2024/11/23-21:11:25.861044 139957164807744 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280762.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 1838600 prefix = 4 raw-key = 0.0294 GB zip-key = 0.0035 GB avg-key = 16.00 avg-zkey = 1.93 raw-val = 0.2170 GB zip-val = 0.0515 GB avg-val = 118.00 avg-zval = 27.98 2024/11/23-21:11:25.861592 139957164807744 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280762.sst: sumWaitingMem = 0.005 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0048 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:11:27.464776 139957164807744 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280762.sst): second pass time = 2.28's, 94.951'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.60's, 36.541'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3335.236'MB/sec (index lex order gen) rebuild zvType time = 1.35's, 0.340'MB/sec write SST data time = 0.25's, 232.631'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 2.162'MB, throughput = 68887.218'MB/sec zip my value time = 2.28's, unzip length = 0.217'GB zip my value throughput = 94.951'MB/sec zip pipeline throughput = 94.951'MB/sec entries = 1838600 avg-key = 28.00 avg-zkey = 1.93 avg-val = 118.00 avg-zval = 27.98 usrkeys = 1838600 avg-key = 20.00 avg-zkey = 1.93 avg-val = 119.30 avg-zval = 27.98 TagRS{ kinds = RS_Key0_TagN bytes = 287400 } TagArray{ size = 340272 bytes = 1190960 } seq expand size = 2381904 multi value expand size = 0 cnt WriteAppend = 15 UnZipSize{ index = 0.0368 GB value = 0.2170 GB dict = 2.16 MB all = 0.2684 GB } __ZipSize{ index = 0.0035 GB value = 0.0515 GB dict = 2.16 MB all = 0.0586 GB } UnZip/Zip{ index = 10.3813 value = 4.2167 dict = 1.00 all = 4.5776 } Zip/UnZip{ index = 0.0963 value = 0.2372 dict = 1.00 all = 0.2185 } ---------------------------- total value len = 17.946124 GB avg = 0.140 KB (by entry num) total key len = 3.565652 GB avg = 0.028 KB total ukey len = 2.515614 GB avg = 0.018 KB total ukey num = 0.141437242 Billion total entry num = 0.128244971 Billion write speed all = 0.486964427 MB/sec (with seq num) write speed all = 0.463739663 MB/sec (without seq num) 2024/11/23-21:11:27.533116 139957164807744 [compaction_job.cc:1948] [default] [JOB 35807] Generated table #280762: 1838600 keys, 58640857 bytes, temperature: kWarm 2024/11/23-21:11:27.533185 139957164807744 EVENT_LOG_v1 {"time_micros": 1732367487533149, "cf_name": "default", "job": 35807, "event": "table_file_creation", "file_number": 280762, "file_size": 58640857, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3680844404, "table_properties": {"data_size": 51451248, "index_size": 3542144, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 51480800, "raw_average_key_size": 28, "raw_value_size": 216954800, "raw_average_value_size": 118, "num_data_blocks": 1, "num_entries": 1838600, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 118, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367481, "oldest_key_time": 0, "file_creation_time": 1732367481, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 280762, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:11:27.588384 139957164807744 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280763.sst) /dev/shm/ToplingTemp/Topling-189103-cbNxoi 2024/11/23-21:11:29.327601 139957164807744 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280763.sst): first pass time = 1.74's, 154.347'MB/sec 2024/11/23-21:11:31.604275 139957164807744 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280763.sst): old prealloc_size = 295279001, real_size = 55264816 2024/11/23-21:11:31.605322 139957164807744 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280763.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 1844291 prefix = 4 raw-key = 0.0295 GB zip-key = 0.0035 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.2168 GB zip-val = 0.0513 GB avg-val = 117.55 avg-zval = 27.80 2024/11/23-21:11:31.605363 139957164807744 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280763.sst: sumWaitingMem = 0.005 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0048 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:11:33.096629 139957164807744 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280763.sst): second pass time = 2.28's, 95.276'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.49's, 38.175'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3448.321'MB/sec (index lex order gen) rebuild zvType time = 1.24's, 0.371'MB/sec write SST data time = 0.25's, 229.956'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 2.160'MB, throughput = 62971.805'MB/sec zip my value time = 2.28's, unzip length = 0.217'GB zip my value throughput = 95.276'MB/sec zip pipeline throughput = 95.276'MB/sec entries = 1844291 avg-key = 28.00 avg-zkey = 1.91 avg-val = 117.55 avg-zval = 27.80 usrkeys = 1844291 avg-key = 20.00 avg-zkey = 1.91 avg-val = 117.55 avg-zval = 27.80 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 8 UnZipSize{ index = 0.0369 GB value = 0.2168 GB dict = 2.16 MB all = 0.2684 GB } __ZipSize{ index = 0.0035 GB value = 0.0513 GB dict = 2.16 MB all = 0.0570 GB } UnZip/Zip{ index = 10.4493 value = 4.2282 dict = 1.00 all = 4.7119 } Zip/UnZip{ index = 0.0957 value = 0.2365 dict = 1.00 all = 0.2122 } ---------------------------- total value len = 18.162919 GB avg = 0.140 KB (by entry num) total key len = 3.617292 GB avg = 0.028 KB total ukey len = 2.552500 GB avg = 0.018 KB total ukey num = 0.143281533 Billion total entry num = 0.130089262 Billion write speed all = 0.492978183 MB/sec (with seq num) write speed all = 0.469422426 MB/sec (without seq num) 2024/11/23-21:11:33.163236 139957164807744 [compaction_job.cc:1948] [default] [JOB 35807] Generated table #280763: 1844291 keys, 56970180 bytes, temperature: kWarm 2024/11/23-21:11:33.163308 139957164807744 EVENT_LOG_v1 {"time_micros": 1732367493163272, "cf_name": "default", "job": 35807, "event": "table_file_creation", "file_number": 280763, "file_size": 56970180, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 51273568, "index_size": 3529984, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 51640148, "raw_average_key_size": 28, "raw_value_size": 216795390, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 1844291, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367487, "oldest_key_time": 0, "file_creation_time": 1732367487, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 280763, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:11:33.233532 139957164807744 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280764.sst) /dev/shm/ToplingTemp/Topling-189103-PvUibj 2024/11/23-21:11:34.907800 139957164807744 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280764.sst): first pass time = 1.67's, 160.334'MB/sec 2024/11/23-21:11:38.019014 139957164807744 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280764.sst): old prealloc_size = 295279001, real_size = 71780864 2024/11/23-21:11:38.020112 139957164807744 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280764.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 1858258 prefix = 4 raw-key = 0.0297 GB zip-key = 0.0036 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.2164 GB zip-val = 0.0678 GB avg-val = 116.46 avg-zval = 36.46 2024/11/23-21:11:38.020165 139957164807744 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280764.sst: sumWaitingMem = 0.005 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0049 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:11:39.462892 139957164807744 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280764.sst): second pass time = 3.11's, 69.586'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.44's, 50.900'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3310.442'MB/sec (index lex order gen) rebuild zvType time = 1.19's, 0.390'MB/sec write SST data time = 0.25's, 291.115'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 2.157'MB, throughput = 62446.124'MB/sec zip my value time = 3.11's, unzip length = 0.216'GB zip my value throughput = 69.586'MB/sec zip pipeline throughput = 69.586'MB/sec entries = 1858258 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.46 avg-zval = 36.46 usrkeys = 1858258 avg-key = 20.00 avg-zkey = 1.91 avg-val = 116.46 avg-zval = 36.46 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 10 UnZipSize{ index = 0.0372 GB value = 0.2164 GB dict = 2.16 MB all = 0.2684 GB } __ZipSize{ index = 0.0036 GB value = 0.0678 GB dict = 2.16 MB all = 0.0735 GB } UnZip/Zip{ index = 10.4464 value = 3.1938 dict = 1.00 all = 3.6525 } Zip/UnZip{ index = 0.0957 value = 0.3131 dict = 1.00 all = 0.2738 } ---------------------------- total value len = 18.379323 GB avg = 0.139 KB (by entry num) total key len = 3.669323 GB avg = 0.028 KB total ukey len = 2.589665 GB avg = 0.018 KB total ukey num = 0.145139791 Billion total entry num = 0.131947520 Billion write speed all = 0.498982110 MB/sec (with seq num) write speed all = 0.475093314 MB/sec (without seq num) 2024/11/23-21:11:39.547917 139957164807744 [compaction_job.cc:1948] [default] [JOB 35807] Generated table #280764: 1858258 keys, 73493082 bytes, temperature: kWarm 2024/11/23-21:11:39.548003 139957164807744 EVENT_LOG_v1 {"time_micros": 1732367499547951, "cf_name": "default", "job": 35807, "event": "table_file_creation", "file_number": 280764, "file_size": 73493082, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 67758448, "index_size": 3557696, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 52031224, "raw_average_key_size": 28, "raw_value_size": 216404232, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 1858258, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367493, "oldest_key_time": 0, "file_creation_time": 1732367493, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 280764, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:11:39.603587 139957164807744 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280765.sst) /dev/shm/ToplingTemp/Topling-189103-VycXoj 2024/11/23-21:11:41.207213 139957164807744 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280765.sst): first pass time = 1.60's, 167.396'MB/sec 2024/11/23-21:11:44.351742 139957164807744 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280765.sst): old prealloc_size = 295279001, real_size = 72177040 2024/11/23-21:11:44.352777 139957164807744 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280765.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 1853878 prefix = 4 raw-key = 0.0297 GB zip-key = 0.0035 GB avg-key = 16.00 avg-zkey = 1.89 raw-val = 0.2165 GB zip-val = 0.0682 GB avg-val = 116.80 avg-zval = 36.79 2024/11/23-21:11:44.352818 139957164807744 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280765.sst: sumWaitingMem = 0.005 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0049 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:11:45.754806 139957164807744 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280765.sst): second pass time = 3.14's, 68.893'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.40's, 52.664'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3460.651'MB/sec (index lex order gen) rebuild zvType time = 1.15's, 0.403'MB/sec write SST data time = 0.25's, 293.199'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 2.158'MB, throughput = 61032.747'MB/sec zip my value time = 3.14's, unzip length = 0.217'GB zip my value throughput = 68.893'MB/sec zip pipeline throughput = 68.893'MB/sec entries = 1853878 avg-key = 28.00 avg-zkey = 1.89 avg-val = 116.80 avg-zval = 36.79 usrkeys = 1853878 avg-key = 20.00 avg-zkey = 1.89 avg-val = 116.80 avg-zval = 36.79 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 8 UnZipSize{ index = 0.0371 GB value = 0.2165 GB dict = 2.16 MB all = 0.2684 GB } __ZipSize{ index = 0.0035 GB value = 0.0682 GB dict = 2.16 MB all = 0.0739 GB } UnZip/Zip{ index = 10.5863 value = 3.1744 dict = 1.00 all = 3.6329 } Zip/UnZip{ index = 0.0945 value = 0.3150 dict = 1.00 all = 0.2753 } ---------------------------- total value len = 18.595850 GB avg = 0.139 KB (by entry num) total key len = 3.721232 GB avg = 0.028 KB total ukey len = 2.626743 GB avg = 0.018 KB total ukey num = 0.146993669 Billion total entry num = 0.133801398 Billion write speed all = 0.504985160 MB/sec (with seq num) write speed all = 0.480764173 MB/sec (without seq num) 2024/11/23-21:11:45.839164 139957164807744 [compaction_job.cc:1948] [default] [JOB 35807] Generated table #280765: 1853878 keys, 73889636 bytes, temperature: kWarm 2024/11/23-21:11:45.839241 139957164807744 EVENT_LOG_v1 {"time_micros": 1732367505839198, "cf_name": "default", "job": 35807, "event": "table_file_creation", "file_number": 280765, "file_size": 73889636, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 68211008, "index_size": 3502400, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 51908584, "raw_average_key_size": 28, "raw_value_size": 216527012, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 1853878, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367499, "oldest_key_time": 0, "file_creation_time": 1732367499, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 280765, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:11:45.893606 139957164807744 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280766.sst) /dev/shm/ToplingTemp/Topling-189103-DXD9Zh 2024/11/23-21:11:47.777870 139957164807744 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280766.sst): first pass time = 1.88's, 142.464'MB/sec 2024/11/23-21:11:50.907181 139957164807744 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280766.sst): old prealloc_size = 295279001, real_size = 72160368 2024/11/23-21:11:50.908313 139957164807744 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280766.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 1853745 prefix = 4 raw-key = 0.0297 GB zip-key = 0.0035 GB avg-key = 16.00 avg-zkey = 1.89 raw-val = 0.2165 GB zip-val = 0.0682 GB avg-val = 116.81 avg-zval = 36.79 2024/11/23-21:11:50.908356 139957164807744 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280766.sst: sumWaitingMem = 0.005 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0049 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:11:52.309911 139957164807744 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280766.sst): second pass time = 3.13's, 69.222'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.40's, 52.665'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3263.520'MB/sec (index lex order gen) rebuild zvType time = 1.15's, 0.403'MB/sec write SST data time = 0.25's, 293.168'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 2.159'MB, throughput = 69235.951'MB/sec zip my value time = 3.13's, unzip length = 0.217'GB zip my value throughput = 69.222'MB/sec zip pipeline throughput = 69.222'MB/sec entries = 1853745 avg-key = 28.00 avg-zkey = 1.89 avg-val = 116.81 avg-zval = 36.79 usrkeys = 1853745 avg-key = 20.00 avg-zkey = 1.89 avg-val = 116.81 avg-zval = 36.79 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 8 UnZipSize{ index = 0.0371 GB value = 0.2165 GB dict = 2.16 MB all = 0.2684 GB } __ZipSize{ index = 0.0035 GB value = 0.0682 GB dict = 2.16 MB all = 0.0739 GB } UnZip/Zip{ index = 10.5871 value = 3.1752 dict = 1.00 all = 3.6337 } Zip/UnZip{ index = 0.0945 value = 0.3149 dict = 1.00 all = 0.2752 } ---------------------------- total value len = 18.812381 GB avg = 0.139 KB (by entry num) total key len = 3.773136 GB avg = 0.028 KB total ukey len = 2.663818 GB avg = 0.018 KB total ukey num = 0.148847414 Billion total entry num = 0.135655143 Billion write speed all = 0.510983457 MB/sec (with seq num) write speed all = 0.486430542 MB/sec (without seq num) 2024/11/23-21:11:52.395896 139957164807744 [compaction_job.cc:1948] [default] [JOB 35807] Generated table #280766: 1853745 keys, 73873256 bytes, temperature: kWarm 2024/11/23-21:11:52.395966 139957164807744 EVENT_LOG_v1 {"time_micros": 1732367512395930, "cf_name": "default", "job": 35807, "event": "table_file_creation", "file_number": 280766, "file_size": 73873256, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 68194848, "index_size": 3501888, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 51904860, "raw_average_key_size": 28, "raw_value_size": 216530630, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 1853745, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367505, "oldest_key_time": 0, "file_creation_time": 1732367505, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 280766, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:11:52.457794 139957164807744 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280767.sst) /dev/shm/ToplingTemp/Topling-189103-5AZ0Qi 2024/11/23-21:11:54.882529 139957164807744 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280767.sst): first pass time = 2.42's, 110.710'MB/sec 2024/11/23-21:11:57.971283 139957164807744 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280767.sst): old prealloc_size = 295279001, real_size = 72648688 2024/11/23-21:11:57.972408 139957164807744 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280767.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 1852484 prefix = 4 raw-key = 0.0296 GB zip-key = 0.0035 GB avg-key = 16.00 avg-zkey = 1.89 raw-val = 0.2166 GB zip-val = 0.0687 GB avg-val = 116.91 avg-zval = 37.08 2024/11/23-21:11:57.972451 139957164807744 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280767.sst: sumWaitingMem = 0.005 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0049 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:11:59.401239 139957164807744 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280767.sst): second pass time = 3.09's, 70.143'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.43's, 52.004'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3224.154'MB/sec (index lex order gen) rebuild zvType time = 1.18's, 0.393'MB/sec write SST data time = 0.25's, 298.374'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 2.159'MB, throughput = 60546.668'MB/sec zip my value time = 3.09's, unzip length = 0.217'GB zip my value throughput = 70.143'MB/sec zip pipeline throughput = 70.143'MB/sec entries = 1852484 avg-key = 28.00 avg-zkey = 1.89 avg-val = 116.91 avg-zval = 37.08 usrkeys = 1852484 avg-key = 20.00 avg-zkey = 1.89 avg-val = 116.91 avg-zval = 37.08 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0370 GB value = 0.2166 GB dict = 2.16 MB all = 0.2684 GB } __ZipSize{ index = 0.0035 GB value = 0.0687 GB dict = 2.16 MB all = 0.0744 GB } UnZip/Zip{ index = 10.5869 value = 3.1530 dict = 1.00 all = 3.6098 } Zip/UnZip{ index = 0.0945 value = 0.3172 dict = 1.00 all = 0.2770 } ---------------------------- total value len = 19.028947 GB avg = 0.138 KB (by entry num) total key len = 3.825006 GB avg = 0.028 KB total ukey len = 2.700867 GB avg = 0.018 KB total ukey num = 0.150699898 Billion total entry num = 0.137507627 Billion write speed all = 0.516973702 MB/sec (with seq num) write speed all = 0.492089490 MB/sec (without seq num) 2024/11/23-21:11:59.487515 139957164807744 [compaction_job.cc:1948] [default] [JOB 35807] Generated table #280767: 1852484 keys, 74362248 bytes, temperature: kWarm 2024/11/23-21:11:59.487586 139957164807744 EVENT_LOG_v1 {"time_micros": 1732367519487549, "cf_name": "default", "job": 35807, "event": "table_file_creation", "file_number": 280767, "file_size": 74362248, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 68685792, "index_size": 3499584, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 51869552, "raw_average_key_size": 28, "raw_value_size": 216565904, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 1852484, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367512, "oldest_key_time": 0, "file_creation_time": 1732367512, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 280767, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:11:59.562484 139957164807744 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280768.sst) /dev/shm/ToplingTemp/Topling-189103-YJrlng 2024/11/23-21:12:01.503246 139957164807744 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280768.sst): first pass time = 1.94's, 138.318'MB/sec 2024/11/23-21:12:03.926437 139957164807744 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280768.sst): old prealloc_size = 295279001, real_size = 71015984 2024/11/23-21:12:03.927461 139957164807744 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280768.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 1844989 prefix = 4 raw-key = 0.0295 GB zip-key = 0.0035 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.2168 GB zip-val = 0.0670 GB avg-val = 117.49 avg-zval = 36.34 2024/11/23-21:12:03.927503 139957164807744 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280768.sst: sumWaitingMem = 0.005 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0048 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:12:05.551225 139957164807744 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280768.sst): second pass time = 2.42's, 89.505'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.62's, 44.761'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3511.903'MB/sec (index lex order gen) rebuild zvType time = 1.38's, 0.335'MB/sec write SST data time = 0.25's, 293.773'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 2.160'MB, throughput = 66088.790'MB/sec zip my value time = 2.42's, unzip length = 0.217'GB zip my value throughput = 89.505'MB/sec zip pipeline throughput = 89.505'MB/sec entries = 1844989 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.49 avg-zval = 36.34 usrkeys = 1844989 avg-key = 20.00 avg-zkey = 1.90 avg-val = 117.49 avg-zval = 36.34 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0369 GB value = 0.2168 GB dict = 2.16 MB all = 0.2684 GB } __ZipSize{ index = 0.0035 GB value = 0.0670 GB dict = 2.16 MB all = 0.0727 GB } UnZip/Zip{ index = 10.5185 value = 3.2332 dict = 1.00 all = 3.6911 } Zip/UnZip{ index = 0.0951 value = 0.3093 dict = 1.00 all = 0.2709 } ---------------------------- total value len = 19.245723 GB avg = 0.138 KB (by entry num) total key len = 3.876666 GB avg = 0.028 KB total ukey len = 2.737767 GB avg = 0.018 KB total ukey num = 0.152544887 Billion total entry num = 0.139352616 Billion write speed all = 0.522973163 MB/sec (with seq num) write speed all = 0.497758578 MB/sec (without seq num) 2024/11/23-21:12:05.634127 139957164807744 [compaction_job.cc:1948] [default] [JOB 35807] Generated table #280768: 1844989 keys, 72725170 bytes, temperature: kWarm 2024/11/23-21:12:05.634198 139957164807744 EVENT_LOG_v1 {"time_micros": 1732367525634161, "cf_name": "default", "job": 35807, "event": "table_file_creation", "file_number": 280768, "file_size": 72725170, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 67046432, "index_size": 3508096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 51659692, "raw_average_key_size": 28, "raw_value_size": 216775866, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 1844989, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367519, "oldest_key_time": 0, "file_creation_time": 1732367519, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 280768, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:12:05.692781 139957164807744 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280769.sst) /dev/shm/ToplingTemp/Topling-189103-JYZsmh 2024/11/23-21:12:07.317388 139957164807744 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280769.sst): first pass time = 1.62's, 165.234'MB/sec 2024/11/23-21:12:10.404225 139957164807744 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280769.sst): old prealloc_size = 295279001, real_size = 72538320 2024/11/23-21:12:10.405330 139957164807744 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280769.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 1853197 prefix = 4 raw-key = 0.0297 GB zip-key = 0.0035 GB avg-key = 16.00 avg-zkey = 1.89 raw-val = 0.2165 GB zip-val = 0.0686 GB avg-val = 116.85 avg-zval = 37.00 2024/11/23-21:12:10.405636 139957164807744 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280769.sst: sumWaitingMem = 0.005 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0049 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:12:11.838671 139957164807744 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280769.sst): second pass time = 3.09's, 70.181'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.43's, 52.302'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3239.292'MB/sec (index lex order gen) rebuild zvType time = 1.18's, 0.393'MB/sec write SST data time = 0.25's, 294.563'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 2.158'MB, throughput = 66603.802'MB/sec zip my value time = 3.09's, unzip length = 0.217'GB zip my value throughput = 70.181'MB/sec zip pipeline throughput = 70.181'MB/sec entries = 1853197 avg-key = 28.00 avg-zkey = 1.89 avg-val = 116.85 avg-zval = 37.00 usrkeys = 1853197 avg-key = 20.00 avg-zkey = 1.89 avg-val = 117.43 avg-zval = 37.00 TagRS{ kinds = RS_Key0_TagN bytes = 289680 } TagArray{ size = 154398 bytes = 482512 } seq expand size = 1080786 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0371 GB value = 0.2165 GB dict = 2.16 MB all = 0.2684 GB } __ZipSize{ index = 0.0035 GB value = 0.0686 GB dict = 2.16 MB all = 0.0750 GB } UnZip/Zip{ index = 10.5865 value = 3.1579 dict = 1.00 all = 3.5780 } Zip/UnZip{ index = 0.0945 value = 0.3167 dict = 1.00 all = 0.2795 } ---------------------------- total value len = 19.463350 GB avg = 0.138 KB (by entry num) total key len = 3.928555 GB avg = 0.028 KB total ukey len = 2.774831 GB avg = 0.018 KB total ukey num = 0.154398084 Billion total entry num = 0.141205813 Billion write speed all = 0.528993751 MB/sec (with seq num) write speed all = 0.503447480 MB/sec (without seq num) 2024/11/23-21:12:11.925923 139957164807744 [compaction_job.cc:1948] [default] [JOB 35807] Generated table #280769: 1853197 keys, 75023537 bytes, temperature: kWarm 2024/11/23-21:12:11.926008 139957164807744 EVENT_LOG_v1 {"time_micros": 1732367531925957, "cf_name": "default", "job": 35807, "event": "table_file_creation", "file_number": 280769, "file_size": 75023537, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3273700812, "table_properties": {"data_size": 68573760, "index_size": 3501056, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 51889516, "raw_average_key_size": 28, "raw_value_size": 216546010, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 1853197, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367525, "oldest_key_time": 0, "file_creation_time": 1732367525, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 280769, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:12:11.980466 139957164807744 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280770.sst) /dev/shm/ToplingTemp/Topling-189103-jK6MAi 2024/11/23-21:12:13.856138 139957164807744 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280770.sst): first pass time = 1.88's, 143.117'MB/sec 2024/11/23-21:12:16.964341 139957164807744 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280770.sst): old prealloc_size = 295279001, real_size = 72142912 2024/11/23-21:12:16.965360 139957164807744 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280770.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 1853701 prefix = 4 raw-key = 0.0297 GB zip-key = 0.0035 GB avg-key = 16.00 avg-zkey = 1.89 raw-val = 0.2165 GB zip-val = 0.0682 GB avg-val = 116.81 avg-zval = 36.78 2024/11/23-21:12:16.965402 139957164807744 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280770.sst: sumWaitingMem = 0.005 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0049 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:12:18.359190 139957164807744 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280770.sst): second pass time = 3.11's, 69.693'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.39's, 52.950'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3505.405'MB/sec (index lex order gen) rebuild zvType time = 1.14's, 0.405'MB/sec write SST data time = 0.25's, 296.775'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 2.159'MB, throughput = 65282.811'MB/sec zip my value time = 3.11's, unzip length = 0.217'GB zip my value throughput = 69.693'MB/sec zip pipeline throughput = 69.693'MB/sec entries = 1853701 avg-key = 28.00 avg-zkey = 1.89 avg-val = 116.81 avg-zval = 36.78 usrkeys = 1853701 avg-key = 20.00 avg-zkey = 1.89 avg-val = 116.81 avg-zval = 36.78 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 8 UnZipSize{ index = 0.0371 GB value = 0.2165 GB dict = 2.16 MB all = 0.2684 GB } __ZipSize{ index = 0.0035 GB value = 0.0682 GB dict = 2.16 MB all = 0.0739 GB } UnZip/Zip{ index = 10.5867 value = 3.1760 dict = 1.00 all = 3.6346 } Zip/UnZip{ index = 0.0945 value = 0.3149 dict = 1.00 all = 0.2751 } ---------------------------- total value len = 19.679881 GB avg = 0.138 KB (by entry num) total key len = 3.980459 GB avg = 0.028 KB total ukey len = 2.811905 GB avg = 0.018 KB total ukey num = 0.156251785 Billion total entry num = 0.143059514 Billion write speed all = 0.534985370 MB/sec (with seq num) write speed all = 0.509107552 MB/sec (without seq num) 2024/11/23-21:12:18.443390 139957164807744 [compaction_job.cc:1948] [default] [JOB 35807] Generated table #280770: 1853701 keys, 73856056 bytes, temperature: kWarm 2024/11/23-21:12:18.443458 139957164807744 EVENT_LOG_v1 {"time_micros": 1732367538443422, "cf_name": "default", "job": 35807, "event": "table_file_creation", "file_number": 280770, "file_size": 73856056, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 68177328, "index_size": 3501952, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 51903628, "raw_average_key_size": 28, "raw_value_size": 216531878, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 1853701, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367531, "oldest_key_time": 0, "file_creation_time": 1732367531, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 280770, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:12:18.500279 139957164807744 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280771.sst) /dev/shm/ToplingTemp/Topling-189103-Eo7kMg 2024/11/23-21:12:20.654442 139957164807744 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280771.sst): first pass time = 2.15's, 124.615'MB/sec 2024/11/23-21:12:23.775771 139957164807744 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280771.sst): old prealloc_size = 295279001, real_size = 72709392 2024/11/23-21:12:23.776886 139957164807744 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280771.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 1852386 prefix = 4 raw-key = 0.0296 GB zip-key = 0.0035 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.2166 GB zip-val = 0.0687 GB avg-val = 116.91 avg-zval = 37.10 2024/11/23-21:12:23.777150 139957164807744 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280771.sst: sumWaitingMem = 0.005 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0049 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:12:25.190125 139957164807744 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280771.sst): second pass time = 3.12's, 69.414'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.41's, 52.966'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3279.067'MB/sec (index lex order gen) rebuild zvType time = 1.16's, 0.398'MB/sec write SST data time = 0.25's, 301.130'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 2.159'MB, throughput = 62414.954'MB/sec zip my value time = 3.12's, unzip length = 0.217'GB zip my value throughput = 69.414'MB/sec zip pipeline throughput = 69.414'MB/sec entries = 1852386 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.91 avg-zval = 37.10 usrkeys = 1852386 avg-key = 20.00 avg-zkey = 1.90 avg-val = 117.16 avg-zval = 37.10 TagRS{ kinds = RS_Key0_TagN bytes = 289520 } TagArray{ size = 66202 bytes = 198624 } seq expand size = 463414 multi value expand size = 0 cnt WriteAppend = 15 UnZipSize{ index = 0.0370 GB value = 0.2166 GB dict = 2.16 MB all = 0.2684 GB } __ZipSize{ index = 0.0035 GB value = 0.0687 GB dict = 2.16 MB all = 0.0749 GB } UnZip/Zip{ index = 10.5165 value = 3.1513 dict = 1.00 all = 3.5834 } Zip/UnZip{ index = 0.0951 value = 0.3173 dict = 1.00 all = 0.2791 } ---------------------------- total value len = 19.896914 GB avg = 0.137 KB (by entry num) total key len = 4.032326 GB avg = 0.028 KB total ukey len = 2.848953 GB avg = 0.018 KB total ukey num = 0.158104171 Billion total entry num = 0.144911900 Billion write speed all = 0.540981904 MB/sec (with seq num) write speed all = 0.514773059 MB/sec (without seq num) 2024/11/23-21:12:25.277351 139957164807744 [compaction_job.cc:1948] [default] [JOB 35807] Generated table #280771: 1852386 keys, 74911019 bytes, temperature: kWarm 2024/11/23-21:12:25.277418 139957164807744 EVENT_LOG_v1 {"time_micros": 1732367545277384, "cf_name": "default", "job": 35807, "event": "table_file_creation", "file_number": 280771, "file_size": 74911019, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4025670058, "table_properties": {"data_size": 68723264, "index_size": 3522816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 51866808, "raw_average_key_size": 28, "raw_value_size": 216568780, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 1852386, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367538, "oldest_key_time": 0, "file_creation_time": 1732367538, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 280771, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:12:25.342400 139957164807744 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280772.sst) /dev/shm/ToplingTemp/Topling-189103-GZ9Qkh 2024/11/23-21:12:27.675890 139957164807744 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280772.sst): first pass time = 2.33's, 115.038'MB/sec 2024/11/23-21:12:29.982624 139957164807744 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280772.sst): old prealloc_size = 295279001, real_size = 59940976 2024/11/23-21:12:29.983685 139957164807744 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280772.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 1843176 prefix = 4 raw-key = 0.0295 GB zip-key = 0.0035 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.2168 GB zip-val = 0.0560 GB avg-val = 117.64 avg-zval = 30.37 2024/11/23-21:12:29.984162 139957164807744 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280772.sst: sumWaitingMem = 0.005 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0048 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:12:31.526863 139957164807744 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280772.sst): second pass time = 2.31's, 94.053'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.54's, 40.904'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3373.832'MB/sec (index lex order gen) rebuild zvType time = 1.29's, 0.357'MB/sec write SST data time = 0.25's, 251.121'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 2.161'MB, throughput = 64158.456'MB/sec zip my value time = 2.31's, unzip length = 0.217'GB zip my value throughput = 94.053'MB/sec zip pipeline throughput = 94.053'MB/sec entries = 1843176 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.64 avg-zval = 30.37 usrkeys = 1843176 avg-key = 20.00 avg-zkey = 1.90 avg-val = 119.02 avg-zval = 30.37 TagRS{ kinds = RS_Key0_TagN bytes = 288080 } TagArray{ size = 362943 bytes = 1224944 } seq expand size = 2540601 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0369 GB value = 0.2168 GB dict = 2.16 MB all = 0.2684 GB } __ZipSize{ index = 0.0035 GB value = 0.0560 GB dict = 2.16 MB all = 0.0632 GB } UnZip/Zip{ index = 10.5170 value = 3.8736 dict = 1.00 all = 4.2498 } Zip/UnZip{ index = 0.0951 value = 0.2582 dict = 1.00 all = 0.2353 } ---------------------------- total value len = 20.116281 GB avg = 0.137 KB (by entry num) total key len = 4.083935 GB avg = 0.028 KB total ukey len = 2.885816 GB avg = 0.018 KB total ukey num = 0.159947347 Billion total entry num = 0.146755076 Billion write speed all = 0.547029649 MB/sec (with seq num) write speed all = 0.520491248 MB/sec (without seq num) 2024/11/23-21:12:31.601363 139957164807744 [compaction_job.cc:1948] [default] [JOB 35807] Generated table #280772: 1843176 keys, 63164201 bytes, temperature: kWarm 2024/11/23-21:12:31.601429 139957164807744 EVENT_LOG_v1 {"time_micros": 1732367551601396, "cf_name": "default", "job": 35807, "event": "table_file_creation", "file_number": 280772, "file_size": 63164201, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4261176248, "table_properties": {"data_size": 55974816, "index_size": 3505152, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 51608928, "raw_average_key_size": 28, "raw_value_size": 216826628, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 1843176, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367545, "oldest_key_time": 0, "file_creation_time": 1732367545, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 280772, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:12:31.656771 139957164807744 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280773.sst) /dev/shm/ToplingTemp/Topling-189103-PPCMGh 2024/11/23-21:12:32.864568 139957164807744 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280773.sst): first pass time = 1.21's, 222.258'MB/sec 2024/11/23-21:12:35.172932 139957164807744 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280773.sst): old prealloc_size = 295279001, real_size = 60898224 2024/11/23-21:12:35.173959 139957164807744 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280773.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 1843001 prefix = 4 raw-key = 0.0295 GB zip-key = 0.0035 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.2168 GB zip-val = 0.0569 GB avg-val = 117.65 avg-zval = 30.89 2024/11/23-21:12:35.174386 139957164807744 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280773.sst: sumWaitingMem = 0.005 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0048 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:12:36.735094 139957164807744 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280773.sst): second pass time = 2.31's, 93.983'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.56's, 40.856'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3444.419'MB/sec (index lex order gen) rebuild zvType time = 1.31's, 0.353'MB/sec write SST data time = 0.25's, 250.404'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 2.161'MB, throughput = 64496.373'MB/sec zip my value time = 2.31's, unzip length = 0.217'GB zip my value throughput = 93.983'MB/sec zip pipeline throughput = 93.983'MB/sec entries = 1843001 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.65 avg-zval = 30.89 usrkeys = 1843001 avg-key = 20.00 avg-zkey = 1.90 avg-val = 118.78 avg-zval = 30.89 TagRS{ kinds = RS_Key0_TagN bytes = 288080 } TagArray{ size = 296434 bytes = 926368 } seq expand size = 2075038 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0369 GB value = 0.2168 GB dict = 2.16 MB all = 0.2684 GB } __ZipSize{ index = 0.0035 GB value = 0.0569 GB dict = 2.16 MB all = 0.0638 GB } UnZip/Zip{ index = 10.5177 value = 3.8086 dict = 1.00 all = 4.2059 } Zip/UnZip{ index = 0.0951 value = 0.2626 dict = 1.00 all = 0.2378 } ---------------------------- total value len = 20.335187 GB avg = 0.137 KB (by entry num) total key len = 4.135539 GB avg = 0.028 KB total ukey len = 2.922676 GB avg = 0.018 KB total ukey num = 0.161790348 Billion total entry num = 0.148598077 Billion write speed all = 0.553079245 MB/sec (with seq num) write speed all = 0.526210728 MB/sec (without seq num) 2024/11/23-21:12:36.808174 139957164807744 [compaction_job.cc:1948] [default] [JOB 35807] Generated table #280773: 1843001 keys, 63822917 bytes, temperature: kWarm 2024/11/23-21:12:36.808250 139957164807744 EVENT_LOG_v1 {"time_micros": 1732367556808214, "cf_name": "default", "job": 35807, "event": "table_file_creation", "file_number": 280773, "file_size": 63822917, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4261176266, "table_properties": {"data_size": 56932704, "index_size": 3504576, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 51604028, "raw_average_key_size": 28, "raw_value_size": 216831438, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 1843001, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367551, "oldest_key_time": 0, "file_creation_time": 1732367551, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 280773, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:12:36.865461 139957164807744 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280774.sst) /dev/shm/ToplingTemp/Topling-189103-GvevQg 2024/11/23-21:12:39.063015 139957164807744 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280774.sst): first pass time = 2.20's, 122.154'MB/sec 2024/11/23-21:12:41.392323 139957164807744 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280774.sst): old prealloc_size = 295279001, real_size = 60852848 2024/11/23-21:12:41.393394 139957164807744 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280774.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 1843046 prefix = 4 raw-key = 0.0295 GB zip-key = 0.0035 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.2168 GB zip-val = 0.0569 GB avg-val = 117.65 avg-zval = 30.85 2024/11/23-21:12:41.394045 139957164807744 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280774.sst: sumWaitingMem = 0.005 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0048 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:12:42.948328 139957164807744 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280774.sst): second pass time = 2.33's, 93.140'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.56's, 41.765'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3366.666'MB/sec (index lex order gen) rebuild zvType time = 1.30's, 0.354'MB/sec write SST data time = 0.25's, 255.799'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 2.160'MB, throughput = 68167.114'MB/sec zip my value time = 2.33's, unzip length = 0.217'GB zip my value throughput = 93.140'MB/sec zip pipeline throughput = 93.140'MB/sec entries = 1843046 avg-key = 28.00 avg-zkey = 1.91 avg-val = 117.65 avg-zval = 30.85 usrkeys = 1843046 avg-key = 20.00 avg-zkey = 1.91 avg-val = 119.96 avg-zval = 30.85 TagRS{ kinds = RS_Key0_TagN bytes = 288080 } TagArray{ size = 609928 bytes = 2134768 } seq expand size = 4269496 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0369 GB value = 0.2168 GB dict = 2.16 MB all = 0.2684 GB } __ZipSize{ index = 0.0035 GB value = 0.0569 GB dict = 2.16 MB all = 0.0650 GB } UnZip/Zip{ index = 10.4481 value = 3.8131 dict = 1.00 all = 4.1307 } Zip/UnZip{ index = 0.0957 value = 0.2623 dict = 1.00 all = 0.2421 } ---------------------------- total value len = 20.556287 GB avg = 0.137 KB (by entry num) total key len = 4.187144 GB avg = 0.028 KB total ukey len = 2.959537 GB avg = 0.018 KB total ukey num = 0.163633394 Billion total entry num = 0.150441123 Billion write speed all = 0.559164311 MB/sec (with seq num) write speed all = 0.531966367 MB/sec (without seq num) 2024/11/23-21:12:43.030702 139957164807744 [compaction_job.cc:1948] [default] [JOB 35807] Generated table #280774: 1843046 keys, 64985710 bytes, temperature: kWarm 2024/11/23-21:12:43.030772 139957164807744 EVENT_LOG_v1 {"time_micros": 1732367563030735, "cf_name": "default", "job": 35807, "event": "table_file_creation", "file_number": 280774, "file_size": 64985710, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4261176570, "table_properties": {"data_size": 56863904, "index_size": 3528000, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 51605288, "raw_average_key_size": 28, "raw_value_size": 216830288, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 1843046, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367556, "oldest_key_time": 0, "file_creation_time": 1732367556, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 280774, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:12:43.088099 139957164807744 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280775.sst) /dev/shm/ToplingTemp/Topling-189103-0EyxKj 2024/11/23-21:12:44.754758 139957164807744 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280775.sst): first pass time = 1.67's, 161.065'MB/sec 2024/11/23-21:12:47.086468 139957164807744 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280775.sst): old prealloc_size = 295279001, real_size = 59861040 2024/11/23-21:12:47.087558 139957164807744 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280775.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 1843484 prefix = 4 raw-key = 0.0295 GB zip-key = 0.0035 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.2168 GB zip-val = 0.0559 GB avg-val = 117.61 avg-zval = 30.32 2024/11/23-21:12:47.088263 139957164807744 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280775.sst: sumWaitingMem = 0.005 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0048 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:12:48.645907 139957164807744 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280775.sst): second pass time = 2.33's, 93.037'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.56's, 41.224'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3295.194'MB/sec (index lex order gen) rebuild zvType time = 1.30's, 0.354'MB/sec write SST data time = 0.26's, 251.000'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 2.160'MB, throughput = 65454.441'MB/sec zip my value time = 2.33's, unzip length = 0.217'GB zip my value throughput = 93.037'MB/sec zip pipeline throughput = 93.037'MB/sec entries = 1843484 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.61 avg-zval = 30.32 usrkeys = 1843484 avg-key = 20.00 avg-zkey = 1.90 avg-val = 120.45 avg-zval = 30.32 TagRS{ kinds = RS_Key0_TagN bytes = 288160 } TagArray{ size = 746620 bytes = 2426528 } seq expand size = 5226340 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0369 GB value = 0.2168 GB dict = 2.16 MB all = 0.2684 GB } __ZipSize{ index = 0.0035 GB value = 0.0559 GB dict = 2.16 MB all = 0.0643 GB } UnZip/Zip{ index = 10.5185 value = 3.8790 dict = 1.00 all = 4.1757 } Zip/UnZip{ index = 0.0951 value = 0.2578 dict = 1.00 all = 0.2395 } ---------------------------- total value len = 20.778331 GB avg = 0.136 KB (by entry num) total key len = 4.238761 GB avg = 0.028 KB total ukey len = 2.996407 GB avg = 0.018 KB total ukey num = 0.165476878 Billion total entry num = 0.152284607 Billion write speed all = 0.565275874 MB/sec (with seq num) write speed all = 0.537748194 MB/sec (without seq num) 2024/11/23-21:12:48.723213 139957164807744 [compaction_job.cc:1948] [default] [JOB 35807] Generated table #280775: 1843484 keys, 64285392 bytes, temperature: kWarm 2024/11/23-21:12:48.723281 139957164807744 EVENT_LOG_v1 {"time_micros": 1732367568723246, "cf_name": "default", "job": 35807, "event": "table_file_creation", "file_number": 280775, "file_size": 64285392, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4261176308, "table_properties": {"data_size": 55894752, "index_size": 3505216, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 51617552, "raw_average_key_size": 28, "raw_value_size": 216817928, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 1843484, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367563, "oldest_key_time": 0, "file_creation_time": 1732367563, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 280775, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:12:48.776830 139957164807744 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280776.sst) /dev/shm/ToplingTemp/Topling-189103-eeC3Eg 2024/11/23-21:12:50.914179 139957164807744 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280776.sst): first pass time = 2.14's, 125.595'MB/sec 2024/11/23-21:12:53.273173 139957164807744 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280776.sst): old prealloc_size = 295279001, real_size = 59333216 2024/11/23-21:12:53.274247 139957164807744 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280776.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 1847298 prefix = 4 raw-key = 0.0296 GB zip-key = 0.0035 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.2167 GB zip-val = 0.0554 GB avg-val = 117.31 avg-zval = 29.97 2024/11/23-21:12:53.274825 139957164807744 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280776.sst: sumWaitingMem = 0.005 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0048 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:12:54.799401 139957164807744 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280776.sst): second pass time = 2.36's, 91.917'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.53's, 41.364'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3353.742'MB/sec (index lex order gen) rebuild zvType time = 1.27's, 0.364'MB/sec write SST data time = 0.26's, 247.220'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 2.159'MB, throughput = 60791.633'MB/sec zip my value time = 2.36's, unzip length = 0.217'GB zip my value throughput = 91.917'MB/sec zip pipeline throughput = 91.917'MB/sec entries = 1847298 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.31 avg-zval = 29.97 usrkeys = 1847298 avg-key = 20.00 avg-zkey = 1.90 avg-val = 119.41 avg-zval = 29.97 TagRS{ kinds = RS_Key0_TagN bytes = 288760 } TagArray{ size = 553883 bytes = 1800128 } seq expand size = 3877181 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0369 GB value = 0.2167 GB dict = 2.16 MB all = 0.2684 GB } __ZipSize{ index = 0.0035 GB value = 0.0554 GB dict = 2.16 MB all = 0.0631 GB } UnZip/Zip{ index = 10.5167 value = 3.9147 dict = 1.00 all = 4.2521 } Zip/UnZip{ index = 0.0951 value = 0.2554 dict = 1.00 all = 0.2352 } ---------------------------- total value len = 20.998920 GB avg = 0.136 KB (by entry num) total key len = 4.290486 GB avg = 0.028 KB total ukey len = 3.033353 GB avg = 0.018 KB total ukey num = 0.167324176 Billion total entry num = 0.154131905 Billion write speed all = 0.571349499 MB/sec (with seq num) write speed all = 0.543491766 MB/sec (without seq num) 2024/11/23-21:12:54.874275 139957164807744 [compaction_job.cc:1948] [default] [JOB 35807] Generated table #280776: 1847298 keys, 63129963 bytes, temperature: kWarm 2024/11/23-21:12:54.874338 139957164807744 EVENT_LOG_v1 {"time_micros": 1732367574874304, "cf_name": "default", "job": 35807, "event": "table_file_creation", "file_number": 280776, "file_size": 63129963, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4261176323, "table_properties": {"data_size": 55358096, "index_size": 3513088, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 51724344, "raw_average_key_size": 28, "raw_value_size": 216711244, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 1847298, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367568, "oldest_key_time": 0, "file_creation_time": 1732367568, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 280776, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:12:54.929139 139957164807744 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280777.sst) /dev/shm/ToplingTemp/Topling-189103-nfxp6g 2024/11/23-21:12:56.659537 139957164807744 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280777.sst): first pass time = 1.73's, 155.133'MB/sec 2024/11/23-21:12:58.961141 139957164807744 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280777.sst): old prealloc_size = 295279001, real_size = 59536560 2024/11/23-21:12:58.962235 139957164807744 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280777.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 1843197 prefix = 4 raw-key = 0.0295 GB zip-key = 0.0035 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.2168 GB zip-val = 0.0556 GB avg-val = 117.64 avg-zval = 30.15 2024/11/23-21:12:58.962845 139957164807744 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280777.sst: sumWaitingMem = 0.005 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0048 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:13:00.503785 139957164807744 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280777.sst): second pass time = 2.30's, 94.262'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.54's, 40.890'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3311.671'MB/sec (index lex order gen) rebuild zvType time = 1.29's, 0.358'MB/sec write SST data time = 0.25's, 247.825'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 2.160'MB, throughput = 66409.320'MB/sec zip my value time = 2.30's, unzip length = 0.217'GB zip my value throughput = 94.262'MB/sec zip pipeline throughput = 94.262'MB/sec entries = 1843197 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.64 avg-zval = 30.15 usrkeys = 1843197 avg-key = 20.00 avg-zkey = 1.90 avg-val = 119.44 avg-zval = 30.15 TagRS{ kinds = RS_Key0_TagN bytes = 288080 } TagArray{ size = 474693 bytes = 1542768 } seq expand size = 3322851 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0369 GB value = 0.2168 GB dict = 2.16 MB all = 0.2684 GB } __ZipSize{ index = 0.0035 GB value = 0.0556 GB dict = 2.16 MB all = 0.0631 GB } UnZip/Zip{ index = 10.5182 value = 3.9018 dict = 1.00 all = 4.2556 } Zip/UnZip{ index = 0.0951 value = 0.2563 dict = 1.00 all = 0.2350 } ---------------------------- total value len = 21.219069 GB avg = 0.136 KB (by entry num) total key len = 4.342095 GB avg = 0.028 KB total ukey len = 3.070217 GB avg = 0.018 KB total ukey num = 0.169167373 Billion total entry num = 0.155975102 Billion write speed all = 0.577414771 MB/sec (with seq num) write speed all = 0.549227533 MB/sec (without seq num) 2024/11/23-21:13:00.578506 139957164807744 [compaction_job.cc:1948] [default] [JOB 35807] Generated table #280777: 1843197 keys, 63077501 bytes, temperature: kWarm 2024/11/23-21:13:00.578575 139957164807744 EVENT_LOG_v1 {"time_micros": 1732367580578540, "cf_name": "default", "job": 35807, "event": "table_file_creation", "file_number": 280777, "file_size": 63077501, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4261176335, "table_properties": {"data_size": 55570784, "index_size": 3504768, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 51609516, "raw_average_key_size": 28, "raw_value_size": 216826074, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 1843197, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367574, "oldest_key_time": 0, "file_creation_time": 1732367574, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 280777, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:13:00.648040 139957164807744 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280778.sst) /dev/shm/ToplingTemp/Topling-189103-MtjQth 2024/11/23-21:13:02.238230 139957164807744 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280778.sst): first pass time = 1.59's, 168.812'MB/sec 2024/11/23-21:13:04.579212 139957164807744 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280778.sst): old prealloc_size = 295279001, real_size = 60849024 2024/11/23-21:13:04.580311 139957164807744 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280778.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 1843205 prefix = 4 raw-key = 0.0295 GB zip-key = 0.0035 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.2168 GB zip-val = 0.0569 GB avg-val = 117.64 avg-zval = 30.86 2024/11/23-21:13:04.580850 139957164807744 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280778.sst: sumWaitingMem = 0.005 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0048 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:13:06.137725 139957164807744 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280778.sst): second pass time = 2.34's, 92.677'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.56's, 41.363'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3262.575'MB/sec (index lex order gen) rebuild zvType time = 1.30's, 0.354'MB/sec write SST data time = 0.26's, 251.829'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 2.160'MB, throughput = 67201.692'MB/sec zip my value time = 2.34's, unzip length = 0.217'GB zip my value throughput = 92.677'MB/sec zip pipeline throughput = 92.677'MB/sec entries = 1843205 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.64 avg-zval = 30.86 usrkeys = 1843205 avg-key = 20.00 avg-zkey = 1.90 avg-val = 119.39 avg-zval = 30.86 TagRS{ kinds = RS_Key0_TagN bytes = 288120 } TagArray{ size = 462073 bytes = 1617264 } seq expand size = 3234511 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0369 GB value = 0.2168 GB dict = 2.16 MB all = 0.2684 GB } __ZipSize{ index = 0.0035 GB value = 0.0569 GB dict = 2.16 MB all = 0.0645 GB } UnZip/Zip{ index = 10.5169 value = 3.8118 dict = 1.00 all = 4.1641 } Zip/UnZip{ index = 0.0951 value = 0.2623 dict = 1.00 all = 0.2401 } ---------------------------- total value len = 21.439129 GB avg = 0.136 KB (by entry num) total key len = 4.393705 GB avg = 0.028 KB total ukey len = 3.107081 GB avg = 0.018 KB total ukey num = 0.171010578 Billion total entry num = 0.157818307 Billion write speed all = 0.583477412 MB/sec (with seq num) write speed all = 0.554960705 MB/sec (without seq num) 2024/11/23-21:13:06.213311 139957164807744 [compaction_job.cc:1948] [default] [JOB 35807] Generated table #280778: 1843205 keys, 64464417 bytes, temperature: kWarm 2024/11/23-21:13:06.213385 139957164807744 EVENT_LOG_v1 {"time_micros": 1732367586213348, "cf_name": "default", "job": 35807, "event": "table_file_creation", "file_number": 280778, "file_size": 64464417, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4261176435, "table_properties": {"data_size": 56882800, "index_size": 3505216, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 51609740, "raw_average_key_size": 28, "raw_value_size": 216825734, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 1843205, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367580, "oldest_key_time": 0, "file_creation_time": 1732367580, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 280778, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:13:06.269468 139957164807744 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280779.sst) /dev/shm/ToplingTemp/Topling-189103-Jqw0vj 2024/11/23-21:13:08.098480 139957164807744 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280779.sst): first pass time = 1.83's, 146.768'MB/sec 2024/11/23-21:13:10.461574 139957164807744 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280779.sst): old prealloc_size = 295279001, real_size = 61128624 2024/11/23-21:13:10.462780 139957164807744 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280779.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 1843013 prefix = 4 raw-key = 0.0295 GB zip-key = 0.0035 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.2168 GB zip-val = 0.0572 GB avg-val = 117.65 avg-zval = 31.02 2024/11/23-21:13:10.463083 139957164807744 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280779.sst: sumWaitingMem = 0.005 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0048 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:13:12.337229 139957164807744 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280779.sst): second pass time = 2.36's, 91.807'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.88's, 33.825'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2950.168'MB/sec (index lex order gen) rebuild zvType time = 1.50's, 0.307'MB/sec write SST data time = 0.37's, 170.579'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 2.160'MB, throughput = 68870.158'MB/sec zip my value time = 2.36's, unzip length = 0.217'GB zip my value throughput = 91.807'MB/sec zip pipeline throughput = 91.807'MB/sec entries = 1843013 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.65 avg-zval = 31.02 usrkeys = 1843013 avg-key = 20.00 avg-zkey = 1.90 avg-val = 118.02 avg-zval = 31.02 TagRS{ kinds = RS_Key0_TagN bytes = 288080 } TagArray{ size = 97239 bytes = 316048 } seq expand size = 680673 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0369 GB value = 0.2168 GB dict = 2.16 MB all = 0.2684 GB } __ZipSize{ index = 0.0035 GB value = 0.0572 GB dict = 2.16 MB all = 0.0634 GB } UnZip/Zip{ index = 10.5170 value = 3.7932 dict = 1.00 all = 4.2311 } Zip/UnZip{ index = 0.0951 value = 0.2636 dict = 1.00 all = 0.2363 } ---------------------------- total value len = 21.656641 GB avg = 0.136 KB (by entry num) total key len = 4.445309 GB avg = 0.028 KB total ukey len = 3.143941 GB avg = 0.018 KB total ukey num = 0.172853591 Billion total entry num = 0.159661320 Billion write speed all = 0.589473305 MB/sec (with seq num) write speed all = 0.560627618 MB/sec (without seq num) 2024/11/23-21:13:12.476069 139957164807744 [compaction_job.cc:1948] [default] [JOB 35807] Generated table #280779: 1843013 keys, 63442837 bytes, temperature: kWarm 2024/11/23-21:13:12.476130 139957164807744 EVENT_LOG_v1 {"time_micros": 1732367592476097, "cf_name": "default", "job": 35807, "event": "table_file_creation", "file_number": 280779, "file_size": 63442837, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4261176359, "table_properties": {"data_size": 57162848, "index_size": 3504832, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 51604364, "raw_average_key_size": 28, "raw_value_size": 216831126, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 1843013, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367586, "oldest_key_time": 0, "file_creation_time": 1732367586, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 280779, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:13:12.535455 139957164807744 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280780.sst) /dev/shm/ToplingTemp/Topling-189103-xlpVxj 2024/11/23-21:13:15.235556 139957164807744 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280780.sst): first pass time = 2.70's, 99.418'MB/sec 2024/11/23-21:13:18.528861 139957164807744 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280780.sst): old prealloc_size = 295279001, real_size = 64262688 2024/11/23-21:13:18.530079 139957164807744 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280780.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 1845699 prefix = 4 raw-key = 0.0295 GB zip-key = 0.0035 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.2168 GB zip-val = 0.0603 GB avg-val = 117.44 avg-zval = 32.65 2024/11/23-21:13:18.530493 139957164807744 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280780.sst: sumWaitingMem = 0.005 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0048 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:13:20.639768 139957164807744 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280780.sst): second pass time = 3.29's, 65.842'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 2.11's, 31.690'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2981.336'MB/sec (index lex order gen) rebuild zvType time = 1.66's, 0.278'MB/sec write SST data time = 0.45's, 148.316'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 2.160'MB, throughput = 66874.923'MB/sec zip my value time = 3.29's, unzip length = 0.217'GB zip my value throughput = 65.842'MB/sec zip pipeline throughput = 65.842'MB/sec entries = 1845699 avg-key = 28.00 avg-zkey = 1.91 avg-val = 117.44 avg-zval = 32.65 usrkeys = 1845699 avg-key = 20.00 avg-zkey = 1.91 avg-val = 118.14 avg-zval = 32.65 TagRS{ kinds = RS_Key0_TagN bytes = 288480 } TagArray{ size = 185553 bytes = 626256 } seq expand size = 1298871 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0369 GB value = 0.2168 GB dict = 2.16 MB all = 0.2684 GB } __ZipSize{ index = 0.0035 GB value = 0.0603 GB dict = 2.16 MB all = 0.0669 GB } UnZip/Zip{ index = 10.4482 value = 3.5965 dict = 1.00 all = 4.0129 } Zip/UnZip{ index = 0.0957 value = 0.2780 dict = 1.00 all = 0.2492 } ---------------------------- total value len = 21.874696 GB avg = 0.135 KB (by entry num) total key len = 4.496989 GB avg = 0.028 KB total ukey len = 3.180855 GB avg = 0.018 KB total ukey num = 0.174699290 Billion total entry num = 0.161507019 Billion write speed all = 0.595453203 MB/sec (with seq num) write speed all = 0.566279527 MB/sec (without seq num) 2024/11/23-21:13:20.717509 139957164807744 [compaction_job.cc:1948] [default] [JOB 35807] Generated table #280780: 1845699 keys, 66893773 bytes, temperature: kWarm 2024/11/23-21:13:20.717598 139957164807744 EVENT_LOG_v1 {"time_micros": 1732367600717548, "cf_name": "default", "job": 35807, "event": "table_file_creation", "file_number": 280780, "file_size": 66893773, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4261176371, "table_properties": {"data_size": 60268048, "index_size": 3533056, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 51679572, "raw_average_key_size": 28, "raw_value_size": 216755930, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 1845699, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367592, "oldest_key_time": 0, "file_creation_time": 1732367592, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 280780, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:13:20.778048 139957164807744 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280781.sst) /dev/shm/ToplingTemp/Topling-189103-pIPH1i 2024/11/23-21:13:22.620447 139957164807744 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280781.sst): first pass time = 1.84's, 145.702'MB/sec 2024/11/23-21:13:25.689642 139957164807744 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280781.sst): old prealloc_size = 295279001, real_size = 55016128 2024/11/23-21:13:25.690737 139957164807744 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280781.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 1869955 prefix = 4 raw-key = 0.0299 GB zip-key = 0.0036 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.2161 GB zip-val = 0.0510 GB avg-val = 115.55 avg-zval = 27.27 2024/11/23-21:13:25.691352 139957164807744 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280781.sst: sumWaitingMem = 0.005 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0049 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:13:27.439529 139957164807744 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280781.sst): second pass time = 3.07's, 70.427'MB/sec, value only(80.5% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.75's, 33.653'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3305.658'MB/sec (index lex order gen) rebuild zvType time = 1.36's, 0.343'MB/sec write SST data time = 0.39's, 152.622'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 2.154'MB, throughput = 80065.276'MB/sec zip my value time = 3.07's, unzip length = 0.216'GB zip my value throughput = 70.427'MB/sec zip pipeline throughput = 80.407'MB/sec entries = 1869955 avg-key = 28.00 avg-zkey = 1.90 avg-val = 115.55 avg-zval = 27.27 usrkeys = 1869955 avg-key = 20.00 avg-zkey = 1.90 avg-val = 117.64 avg-zval = 27.27 TagRS{ kinds = RS_Key0_TagN bytes = 292280 } TagArray{ size = 557676 bytes = 1882176 } seq expand size = 3903732 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0374 GB value = 0.2161 GB dict = 2.15 MB all = 0.2684 GB } __ZipSize{ index = 0.0036 GB value = 0.0510 GB dict = 2.15 MB all = 0.0589 GB } UnZip/Zip{ index = 10.5192 value = 4.2374 dict = 1.00 all = 4.5584 } Zip/UnZip{ index = 0.0951 value = 0.2360 dict = 1.00 all = 0.2194 } ---------------------------- total value len = 22.094676 GB avg = 0.135 KB (by entry num) total key len = 4.549348 GB avg = 0.028 KB total ukey len = 3.218254 GB avg = 0.018 KB total ukey num = 0.176569245 Billion total entry num = 0.163376974 Billion write speed all = 0.601510070 MB/sec (with seq num) write speed all = 0.572003147 MB/sec (without seq num) 2024/11/23-21:13:27.507515 139957164807744 [compaction_job.cc:1948] [default] [JOB 35807] Generated table #280781: 1869955 keys, 58887550 bytes, temperature: kWarm 2024/11/23-21:13:27.507580 139957164807744 EVENT_LOG_v1 {"time_micros": 1732367607507548, "cf_name": "default", "job": 35807, "event": "table_file_creation", "file_number": 280781, "file_size": 58887550, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4261174986, "table_properties": {"data_size": 50993136, "index_size": 3555328, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 52358740, "raw_average_key_size": 28, "raw_value_size": 216076774, "raw_average_value_size": 115, "num_data_blocks": 1, "num_entries": 1869955, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367600, "oldest_key_time": 0, "file_creation_time": 1732367600, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 280781, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:13:27.561648 139957164807744 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280782.sst) /dev/shm/ToplingTemp/Topling-189103-JwyGHg 2024/11/23-21:13:29.685907 139957164807744 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280782.sst): first pass time = 2.12's, 126.368'MB/sec 2024/11/23-21:13:32.526934 139957164807744 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280782.sst): old prealloc_size = 295279001, real_size = 54941216 2024/11/23-21:13:32.528297 139957164807744 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280782.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 1839961 prefix = 4 raw-key = 0.0294 GB zip-key = 0.0035 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.2169 GB zip-val = 0.0510 GB avg-val = 117.89 avg-zval = 27.70 2024/11/23-21:13:32.528698 139957164807744 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280782.sst: sumWaitingMem = 0.005 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0048 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:13:34.372260 139957164807744 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280782.sst): second pass time = 2.84's, 76.398'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.85's, 31.230'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2650.390'MB/sec (index lex order gen) rebuild zvType time = 1.46's, 0.314'MB/sec write SST data time = 0.38's, 151.128'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 2.162'MB, throughput = 67404.652'MB/sec zip my value time = 2.84's, unzip length = 0.217'GB zip my value throughput = 76.398'MB/sec zip pipeline throughput = 99.190'MB/sec entries = 1839961 avg-key = 28.00 avg-zkey = 1.91 avg-val = 117.89 avg-zval = 27.70 usrkeys = 1839961 avg-key = 20.00 avg-zkey = 1.91 avg-val = 118.67 avg-zval = 27.70 TagRS{ kinds = RS_Key0_TagN bytes = 287600 } TagArray{ size = 204855 bytes = 691408 } seq expand size = 1433985 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0368 GB value = 0.2169 GB dict = 2.16 MB all = 0.2684 GB } __ZipSize{ index = 0.0035 GB value = 0.0510 GB dict = 2.16 MB all = 0.0576 GB } UnZip/Zip{ index = 10.4500 value = 4.2566 dict = 1.00 all = 4.6580 } Zip/UnZip{ index = 0.0957 value = 0.2349 dict = 1.00 all = 0.2147 } ---------------------------- total value len = 22.313027 GB avg = 0.135 KB (by entry num) total key len = 4.600867 GB avg = 0.028 KB total ukey len = 3.255053 GB avg = 0.018 KB total ukey num = 0.178409206 Billion total entry num = 0.165216935 Billion write speed all = 0.607507506 MB/sec (with seq num) write speed all = 0.577672944 MB/sec (without seq num) 2024/11/23-21:13:34.444876 139957164807744 [compaction_job.cc:1948] [default] [JOB 35807] Generated table #280782: 1839961 keys, 57628763 bytes, temperature: kWarm 2024/11/23-21:13:34.444968 139957164807744 EVENT_LOG_v1 {"time_micros": 1732367614444919, "cf_name": "default", "job": 35807, "event": "table_file_creation", "file_number": 280782, "file_size": 57628763, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4261173637, "table_properties": {"data_size": 50959568, "index_size": 3521472, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 51518908, "raw_average_key_size": 28, "raw_value_size": 216916550, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 1839961, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367607, "oldest_key_time": 0, "file_creation_time": 1732367607, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 280782, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:13:34.568356 139957164807744 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280783.sst) /dev/shm/ToplingTemp/Topling-189103-6C9E8h 2024/11/23-21:13:36.626459 139957164807744 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280783.sst): first pass time = 2.06's, 130.432'MB/sec 2024/11/23-21:13:39.596208 139957164807744 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280783.sst): old prealloc_size = 295279001, real_size = 59045072 2024/11/23-21:13:39.597604 139957164807744 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280783.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 1851998 prefix = 4 raw-key = 0.0296 GB zip-key = 0.0035 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.2166 GB zip-val = 0.0550 GB avg-val = 116.94 avg-zval = 29.72 2024/11/23-21:13:39.598088 139957164807744 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280783.sst: sumWaitingMem = 0.005 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0049 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:13:41.426656 139957164807744 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280783.sst): second pass time = 2.97's, 72.982'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.83's, 33.871'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2617.715'MB/sec (index lex order gen) rebuild zvType time = 1.53's, 0.303'MB/sec write SST data time = 0.30's, 206.273'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 2.158'MB, throughput = 64385.871'MB/sec zip my value time = 2.97's, unzip length = 0.217'GB zip my value throughput = 72.982'MB/sec zip pipeline throughput = 117.338'MB/sec entries = 1851998 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.94 avg-zval = 29.72 usrkeys = 1851998 avg-key = 20.00 avg-zkey = 1.91 avg-val = 118.02 avg-zval = 29.72 TagRS{ kinds = RS_Key0_TagN bytes = 289480 } TagArray{ size = 283945 bytes = 958336 } seq expand size = 1987615 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0370 GB value = 0.2166 GB dict = 2.16 MB all = 0.2684 GB } __ZipSize{ index = 0.0035 GB value = 0.0550 GB dict = 2.16 MB all = 0.0620 GB } UnZip/Zip{ index = 10.4479 value = 3.9352 dict = 1.00 all = 4.3297 } Zip/UnZip{ index = 0.0957 value = 0.2541 dict = 1.00 all = 0.2310 } ---------------------------- total value len = 22.531594 GB avg = 0.135 KB (by entry num) total key len = 4.652723 GB avg = 0.028 KB total ukey len = 3.292093 GB avg = 0.018 KB total ukey num = 0.180261204 Billion total entry num = 0.167068933 Billion write speed all = 0.613513875 MB/sec (with seq num) write speed all = 0.583349686 MB/sec (without seq num) 2024/11/23-21:13:41.503445 139957164807744 [compaction_job.cc:1948] [default] [JOB 35807] Generated table #280783: 1851998 keys, 61998487 bytes, temperature: kWarm 2024/11/23-21:13:41.503546 139957164807744 EVENT_LOG_v1 {"time_micros": 1732367621503487, "cf_name": "default", "job": 35807, "event": "table_file_creation", "file_number": 280783, "file_size": 61998487, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4261176166, "table_properties": {"data_size": 55036672, "index_size": 3545216, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 51855944, "raw_average_key_size": 28, "raw_value_size": 216579544, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 1851998, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367614, "oldest_key_time": 0, "file_creation_time": 1732367614, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 280783, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:13:41.590322 139957164807744 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280784.sst) /dev/shm/ToplingTemp/Topling-189103-k0HnQj 2024/11/23-21:13:42.564904 139957164807744 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280784.sst): first pass time = 0.97's, 195.585'MB/sec 2024/11/23-21:13:44.619736 139957164807744 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280784.sst): old prealloc_size = 295279001, real_size = 45881568 2024/11/23-21:13:44.620555 139957164807744 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280784.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 1305500 prefix = 4 raw-key = 0.0209 GB zip-key = 0.0025 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1540 GB zip-val = 0.0431 GB avg-val = 118.00 avg-zval = 32.99 2024/11/23-21:13:44.620889 139957164807744 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280784.sst: sumWaitingMem = 0.003 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0034 GB, waited 0.000 sec, Key+Value = 0.191 GB 2024/11/23-21:13:45.991391 139957164807744 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00/280784.sst): second pass time = 2.05's, 75.009'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.37's, 34.980'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3121.839'MB/sec (index lex order gen) rebuild zvType time = 1.19's, 0.275'MB/sec write SST data time = 0.18's, 260.196'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.525'MB, throughput = 40961.612'MB/sec zip my value time = 2.05's, unzip length = 0.154'GB zip my value throughput = 75.009'MB/sec zip pipeline throughput = 103.720'MB/sec entries = 1305500 avg-key = 28.00 avg-zkey = 1.90 avg-val = 118.00 avg-zval = 32.99 usrkeys = 1305500 avg-key = 20.00 avg-zkey = 1.90 avg-val = 119.18 avg-zval = 32.99 TagRS{ kinds = RS_Key0_TagN bytes = 204080 } TagArray{ size = 220102 bytes = 687840 } seq expand size = 1540714 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0261 GB value = 0.1540 GB dict = 1.52 MB all = 0.1906 GB } __ZipSize{ index = 0.0025 GB value = 0.0431 GB dict = 1.52 MB all = 0.0480 GB } UnZip/Zip{ index = 10.5176 value = 3.5765 dict = 1.00 all = 3.9726 } Zip/UnZip{ index = 0.0951 value = 0.2796 dict = 1.00 all = 0.2517 } ---------------------------- total value len = 22.687183 GB avg = 0.135 KB (by entry num) total key len = 4.689277 GB avg = 0.028 KB total ukey len = 3.318203 GB avg = 0.018 KB total ukey num = 0.181566704 Billion total entry num = 0.168374433 Billion write speed all = 0.617786659 MB/sec (with seq num) write speed all = 0.587389894 MB/sec (without seq num) 2024/11/23-21:13:46.054222 139957164807744 [compaction_job.cc:1948] [default] [JOB 35807] Generated table #280784: 1305500 keys, 47979676 bytes, temperature: kWarm 2024/11/23-21:13:46.054290 139957164807744 EVENT_LOG_v1 {"time_micros": 1732367626054257, "cf_name": "default", "job": 35807, "event": "table_file_creation", "file_number": 280784, "file_size": 47979676, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4206414522, "table_properties": {"data_size": 43072528, "index_size": 2482496, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 36554000, "raw_average_key_size": 28, "raw_value_size": 154049000, "raw_average_value_size": 118, "num_data_blocks": 1, "num_entries": 1305500, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 118, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367621, "oldest_key_time": 0, "file_creation_time": 1732367621, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 280784, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:13:46.090024 139957164807744 [compaction_job.cc:703] job-35807: subcompact[0], size: 4.088149 G, files: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35807/att-00 [280722,280723,280724,280725,280726,280727,280728,280729,280730,280731,280732,280733,280734,280735,280736,280737,280738,280739,280740,280741,280742,280743,280744,280745,280746,280747,280748,280749,280750,280751,280752,280753,280754,280755,280756,280757,280758,280759,280760,280761,280762,280763,280764,280765,280766,280767,280768,280769,280770,280771,280772,280773,280774,280775,280776,280777,280778,280779,280780,280781,280782,280783,280784] 2024/11/23-21:13:46.915364 139957164807744 (Original Log Time 2024/11/23-21:07:12.528380) EVENT_LOG_v1 {"time_micros": 1732367232528312, "job": 35807, "event": "compaction_started", "compaction_reason": "ManualCompaction", "files_L3": [280707, 280708, 280709, 280710, 280711, 280712, 280713, 280714, 280715, 280716, 280717, 280718, 280719, 280602, 280603, 280604], "files_L4": [280640, 280641, 280642, 280643, 280644, 280645, 280646, 280647, 280648, 280649, 280650, 280651, 269340, 272194, 273704, 273705, 276312, 280233, 201775, 201782, 201761, 201838, 201829, 201823, 201824, 231340, 201995, 239581, 257953, 257954, 230765, 246883, 256911, 237632, 260330, 260331, 240003, 260548, 260549, 227336, 251597, 262846, 243186, 246734, 255953, 235890, 249930, 261504, 240379, 253021, 262996, 243529, 256305, 233631, 279361, 279362, 279363, 259741, 233286, 202069, 202167, 202168, 202139, 202245, 202311, 202393, 202391, 202459, 202452, 202441, 245129, 245130, 218007, 202676, 202686, 202685, 202760, 202736, 223811, 202810, 202889, 202907, 202903, 202990, 202975, 202985, 202974, 278925, 278926, 278927, 277087, 277633, 277634, 277419, 280431, 280432, 278065, 278066, 278474, 278475], "score": -1, "input_data_size": 4344756290, "oldest_snapshot_seqno": 4262774987} 2024/11/23-21:13:46.915370 139957164807744 (Original Log Time 2024/11/23-21:13:46.913125) [compaction_job.cc:2022] [default] [JOB 35807] Compacted 16@3 + 100@4 files to L4 => 4088148614 bytes 2024/11/23-21:13:46.915372 139957164807744 (Original Log Time 2024/11/23-21:13:46.915240) [compaction_job.cc:1224] [default] compacted to: files[0 0 0 0 63 0 0] max score 0.02, MB/sec: 11.0 rd, 10.4 wr, level 4, files in(16, 100) out(63 +0 blob) MB in(553.8, 3589.7 +0.0 blob) out(3898.8 +0.0 blob), read-write-amplify(14.5) write-amplify(7.0) OK, records in: 121026253, records dropped: 5009984 output_compression: Snappy 2024/11/23-21:13:46.915378 139957164807744 (Original Log Time 2024/11/23-21:13:46.915325) EVENT_LOG_v1 {"time_micros": 1732367626915275, "cf": "default", "job": 35807, "event": "compaction_finished", "compaction_time_micros": 393561652, "compaction_time_cpu_micros": 173648222, "output_level": 4, "num_output_files": 63, "total_output_size": 4088148614, "num_input_records": 121026253, "num_output_records": 116016269, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "file_write_nanos": 2943699873, "file_range_sync_nanos": 0, "file_fsync_nanos": 46537, "file_prepare_write_nanos": 181135, "lsm_state": [0, 0, 0, 0, 63, 0, 0]} 2024/11/23-21:13:47.074812 139957164807744 DEBG dcompact_worker.cpp:240: HttpPost: 200 OK: url = http://nlb-7zny4kaa1poal01o64.cn-shenzhen.nlb.aliyuncs.com:8443, body = {"instanceId":"nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137","labourId":"","dbId":"d89b4006-2803-486e-b7a2-759bcf348921","dbStarts":1732256054,"starts":1732367232,"executesMs":394527,"compactionJobId":35807,"attempt":0,"compactionInputRawBytes":17545023907,"compactionInputZipBytes":4344756290,"compactionOutputRawBytes":0,"compactionOutputZipBytes":4088148614,"headers":{"Accept":"*/*","Connection":"close","Host":"aliyun-topling-saas.topling.cn:18443","RemoteIp":"120.24.192.169","X-Forwarded-For":"120.24.192.169","region":"cn-shenzhen","token":"e6474c481bd4415abc537135cc03626b","instance-token":"e6474c481bd4415abc537135cc03626b","provider":"aliyun","CloudMarketInstanceId":"si-59c0ae5c955845588903","MeteringAssit":"","Transfer-Encoding":"chunked","traceparent":"00-fc06693b4dc8479bd68367e67e328a04-76c7f356bc554bf5-00"}}, response = 2024/11/23-21:13:47.074919 139957164807744 INFO dcompact_worker.cpp:1459: finish /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-35807/att-00: olev 4, work 394.527 s, result 9.445 ms, install 2.286 ms, input{raw 16.340 GiB zip 4.046 GiB}