2024/11/20-12:48:17.670991 140257189590592 DEBG dcompact_worker.cpp:2219: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00: fork to child time = 0.022228 sec 2024/11/20-12:48:17.671493 140257189590592 DEBG dcompact_worker.cpp:1013: Beg SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00 2024/11/20-12:48:17.678106 140257189590592 DEBG dcompact_worker.cpp:1033: End SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00 2024/11/20-12:48:17.679778 140257189590592 TRAC dcompact_worker.cpp:1083: INFO_LOG_LEVEL: rpc = INFO_LEVEL, env_var = undefined 2024/11/20-12:48:17.679985 140257189590592 [WARN] [column_family.cc:386] multiple cf_paths/db_paths and level_compaction_dynamic_level_bytes can't be used together 2024/11/20-12:48:17.731488 140257189590592 [version_set.cc:6211] Recovering from manifest file: /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-20T12.20.00/.rocksdb/job-05260/att-00/MANIFEST-019309 2024/11/20-12:48:17.784227 140257189590592 [version_set.cc:6254] Recovered from manifest file:/worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-20T12.20.00/.rocksdb/job-05260/att-00/MANIFEST-019309 succeeded,manifest_file_number is 19309, next_file_number is 26591, last_sequence is 527014068, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 25937 2024/11/20-12:48:17.784232 140257189590592 [version_set.cc:6269] Column family [default] (ID 0), log number is 0 2024/11/20-12:48:17.784362 140257189590592 [version_set.cc:5724] Creating manifest 26591 2024/11/20-12:48:17.817442 140257189590592 DEBG dcompact_worker.cpp:1225: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00: bottommost_level: fake = 1, rpc = 0 2024/11/20-12:48:17.839232 140257189590592 [compaction_job.cc:2437] [default] [JOB 5260] Compacting 1@2 + 56@3 files to L3, score 0.94, subcompactions 1 : 1 2024/11/20-12:48:17.839257 140257189590592 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 5051 Base level 2, inputs: [26572(31MB)], [26509(39MB) 26510(39MB) 26511(39MB) 26512(39MB) 26529(39MB) 26530(39MB) 26531(39MB) 26532(39MB) 26533(39MB) 26534(39MB) 26535(39MB) 26536(39MB) 26537(39MB) 26538(39MB) 26539(39MB) 26540(39MB) 26541(39MB) 26542(39MB) 26543(39MB) 26544(39MB) 26545(39MB) 26546(39MB) 26547(39MB) 26548(39MB) 26549(39MB) 26550(39MB) 26551(39MB) 26552(39MB) 26553(39MB) 26554(39MB) 26555(39MB) 26556(39MB) 26557(34MB) 26199(39MB) 26200(39MB) 26201(39MB) 26202(39MB) 26203(39MB) 26204(39MB) 26205(7507KB) 26146(10177KB) 26197(10147KB) 26196(10119KB) 26195(10172KB) 26198(10135KB) 26128(10151KB) 26131(10117KB) 26209(1105KB) 26286(10125KB) 26271(10137KB) 26250(10120KB) 26263(10175KB) 26298(10150KB) 26289(10120KB) 26291(10178KB) 26346(23MB)] 2024/11/20-12:48:17.847261 140257189590592 [top_zip_table.cc:59] core git_version_hash_info_is:commit 81964c21ebbcc178d8e99dae0fbf61bded2729cc Author: rockeet Date: Mon Nov 11 21:28:46 2024 +0800 Makefile: fix gen git-version-*.cpp GIT_PATH_ARG = :!src/terark/fsa :!tools/fsa :!src/terark/zbs :!tools/zbs g++ (GCC) 12.2.1 20221121 (Red Hat 12.2.1-7) Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/zstd -Iboost-include DEFS = -DTOPLING_IO_WITH_URING=1 -DDIVSUFSORT_API= CXXFLAGS = -fPIC -time -fdiagnostics-color -mcx16 -fno-stack-protector WARNINGS = -Wno-class-memaccess -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -Wno-deprecated-declarations -Wstrict-aliasing=3 RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 LDFLAGS = -fPIC -rdynamic 2024/11/20-12:48:17.847280 140257189590592 [top_zip_table.cc:60] fsa git_version_hash_info_is:commit 5dfecb7d107196f044ff5bf78dc39d2e725b9d9b Author: leipeng Date: Thu Nov 7 15:22:45 2024 +0800 Makefile: fix for x86_64 CPU older than haswell GIT_PATH_ARG = src/terark/fsa tools/fsa g++ (GCC) 12.2.1 20221121 (Red Hat 12.2.1-7) Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/zstd -Iboost-include DEFS = -DTOPLING_IO_WITH_URING=1 -DDIVSUFSORT_API= CXXFLAGS = -fPIC -time -fdiagnostics-color -mcx16 -fno-stack-protector WARNINGS = -Wno-class-memaccess -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -Wno-deprecated-declarations -Wstrict-aliasing=3 RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 LDFLAGS = -fPIC -rdynamic 2024/11/20-12:48:17.847295 140257189590592 [top_zip_table.cc:61] zbs git_version_hash_info_is:commit d44dd5ff72707128fe3c916077b43d2093c01f7c Author: leipeng Date: Sun Oct 27 23:38:26 2024 +0800 Fix for msvc, when toplingdb on msvc GIT_PATH_ARG = src/terark/zbs tools/zbs g++ (GCC) 12.2.1 20221121 (Red Hat 12.2.1-7) Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/zstd -Iboost-include DEFS = -DTOPLING_IO_WITH_URING=1 -DDIVSUFSORT_API= CXXFLAGS = -fPIC -time -fdiagnostics-color -mcx16 -fno-stack-protector WARNINGS = -Wno-class-memaccess -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -Wno-deprecated-declarations -Wstrict-aliasing=3 RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 LDFLAGS = -fPIC -rdynamic 2024/11/20-12:48:17.847304 140257189590592 [top_zip_table.cc:62] topling-zip_table_reader: git_version_hash_info_is: commit 79614a7e7dc27362fc5151b0797eb7d83c674c7b Author: rockeet Date: Sun Nov 10 15:02:21 2024 +0800 cpu_has_bmi2.sh: detect by compile c++ code check __BMI2__ g++ (GCC) 12.2.1 20221121 (Red Hat 12.2.1-7) Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/20-12:48:17.847307 140257189590592 [top_zip_table.cc:64] topling-rocks git_version_hash_info_is: commit c46b65a52d9c74aa8b87aeb8438620ff2dbc669c Author: rockeet Date: Sun Nov 10 15:02:42 2024 +0800 cpu_has_bmi2.sh: detect by compile c++ code check __BMI2__ g++ (GCC) 12.2.1 20221121 (Red Hat 12.2.1-7) Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/20-12:48:18.501676 140257189590592 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026592.sst) /dev/shm/ToplingTemp/Topling-183460-vJjXkA 2024/11/20-12:48:18.683407 140257189590592 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026592.sst): first pass time = 0.18's, 738.739'MB/sec 2024/11/20-12:48:19.288785 140257189590592 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026592.sst): old prealloc_size = 147639500, real_size = 40355776 2024/11/20-12:48:19.288900 140257189590592 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026592.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129430 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.70 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1017.00 avg-zval = 309.85 2024/11/20-12:48:19.288972 140257189590592 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026592.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-12:48:19.452332 140257189590592 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026592.sst): second pass time = 0.60's, 220.881'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 255.139'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2289.355'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.265'MB/sec write SST data time = 0.04's, 1012.713'MB/sec dict compress time = 7737577176.75's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 34343.228'MB/sec zip my value time = 0.60's, unzip length = 0.132'GB zip my value throughput = 220.881'MB/sec zip pipeline throughput = 220.881'MB/sec entries = 129430 avg-key = 20.00 avg-zkey = 1.70 avg-val = 1017.00 avg-zval = 309.85 usrkeys = 129430 avg-key = 12.00 avg-zkey = 1.70 avg-val = 1017.04 avg-zval = 309.85 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 695 bytes = 2272 } seq expand size = 4865 multi value expand size = 0 cnt WriteAppend = 15 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0629 value = 3.2823 dict = 1.00 all = 3.2167 } Zip/UnZip{ index = 0.1416 value = 0.3047 dict = 1.00 all = 0.3109 } ---------------------------- total value len = 0.131635 GB avg = 1.017 KB (by entry num) total key len = 0.002589 GB avg = 0.020 KB total ukey len = 0.001553 GB avg = 0.012 KB total ukey num = 0.000129430 Billion total entry num = 0.000129430 Billion write speed all = 0.009296789 MB/sec (with seq num) write speed all = 0.009225070 MB/sec (without seq num) 2024/11/20-12:48:19.511881 140257189590592 [compaction_job.cc:1948] [default] [JOB 5260] Generated table #26592: 129430 keys, 41725694 bytes, temperature: kWarm 2024/11/20-12:48:19.511999 140257189590592 EVENT_LOG_v1 {"time_micros": 1732078099511939, "cf_name": "default", "job": 5260, "event": "table_file_creation", "file_number": 26592, "file_size": 41725694, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 522330460, "table_properties": {"data_size": 40103344, "index_size": 219904, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588600, "raw_average_key_size": 20, "raw_value_size": 131629978, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129430, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732078098, "oldest_key_time": 0, "file_creation_time": 1732078098, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "92E45FH6K6HCJOD41QCQ", "orig_file_number": 26592, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-12:48:19.556213 140257189590592 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026593.sst) /dev/shm/ToplingTemp/Topling-183460-hXjGUy 2024/11/20-12:48:20.302965 140257189590592 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026593.sst): first pass time = 0.75's, 179.747'MB/sec 2024/11/20-12:48:20.797148 140257189590592 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026593.sst): old prealloc_size = 147639500, real_size = 40355136 2024/11/20-12:48:20.797253 140257189590592 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026593.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129430 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1017.00 avg-zval = 309.85 2024/11/20-12:48:20.797299 140257189590592 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026593.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-12:48:20.954579 140257189590592 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026593.sst): second pass time = 0.49's, 266.692'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 265.044'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2527.199'MB/sec (index lex order gen) rebuild zvType time = 0.11's, 0.282'MB/sec write SST data time = 0.04's, 976.452'MB/sec dict compress time = 0.00's, 1377984.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 40287.218'MB/sec zip my value time = 0.49's, unzip length = 0.132'GB zip my value throughput = 266.692'MB/sec zip pipeline throughput = 266.692'MB/sec entries = 129430 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1017.00 avg-zval = 309.85 usrkeys = 129430 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1017.02 avg-zval = 309.85 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 329 bytes = 1040 } seq expand size = 2303 multi value expand size = 0 cnt WriteAppend = 17 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0814 value = 3.2823 dict = 1.00 all = 3.2168 } Zip/UnZip{ index = 0.1412 value = 0.3047 dict = 1.00 all = 0.3109 } ---------------------------- total value len = 0.263267 GB avg = 1.017 KB (by entry num) total key len = 0.005177 GB avg = 0.020 KB total ukey len = 0.003106 GB avg = 0.012 KB total ukey num = 0.000258860 Billion total entry num = 0.000258860 Billion write speed all = 0.018591465 MB/sec (with seq num) write speed all = 0.018448043 MB/sec (without seq num) 2024/11/20-12:48:21.003702 140257189590592 [compaction_job.cc:1948] [default] [JOB 5260] Generated table #26593: 129430 keys, 41723839 bytes, temperature: kWarm 2024/11/20-12:48:21.003761 140257189590592 EVENT_LOG_v1 {"time_micros": 1732078101003731, "cf_name": "default", "job": 5260, "event": "table_file_creation", "file_number": 26593, "file_size": 41723839, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 518475914, "table_properties": {"data_size": 40103280, "index_size": 219328, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588600, "raw_average_key_size": 20, "raw_value_size": 131629973, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129430, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732078099, "oldest_key_time": 0, "file_creation_time": 1732078099, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "92E45FH6K6HCJOD41QCQ", "orig_file_number": 26593, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-12:48:21.040411 140257189590592 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026594.sst) /dev/shm/ToplingTemp/Topling-183460-aghbmC 2024/11/20-12:48:21.611189 140257189590592 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026594.sst): first pass time = 0.57's, 235.164'MB/sec 2024/11/20-12:48:22.172278 140257189590592 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026594.sst): old prealloc_size = 147639500, real_size = 40351536 2024/11/20-12:48:22.172527 140257189590592 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026594.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129430 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1016.99 avg-zval = 309.82 2024/11/20-12:48:22.172602 140257189590592 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026594.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-12:48:22.402250 140257189590592 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026594.sst): second pass time = 0.55's, 237.469'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.23's, 181.410'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1776.394'MB/sec (index lex order gen) rebuild zvType time = 0.18's, 0.176'MB/sec write SST data time = 0.05's, 915.609'MB/sec dict compress time = 0.00's, 1377930.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 46849.245'MB/sec zip my value time = 0.55's, unzip length = 0.132'GB zip my value throughput = 237.469'MB/sec zip pipeline throughput = 237.469'MB/sec entries = 129430 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1016.99 avg-zval = 309.82 usrkeys = 129430 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1017.00 avg-zval = 309.82 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 169 bytes = 480 } seq expand size = 1183 multi value expand size = 0 cnt WriteAppend = 15 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0897 value = 3.2825 dict = 1.00 all = 3.2171 } Zip/UnZip{ index = 0.1410 value = 0.3046 dict = 1.00 all = 0.3108 } ---------------------------- total value len = 0.394898 GB avg = 1.017 KB (by entry num) total key len = 0.007766 GB avg = 0.020 KB total ukey len = 0.004659 GB avg = 0.012 KB total ukey num = 0.000388290 Billion total entry num = 0.000388290 Billion write speed all = 0.027884212 MB/sec (with seq num) write speed all = 0.027669101 MB/sec (without seq num) 2024/11/20-12:48:22.482282 140257189590592 [compaction_job.cc:1948] [default] [JOB 5260] Generated table #26594: 129430 keys, 41719689 bytes, temperature: kWarm 2024/11/20-12:48:22.482338 140257189590592 EVENT_LOG_v1 {"time_micros": 1732078102482310, "cf_name": "default", "job": 5260, "event": "table_file_creation", "file_number": 26594, "file_size": 41719689, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 517251637, "table_properties": {"data_size": 40099936, "index_size": 219072, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588600, "raw_average_key_size": 20, "raw_value_size": 131629631, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129430, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732078101, "oldest_key_time": 0, "file_creation_time": 1732078101, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "92E45FH6K6HCJOD41QCQ", "orig_file_number": 26594, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-12:48:22.517763 140257189590592 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026595.sst) /dev/shm/ToplingTemp/Topling-183460-HIwvYy 2024/11/20-12:48:23.082039 140257189590592 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026595.sst): first pass time = 0.56's, 237.874'MB/sec 2024/11/20-12:48:23.548237 140257189590592 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026595.sst): old prealloc_size = 147639500, real_size = 40358320 2024/11/20-12:48:23.548343 140257189590592 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026595.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129424 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1017.04 avg-zval = 309.89 2024/11/20-12:48:23.548393 140257189590592 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026595.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-12:48:23.704546 140257189590592 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026595.sst): second pass time = 0.47's, 282.787'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 266.954'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2537.670'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.280'MB/sec write SST data time = 0.04's, 1027.676'MB/sec dict compress time = 0.00's, 1378251.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 25155.615'MB/sec zip my value time = 0.47's, unzip length = 0.132'GB zip my value throughput = 282.787'MB/sec zip pipeline throughput = 282.787'MB/sec entries = 129424 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1017.04 avg-zval = 309.89 usrkeys = 129424 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1017.05 avg-zval = 309.89 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 190 bytes = 560 } seq expand size = 1330 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0894 value = 3.2820 dict = 1.00 all = 3.2166 } Zip/UnZip{ index = 0.1411 value = 0.3047 dict = 1.00 all = 0.3109 } ---------------------------- total value len = 0.526529 GB avg = 1.017 KB (by entry num) total key len = 0.010354 GB avg = 0.020 KB total ukey len = 0.006213 GB avg = 0.012 KB total ukey num = 0.000517714 Billion total entry num = 0.000517714 Billion write speed all = 0.037175462 MB/sec (with seq num) write speed all = 0.036888677 MB/sec (without seq num) 2024/11/20-12:48:23.754058 140257189590592 [compaction_job.cc:1948] [default] [JOB 5260] Generated table #26595: 129424 keys, 41726858 bytes, temperature: kWarm 2024/11/20-12:48:23.754108 140257189590592 EVENT_LOG_v1 {"time_micros": 1732078103754080, "cf_name": "default", "job": 5260, "event": "table_file_creation", "file_number": 26595, "file_size": 41726858, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 518475938, "table_properties": {"data_size": 40106720, "index_size": 219072, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588480, "raw_average_key_size": 20, "raw_value_size": 131629502, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129424, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732078102, "oldest_key_time": 0, "file_creation_time": 1732078102, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "92E45FH6K6HCJOD41QCQ", "orig_file_number": 26595, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-12:48:23.794181 140257189590592 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026596.sst) /dev/shm/ToplingTemp/Topling-183460-HYbUCz 2024/11/20-12:48:24.419284 140257189590592 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026596.sst): first pass time = 0.63's, 214.731'MB/sec 2024/11/20-12:48:24.941407 140257189590592 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026596.sst): old prealloc_size = 147639500, real_size = 40353856 2024/11/20-12:48:24.941539 140257189590592 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026596.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129427 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1017.02 avg-zval = 309.85 2024/11/20-12:48:24.941586 140257189590592 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026596.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-12:48:25.136965 140257189590592 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026596.sst): second pass time = 0.52's, 252.442'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.20's, 213.237'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2093.913'MB/sec (index lex order gen) rebuild zvType time = 0.15's, 0.214'MB/sec write SST data time = 0.04's, 949.385'MB/sec dict compress time = 7809653381.23's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 47767.804'MB/sec zip my value time = 0.52's, unzip length = 0.132'GB zip my value throughput = 252.442'MB/sec zip pipeline throughput = 252.516'MB/sec entries = 129427 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1017.02 avg-zval = 309.85 usrkeys = 129427 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1017.02 avg-zval = 309.85 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0979 value = 3.2823 dict = 1.00 all = 3.2186 } Zip/UnZip{ index = 0.1409 value = 0.3047 dict = 1.00 all = 0.3107 } ---------------------------- total value len = 0.658158 GB avg = 1.017 KB (by entry num) total key len = 0.012943 GB avg = 0.020 KB total ukey len = 0.007766 GB avg = 0.012 KB total ukey num = 0.000647141 Billion total entry num = 0.000647141 Billion write speed all = 0.046464517 MB/sec (with seq num) write speed all = 0.046106072 MB/sec (without seq num) 2024/11/20-12:48:25.189160 140257189590592 [compaction_job.cc:1948] [default] [JOB 5260] Generated table #26596: 129427 keys, 41700905 bytes, temperature: kWarm 2024/11/20-12:48:25.189224 140257189590592 EVENT_LOG_v1 {"time_micros": 1732078105189194, "cf_name": "default", "job": 5260, "event": "table_file_creation", "file_number": 26596, "file_size": 41700905, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 40102512, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588540, "raw_average_key_size": 20, "raw_value_size": 131629302, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129427, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732078103, "oldest_key_time": 0, "file_creation_time": 1732078103, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "92E45FH6K6HCJOD41QCQ", "orig_file_number": 26596, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-12:48:25.226811 140257189590592 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026597.sst) /dev/shm/ToplingTemp/Topling-183460-SENz8B 2024/11/20-12:48:25.771486 140257189590592 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026597.sst): first pass time = 0.54's, 246.436'MB/sec 2024/11/20-12:48:26.257378 140257189590592 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026597.sst): old prealloc_size = 147639500, real_size = 40349552 2024/11/20-12:48:26.257484 140257189590592 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026597.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129433 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1016.97 avg-zval = 309.80 2024/11/20-12:48:26.257516 140257189590592 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026597.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-12:48:26.420747 140257189590592 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026597.sst): second pass time = 0.49's, 271.220'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 255.252'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2418.311'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.266'MB/sec write SST data time = 0.04's, 1000.727'MB/sec dict compress time = 7809653381.23's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 35857.831'MB/sec zip my value time = 0.49's, unzip length = 0.132'GB zip my value throughput = 271.220'MB/sec zip pipeline throughput = 271.220'MB/sec entries = 129433 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1016.97 avg-zval = 309.80 usrkeys = 129433 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1016.97 avg-zval = 309.80 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0982 value = 3.2827 dict = 1.00 all = 3.2189 } Zip/UnZip{ index = 0.1409 value = 0.3046 dict = 1.00 all = 0.3107 } ---------------------------- total value len = 0.789788 GB avg = 1.017 KB (by entry num) total key len = 0.015531 GB avg = 0.020 KB total ukey len = 0.009319 GB avg = 0.012 KB total ukey num = 0.000776574 Billion total entry num = 0.000776574 Billion write speed all = 0.055752365 MB/sec (with seq num) write speed all = 0.055322266 MB/sec (without seq num) 2024/11/20-12:48:26.473847 140257189590592 [compaction_job.cc:1948] [default] [JOB 5260] Generated table #26597: 129433 keys, 41697022 bytes, temperature: kWarm 2024/11/20-12:48:26.473903 140257189590592 EVENT_LOG_v1 {"time_micros": 1732078106473874, "cf_name": "default", "job": 5260, "event": "table_file_creation", "file_number": 26597, "file_size": 41697022, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 40098208, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588660, "raw_average_key_size": 20, "raw_value_size": 131630068, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129433, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732078105, "oldest_key_time": 0, "file_creation_time": 1732078105, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "92E45FH6K6HCJOD41QCQ", "orig_file_number": 26597, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-12:48:26.515170 140257189590592 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026598.sst) /dev/shm/ToplingTemp/Topling-183460-b2wjCC 2024/11/20-12:48:27.053208 140257189590592 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026598.sst): first pass time = 0.54's, 249.475'MB/sec 2024/11/20-12:48:28.200538 140257189590592 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026598.sst): old prealloc_size = 147639500, real_size = 40352032 2024/11/20-12:48:28.200637 140257189590592 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026598.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129431 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1016.99 avg-zval = 309.82 2024/11/20-12:48:28.200664 140257189590592 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026598.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-12:48:28.361804 140257189590592 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026598.sst): second pass time = 1.15's, 114.792'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 258.584'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2657.243'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.271'MB/sec write SST data time = 0.04's, 997.397'MB/sec dict compress time = 140278.07's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 21772.671'MB/sec zip my value time = 1.15's, unzip length = 0.132'GB zip my value throughput = 114.792'MB/sec zip pipeline throughput = 262.725'MB/sec entries = 129431 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1016.99 avg-zval = 309.82 usrkeys = 129431 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1016.99 avg-zval = 309.82 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 8 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0981 value = 3.2825 dict = 1.00 all = 3.2187 } Zip/UnZip{ index = 0.1409 value = 0.3046 dict = 1.00 all = 0.3107 } ---------------------------- total value len = 0.921418 GB avg = 1.017 KB (by entry num) total key len = 0.018120 GB avg = 0.020 KB total ukey len = 0.010872 GB avg = 0.012 KB total ukey num = 0.000906005 Billion total entry num = 0.000906005 Billion write speed all = 0.065035597 MB/sec (with seq num) write speed all = 0.064533882 MB/sec (without seq num) 2024/11/20-12:48:28.412299 140257189590592 [compaction_job.cc:1948] [default] [JOB 5260] Generated table #26598: 129431 keys, 41699257 bytes, temperature: kWarm 2024/11/20-12:48:28.412356 140257189590592 EVENT_LOG_v1 {"time_micros": 1732078108412328, "cf_name": "default", "job": 5260, "event": "table_file_creation", "file_number": 26598, "file_size": 41699257, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 40100688, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588620, "raw_average_key_size": 20, "raw_value_size": 131630033, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129431, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732078106, "oldest_key_time": 0, "file_creation_time": 1732078106, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "92E45FH6K6HCJOD41QCQ", "orig_file_number": 26598, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-12:48:28.446822 140257189590592 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026599.sst) /dev/shm/ToplingTemp/Topling-183460-ZOSnMB 2024/11/20-12:48:29.069699 140257189590592 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026599.sst): first pass time = 0.62's, 215.494'MB/sec 2024/11/20-12:48:29.669826 140257189590592 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026599.sst): old prealloc_size = 147639500, real_size = 40350080 2024/11/20-12:48:29.669935 140257189590592 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026599.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129429 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1017.00 avg-zval = 309.81 2024/11/20-12:48:29.669969 140257189590592 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026599.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-12:48:29.834103 140257189590592 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026599.sst): second pass time = 0.60's, 219.564'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 253.888'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2422.836'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.265'MB/sec write SST data time = 0.04's, 989.972'MB/sec dict compress time = 140278.07's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 52423.655'MB/sec zip my value time = 0.60's, unzip length = 0.132'GB zip my value throughput = 219.564'MB/sec zip pipeline throughput = 219.564'MB/sec entries = 129429 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1017.00 avg-zval = 309.81 usrkeys = 129429 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1017.00 avg-zval = 309.81 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0980 value = 3.2826 dict = 1.00 all = 3.2188 } Zip/UnZip{ index = 0.1409 value = 0.3046 dict = 1.00 all = 0.3107 } ---------------------------- total value len = 1.053048 GB avg = 1.017 KB (by entry num) total key len = 0.020709 GB avg = 0.020 KB total ukey len = 0.012425 GB avg = 0.012 KB total ukey num = 0.001035434 Billion total entry num = 0.001035434 Billion write speed all = 0.074318734 MB/sec (with seq num) write speed all = 0.073745404 MB/sec (without seq num) 2024/11/20-12:48:29.904154 140257189590592 [compaction_job.cc:1948] [default] [JOB 5260] Generated table #26599: 129429 keys, 41697890 bytes, temperature: kWarm 2024/11/20-12:48:29.904225 140257189590592 EVENT_LOG_v1 {"time_micros": 1732078109904189, "cf_name": "default", "job": 5260, "event": "table_file_creation", "file_number": 26599, "file_size": 41697890, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 40098736, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588580, "raw_average_key_size": 20, "raw_value_size": 131629892, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129429, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732078108, "oldest_key_time": 0, "file_creation_time": 1732078108, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "92E45FH6K6HCJOD41QCQ", "orig_file_number": 26599, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-12:48:29.941812 140257189590592 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026600.sst) /dev/shm/ToplingTemp/Topling-183460-m57mQy 2024/11/20-12:48:30.611606 140257189590592 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026600.sst): first pass time = 0.67's, 200.398'MB/sec 2024/11/20-12:48:31.232086 140257189590592 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026600.sst): old prealloc_size = 147639500, real_size = 40349520 2024/11/20-12:48:31.232213 140257189590592 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026600.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129432 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1016.98 avg-zval = 309.80 2024/11/20-12:48:31.232251 140257189590592 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026600.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-12:48:31.403505 140257189590592 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026600.sst): second pass time = 0.62's, 212.429'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.17's, 243.220'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2283.424'MB/sec (index lex order gen) rebuild zvType time = 0.13's, 0.251'MB/sec write SST data time = 0.04's, 977.595'MB/sec dict compress time = 140278.07's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 43619.390'MB/sec zip my value time = 0.62's, unzip length = 0.132'GB zip my value throughput = 212.429'MB/sec zip pipeline throughput = 265.046'MB/sec entries = 129432 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1016.98 avg-zval = 309.80 usrkeys = 129432 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1016.98 avg-zval = 309.80 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0981 value = 3.2827 dict = 1.00 all = 3.2189 } Zip/UnZip{ index = 0.1409 value = 0.3046 dict = 1.00 all = 0.3107 } ---------------------------- total value len = 1.184678 GB avg = 1.017 KB (by entry num) total key len = 0.023297 GB avg = 0.020 KB total ukey len = 0.013978 GB avg = 0.012 KB total ukey num = 0.001164866 Billion total entry num = 0.001164866 Billion write speed all = 0.083599400 MB/sec (with seq num) write speed all = 0.082954472 MB/sec (without seq num) 2024/11/20-12:48:31.455359 140257189590592 [compaction_job.cc:1948] [default] [JOB 5260] Generated table #26600: 129432 keys, 41696945 bytes, temperature: kWarm 2024/11/20-12:48:31.455423 140257189590592 EVENT_LOG_v1 {"time_micros": 1732078111455394, "cf_name": "default", "job": 5260, "event": "table_file_creation", "file_number": 26600, "file_size": 41696945, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 40098176, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588640, "raw_average_key_size": 20, "raw_value_size": 131629584, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129432, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732078109, "oldest_key_time": 0, "file_creation_time": 1732078109, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "92E45FH6K6HCJOD41QCQ", "orig_file_number": 26600, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-12:48:31.496930 140257189590592 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026601.sst) /dev/shm/ToplingTemp/Topling-183460-8XHoMB 2024/11/20-12:48:31.996155 140257189590592 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026601.sst): first pass time = 0.50's, 268.879'MB/sec 2024/11/20-12:48:32.527975 140257189590592 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026601.sst): old prealloc_size = 147639500, real_size = 40350192 2024/11/20-12:48:32.528165 140257189590592 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026601.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129430 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1016.99 avg-zval = 309.81 2024/11/20-12:48:32.528229 140257189590592 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026601.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-12:48:32.754181 140257189590592 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026601.sst): second pass time = 0.53's, 247.899'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.23's, 184.327'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1357.175'MB/sec (index lex order gen) rebuild zvType time = 0.18's, 0.177'MB/sec write SST data time = 0.04's, 974.172'MB/sec dict compress time = 140278.07's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 30890.388'MB/sec zip my value time = 0.53's, unzip length = 0.132'GB zip my value throughput = 247.899'MB/sec zip pipeline throughput = 247.899'MB/sec entries = 129430 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1016.99 avg-zval = 309.81 usrkeys = 129430 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1016.99 avg-zval = 309.81 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0980 value = 3.2826 dict = 1.00 all = 3.2188 } Zip/UnZip{ index = 0.1409 value = 0.3046 dict = 1.00 all = 0.3107 } ---------------------------- total value len = 1.316307 GB avg = 1.017 KB (by entry num) total key len = 0.025886 GB avg = 0.020 KB total ukey len = 0.015532 GB avg = 0.012 KB total ukey num = 0.001294296 Billion total entry num = 0.001294296 Billion write speed all = 0.092879430 MB/sec (with seq num) write speed all = 0.092162910 MB/sec (without seq num) 2024/11/20-12:48:32.805467 140257189590592 [compaction_job.cc:1948] [default] [JOB 5260] Generated table #26601: 129430 keys, 41697620 bytes, temperature: kWarm 2024/11/20-12:48:32.805528 140257189590592 EVENT_LOG_v1 {"time_micros": 1732078112805499, "cf_name": "default", "job": 5260, "event": "table_file_creation", "file_number": 26601, "file_size": 41697620, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 40098848, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588600, "raw_average_key_size": 20, "raw_value_size": 131629245, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129430, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732078111, "oldest_key_time": 0, "file_creation_time": 1732078111, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "92E45FH6K6HCJOD41QCQ", "orig_file_number": 26601, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-12:48:32.839814 140257189590592 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026602.sst) /dev/shm/ToplingTemp/Topling-183460-1VNiaB 2024/11/20-12:48:33.778616 140257189590592 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026602.sst): first pass time = 0.94's, 142.974'MB/sec 2024/11/20-12:48:34.340973 140257189590592 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026602.sst): old prealloc_size = 147639500, real_size = 40351536 2024/11/20-12:48:34.341114 140257189590592 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026602.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129430 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1017.00 avg-zval = 309.82 2024/11/20-12:48:34.341163 140257189590592 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026602.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-12:48:34.495253 140257189590592 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026602.sst): second pass time = 0.56's, 234.342'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.15's, 270.444'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1811.271'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.281'MB/sec write SST data time = 0.04's, 1072.957'MB/sec dict compress time = 140278.07's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 31565.658'MB/sec zip my value time = 0.56's, unzip length = 0.132'GB zip my value throughput = 234.342'MB/sec zip pipeline throughput = 234.342'MB/sec entries = 129430 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1017.00 avg-zval = 309.82 usrkeys = 129430 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1017.00 avg-zval = 309.82 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 36 bytes = 80 } seq expand size = 252 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0980 value = 3.2825 dict = 1.00 all = 3.2172 } Zip/UnZip{ index = 0.1409 value = 0.3046 dict = 1.00 all = 0.3108 } ---------------------------- total value len = 1.447937 GB avg = 1.017 KB (by entry num) total key len = 0.028475 GB avg = 0.020 KB total ukey len = 0.017085 GB avg = 0.012 KB total ukey num = 0.001423726 Billion total entry num = 0.001423726 Billion write speed all = 0.102155033 MB/sec (with seq num) write speed all = 0.101366956 MB/sec (without seq num) 2024/11/20-12:48:34.544935 140257189590592 [compaction_job.cc:1948] [default] [JOB 5260] Generated table #26602: 129430 keys, 41718931 bytes, temperature: kWarm 2024/11/20-12:48:34.545002 140257189590592 EVENT_LOG_v1 {"time_micros": 1732078114544972, "cf_name": "default", "job": 5260, "event": "table_file_creation", "file_number": 26602, "file_size": 41718931, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 517278309, "table_properties": {"data_size": 40100192, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588600, "raw_average_key_size": 20, "raw_value_size": 131629960, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129430, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732078112, "oldest_key_time": 0, "file_creation_time": 1732078112, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "92E45FH6K6HCJOD41QCQ", "orig_file_number": 26602, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-12:48:34.583529 140257189590592 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026603.sst) /dev/shm/ToplingTemp/Topling-183460-ggufgy 2024/11/20-12:48:35.085934 140257189590592 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026603.sst): first pass time = 0.50's, 267.177'MB/sec 2024/11/20-12:48:35.693236 140257189590592 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026603.sst): old prealloc_size = 147639500, real_size = 40350736 2024/11/20-12:48:35.693390 140257189590592 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026603.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129430 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1017.00 avg-zval = 309.82 2024/11/20-12:48:35.693470 140257189590592 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026603.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-12:48:35.879287 140257189590592 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026603.sst): second pass time = 0.61's, 217.071'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.19's, 224.217'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1904.222'MB/sec (index lex order gen) rebuild zvType time = 0.14's, 0.231'MB/sec write SST data time = 0.05's, 907.118'MB/sec dict compress time = 140278.07's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 44359.598'MB/sec zip my value time = 0.61's, unzip length = 0.132'GB zip my value throughput = 217.071'MB/sec zip pipeline throughput = 217.071'MB/sec entries = 129430 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1017.00 avg-zval = 309.82 usrkeys = 129430 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1017.00 avg-zval = 309.82 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 49 bytes = 160 } seq expand size = 343 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0980 value = 3.2826 dict = 1.00 all = 3.2172 } Zip/UnZip{ index = 0.1409 value = 0.3046 dict = 1.00 all = 0.3108 } ---------------------------- total value len = 1.579567 GB avg = 1.017 KB (by entry num) total key len = 0.031063 GB avg = 0.020 KB total ukey len = 0.018638 GB avg = 0.012 KB total ukey num = 0.001553156 Billion total entry num = 0.001553156 Billion write speed all = 0.111431141 MB/sec (with seq num) write speed all = 0.110571503 MB/sec (without seq num) 2024/11/20-12:48:35.929484 140257189590592 [compaction_job.cc:1948] [default] [JOB 5260] Generated table #26603: 129430 keys, 41718771 bytes, temperature: kWarm 2024/11/20-12:48:35.929548 140257189590592 EVENT_LOG_v1 {"time_micros": 1732078115929520, "cf_name": "default", "job": 5260, "event": "table_file_creation", "file_number": 26603, "file_size": 41718771, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 522320346, "table_properties": {"data_size": 40099392, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588600, "raw_average_key_size": 20, "raw_value_size": 131629692, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129430, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732078114, "oldest_key_time": 0, "file_creation_time": 1732078114, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "92E45FH6K6HCJOD41QCQ", "orig_file_number": 26603, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-12:48:35.967535 140257189590592 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026604.sst) /dev/shm/ToplingTemp/Topling-183460-yPie4x 2024/11/20-12:48:36.753596 140257189590592 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026604.sst): first pass time = 0.79's, 170.761'MB/sec 2024/11/20-12:48:37.454087 140257189590592 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026604.sst): old prealloc_size = 147639500, real_size = 40351520 2024/11/20-12:48:37.454204 140257189590592 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026604.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129428 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1017.01 avg-zval = 309.83 2024/11/20-12:48:37.454259 140257189590592 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026604.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-12:48:37.621534 140257189590592 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026604.sst): second pass time = 0.70's, 188.109'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.17's, 249.124'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2275.943'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.275'MB/sec write SST data time = 0.05's, 841.784'MB/sec dict compress time = 140278.07's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 41274.301'MB/sec zip my value time = 0.70's, unzip length = 0.132'GB zip my value throughput = 188.109'MB/sec zip pipeline throughput = 222.623'MB/sec entries = 129428 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1017.01 avg-zval = 309.83 usrkeys = 129428 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1017.01 avg-zval = 309.83 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 6 bytes = 16 } seq expand size = 42 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0979 value = 3.2825 dict = 1.00 all = 3.2172 } Zip/UnZip{ index = 0.1409 value = 0.3046 dict = 1.00 all = 0.3108 } ---------------------------- total value len = 1.711196 GB avg = 1.017 KB (by entry num) total key len = 0.033652 GB avg = 0.020 KB total ukey len = 0.020191 GB avg = 0.012 KB total ukey num = 0.001682584 Billion total entry num = 0.001682584 Billion write speed all = 0.120702423 MB/sec (with seq num) write speed all = 0.119771261 MB/sec (without seq num) 2024/11/20-12:48:37.671165 140257189590592 [compaction_job.cc:1948] [default] [JOB 5260] Generated table #26604: 129428 keys, 41719043 bytes, temperature: kWarm 2024/11/20-12:48:37.671216 140257189590592 EVENT_LOG_v1 {"time_micros": 1732078117671187, "cf_name": "default", "job": 5260, "event": "table_file_creation", "file_number": 26604, "file_size": 41719043, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 522320352, "table_properties": {"data_size": 40100176, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588560, "raw_average_key_size": 20, "raw_value_size": 131629168, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129428, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732078115, "oldest_key_time": 0, "file_creation_time": 1732078115, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "92E45FH6K6HCJOD41QCQ", "orig_file_number": 26604, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-12:48:37.710663 140257189590592 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026605.sst) /dev/shm/ToplingTemp/Topling-183460-UvI7DB 2024/11/20-12:48:38.275121 140257189590592 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026605.sst): first pass time = 0.56's, 237.796'MB/sec 2024/11/20-12:48:38.806945 140257189590592 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026605.sst): old prealloc_size = 147639500, real_size = 40352304 2024/11/20-12:48:38.807090 140257189590592 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026605.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129428 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1017.01 avg-zval = 309.83 2024/11/20-12:48:38.807134 140257189590592 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026605.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-12:48:38.968147 140257189590592 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026605.sst): second pass time = 0.53's, 247.804'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 258.685'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1685.962'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.276'MB/sec write SST data time = 0.04's, 952.355'MB/sec dict compress time = 140278.07's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 43485.282'MB/sec zip my value time = 0.53's, unzip length = 0.132'GB zip my value throughput = 247.804'MB/sec zip pipeline throughput = 247.804'MB/sec entries = 129428 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1017.01 avg-zval = 309.83 usrkeys = 129428 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1017.01 avg-zval = 309.83 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0979 value = 3.2824 dict = 1.00 all = 3.2187 } Zip/UnZip{ index = 0.1409 value = 0.3047 dict = 1.00 all = 0.3107 } ---------------------------- total value len = 1.842826 GB avg = 1.017 KB (by entry num) total key len = 0.036240 GB avg = 0.020 KB total ukey len = 0.021744 GB avg = 0.012 KB total ukey num = 0.001812012 Billion total entry num = 0.001812012 Billion write speed all = 0.129975036 MB/sec (with seq num) write speed all = 0.128972341 MB/sec (without seq num) 2024/11/20-12:48:39.023905 140257189590592 [compaction_job.cc:1948] [default] [JOB 5260] Generated table #26605: 129428 keys, 41699916 bytes, temperature: kWarm 2024/11/20-12:48:39.023963 140257189590592 EVENT_LOG_v1 {"time_micros": 1732078119023933, "cf_name": "default", "job": 5260, "event": "table_file_creation", "file_number": 26605, "file_size": 41699916, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 40100960, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588560, "raw_average_key_size": 20, "raw_value_size": 131629353, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129428, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732078117, "oldest_key_time": 0, "file_creation_time": 1732078117, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "92E45FH6K6HCJOD41QCQ", "orig_file_number": 26605, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-12:48:39.069539 140257189590592 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026606.sst) /dev/shm/ToplingTemp/Topling-183460-IyPMIA 2024/11/20-12:48:39.824385 140257189590592 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026606.sst): first pass time = 0.75's, 177.817'MB/sec 2024/11/20-12:48:40.420926 140257189590592 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026606.sst): old prealloc_size = 147639500, real_size = 40352288 2024/11/20-12:48:40.421033 140257189590592 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026606.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129427 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1017.02 avg-zval = 309.83 2024/11/20-12:48:40.421102 140257189590592 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026606.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-12:48:40.575874 140257189590592 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026606.sst): second pass time = 0.60's, 220.869'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.15's, 269.269'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2014.546'MB/sec (index lex order gen) rebuild zvType time = 0.11's, 0.282'MB/sec write SST data time = 0.04's, 1043.067'MB/sec dict compress time = 140278.07's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 26707.119'MB/sec zip my value time = 0.60's, unzip length = 0.132'GB zip my value throughput = 220.869'MB/sec zip pipeline throughput = 338.119'MB/sec entries = 129427 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1017.02 avg-zval = 309.83 usrkeys = 129427 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1017.02 avg-zval = 309.83 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 6 bytes = 16 } seq expand size = 42 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0979 value = 3.2825 dict = 1.00 all = 3.2171 } Zip/UnZip{ index = 0.1409 value = 0.3047 dict = 1.00 all = 0.3108 } ---------------------------- total value len = 1.974455 GB avg = 1.017 KB (by entry num) total key len = 0.038829 GB avg = 0.020 KB total ukey len = 0.023297 GB avg = 0.012 KB total ukey num = 0.001941439 Billion total entry num = 0.001941439 Billion write speed all = 0.139243410 MB/sec (with seq num) write speed all = 0.138169214 MB/sec (without seq num) 2024/11/20-12:48:40.628011 140257189590592 [compaction_job.cc:1948] [default] [JOB 5260] Generated table #26606: 129427 keys, 41719798 bytes, temperature: kWarm 2024/11/20-12:48:40.628093 140257189590592 EVENT_LOG_v1 {"time_micros": 1732078120628039, "cf_name": "default", "job": 5260, "event": "table_file_creation", "file_number": 26606, "file_size": 41719798, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 522320290, "table_properties": {"data_size": 40100944, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588540, "raw_average_key_size": 20, "raw_value_size": 131629365, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129427, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732078119, "oldest_key_time": 0, "file_creation_time": 1732078119, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "92E45FH6K6HCJOD41QCQ", "orig_file_number": 26606, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-12:48:40.665715 140257189590592 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026607.sst) /dev/shm/ToplingTemp/Topling-183460-k6Hdfz 2024/11/20-12:48:41.203831 140257189590592 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026607.sst): first pass time = 0.54's, 249.438'MB/sec 2024/11/20-12:48:41.769929 140257189590592 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026607.sst): old prealloc_size = 147639500, real_size = 40349296 2024/11/20-12:48:41.770072 140257189590592 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026607.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129431 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1016.98 avg-zval = 309.80 2024/11/20-12:48:41.770124 140257189590592 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026607.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-12:48:41.934059 140257189590592 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026607.sst): second pass time = 0.57's, 232.755'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 254.223'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1795.973'MB/sec (index lex order gen) rebuild zvType time = 0.13's, 0.259'MB/sec write SST data time = 0.04's, 1072.881'MB/sec dict compress time = 140278.07's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 47260.591'MB/sec zip my value time = 0.57's, unzip length = 0.132'GB zip my value throughput = 232.755'MB/sec zip pipeline throughput = 232.755'MB/sec entries = 129431 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1016.98 avg-zval = 309.80 usrkeys = 129431 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1016.98 avg-zval = 309.80 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 2 bytes = 16 } seq expand size = 14 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0981 value = 3.2827 dict = 1.00 all = 3.2174 } Zip/UnZip{ index = 0.1409 value = 0.3046 dict = 1.00 all = 0.3108 } ---------------------------- total value len = 2.106084 GB avg = 1.017 KB (by entry num) total key len = 0.041417 GB avg = 0.020 KB total ukey len = 0.024850 GB avg = 0.012 KB total ukey num = 0.002070870 Billion total entry num = 0.002070870 Billion write speed all = 0.148512277 MB/sec (with seq num) write speed all = 0.147366575 MB/sec (without seq num) 2024/11/20-12:48:41.985900 140257189590592 [compaction_job.cc:1948] [default] [JOB 5260] Generated table #26607: 129431 keys, 41716795 bytes, temperature: kWarm 2024/11/20-12:48:41.985954 140257189590592 EVENT_LOG_v1 {"time_micros": 1732078121985927, "cf_name": "default", "job": 5260, "event": "table_file_creation", "file_number": 26607, "file_size": 41716795, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 522320292, "table_properties": {"data_size": 40097952, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588620, "raw_average_key_size": 20, "raw_value_size": 131629181, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129431, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732078120, "oldest_key_time": 0, "file_creation_time": 1732078120, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "92E45FH6K6HCJOD41QCQ", "orig_file_number": 26607, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-12:48:42.026661 140257189590592 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026608.sst) /dev/shm/ToplingTemp/Topling-183460-vuHRnB 2024/11/20-12:48:42.665995 140257189590592 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026608.sst): first pass time = 0.64's, 209.947'MB/sec 2024/11/20-12:48:43.257320 140257189590592 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026608.sst): old prealloc_size = 147639500, real_size = 40351136 2024/11/20-12:48:43.257458 140257189590592 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026608.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129431 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1016.99 avg-zval = 309.82 2024/11/20-12:48:43.257511 140257189590592 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026608.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-12:48:43.452744 140257189590592 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026608.sst): second pass time = 0.59's, 222.907'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.20's, 213.396'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1884.785'MB/sec (index lex order gen) rebuild zvType time = 0.13's, 0.244'MB/sec write SST data time = 0.06's, 666.102'MB/sec dict compress time = 140278.07's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 44142.468'MB/sec zip my value time = 0.59's, unzip length = 0.132'GB zip my value throughput = 222.907'MB/sec zip pipeline throughput = 222.907'MB/sec entries = 129431 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1016.99 avg-zval = 309.82 usrkeys = 129431 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1016.99 avg-zval = 309.82 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 8 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0981 value = 3.2826 dict = 1.00 all = 3.2188 } Zip/UnZip{ index = 0.1409 value = 0.3046 dict = 1.00 all = 0.3107 } ---------------------------- total value len = 2.237714 GB avg = 1.017 KB (by entry num) total key len = 0.044006 GB avg = 0.020 KB total ukey len = 0.026404 GB avg = 0.012 KB total ukey num = 0.002200301 Billion total entry num = 0.002200301 Billion write speed all = 0.157777686 MB/sec (with seq num) write speed all = 0.156560505 MB/sec (without seq num) 2024/11/20-12:48:43.510703 140257189590592 [compaction_job.cc:1948] [default] [JOB 5260] Generated table #26608: 129431 keys, 41698297 bytes, temperature: kWarm 2024/11/20-12:48:43.510779 140257189590592 EVENT_LOG_v1 {"time_micros": 1732078123510737, "cf_name": "default", "job": 5260, "event": "table_file_creation", "file_number": 26608, "file_size": 41698297, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 40099792, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588620, "raw_average_key_size": 20, "raw_value_size": 131629701, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129431, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732078122, "oldest_key_time": 0, "file_creation_time": 1732078122, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "92E45FH6K6HCJOD41QCQ", "orig_file_number": 26608, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-12:48:43.573540 140257189590592 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026609.sst) /dev/shm/ToplingTemp/Topling-183460-Y32TDz 2024/11/20-12:48:44.270407 140257189590592 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026609.sst): first pass time = 0.70's, 192.614'MB/sec 2024/11/20-12:48:44.769916 140257189590592 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026609.sst): old prealloc_size = 147639500, real_size = 40354368 2024/11/20-12:48:44.770033 140257189590592 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026609.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129428 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1017.01 avg-zval = 309.85 2024/11/20-12:48:44.770090 140257189590592 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026609.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-12:48:44.937794 140257189590592 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026609.sst): second pass time = 0.50's, 263.849'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.17's, 248.416'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1908.840'MB/sec (index lex order gen) rebuild zvType time = 0.13's, 0.256'MB/sec write SST data time = 0.04's, 1005.030'MB/sec dict compress time = 140278.07's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 47559.763'MB/sec zip my value time = 0.50's, unzip length = 0.132'GB zip my value throughput = 263.849'MB/sec zip pipeline throughput = 263.849'MB/sec entries = 129428 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1017.01 avg-zval = 309.85 usrkeys = 129428 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1017.01 avg-zval = 309.85 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0979 value = 3.2823 dict = 1.00 all = 3.2185 } Zip/UnZip{ index = 0.1409 value = 0.3047 dict = 1.00 all = 0.3107 } ---------------------------- total value len = 2.369344 GB avg = 1.017 KB (by entry num) total key len = 0.046595 GB avg = 0.020 KB total ukey len = 0.027957 GB avg = 0.012 KB total ukey num = 0.002329729 Billion total entry num = 0.002329729 Billion write speed all = 0.167041533 MB/sec (with seq num) write speed all = 0.165752886 MB/sec (without seq num) 2024/11/20-12:48:45.011657 140257189590592 [compaction_job.cc:1948] [default] [JOB 5260] Generated table #26609: 129428 keys, 41701647 bytes, temperature: kWarm 2024/11/20-12:48:45.011721 140257189590592 EVENT_LOG_v1 {"time_micros": 1732078125011691, "cf_name": "default", "job": 5260, "event": "table_file_creation", "file_number": 26609, "file_size": 41701647, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 40103024, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588560, "raw_average_key_size": 20, "raw_value_size": 131629689, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129428, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732078123, "oldest_key_time": 0, "file_creation_time": 1732078123, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "92E45FH6K6HCJOD41QCQ", "orig_file_number": 26609, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-12:48:45.047069 140257189590592 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026610.sst) /dev/shm/ToplingTemp/Topling-183460-FvmPiB 2024/11/20-12:48:45.713513 140257189590592 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026610.sst): first pass time = 0.67's, 201.405'MB/sec 2024/11/20-12:48:46.208163 140257189590592 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026610.sst): old prealloc_size = 147639500, real_size = 40352896 2024/11/20-12:48:46.208265 140257189590592 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026610.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129428 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1017.01 avg-zval = 309.84 2024/11/20-12:48:46.208293 140257189590592 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026610.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-12:48:46.363603 140257189590592 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026610.sst): second pass time = 0.49's, 266.437'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 268.289'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2650.741'MB/sec (index lex order gen) rebuild zvType time = 0.11's, 0.284'MB/sec write SST data time = 0.04's, 1009.676'MB/sec dict compress time = 140278.07's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 51293.384'MB/sec zip my value time = 0.49's, unzip length = 0.132'GB zip my value throughput = 266.437'MB/sec zip pipeline throughput = 266.437'MB/sec entries = 129428 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1017.01 avg-zval = 309.84 usrkeys = 129428 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1017.01 avg-zval = 309.84 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0979 value = 3.2824 dict = 1.00 all = 3.2187 } Zip/UnZip{ index = 0.1409 value = 0.3047 dict = 1.00 all = 0.3107 } ---------------------------- total value len = 2.500973 GB avg = 1.017 KB (by entry num) total key len = 0.049183 GB avg = 0.020 KB total ukey len = 0.029510 GB avg = 0.012 KB total ukey num = 0.002459157 Billion total entry num = 0.002459157 Billion write speed all = 0.176304206 MB/sec (with seq num) write speed all = 0.174944102 MB/sec (without seq num) 2024/11/20-12:48:46.413893 140257189590592 [compaction_job.cc:1948] [default] [JOB 5260] Generated table #26610: 129428 keys, 41699915 bytes, temperature: kWarm 2024/11/20-12:48:46.413948 140257189590592 EVENT_LOG_v1 {"time_micros": 1732078126413920, "cf_name": "default", "job": 5260, "event": "table_file_creation", "file_number": 26610, "file_size": 41699915, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 40101552, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588560, "raw_average_key_size": 20, "raw_value_size": 131629775, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129428, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732078125, "oldest_key_time": 0, "file_creation_time": 1732078125, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "92E45FH6K6HCJOD41QCQ", "orig_file_number": 26610, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-12:48:46.448178 140257189590592 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026611.sst) /dev/shm/ToplingTemp/Topling-183460-lcnDoz 2024/11/20-12:48:47.086573 140257189590592 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026611.sst): first pass time = 0.64's, 210.254'MB/sec 2024/11/20-12:48:47.588929 140257189590592 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026611.sst): old prealloc_size = 147639500, real_size = 40348624 2024/11/20-12:48:47.589033 140257189590592 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026611.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129432 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1016.98 avg-zval = 309.79 2024/11/20-12:48:47.589090 140257189590592 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026611.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-12:48:47.747394 140257189590592 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026611.sst): second pass time = 0.50's, 262.291'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 263.175'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2571.643'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.278'MB/sec write SST data time = 0.04's, 989.616'MB/sec dict compress time = 140278.07's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 41266.896'MB/sec zip my value time = 0.50's, unzip length = 0.132'GB zip my value throughput = 262.291'MB/sec zip pipeline throughput = 262.291'MB/sec entries = 129432 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1016.98 avg-zval = 309.79 usrkeys = 129432 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1016.98 avg-zval = 309.79 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0981 value = 3.2828 dict = 1.00 all = 3.2190 } Zip/UnZip{ index = 0.1409 value = 0.3046 dict = 1.00 all = 0.3107 } ---------------------------- total value len = 2.632603 GB avg = 1.017 KB (by entry num) total key len = 0.051772 GB avg = 0.020 KB total ukey len = 0.031063 GB avg = 0.012 KB total ukey num = 0.002588589 Billion total entry num = 0.002588589 Billion write speed all = 0.185565616 MB/sec (with seq num) write speed all = 0.184134063 MB/sec (without seq num) 2024/11/20-12:48:47.800141 140257189590592 [compaction_job.cc:1948] [default] [JOB 5260] Generated table #26611: 129432 keys, 41696046 bytes, temperature: kWarm 2024/11/20-12:48:47.800198 140257189590592 EVENT_LOG_v1 {"time_micros": 1732078127800170, "cf_name": "default", "job": 5260, "event": "table_file_creation", "file_number": 26611, "file_size": 41696046, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 40097280, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588640, "raw_average_key_size": 20, "raw_value_size": 131630030, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129432, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732078126, "oldest_key_time": 0, "file_creation_time": 1732078126, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "92E45FH6K6HCJOD41QCQ", "orig_file_number": 26611, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-12:48:47.836664 140257189590592 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026612.sst) /dev/shm/ToplingTemp/Topling-183460-GUgeGC 2024/11/20-12:48:48.396965 140257189590592 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026612.sst): first pass time = 0.56's, 239.562'MB/sec 2024/11/20-12:48:48.892309 140257189590592 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026612.sst): old prealloc_size = 147639500, real_size = 40353712 2024/11/20-12:48:48.892415 140257189590592 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026612.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129428 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1017.01 avg-zval = 309.84 2024/11/20-12:48:48.892445 140257189590592 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026612.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-12:48:49.050882 140257189590592 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026612.sst): second pass time = 0.49's, 267.895'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 262.992'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2510.797'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.280'MB/sec write SST data time = 0.04's, 970.915'MB/sec dict compress time = 140278.07's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 25105.992'MB/sec zip my value time = 0.49's, unzip length = 0.132'GB zip my value throughput = 267.895'MB/sec zip pipeline throughput = 296.625'MB/sec entries = 129428 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1017.01 avg-zval = 309.84 usrkeys = 129428 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1017.01 avg-zval = 309.84 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0979 value = 3.2823 dict = 1.00 all = 3.2186 } Zip/UnZip{ index = 0.1409 value = 0.3047 dict = 1.00 all = 0.3107 } ---------------------------- total value len = 2.764233 GB avg = 1.017 KB (by entry num) total key len = 0.054360 GB avg = 0.020 KB total ukey len = 0.032616 GB avg = 0.012 KB total ukey num = 0.002718017 Billion total entry num = 0.002718017 Billion write speed all = 0.194826289 MB/sec (with seq num) write speed all = 0.193323295 MB/sec (without seq num) 2024/11/20-12:48:49.103158 140257189590592 [compaction_job.cc:1948] [default] [JOB 5260] Generated table #26612: 129428 keys, 41701151 bytes, temperature: kWarm 2024/11/20-12:48:49.103214 140257189590592 EVENT_LOG_v1 {"time_micros": 1732078129103185, "cf_name": "default", "job": 5260, "event": "table_file_creation", "file_number": 26612, "file_size": 41701151, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 40102368, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588560, "raw_average_key_size": 20, "raw_value_size": 131629460, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129428, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732078127, "oldest_key_time": 0, "file_creation_time": 1732078127, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "92E45FH6K6HCJOD41QCQ", "orig_file_number": 26612, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-12:48:49.139289 140257189590592 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026613.sst) /dev/shm/ToplingTemp/Topling-183460-rlpwcy 2024/11/20-12:48:49.719810 140257189590592 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026613.sst): first pass time = 0.58's, 231.216'MB/sec 2024/11/20-12:48:50.321350 140257189590592 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026613.sst): old prealloc_size = 147639500, real_size = 40352768 2024/11/20-12:48:50.321509 140257189590592 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026613.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129429 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1017.00 avg-zval = 309.83 2024/11/20-12:48:50.321564 140257189590592 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026613.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-12:48:50.477888 140257189590592 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026613.sst): second pass time = 0.59's, 222.279'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 266.399'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1686.339'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.277'MB/sec write SST data time = 0.04's, 1051.575'MB/sec dict compress time = 140278.07's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 46904.978'MB/sec zip my value time = 0.59's, unzip length = 0.132'GB zip my value throughput = 222.279'MB/sec zip pipeline throughput = 302.527'MB/sec entries = 129429 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1017.00 avg-zval = 309.83 usrkeys = 129429 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1017.00 avg-zval = 309.83 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0980 value = 3.2824 dict = 1.00 all = 3.2187 } Zip/UnZip{ index = 0.1409 value = 0.3047 dict = 1.00 all = 0.3107 } ---------------------------- total value len = 2.895862 GB avg = 1.017 KB (by entry num) total key len = 0.056949 GB avg = 0.020 KB total ukey len = 0.034169 GB avg = 0.012 KB total ukey num = 0.002847446 Billion total entry num = 0.002847446 Billion write speed all = 0.204083555 MB/sec (with seq num) write speed all = 0.202509145 MB/sec (without seq num) 2024/11/20-12:48:50.528172 140257189590592 [compaction_job.cc:1948] [default] [JOB 5260] Generated table #26613: 129429 keys, 41699791 bytes, temperature: kWarm 2024/11/20-12:48:50.528239 140257189590592 EVENT_LOG_v1 {"time_micros": 1732078130528210, "cf_name": "default", "job": 5260, "event": "table_file_creation", "file_number": 26613, "file_size": 41699791, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 40101424, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588580, "raw_average_key_size": 20, "raw_value_size": 131629479, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129429, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732078129, "oldest_key_time": 0, "file_creation_time": 1732078129, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "92E45FH6K6HCJOD41QCQ", "orig_file_number": 26613, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-12:48:50.561015 140257189590592 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026614.sst) /dev/shm/ToplingTemp/Topling-183460-kVV88x 2024/11/20-12:48:51.250130 140257189590592 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026614.sst): first pass time = 0.69's, 194.786'MB/sec 2024/11/20-12:48:51.758833 140257189590592 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026614.sst): old prealloc_size = 147639500, real_size = 40350944 2024/11/20-12:48:51.758946 140257189590592 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026614.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129430 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1017.00 avg-zval = 309.82 2024/11/20-12:48:51.758979 140257189590592 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026614.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-12:48:51.915787 140257189590592 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026614.sst): second pass time = 0.51's, 259.111'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 265.691'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2348.819'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.276'MB/sec write SST data time = 0.04's, 1057.411'MB/sec dict compress time = 140278.07's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 31338.822'MB/sec zip my value time = 0.51's, unzip length = 0.132'GB zip my value throughput = 259.111'MB/sec zip pipeline throughput = 259.111'MB/sec entries = 129430 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1017.00 avg-zval = 309.82 usrkeys = 129430 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1017.00 avg-zval = 309.82 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 8 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0980 value = 3.2826 dict = 1.00 all = 3.2188 } Zip/UnZip{ index = 0.1409 value = 0.3046 dict = 1.00 all = 0.3107 } ---------------------------- total value len = 3.027492 GB avg = 1.017 KB (by entry num) total key len = 0.059538 GB avg = 0.020 KB total ukey len = 0.035723 GB avg = 0.012 KB total ukey num = 0.002976876 Billion total entry num = 0.002976876 Billion write speed all = 0.213338859 MB/sec (with seq num) write speed all = 0.211693049 MB/sec (without seq num) 2024/11/20-12:48:51.968357 140257189590592 [compaction_job.cc:1948] [default] [JOB 5260] Generated table #26614: 129430 keys, 41698304 bytes, temperature: kWarm 2024/11/20-12:48:51.968411 140257189590592 EVENT_LOG_v1 {"time_micros": 1732078131968378, "cf_name": "default", "job": 5260, "event": "table_file_creation", "file_number": 26614, "file_size": 41698304, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 40099600, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588600, "raw_average_key_size": 20, "raw_value_size": 131629817, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129430, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732078130, "oldest_key_time": 0, "file_creation_time": 1732078130, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "92E45FH6K6HCJOD41QCQ", "orig_file_number": 26614, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-12:48:52.013819 140257189590592 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026615.sst) /dev/shm/ToplingTemp/Topling-183460-1CO8oB 2024/11/20-12:48:52.587820 140257189590592 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026615.sst): first pass time = 0.57's, 233.846'MB/sec 2024/11/20-12:48:53.086591 140257189590592 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026615.sst): old prealloc_size = 147639500, real_size = 40354128 2024/11/20-12:48:53.086697 140257189590592 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026615.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129425 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1017.03 avg-zval = 309.85 2024/11/20-12:48:53.086726 140257189590592 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026615.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-12:48:53.272481 140257189590592 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026615.sst): second pass time = 0.50's, 264.258'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.19's, 224.375'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2497.158'MB/sec (index lex order gen) rebuild zvType time = 0.13's, 0.255'MB/sec write SST data time = 0.06's, 706.934'MB/sec dict compress time = 140278.07's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 27188.134'MB/sec zip my value time = 0.50's, unzip length = 0.132'GB zip my value throughput = 264.258'MB/sec zip pipeline throughput = 264.258'MB/sec entries = 129425 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1017.03 avg-zval = 309.85 usrkeys = 129425 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1017.03 avg-zval = 309.85 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0977 value = 3.2823 dict = 1.00 all = 3.2185 } Zip/UnZip{ index = 0.1409 value = 0.3047 dict = 1.00 all = 0.3107 } ---------------------------- total value len = 3.159122 GB avg = 1.017 KB (by entry num) total key len = 0.062126 GB avg = 0.020 KB total ukey len = 0.037276 GB avg = 0.012 KB total ukey num = 0.003106301 Billion total entry num = 0.003106301 Billion write speed all = 0.222593528 MB/sec (with seq num) write speed all = 0.220876324 MB/sec (without seq num) 2024/11/20-12:48:53.329534 140257189590592 [compaction_job.cc:1948] [default] [JOB 5260] Generated table #26615: 129425 keys, 41701391 bytes, temperature: kWarm 2024/11/20-12:48:53.329622 140257189590592 EVENT_LOG_v1 {"time_micros": 1732078133329577, "cf_name": "default", "job": 5260, "event": "table_file_creation", "file_number": 26615, "file_size": 41701391, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 40102784, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588500, "raw_average_key_size": 20, "raw_value_size": 131629263, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129425, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732078131, "oldest_key_time": 0, "file_creation_time": 1732078131, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "92E45FH6K6HCJOD41QCQ", "orig_file_number": 26615, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-12:48:53.370542 140257189590592 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026616.sst) /dev/shm/ToplingTemp/Topling-183460-YKIW7A 2024/11/20-12:48:53.915005 140257189590592 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026616.sst): first pass time = 0.54's, 246.531'MB/sec 2024/11/20-12:48:54.489290 140257189590592 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026616.sst): old prealloc_size = 147639500, real_size = 40353088 2024/11/20-12:48:54.489414 140257189590592 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026616.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129430 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1016.99 avg-zval = 309.83 2024/11/20-12:48:54.489472 140257189590592 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026616.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-12:48:54.648489 140257189590592 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026616.sst): second pass time = 0.57's, 229.517'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 262.074'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2229.222'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.275'MB/sec write SST data time = 0.04's, 1001.882'MB/sec dict compress time = 140278.07's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 36227.115'MB/sec zip my value time = 0.57's, unzip length = 0.132'GB zip my value throughput = 229.517'MB/sec zip pipeline throughput = 229.517'MB/sec entries = 129430 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1016.99 avg-zval = 309.83 usrkeys = 129430 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1016.99 avg-zval = 309.83 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 8 bytes = 16 } seq expand size = 56 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0980 value = 3.2824 dict = 1.00 all = 3.2171 } Zip/UnZip{ index = 0.1409 value = 0.3047 dict = 1.00 all = 0.3108 } ---------------------------- total value len = 3.290751 GB avg = 1.017 KB (by entry num) total key len = 0.064715 GB avg = 0.020 KB total ukey len = 0.038829 GB avg = 0.012 KB total ukey num = 0.003235731 Billion total entry num = 0.003235731 Billion write speed all = 0.231846183 MB/sec (with seq num) write speed all = 0.230057598 MB/sec (without seq num) 2024/11/20-12:48:54.698563 140257189590592 [compaction_job.cc:1948] [default] [JOB 5260] Generated table #26616: 129430 keys, 41720790 bytes, temperature: kWarm 2024/11/20-12:48:54.698620 140257189590592 EVENT_LOG_v1 {"time_micros": 1732078134698590, "cf_name": "default", "job": 5260, "event": "table_file_creation", "file_number": 26616, "file_size": 41720790, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 522320386, "table_properties": {"data_size": 40101744, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588600, "raw_average_key_size": 20, "raw_value_size": 131629552, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129430, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732078133, "oldest_key_time": 0, "file_creation_time": 1732078133, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "92E45FH6K6HCJOD41QCQ", "orig_file_number": 26616, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-12:48:54.733363 140257189590592 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026617.sst) /dev/shm/ToplingTemp/Topling-183460-M66VHz 2024/11/20-12:48:55.244171 140257189590592 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026617.sst): first pass time = 0.51's, 262.776'MB/sec 2024/11/20-12:48:55.791873 140257189590592 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026617.sst): old prealloc_size = 147639500, real_size = 40350368 2024/11/20-12:48:55.791987 140257189590592 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026617.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129434 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1016.97 avg-zval = 309.80 2024/11/20-12:48:55.792039 140257189590592 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026617.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-12:48:55.960234 140257189590592 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026617.sst): second pass time = 0.55's, 240.626'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.17's, 247.832'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2257.231'MB/sec (index lex order gen) rebuild zvType time = 0.13's, 0.255'MB/sec write SST data time = 0.04's, 1005.375'MB/sec dict compress time = 140278.07's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 32188.961'MB/sec zip my value time = 0.55's, unzip length = 0.132'GB zip my value throughput = 240.626'MB/sec zip pipeline throughput = 243.982'MB/sec entries = 129434 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1016.97 avg-zval = 309.80 usrkeys = 129434 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1016.97 avg-zval = 309.80 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 21 bytes = 80 } seq expand size = 147 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0982 value = 3.2826 dict = 1.00 all = 3.2173 } Zip/UnZip{ index = 0.1409 value = 0.3046 dict = 1.00 all = 0.3108 } ---------------------------- total value len = 3.422381 GB avg = 1.017 KB (by entry num) total key len = 0.067303 GB avg = 0.020 KB total ukey len = 0.040382 GB avg = 0.012 KB total ukey num = 0.003365165 Billion total entry num = 0.003365165 Billion write speed all = 0.241098197 MB/sec (with seq num) write speed all = 0.239238235 MB/sec (without seq num) 2024/11/20-12:48:56.009615 140257189590592 [compaction_job.cc:1948] [default] [JOB 5260] Generated table #26617: 129434 keys, 41718201 bytes, temperature: kWarm 2024/11/20-12:48:56.009662 140257189590592 EVENT_LOG_v1 {"time_micros": 1732078136009636, "cf_name": "default", "job": 5260, "event": "table_file_creation", "file_number": 26617, "file_size": 41718201, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 522320390, "table_properties": {"data_size": 40099024, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588680, "raw_average_key_size": 20, "raw_value_size": 131630066, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129434, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732078134, "oldest_key_time": 0, "file_creation_time": 1732078134, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "92E45FH6K6HCJOD41QCQ", "orig_file_number": 26617, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-12:48:56.044413 140257189590592 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026618.sst) /dev/shm/ToplingTemp/Topling-183460-dxFRsB 2024/11/20-12:48:56.659915 140257189590592 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026618.sst): first pass time = 0.62's, 218.074'MB/sec 2024/11/20-12:48:57.224167 140257189590592 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026618.sst): old prealloc_size = 147639500, real_size = 40347504 2024/11/20-12:48:57.224281 140257189590592 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026618.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129431 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1016.98 avg-zval = 309.79 2024/11/20-12:48:57.224314 140257189590592 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026618.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-12:48:57.384676 140257189590592 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026618.sst): second pass time = 0.56's, 233.558'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 259.776'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2375.930'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.272'MB/sec write SST data time = 0.04's, 1004.466'MB/sec dict compress time = 140278.07's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 47620.930'MB/sec zip my value time = 0.56's, unzip length = 0.132'GB zip my value throughput = 233.558'MB/sec zip pipeline throughput = 233.558'MB/sec entries = 129431 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1016.98 avg-zval = 309.79 usrkeys = 129431 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1016.98 avg-zval = 309.79 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0981 value = 3.2828 dict = 1.00 all = 3.2191 } Zip/UnZip{ index = 0.1409 value = 0.3046 dict = 1.00 all = 0.3106 } ---------------------------- total value len = 3.554010 GB avg = 1.017 KB (by entry num) total key len = 0.069892 GB avg = 0.020 KB total ukey len = 0.041935 GB avg = 0.012 KB total ukey num = 0.003494596 Billion total entry num = 0.003494596 Billion write speed all = 0.250346504 MB/sec (with seq num) write speed all = 0.248415194 MB/sec (without seq num) 2024/11/20-12:48:57.435262 140257189590592 [compaction_job.cc:1948] [default] [JOB 5260] Generated table #26618: 129431 keys, 41694714 bytes, temperature: kWarm 2024/11/20-12:48:57.435315 140257189590592 EVENT_LOG_v1 {"time_micros": 1732078137435287, "cf_name": "default", "job": 5260, "event": "table_file_creation", "file_number": 26618, "file_size": 41694714, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 40096160, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588620, "raw_average_key_size": 20, "raw_value_size": 131629117, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129431, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732078136, "oldest_key_time": 0, "file_creation_time": 1732078136, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "92E45FH6K6HCJOD41QCQ", "orig_file_number": 26618, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-12:48:57.473188 140257189590592 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026619.sst) /dev/shm/ToplingTemp/Topling-183460-Yt0sqA 2024/11/20-12:48:58.033582 140257189590592 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026619.sst): first pass time = 0.56's, 239.522'MB/sec 2024/11/20-12:48:58.553573 140257189590592 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026619.sst): old prealloc_size = 147639500, real_size = 40348464 2024/11/20-12:48:58.553685 140257189590592 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026619.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129434 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1016.96 avg-zval = 309.79 2024/11/20-12:48:58.553724 140257189590592 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026619.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-12:48:58.868342 140257189590592 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026619.sst): second pass time = 0.52's, 253.445'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.31's, 132.480'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2361.672'MB/sec (index lex order gen) rebuild zvType time = 0.19's, 0.167'MB/sec write SST data time = 0.12's, 344.646'MB/sec dict compress time = 140278.07's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 31351.766'MB/sec zip my value time = 0.52's, unzip length = 0.132'GB zip my value throughput = 253.445'MB/sec zip pipeline throughput = 253.445'MB/sec entries = 129434 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1016.96 avg-zval = 309.79 usrkeys = 129434 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1016.96 avg-zval = 309.79 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0982 value = 3.2828 dict = 1.00 all = 3.2190 } Zip/UnZip{ index = 0.1409 value = 0.3046 dict = 1.00 all = 0.3107 } ---------------------------- total value len = 3.685640 GB avg = 1.017 KB (by entry num) total key len = 0.072481 GB avg = 0.020 KB total ukey len = 0.043488 GB avg = 0.012 KB total ukey num = 0.003624030 Billion total entry num = 0.003624030 Billion write speed all = 0.259591974 MB/sec (with seq num) write speed all = 0.257589336 MB/sec (without seq num) 2024/11/20-12:48:58.924483 140257189590592 [compaction_job.cc:1948] [default] [JOB 5260] Generated table #26619: 129434 keys, 41696065 bytes, temperature: kWarm 2024/11/20-12:48:58.924572 140257189590592 EVENT_LOG_v1 {"time_micros": 1732078138924527, "cf_name": "default", "job": 5260, "event": "table_file_creation", "file_number": 26619, "file_size": 41696065, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 40097120, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588680, "raw_average_key_size": 20, "raw_value_size": 131629674, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129434, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732078137, "oldest_key_time": 0, "file_creation_time": 1732078137, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "92E45FH6K6HCJOD41QCQ", "orig_file_number": 26619, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-12:48:58.984631 140257189590592 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026620.sst) /dev/shm/ToplingTemp/Topling-183460-LhbGxy 2024/11/20-12:48:59.661710 140257189590592 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026620.sst): first pass time = 0.68's, 198.249'MB/sec 2024/11/20-12:49:00.235928 140257189590592 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026620.sst): old prealloc_size = 147639500, real_size = 40352624 2024/11/20-12:49:00.236037 140257189590592 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026620.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129426 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1017.03 avg-zval = 309.84 2024/11/20-12:49:00.236092 140257189590592 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026620.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-12:49:00.388462 140257189590592 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026620.sst): second pass time = 0.57's, 229.498'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.15's, 273.405'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2010.253'MB/sec (index lex order gen) rebuild zvType time = 0.11's, 0.285'MB/sec write SST data time = 0.04's, 1077.268'MB/sec dict compress time = 140278.07's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 43848.102'MB/sec zip my value time = 0.57's, unzip length = 0.132'GB zip my value throughput = 229.498'MB/sec zip pipeline throughput = 229.498'MB/sec entries = 129426 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1017.03 avg-zval = 309.84 usrkeys = 129426 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1017.03 avg-zval = 309.84 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0978 value = 3.2824 dict = 1.00 all = 3.2187 } Zip/UnZip{ index = 0.1409 value = 0.3047 dict = 1.00 all = 0.3107 } ---------------------------- total value len = 3.817270 GB avg = 1.017 KB (by entry num) total key len = 0.075069 GB avg = 0.020 KB total ukey len = 0.045041 GB avg = 0.012 KB total ukey num = 0.003753456 Billion total entry num = 0.003753456 Billion write speed all = 0.268834888 MB/sec (with seq num) write speed all = 0.266760948 MB/sec (without seq num) 2024/11/20-12:49:00.439216 140257189590592 [compaction_job.cc:1948] [default] [JOB 5260] Generated table #26620: 129426 keys, 41700072 bytes, temperature: kWarm 2024/11/20-12:49:00.439278 140257189590592 EVENT_LOG_v1 {"time_micros": 1732078140439247, "cf_name": "default", "job": 5260, "event": "table_file_creation", "file_number": 26620, "file_size": 41700072, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 40101280, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588520, "raw_average_key_size": 20, "raw_value_size": 131630102, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129426, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732078138, "oldest_key_time": 0, "file_creation_time": 1732078138, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "92E45FH6K6HCJOD41QCQ", "orig_file_number": 26620, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-12:49:00.481404 140257189590592 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026621.sst) /dev/shm/ToplingTemp/Topling-183460-HCfFsB 2024/11/20-12:49:01.071436 140257189590592 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026621.sst): first pass time = 0.59's, 227.495'MB/sec 2024/11/20-12:49:01.588250 140257189590592 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026621.sst): old prealloc_size = 147639500, real_size = 40347504 2024/11/20-12:49:01.588389 140257189590592 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026621.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129433 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1016.97 avg-zval = 309.78 2024/11/20-12:49:01.588443 140257189590592 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026621.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-12:49:01.932322 140257189590592 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026621.sst): second pass time = 0.52's, 255.079'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.34's, 121.188'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1847.422'MB/sec (index lex order gen) rebuild zvType time = 0.22's, 0.147'MB/sec write SST data time = 0.12's, 335.869'MB/sec dict compress time = 140278.07's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 44771.490'MB/sec zip my value time = 0.52's, unzip length = 0.132'GB zip my value throughput = 255.079'MB/sec zip pipeline throughput = 255.107'MB/sec entries = 129433 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1016.97 avg-zval = 309.78 usrkeys = 129433 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1016.97 avg-zval = 309.78 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 8 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0982 value = 3.2829 dict = 1.00 all = 3.2191 } Zip/UnZip{ index = 0.1409 value = 0.3046 dict = 1.00 all = 0.3107 } ---------------------------- total value len = 3.948900 GB avg = 1.017 KB (by entry num) total key len = 0.077658 GB avg = 0.020 KB total ukey len = 0.046595 GB avg = 0.012 KB total ukey num = 0.003882889 Billion total entry num = 0.003882889 Billion write speed all = 0.278075391 MB/sec (with seq num) write speed all = 0.275930162 MB/sec (without seq num) 2024/11/20-12:49:01.993094 140257189590592 [compaction_job.cc:1948] [default] [JOB 5260] Generated table #26621: 129433 keys, 41695006 bytes, temperature: kWarm 2024/11/20-12:49:01.993178 140257189590592 EVENT_LOG_v1 {"time_micros": 1732078141993133, "cf_name": "default", "job": 5260, "event": "table_file_creation", "file_number": 26621, "file_size": 41695006, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 40096160, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588660, "raw_average_key_size": 20, "raw_value_size": 131629721, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129433, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732078140, "oldest_key_time": 0, "file_creation_time": 1732078140, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "92E45FH6K6HCJOD41QCQ", "orig_file_number": 26621, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-12:49:02.041686 140257189590592 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026622.sst) /dev/shm/ToplingTemp/Topling-183460-5lkekA 2024/11/20-12:49:02.620164 140257189590592 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026622.sst): first pass time = 0.58's, 232.037'MB/sec 2024/11/20-12:49:03.116608 140257189590592 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026622.sst): old prealloc_size = 147639500, real_size = 40350896 2024/11/20-12:49:03.116717 140257189590592 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026622.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129430 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1016.99 avg-zval = 309.82 2024/11/20-12:49:03.116777 140257189590592 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026622.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-12:49:03.333090 140257189590592 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026622.sst): second pass time = 0.50's, 265.460'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.22's, 193.077'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2366.730'MB/sec (index lex order gen) rebuild zvType time = 0.16's, 0.205'MB/sec write SST data time = 0.06's, 711.698'MB/sec dict compress time = 140278.07's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 30060.095'MB/sec zip my value time = 0.50's, unzip length = 0.132'GB zip my value throughput = 265.460'MB/sec zip pipeline throughput = 265.460'MB/sec entries = 129430 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1016.99 avg-zval = 309.82 usrkeys = 129430 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1018.70 avg-zval = 309.82 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 31509 bytes = 63040 } seq expand size = 220563 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0418 GB } UnZip/Zip{ index = 7.0980 value = 3.2826 dict = 1.00 all = 3.2124 } Zip/UnZip{ index = 0.1409 value = 0.3046 dict = 1.00 all = 0.3113 } ---------------------------- total value len = 4.080750 GB avg = 1.017 KB (by entry num) total key len = 0.080246 GB avg = 0.020 KB total ukey len = 0.048148 GB avg = 0.012 KB total ukey num = 0.004012319 Billion total entry num = 0.004012319 Billion write speed all = 0.287331975 MB/sec (with seq num) write speed all = 0.285115453 MB/sec (without seq num) 2024/11/20-12:49:03.386486 140257189590592 [compaction_job.cc:1948] [default] [JOB 5260] Generated table #26622: 129430 keys, 41781722 bytes, temperature: kWarm 2024/11/20-12:49:03.386550 140257189590592 EVENT_LOG_v1 {"time_micros": 1732078143386521, "cf_name": "default", "job": 5260, "event": "table_file_creation", "file_number": 26622, "file_size": 41781722, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 513380125, "table_properties": {"data_size": 40099552, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588600, "raw_average_key_size": 20, "raw_value_size": 131629511, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129430, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732078142, "oldest_key_time": 0, "file_creation_time": 1732078142, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "92E45FH6K6HCJOD41QCQ", "orig_file_number": 26622, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-12:49:03.421027 140257189590592 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026623.sst) /dev/shm/ToplingTemp/Topling-183460-mzYLXA 2024/11/20-12:49:04.081889 140257189590592 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026623.sst): first pass time = 0.66's, 203.119'MB/sec 2024/11/20-12:49:05.012347 140257189590592 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026623.sst): old prealloc_size = 147639500, real_size = 40353392 2024/11/20-12:49:05.012468 140257189590592 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026623.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129426 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1017.03 avg-zval = 309.85 2024/11/20-12:49:05.012500 140257189590592 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026623.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-12:49:05.287546 140257189590592 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026623.sst): second pass time = 0.93's, 141.562'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.28's, 151.552'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2174.374'MB/sec (index lex order gen) rebuild zvType time = 0.21's, 0.155'MB/sec write SST data time = 0.07's, 627.347'MB/sec dict compress time = 140278.07's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 36476.071'MB/sec zip my value time = 0.93's, unzip length = 0.132'GB zip my value throughput = 141.562'MB/sec zip pipeline throughput = 242.718'MB/sec entries = 129426 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1017.03 avg-zval = 309.85 usrkeys = 129426 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1017.03 avg-zval = 309.85 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0978 value = 3.2824 dict = 1.00 all = 3.2186 } Zip/UnZip{ index = 0.1409 value = 0.3047 dict = 1.00 all = 0.3107 } ---------------------------- total value len = 4.212380 GB avg = 1.017 KB (by entry num) total key len = 0.082835 GB avg = 0.020 KB total ukey len = 0.049701 GB avg = 0.012 KB total ukey num = 0.004141745 Billion total entry num = 0.004141745 Billion write speed all = 0.296560209 MB/sec (with seq num) write speed all = 0.294272497 MB/sec (without seq num) 2024/11/20-12:49:05.339982 140257189590592 [compaction_job.cc:1948] [default] [JOB 5260] Generated table #26623: 129426 keys, 41700731 bytes, temperature: kWarm 2024/11/20-12:49:05.340056 140257189590592 EVENT_LOG_v1 {"time_micros": 1732078145340011, "cf_name": "default", "job": 5260, "event": "table_file_creation", "file_number": 26623, "file_size": 41700731, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 40102048, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588520, "raw_average_key_size": 20, "raw_value_size": 131629723, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129426, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732078143, "oldest_key_time": 0, "file_creation_time": 1732078143, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "92E45FH6K6HCJOD41QCQ", "orig_file_number": 26623, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-12:49:05.375283 140257189590592 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026624.sst) /dev/shm/ToplingTemp/Topling-183460-hl2Ufy 2024/11/20-12:49:06.295970 140257189590592 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026624.sst): first pass time = 0.92's, 145.787'MB/sec 2024/11/20-12:49:06.902094 140257189590592 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026624.sst): old prealloc_size = 147639500, real_size = 40356544 2024/11/20-12:49:06.902236 140257189590592 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026624.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129422 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1017.05 avg-zval = 309.88 2024/11/20-12:49:06.902336 140257189590592 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026624.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-12:49:07.076322 140257189590592 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026624.sst): second pass time = 0.61's, 217.461'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.17's, 239.799'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1904.205'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.264'MB/sec write SST data time = 0.05's, 811.828'MB/sec dict compress time = 140278.07's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 48945.693'MB/sec zip my value time = 0.61's, unzip length = 0.132'GB zip my value throughput = 217.461'MB/sec zip pipeline throughput = 259.627'MB/sec entries = 129422 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1017.05 avg-zval = 309.88 usrkeys = 129422 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1018.77 avg-zval = 309.88 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 31731 bytes = 59504 } seq expand size = 222117 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0418 GB } UnZip/Zip{ index = 7.0976 value = 3.2821 dict = 1.00 all = 3.2122 } Zip/UnZip{ index = 0.1409 value = 0.3047 dict = 1.00 all = 0.3113 } ---------------------------- total value len = 4.344231 GB avg = 1.017 KB (by entry num) total key len = 0.085423 GB avg = 0.020 KB total ukey len = 0.051254 GB avg = 0.012 KB total ukey num = 0.004271167 Billion total entry num = 0.004271167 Billion write speed all = 0.305804749 MB/sec (with seq num) write speed all = 0.303445841 MB/sec (without seq num) 2024/11/20-12:49:07.125201 140257189590592 [compaction_job.cc:1948] [default] [JOB 5260] Generated table #26624: 129422 keys, 41783825 bytes, temperature: kWarm 2024/11/20-12:49:07.125265 140257189590592 EVENT_LOG_v1 {"time_micros": 1732078147125235, "cf_name": "default", "job": 5260, "event": "table_file_creation", "file_number": 26624, "file_size": 41783825, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 514468462, "table_properties": {"data_size": 40105200, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588440, "raw_average_key_size": 20, "raw_value_size": 131629292, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129422, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732078145, "oldest_key_time": 0, "file_creation_time": 1732078145, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "92E45FH6K6HCJOD41QCQ", "orig_file_number": 26624, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-12:49:07.156780 140257189590592 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026625.sst) /dev/shm/ToplingTemp/Topling-183460-UzPylA 2024/11/20-12:49:07.804199 140257189590592 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026625.sst): first pass time = 0.65's, 207.324'MB/sec 2024/11/20-12:49:08.545891 140257189590592 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026625.sst): old prealloc_size = 147639500, real_size = 40352192 2024/11/20-12:49:08.545999 140257189590592 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026625.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129429 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1017.00 avg-zval = 309.83 2024/11/20-12:49:08.546033 140257189590592 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026625.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-12:49:08.703820 140257189590592 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026625.sst): second pass time = 0.74's, 177.679'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 264.069'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2531.362'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.276'MB/sec write SST data time = 0.04's, 1026.973'MB/sec dict compress time = 140278.07's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 35509.663'MB/sec zip my value time = 0.74's, unzip length = 0.132'GB zip my value throughput = 177.679'MB/sec zip pipeline throughput = 346.537'MB/sec entries = 129429 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1017.00 avg-zval = 309.83 usrkeys = 129429 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1017.00 avg-zval = 309.83 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0980 value = 3.2825 dict = 1.00 all = 3.2187 } Zip/UnZip{ index = 0.1409 value = 0.3046 dict = 1.00 all = 0.3107 } ---------------------------- total value len = 4.475861 GB avg = 1.017 KB (by entry num) total key len = 0.088012 GB avg = 0.020 KB total ukey len = 0.052807 GB avg = 0.012 KB total ukey num = 0.004400596 Billion total entry num = 0.004400596 Billion write speed all = 0.315035199 MB/sec (with seq num) write speed all = 0.312605083 MB/sec (without seq num) 2024/11/20-12:49:08.752905 140257189590592 [compaction_job.cc:1948] [default] [JOB 5260] Generated table #26625: 129429 keys, 41699581 bytes, temperature: kWarm 2024/11/20-12:49:08.752964 140257189590592 EVENT_LOG_v1 {"time_micros": 1732078148752936, "cf_name": "default", "job": 5260, "event": "table_file_creation", "file_number": 26625, "file_size": 41699581, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 40100848, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588580, "raw_average_key_size": 20, "raw_value_size": 131629412, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129429, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732078147, "oldest_key_time": 0, "file_creation_time": 1732078147, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "92E45FH6K6HCJOD41QCQ", "orig_file_number": 26625, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-12:49:08.804116 140257189590592 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026626.sst) /dev/shm/ToplingTemp/Topling-183460-qbmA7A 2024/11/20-12:49:09.317180 140257189590592 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026626.sst): first pass time = 0.51's, 261.619'MB/sec 2024/11/20-12:49:09.977664 140257189590592 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026626.sst): old prealloc_size = 147639500, real_size = 40351424 2024/11/20-12:49:09.977779 140257189590592 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026626.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129431 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1016.98 avg-zval = 309.82 2024/11/20-12:49:09.977815 140257189590592 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026626.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-12:49:10.137773 140257189590592 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026626.sst): second pass time = 0.66's, 199.505'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 260.450'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2452.654'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.273'MB/sec write SST data time = 0.04's, 1004.654'MB/sec dict compress time = 140278.07's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 43352.897'MB/sec zip my value time = 0.66's, unzip length = 0.132'GB zip my value throughput = 199.505'MB/sec zip pipeline throughput = 199.505'MB/sec entries = 129431 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1016.98 avg-zval = 309.82 usrkeys = 129431 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1016.98 avg-zval = 309.82 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0981 value = 3.2825 dict = 1.00 all = 3.2188 } Zip/UnZip{ index = 0.1409 value = 0.3046 dict = 1.00 all = 0.3107 } ---------------------------- total value len = 4.607490 GB avg = 1.017 KB (by entry num) total key len = 0.090601 GB avg = 0.020 KB total ukey len = 0.054360 GB avg = 0.012 KB total ukey num = 0.004530027 Billion total entry num = 0.004530027 Billion write speed all = 0.324267905 MB/sec (with seq num) write speed all = 0.321766562 MB/sec (without seq num) 2024/11/20-12:49:10.188501 140257189590592 [compaction_job.cc:1948] [default] [JOB 5260] Generated table #26626: 129431 keys, 41698379 bytes, temperature: kWarm 2024/11/20-12:49:10.188558 140257189590592 EVENT_LOG_v1 {"time_micros": 1732078150188529, "cf_name": "default", "job": 5260, "event": "table_file_creation", "file_number": 26626, "file_size": 41698379, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 40100080, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588620, "raw_average_key_size": 20, "raw_value_size": 131629334, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129431, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732078148, "oldest_key_time": 0, "file_creation_time": 1732078148, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "92E45FH6K6HCJOD41QCQ", "orig_file_number": 26626, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-12:49:10.220669 140257189590592 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026627.sst) /dev/shm/ToplingTemp/Topling-183460-0dXejy 2024/11/20-12:49:11.021606 140257189590592 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026627.sst): first pass time = 0.80's, 167.586'MB/sec 2024/11/20-12:49:11.552402 140257189590592 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026627.sst): old prealloc_size = 147639500, real_size = 40347488 2024/11/20-12:49:11.552517 140257189590592 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026627.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129434 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1016.96 avg-zval = 309.78 2024/11/20-12:49:11.552547 140257189590592 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026627.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-12:49:11.708368 140257189590592 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026627.sst): second pass time = 0.53's, 248.456'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 267.363'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2318.924'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.281'MB/sec write SST data time = 0.04's, 1022.797'MB/sec dict compress time = 140278.07's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 27754.854'MB/sec zip my value time = 0.53's, unzip length = 0.132'GB zip my value throughput = 248.456'MB/sec zip pipeline throughput = 248.456'MB/sec entries = 129434 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1016.96 avg-zval = 309.78 usrkeys = 129434 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1016.96 avg-zval = 309.78 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 8 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0982 value = 3.2829 dict = 1.00 all = 3.2191 } Zip/UnZip{ index = 0.1409 value = 0.3046 dict = 1.00 all = 0.3106 } ---------------------------- total value len = 4.739120 GB avg = 1.017 KB (by entry num) total key len = 0.093189 GB avg = 0.020 KB total ukey len = 0.055914 GB avg = 0.012 KB total ukey num = 0.004659461 Billion total entry num = 0.004659461 Billion write speed all = 0.333495676 MB/sec (with seq num) write speed all = 0.330923142 MB/sec (without seq num) 2024/11/20-12:49:11.760655 140257189590592 [compaction_job.cc:1948] [default] [JOB 5260] Generated table #26627: 129434 keys, 41694759 bytes, temperature: kWarm 2024/11/20-12:49:11.760718 140257189590592 EVENT_LOG_v1 {"time_micros": 1732078151760689, "cf_name": "default", "job": 5260, "event": "table_file_creation", "file_number": 26627, "file_size": 41694759, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 40096144, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588680, "raw_average_key_size": 20, "raw_value_size": 131629807, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129434, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732078150, "oldest_key_time": 0, "file_creation_time": 1732078150, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "92E45FH6K6HCJOD41QCQ", "orig_file_number": 26627, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-12:49:11.795978 140257189590592 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026628.sst) /dev/shm/ToplingTemp/Topling-183460-CAW7iA 2024/11/20-12:49:12.370928 140257189590592 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026628.sst): first pass time = 0.57's, 233.459'MB/sec 2024/11/20-12:49:12.920429 140257189590592 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026628.sst): old prealloc_size = 147639500, real_size = 40350464 2024/11/20-12:49:12.920545 140257189590592 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026628.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129431 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1016.99 avg-zval = 309.81 2024/11/20-12:49:12.920581 140257189590592 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026628.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-12:49:13.078272 140257189590592 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026628.sst): second pass time = 0.54's, 243.153'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 264.182'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2449.469'MB/sec (index lex order gen) rebuild zvType time = 0.11's, 0.284'MB/sec write SST data time = 0.04's, 951.678'MB/sec dict compress time = 140278.07's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 22464.465'MB/sec zip my value time = 0.54's, unzip length = 0.132'GB zip my value throughput = 243.153'MB/sec zip pipeline throughput = 243.153'MB/sec entries = 129431 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1016.99 avg-zval = 309.81 usrkeys = 129431 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1016.99 avg-zval = 309.81 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0981 value = 3.2826 dict = 1.00 all = 3.2188 } Zip/UnZip{ index = 0.1409 value = 0.3046 dict = 1.00 all = 0.3107 } ---------------------------- total value len = 4.870749 GB avg = 1.017 KB (by entry num) total key len = 0.095778 GB avg = 0.020 KB total ukey len = 0.057467 GB avg = 0.012 KB total ukey num = 0.004788892 Billion total entry num = 0.004788892 Billion write speed all = 0.342726172 MB/sec (with seq num) write speed all = 0.340082428 MB/sec (without seq num) 2024/11/20-12:49:13.143574 140257189590592 [compaction_job.cc:1948] [default] [JOB 5260] Generated table #26628: 129431 keys, 41697944 bytes, temperature: kWarm 2024/11/20-12:49:13.143659 140257189590592 EVENT_LOG_v1 {"time_micros": 1732078153143618, "cf_name": "default", "job": 5260, "event": "table_file_creation", "file_number": 26628, "file_size": 41697944, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 40099120, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588620, "raw_average_key_size": 20, "raw_value_size": 131629573, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129431, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732078151, "oldest_key_time": 0, "file_creation_time": 1732078151, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "92E45FH6K6HCJOD41QCQ", "orig_file_number": 26628, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-12:49:13.349568 140257189590592 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026629.sst) /dev/shm/ToplingTemp/Topling-183460-lwhV7y 2024/11/20-12:49:14.212704 140257189590592 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026629.sst): first pass time = 0.86's, 155.513'MB/sec 2024/11/20-12:49:14.757176 140257189590592 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026629.sst): old prealloc_size = 147639500, real_size = 40349488 2024/11/20-12:49:14.757276 140257189590592 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026629.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129432 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1016.98 avg-zval = 309.80 2024/11/20-12:49:14.757303 140257189590592 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026629.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-12:49:14.913490 140257189590592 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026629.sst): second pass time = 0.54's, 242.043'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 266.776'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2685.650'MB/sec (index lex order gen) rebuild zvType time = 0.11's, 0.282'MB/sec write SST data time = 0.04's, 1005.653'MB/sec dict compress time = 140278.07's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 35026.256'MB/sec zip my value time = 0.54's, unzip length = 0.132'GB zip my value throughput = 242.043'MB/sec zip pipeline throughput = 242.043'MB/sec entries = 129432 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1016.98 avg-zval = 309.80 usrkeys = 129432 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1016.98 avg-zval = 309.80 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0981 value = 3.2827 dict = 1.00 all = 3.2189 } Zip/UnZip{ index = 0.1409 value = 0.3046 dict = 1.00 all = 0.3107 } ---------------------------- total value len = 5.002379 GB avg = 1.017 KB (by entry num) total key len = 0.098366 GB avg = 0.020 KB total ukey len = 0.059020 GB avg = 0.012 KB total ukey num = 0.004918324 Billion total entry num = 0.004918324 Billion write speed all = 0.351943605 MB/sec (with seq num) write speed all = 0.349228750 MB/sec (without seq num) 2024/11/20-12:49:14.965221 140257189590592 [compaction_job.cc:1948] [default] [JOB 5260] Generated table #26629: 129432 keys, 41696872 bytes, temperature: kWarm 2024/11/20-12:49:14.965274 140257189590592 EVENT_LOG_v1 {"time_micros": 1732078154965247, "cf_name": "default", "job": 5260, "event": "table_file_creation", "file_number": 26629, "file_size": 41696872, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 40098144, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588640, "raw_average_key_size": 20, "raw_value_size": 131629272, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129432, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732078153, "oldest_key_time": 0, "file_creation_time": 1732078153, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "92E45FH6K6HCJOD41QCQ", "orig_file_number": 26629, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-12:49:15.004212 140257189590592 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026630.sst) /dev/shm/ToplingTemp/Topling-183460-BEVHXA 2024/11/20-12:49:15.301260 140257189590592 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026630.sst): first pass time = 0.30's, 451.903'MB/sec 2024/11/20-12:49:15.807211 140257189590592 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026630.sst): old prealloc_size = 147639500, real_size = 40353344 2024/11/20-12:49:15.807330 140257189590592 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026630.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129428 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1017.01 avg-zval = 309.84 2024/11/20-12:49:15.807365 140257189590592 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026630.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-12:49:15.965815 140257189590592 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026630.sst): second pass time = 0.51's, 260.540'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 262.945'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2247.194'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.279'MB/sec write SST data time = 0.04's, 979.741'MB/sec dict compress time = 140278.07's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 44926.525'MB/sec zip my value time = 0.51's, unzip length = 0.132'GB zip my value throughput = 260.540'MB/sec zip pipeline throughput = 260.540'MB/sec entries = 129428 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1017.01 avg-zval = 309.84 usrkeys = 129428 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1017.01 avg-zval = 309.84 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0979 value = 3.2824 dict = 1.00 all = 3.2186 } Zip/UnZip{ index = 0.1409 value = 0.3047 dict = 1.00 all = 0.3107 } ---------------------------- total value len = 5.134008 GB avg = 1.017 KB (by entry num) total key len = 0.100955 GB avg = 0.020 KB total ukey len = 0.060573 GB avg = 0.012 KB total ukey num = 0.005047752 Billion total entry num = 0.005047752 Billion write speed all = 0.361178238 MB/sec (with seq num) write speed all = 0.358392143 MB/sec (without seq num) 2024/11/20-12:49:16.021414 140257189590592 [compaction_job.cc:1948] [default] [JOB 5260] Generated table #26630: 129428 keys, 41700885 bytes, temperature: kWarm 2024/11/20-12:49:16.021484 140257189590592 EVENT_LOG_v1 {"time_micros": 1732078156021453, "cf_name": "default", "job": 5260, "event": "table_file_creation", "file_number": 26630, "file_size": 41700885, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 40102000, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588560, "raw_average_key_size": 20, "raw_value_size": 131629751, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129428, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732078154, "oldest_key_time": 0, "file_creation_time": 1732078154, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "92E45FH6K6HCJOD41QCQ", "orig_file_number": 26630, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-12:49:16.066898 140257189590592 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026631.sst) /dev/shm/ToplingTemp/Topling-183460-F822wy 2024/11/20-12:49:16.732096 140257189590592 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026631.sst): first pass time = 0.67's, 201.795'MB/sec 2024/11/20-12:49:17.473984 140257189590592 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026631.sst): old prealloc_size = 147639500, real_size = 40350272 2024/11/20-12:49:17.474140 140257189590592 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026631.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129431 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1016.99 avg-zval = 309.81 2024/11/20-12:49:17.474191 140257189590592 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026631.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-12:49:17.702987 140257189590592 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026631.sst): second pass time = 0.74's, 177.600'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.23's, 182.088'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1620.187'MB/sec (index lex order gen) rebuild zvType time = 0.18's, 0.177'MB/sec write SST data time = 0.05's, 905.640'MB/sec dict compress time = 140278.07's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 33783.478'MB/sec zip my value time = 0.74's, unzip length = 0.132'GB zip my value throughput = 177.600'MB/sec zip pipeline throughput = 177.600'MB/sec entries = 129431 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1016.99 avg-zval = 309.81 usrkeys = 129431 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1016.99 avg-zval = 309.81 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0981 value = 3.2826 dict = 1.00 all = 3.2188 } Zip/UnZip{ index = 0.1409 value = 0.3046 dict = 1.00 all = 0.3107 } ---------------------------- total value len = 5.265638 GB avg = 1.017 KB (by entry num) total key len = 0.103544 GB avg = 0.020 KB total ukey len = 0.062126 GB avg = 0.012 KB total ukey num = 0.005177183 Billion total entry num = 0.005177183 Billion write speed all = 0.370394043 MB/sec (with seq num) write speed all = 0.367536851 MB/sec (without seq num) 2024/11/20-12:49:17.758995 140257189590592 [compaction_job.cc:1948] [default] [JOB 5260] Generated table #26631: 129431 keys, 41697799 bytes, temperature: kWarm 2024/11/20-12:49:17.759057 140257189590592 EVENT_LOG_v1 {"time_micros": 1732078157759015, "cf_name": "default", "job": 5260, "event": "table_file_creation", "file_number": 26631, "file_size": 41697799, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 40098928, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588620, "raw_average_key_size": 20, "raw_value_size": 131629863, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129431, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732078156, "oldest_key_time": 0, "file_creation_time": 1732078156, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "92E45FH6K6HCJOD41QCQ", "orig_file_number": 26631, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-12:49:17.792918 140257189590592 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026632.sst) /dev/shm/ToplingTemp/Topling-183460-cxHTXy 2024/11/20-12:49:18.524926 140257189590592 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026632.sst): first pass time = 0.73's, 183.366'MB/sec 2024/11/20-12:49:19.069377 140257189590592 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026632.sst): old prealloc_size = 147639500, real_size = 40351664 2024/11/20-12:49:19.069491 140257189590592 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026632.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129428 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1017.01 avg-zval = 309.83 2024/11/20-12:49:19.069528 140257189590592 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026632.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-12:49:19.227603 140257189590592 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026632.sst): second pass time = 0.54's, 245.413'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 263.561'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2354.025'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.276'MB/sec write SST data time = 0.04's, 1015.806'MB/sec dict compress time = 140278.07's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 44888.285'MB/sec zip my value time = 0.54's, unzip length = 0.132'GB zip my value throughput = 245.413'MB/sec zip pipeline throughput = 245.413'MB/sec entries = 129428 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1017.01 avg-zval = 309.83 usrkeys = 129428 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1017.01 avg-zval = 309.83 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 10 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0979 value = 3.2825 dict = 1.00 all = 3.2187 } Zip/UnZip{ index = 0.1409 value = 0.3046 dict = 1.00 all = 0.3107 } ---------------------------- total value len = 5.397267 GB avg = 1.017 KB (by entry num) total key len = 0.106132 GB avg = 0.020 KB total ukey len = 0.063679 GB avg = 0.012 KB total ukey num = 0.005306611 Billion total entry num = 0.005306611 Billion write speed all = 0.379613153 MB/sec (with seq num) write speed all = 0.376684840 MB/sec (without seq num) 2024/11/20-12:49:19.281362 140257189590592 [compaction_job.cc:1948] [default] [JOB 5260] Generated table #26632: 129428 keys, 41699343 bytes, temperature: kWarm 2024/11/20-12:49:19.281421 140257189590592 EVENT_LOG_v1 {"time_micros": 1732078159281391, "cf_name": "default", "job": 5260, "event": "table_file_creation", "file_number": 26632, "file_size": 41699343, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 40100320, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588560, "raw_average_key_size": 20, "raw_value_size": 131629178, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129428, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732078157, "oldest_key_time": 0, "file_creation_time": 1732078157, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "92E45FH6K6HCJOD41QCQ", "orig_file_number": 26632, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-12:49:19.323111 140257189590592 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026633.sst) /dev/shm/ToplingTemp/Topling-183460-HvTGUz 2024/11/20-12:49:19.892750 140257189590592 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026633.sst): first pass time = 0.57's, 235.635'MB/sec 2024/11/20-12:49:20.461309 140257189590592 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026633.sst): old prealloc_size = 147639500, real_size = 40346992 2024/11/20-12:49:20.461418 140257189590592 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026633.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129435 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1016.96 avg-zval = 309.77 2024/11/20-12:49:20.461449 140257189590592 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026633.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-12:49:20.656432 140257189590592 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026633.sst): second pass time = 0.57's, 231.769'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.20's, 213.703'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2389.082'MB/sec (index lex order gen) rebuild zvType time = 0.14's, 0.236'MB/sec write SST data time = 0.06's, 723.491'MB/sec dict compress time = 140278.07's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.379'MB, throughput = 32416.220'MB/sec zip my value time = 0.57's, unzip length = 0.132'GB zip my value throughput = 231.769'MB/sec zip pipeline throughput = 240.904'MB/sec entries = 129435 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1016.96 avg-zval = 309.77 usrkeys = 129435 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1016.96 avg-zval = 309.77 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0983 value = 3.2829 dict = 1.00 all = 3.2191 } Zip/UnZip{ index = 0.1409 value = 0.3046 dict = 1.00 all = 0.3106 } ---------------------------- total value len = 5.528897 GB avg = 1.017 KB (by entry num) total key len = 0.108721 GB avg = 0.020 KB total ukey len = 0.065233 GB avg = 0.012 KB total ukey num = 0.005436046 Billion total entry num = 0.005436046 Billion write speed all = 0.388832964 MB/sec (with seq num) write speed all = 0.385833521 MB/sec (without seq num) 2024/11/20-12:49:20.709796 140257189590592 [compaction_job.cc:1948] [default] [JOB 5260] Generated table #26633: 129435 keys, 41694935 bytes, temperature: kWarm 2024/11/20-12:49:20.709851 140257189590592 EVENT_LOG_v1 {"time_micros": 1732078160709822, "cf_name": "default", "job": 5260, "event": "table_file_creation", "file_number": 26633, "file_size": 41694935, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 40095648, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588700, "raw_average_key_size": 20, "raw_value_size": 131630060, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129435, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732078159, "oldest_key_time": 0, "file_creation_time": 1732078159, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "92E45FH6K6HCJOD41QCQ", "orig_file_number": 26633, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-12:49:20.747066 140257189590592 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026634.sst) /dev/shm/ToplingTemp/Topling-183460-s38oiB 2024/11/20-12:49:21.457593 140257189590592 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026634.sst): first pass time = 0.71's, 188.909'MB/sec 2024/11/20-12:49:21.957373 140257189590592 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026634.sst): old prealloc_size = 147639500, real_size = 40354304 2024/11/20-12:49:21.957516 140257189590592 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026634.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129427 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1017.02 avg-zval = 309.85 2024/11/20-12:49:21.957607 140257189590592 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026634.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-12:49:22.155395 140257189590592 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026634.sst): second pass time = 0.50's, 263.791'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.20's, 211.038'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1892.234'MB/sec (index lex order gen) rebuild zvType time = 0.15's, 0.212'MB/sec write SST data time = 0.05's, 918.489'MB/sec dict compress time = 140278.07's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.379'MB, throughput = 25794.492'MB/sec zip my value time = 0.50's, unzip length = 0.132'GB zip my value throughput = 263.791'MB/sec zip pipeline throughput = 263.791'MB/sec entries = 129427 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1017.02 avg-zval = 309.85 usrkeys = 129427 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1018.75 avg-zval = 309.85 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 31979 bytes = 67968 } seq expand size = 223853 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0418 GB } UnZip/Zip{ index = 7.0979 value = 3.2823 dict = 1.00 all = 3.2117 } Zip/UnZip{ index = 0.1409 value = 0.3047 dict = 1.00 all = 0.3114 } ---------------------------- total value len = 5.660751 GB avg = 1.017 KB (by entry num) total key len = 0.111309 GB avg = 0.020 KB total ukey len = 0.066786 GB avg = 0.012 KB total ukey num = 0.005565473 Billion total entry num = 0.005565473 Billion write speed all = 0.398064430 MB/sec (with seq num) write speed all = 0.394993891 MB/sec (without seq num) 2024/11/20-12:49:22.204289 140257189590592 [compaction_job.cc:1948] [default] [JOB 5260] Generated table #26634: 129427 keys, 41790760 bytes, temperature: kWarm 2024/11/20-12:49:22.204336 140257189590592 EVENT_LOG_v1 {"time_micros": 1732078162204308, "cf_name": "default", "job": 5260, "event": "table_file_creation", "file_number": 26634, "file_size": 41790760, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 521435143, "table_properties": {"data_size": 40102960, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588540, "raw_average_key_size": 20, "raw_value_size": 131629633, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129427, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732078160, "oldest_key_time": 0, "file_creation_time": 1732078160, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "92E45FH6K6HCJOD41QCQ", "orig_file_number": 26634, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-12:49:22.239259 140257189590592 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026635.sst) /dev/shm/ToplingTemp/Topling-183460-DiaIuy 2024/11/20-12:49:22.302590 140257189590592 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026635.sst): first pass time = 0.06's, 809.877'MB/sec 2024/11/20-12:49:22.617540 140257189590592 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026635.sst): old prealloc_size = 147639500, real_size = 15506704 2024/11/20-12:49:22.617629 140257189590592 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026635.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 49439 prefix = 4 raw-key = 0.0004 GB zip-key = 0.0001 GB avg-key = 8.00 avg-zkey = 1.71 raw-val = 0.0503 GB zip-val = 0.0154 GB avg-val =1016.98 avg-zval = 311.69 2024/11/20-12:49:22.617659 140257189590592 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026635.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0001 GB, waited 0.000 sec, Key+Value = 0.051 GB 2024/11/20-12:49:22.680470 140257189590592 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00/026635.sst): second pass time = 0.31's, 159.957'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.06's, 254.339'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1252.263'MB/sec (index lex order gen) rebuild zvType time = 0.05's, 0.265'MB/sec write SST data time = 0.02's, 983.494'MB/sec dict compress time = 140278.07's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.506'MB, throughput = 15829.033'MB/sec zip my value time = 0.31's, unzip length = 0.050'GB zip my value throughput = 159.957'MB/sec zip pipeline throughput = 159.957'MB/sec entries = 49439 avg-key = 20.00 avg-zkey = 1.71 avg-val = 1016.98 avg-zval = 311.69 usrkeys = 49439 avg-key = 12.00 avg-zkey = 1.71 avg-val = 1016.98 avg-zval = 311.69 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0006 GB value = 0.0503 GB dict = 0.51 MB all = 0.0513 GB } __ZipSize{ index = 0.0001 GB value = 0.0154 GB dict = 0.51 MB all = 0.0160 GB } UnZip/Zip{ index = 7.0173 value = 3.2628 dict = 1.00 all = 3.2040 } Zip/UnZip{ index = 0.1425 value = 0.3065 dict = 1.00 all = 0.3121 } ---------------------------- total value len = 5.711029 GB avg = 1.017 KB (by entry num) total key len = 0.112298 GB avg = 0.020 KB total ukey len = 0.067379 GB avg = 0.012 KB total ukey num = 0.005614912 Billion total entry num = 0.005614912 Billion write speed all = 0.401585482 MB/sec (with seq num) write speed all = 0.398487779 MB/sec (without seq num) 2024/11/20-12:49:22.716442 140257189590592 [compaction_job.cc:1948] [default] [JOB 5260] Generated table #26635: 49439 keys, 16001181 bytes, temperature: kWarm 2024/11/20-12:49:22.716526 140257189590592 EVENT_LOG_v1 {"time_micros": 1732078162716484, "cf_name": "default", "job": 5260, "event": "table_file_creation", "file_number": 26635, "file_size": 16001181, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 15409600, "index_size": 84544, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 988780, "raw_average_key_size": 20, "raw_value_size": 50278458, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 49439, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732078162, "oldest_key_time": 0, "file_creation_time": 1732078162, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "92E45FH6K6HCJOD41QCQ", "orig_file_number": 26635, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-12:49:22.738024 140257189590592 [compaction_job.cc:703] job-05260: subcompact[0], size: 1.809539 G, files: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-05260/att-00 [026592,026593,026594,026595,026596,026597,026598,026599,026600,026601,026602,026603,026604,026605,026606,026607,026608,026609,026610,026611,026612,026613,026614,026615,026616,026617,026618,026619,026620,026621,026622,026623,026624,026625,026626,026627,026628,026629,026630,026631,026632,026633,026634,026635] 2024/11/20-12:49:23.123363 140257189590592 (Original Log Time 2024/11/20-12:48:17.839297) EVENT_LOG_v1 {"time_micros": 1732078097839267, "job": 5260, "event": "compaction_started", "compaction_reason": "FilesMarkedForCompaction", "files_L2": [26572], "files_L3": [26509, 26510, 26511, 26512, 26529, 26530, 26531, 26532, 26533, 26534, 26535, 26536, 26537, 26538, 26539, 26540, 26541, 26542, 26543, 26544, 26545, 26546, 26547, 26548, 26549, 26550, 26551, 26552, 26553, 26554, 26555, 26556, 26557, 26199, 26200, 26201, 26202, 26203, 26204, 26205, 26146, 26197, 26196, 26195, 26198, 26128, 26131, 26209, 26286, 26271, 26250, 26263, 26298, 26289, 26291, 26346], "score": 0.939556, "input_data_size": 1832722791, "oldest_snapshot_seqno": 527014068} 2024/11/20-12:49:23.123365 140257189590592 (Original Log Time 2024/11/20-12:49:23.121583) [compaction_job.cc:2022] [default] [JOB 5260] Compacted 1@2 + 56@3 files to L3 => 1809539079 bytes 2024/11/20-12:49:23.123366 140257189590592 (Original Log Time 2024/11/20-12:49:23.123287) [compaction_job.cc:1224] [default] compacted to: files[0 0 0 44 0 0 0] max score 0.07, MB/sec: 28.2 rd, 27.9 wr, level 3, files in(1, 56) out(44 +0 blob) MB in(31.3, 1716.5 +0.0 blob) out(1725.7 +0.0 blob), read-write-amplify(110.9) write-amplify(55.1) OK, records in: 5614963, records dropped: 51 output_compression: Snappy 2024/11/20-12:49:23.123369 140257189590592 (Original Log Time 2024/11/20-12:49:23.123341) EVENT_LOG_v1 {"time_micros": 1732078163123308, "cf": "default", "job": 5260, "event": "compaction_finished", "compaction_time_micros": 64898730, "compaction_time_cpu_micros": 16113726, "output_level": 3, "num_output_files": 44, "total_output_size": 1809539079, "num_input_records": 5614963, "num_output_records": 5614912, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "file_write_nanos": 1530909402, "file_range_sync_nanos": 0, "file_fsync_nanos": 41755, "file_prepare_write_nanos": 92277, "lsm_state": [0, 0, 0, 44, 0, 0, 0]} 2024/11/20-12:49:23.263389 140257189590592 DEBG dcompact_worker.cpp:240: HttpPost: 200 OK: url = http://nlb-7zny4kaa1poal01o64.cn-shenzhen.nlb.aliyuncs.com:8443, body = {"instanceId":"nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137","labourId":"","dbId":"d89b4006-2803-486e-b7a2-759bcf348921","dbStarts":1732076400,"starts":1732078097,"executesMs":65441,"compactionJobId":5260,"attempt":0,"compactionInputRawBytes":5822703335,"compactionInputZipBytes":1832722791,"compactionOutputRawBytes":0,"compactionOutputZipBytes":1809539079,"headers":{"Accept":"*/*","Connection":"close","Host":"aliyun-topling-saas.topling.cn:18443","RemoteIp":"120.24.192.169","X-Forwarded-For":"120.24.192.169","region":"cn-shenzhen","token":"e6474c481bd4415abc537135cc03626b","instance-token":"e6474c481bd4415abc537135cc03626b","provider":"aliyun","CloudMarketInstanceId":"si-59c0ae5c955845588903","MeteringAssit":"","Transfer-Encoding":"chunked","traceparent":"00-c53ed1775ce3f1c321d33bdc3e07488c-84a981ef10f45ed9-00"}}, response = 2024/11/20-12:49:23.263459 140257189590592 INFO dcompact_worker.cpp:1464: finish /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-20T12.20.00/.rocksdb/job-05260/att-00: olev 3, work 65.441 s, result 9.104 ms, install 1.800 ms, input{raw 5.423 GiB zip 1.707 GiB}