2024/11/23-16:57:59.059824 139957248734784 DEBG dcompact_worker.cpp:2214: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00: fork to child time = 0.008347 sec 2024/11/23-16:57:59.060645 139957248734784 DEBG dcompact_worker.cpp:1013: Beg SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00 2024/11/23-16:57:59.068211 139957248734784 DEBG dcompact_worker.cpp:1033: End SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00 2024/11/23-16:57:59.069115 139957248734784 TRAC dcompact_worker.cpp:1083: INFO_LOG_LEVEL: rpc = INFO_LEVEL, env_var = undefined 2024/11/23-16:57:59.069404 139957248734784 [WARN] [column_family.cc:386] multiple cf_paths/db_paths and level_compaction_dynamic_level_bytes can't be used together 2024/11/23-16:57:59.126346 139957248734784 [version_set.cc:6208] Recovering from manifest file: /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-31311/att-00/MANIFEST-206347 2024/11/23-16:57:59.178721 139957248734784 [version_set.cc:6251] Recovered from manifest file:/worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-31311/att-00/MANIFEST-206347 succeeded,manifest_file_number is 206347, next_file_number is 270922, last_sequence is 4128827963, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 270771 2024/11/23-16:57:59.178734 139957248734784 [version_set.cc:6266] Column family [default] (ID 0), log number is 0 2024/11/23-16:57:59.178886 139957248734784 [version_set.cc:5721] Creating manifest 270922 2024/11/23-16:57:59.222924 139957248734784 DEBG dcompact_worker.cpp:1218: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00: bottommost_level: fake = 1, rpc = 0 2024/11/23-16:57:59.248679 139957248734784 [compaction_job.cc:2437] [default] [JOB 31311] Compacting 1@2 + 22@3 files to L3, score 1.00, subcompactions 1 : 1 2024/11/23-16:57:59.248707 139957248734784 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 23420 Base level 2, inputs: [270905(31MB)], [270826(40MB) 270827(40MB) 270828(40MB) 270829(40MB) 270830(40MB) 270831(40MB) 270832(40MB) 270833(40MB) 270834(40MB) 270835(40MB) 270836(40MB) 270837(40MB) 270838(40MB) 270839(40MB) 270840(40MB) 270841(40MB) 270842(40MB) 270843(40MB) 270844(40MB) 270845(39MB) 270846(40MB) 270917(40MB)] 2024/11/23-16:57:59.259900 139957248734784 [top_zip_table.cc:59] core git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-16:57:59.259926 139957248734784 [top_zip_table.cc:60] fsa git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-16:57:59.259942 139957248734784 [top_zip_table.cc:61] zbs git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-16:57:59.259947 139957248734784 [top_zip_table.cc:62] topling-zip_table_reader: git_version_hash_info_is: commit a4a382006cb82713acf5b3425835f22711877681 Author: leipeng Date: 2024-04-11 19:44:14 +0800 fixed_len_hole_index.cc: Add env bool FixedLenHoleIndexUseAVX512 for ut & debug 1. FixedLenHoleIndexUseAVX512 is only in unit tests or debug 2. In release mode, use avx512 by compile options(-march=) g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/23-16:57:59.259958 139957248734784 [top_zip_table.cc:64] topling-rocks git_version_hash_info_is: commit feab587e468621ba0204d47b4ffacc52e7c4290d Author: leipeng Date: 2024-03-22 13:35:06 +0800 ToplingZipTableBuilder::Add: immediately return after error This function returns void, and caller does not check builder->status() after calling this function and graceful abandon. So immediately return after error, and return error status in Finish(). g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/23-16:57:59.923502 139957248734784 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270923.sst) /dev/shm/ToplingTemp/Topling-123765-HkjRzI 2024/11/23-16:58:00.157580 139957248734784 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270923.sst): first pass time = 0.23's, 573.493'MB/sec 2024/11/23-16:58:01.101169 139957248734784 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270923.sst): old prealloc_size = 147639500, real_size = 40615584 2024/11/23-16:58:01.101318 139957248734784 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270923.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129430 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.81 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1016.99 avg-zval = 311.75 2024/11/23-16:58:01.101531 139957248734784 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270923.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:58:01.279307 139957248734784 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270923.sst): second pass time = 0.94's, 139.639'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.18's, 238.299'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1819.856'MB/sec (index lex order gen) rebuild zvType time = 0.13's, 0.251'MB/sec write SST data time = 0.05's, 864.365'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 47478.775'MB/sec zip my value time = 0.94's, unzip length = 0.132'GB zip my value throughput = 139.639'MB/sec zip pipeline throughput = 139.639'MB/sec entries = 129430 avg-key = 20.00 avg-zkey = 1.81 avg-val = 1016.99 avg-zval = 311.75 usrkeys = 129430 avg-key = 12.00 avg-zkey = 1.81 avg-val = 1023.99 avg-zval = 311.75 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129430 bytes = 485376 } seq expand size = 906010 multi value expand size = 0 cnt WriteAppend = 11 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0424 GB } UnZip/Zip{ index = 6.6470 value = 3.2622 dict = 1.00 all = 3.1619 } Zip/UnZip{ index = 0.1504 value = 0.3065 dict = 1.00 all = 0.3163 } ---------------------------- total value len = 8.981155 GB avg = 0.171 KB (by entry num) total key len = 1.443410 GB avg = 0.028 KB total ukey len = 0.999431 GB avg = 0.015 KB total ukey num = 0.065679865 Billion total entry num = 0.052487594 Billion write speed all = 0.359851619 MB/sec (with seq num) write speed all = 0.345356821 MB/sec (without seq num) 2024/11/23-16:58:01.331157 139957248734784 [compaction_job.cc:1948] [default] [JOB 31311] Generated table #270923: 129430 keys, 42448264 bytes, temperature: kWarm 2024/11/23-16:58:01.331247 139957248734784 EVENT_LOG_v1 {"time_micros": 1732352281331194, "cf_name": "default", "job": 31311, "event": "table_file_creation", "file_number": 270923, "file_size": 42448264, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237877277, "largest_seqno": 4128740092, "table_properties": {"data_size": 40349392, "index_size": 233664, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588600, "raw_average_key_size": 20, "raw_value_size": 131629333, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129430, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732352279, "oldest_key_time": 0, "file_creation_time": 1732352279, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 270923, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:58:01.374526 139957248734784 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270924.sst) /dev/shm/ToplingTemp/Topling-123765-SNJotJ 2024/11/23-16:58:02.150603 139957248734784 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270924.sst): first pass time = 0.78's, 172.957'MB/sec 2024/11/23-16:58:03.573722 139957248734784 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270924.sst): old prealloc_size = 147639500, real_size = 40860752 2024/11/23-16:58:03.573854 139957248734784 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270924.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129433 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.74 raw-val = 0.1316 GB zip-val = 0.0406 GB avg-val =1016.97 avg-zval = 313.70 2024/11/23-16:58:03.574045 139957248734784 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270924.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:58:03.755675 139957248734784 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270924.sst): second pass time = 1.42's, 92.615'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.18's, 234.668'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2096.780'MB/sec (index lex order gen) rebuild zvType time = 0.13's, 0.245'MB/sec write SST data time = 0.05's, 853.562'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 37189.555'MB/sec zip my value time = 1.42's, unzip length = 0.132'GB zip my value throughput = 92.615'MB/sec zip pipeline throughput = 105.594'MB/sec entries = 129433 avg-key = 20.00 avg-zkey = 1.74 avg-val = 1016.97 avg-zval = 313.70 usrkeys = 129433 avg-key = 12.00 avg-zkey = 1.74 avg-val = 1023.97 avg-zval = 313.70 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129433 bytes = 485392 } seq expand size = 906031 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0406 GB dict = 1.38 MB all = 0.0427 GB } UnZip/Zip{ index = 6.8867 value = 3.2419 dict = 1.00 all = 3.1438 } Zip/UnZip{ index = 0.1452 value = 0.3085 dict = 1.00 all = 0.3181 } ---------------------------- total value len = 9.113690 GB avg = 0.173 KB (by entry num) total key len = 1.445998 GB avg = 0.027 KB total ukey len = 1.000984 GB avg = 0.015 KB total ukey num = 0.065809298 Billion total entry num = 0.052617027 Billion write speed all = 0.364484880 MB/sec (with seq num) write speed all = 0.349955580 MB/sec (without seq num) 2024/11/23-16:58:03.809056 139957248734784 [compaction_job.cc:1948] [default] [JOB 31311] Generated table #270924: 129433 keys, 42693392 bytes, temperature: kWarm 2024/11/23-16:58:03.809116 139957248734784 EVENT_LOG_v1 {"time_micros": 1732352283809083, "cf_name": "default", "job": 31311, "event": "table_file_creation", "file_number": 270924, "file_size": 42693392, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237868195, "largest_seqno": 4128739147, "table_properties": {"data_size": 40602688, "index_size": 225536, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588660, "raw_average_key_size": 20, "raw_value_size": 131629142, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129433, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732352281, "oldest_key_time": 0, "file_creation_time": 1732352281, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 270924, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:58:03.848319 139957248734784 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270925.sst) /dev/shm/ToplingTemp/Topling-123765-OBubRK 2024/11/23-16:58:04.602889 139957248734784 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270925.sst): first pass time = 0.75's, 177.883'MB/sec 2024/11/23-16:58:05.494080 139957248734784 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270925.sst): old prealloc_size = 147639500, real_size = 40583952 2024/11/23-16:58:05.494209 139957248734784 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270925.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129433 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.81 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1016.97 avg-zval = 311.49 2024/11/23-16:58:05.494369 139957248734784 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270925.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:58:05.658026 139957248734784 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270925.sst): second pass time = 0.89's, 147.809'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 258.777'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2190.948'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.275'MB/sec write SST data time = 0.05's, 917.598'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 48247.515'MB/sec zip my value time = 0.89's, unzip length = 0.132'GB zip my value throughput = 147.809'MB/sec zip pipeline throughput = 147.809'MB/sec entries = 129433 avg-key = 20.00 avg-zkey = 1.81 avg-val = 1016.97 avg-zval = 311.49 usrkeys = 129433 avg-key = 12.00 avg-zkey = 1.81 avg-val = 1023.97 avg-zval = 311.49 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129433 bytes = 485392 } seq expand size = 906031 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0424 GB } UnZip/Zip{ index = 6.6362 value = 3.2648 dict = 1.00 all = 3.1643 } Zip/UnZip{ index = 0.1507 value = 0.3063 dict = 1.00 all = 0.3160 } ---------------------------- total value len = 9.246226 GB avg = 0.175 KB (by entry num) total key len = 1.448587 GB avg = 0.027 KB total ukey len = 1.002538 GB avg = 0.015 KB total ukey num = 0.065938731 Billion total entry num = 0.052746460 Billion write speed all = 0.369124685 MB/sec (with seq num) write speed all = 0.354560600 MB/sec (without seq num) 2024/11/23-16:58:05.709771 139957248734784 [compaction_job.cc:1948] [default] [JOB 31311] Generated table #270925: 129433 keys, 42417054 bytes, temperature: kWarm 2024/11/23-16:58:05.709838 139957248734784 EVENT_LOG_v1 {"time_micros": 1732352285709803, "cf_name": "default", "job": 31311, "event": "table_file_creation", "file_number": 270925, "file_size": 42417054, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237873554, "largest_seqno": 4128747187, "table_properties": {"data_size": 40317376, "index_size": 234048, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588660, "raw_average_key_size": 20, "raw_value_size": 131629815, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129433, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732352283, "oldest_key_time": 0, "file_creation_time": 1732352283, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 270925, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:58:05.794161 139957248734784 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270926.sst) /dev/shm/ToplingTemp/Topling-123765-doA7iI 2024/11/23-16:58:06.761739 139957248734784 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270926.sst): first pass time = 0.97's, 138.722'MB/sec 2024/11/23-16:58:08.411469 139957248734784 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270926.sst): old prealloc_size = 147639500, real_size = 40867632 2024/11/23-16:58:08.411586 139957248734784 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270926.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129433 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.74 raw-val = 0.1316 GB zip-val = 0.0406 GB avg-val =1016.97 avg-zval = 313.75 2024/11/23-16:58:08.411738 139957248734784 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270926.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:58:08.577825 139957248734784 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270926.sst): second pass time = 1.65's, 79.834'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.17's, 256.702'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2297.754'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.272'MB/sec write SST data time = 0.05's, 903.200'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 45716.172'MB/sec zip my value time = 1.65's, unzip length = 0.132'GB zip my value throughput = 79.834'MB/sec zip pipeline throughput = 126.494'MB/sec entries = 129433 avg-key = 20.00 avg-zkey = 1.74 avg-val = 1016.97 avg-zval = 313.75 usrkeys = 129433 avg-key = 12.00 avg-zkey = 1.74 avg-val = 1023.97 avg-zval = 313.75 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129433 bytes = 485392 } seq expand size = 906031 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0406 GB dict = 1.38 MB all = 0.0427 GB } UnZip/Zip{ index = 6.9004 value = 3.2413 dict = 1.00 all = 3.1432 } Zip/UnZip{ index = 0.1449 value = 0.3085 dict = 1.00 all = 0.3181 } ---------------------------- total value len = 9.378762 GB avg = 0.177 KB (by entry num) total key len = 1.451176 GB avg = 0.027 KB total ukey len = 1.004091 GB avg = 0.015 KB total ukey num = 0.066068164 Billion total entry num = 0.052875893 Billion write speed all = 0.373750749 MB/sec (with seq num) write speed all = 0.359152398 MB/sec (without seq num) 2024/11/23-16:58:08.636086 139957248734784 [compaction_job.cc:1948] [default] [JOB 31311] Generated table #270926: 129433 keys, 42700545 bytes, temperature: kWarm 2024/11/23-16:58:08.636148 139957248734784 EVENT_LOG_v1 {"time_micros": 1732352288636113, "cf_name": "default", "job": 31311, "event": "table_file_creation", "file_number": 270926, "file_size": 42700545, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237868596, "largest_seqno": 4128742839, "table_properties": {"data_size": 40610016, "index_size": 225088, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588660, "raw_average_key_size": 20, "raw_value_size": 131629608, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129433, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732352285, "oldest_key_time": 0, "file_creation_time": 1732352285, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 270926, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:58:08.675901 139957248734784 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270927.sst) /dev/shm/ToplingTemp/Topling-123765-jEv2CH 2024/11/23-16:58:09.316811 139957248734784 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270927.sst): first pass time = 0.64's, 209.432'MB/sec 2024/11/23-16:58:10.339341 139957248734784 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270927.sst): old prealloc_size = 147639500, real_size = 40591936 2024/11/23-16:58:10.339482 139957248734784 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270927.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129431 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.81 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1016.99 avg-zval = 311.56 2024/11/23-16:58:10.339645 139957248734784 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270927.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:58:10.503405 139957248734784 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270927.sst): second pass time = 1.02's, 128.814'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 258.609'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1970.731'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.274'MB/sec write SST data time = 0.05's, 924.279'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 38442.129'MB/sec zip my value time = 1.02's, unzip length = 0.132'GB zip my value throughput = 128.814'MB/sec zip pipeline throughput = 145.840'MB/sec entries = 129431 avg-key = 20.00 avg-zkey = 1.81 avg-val = 1016.99 avg-zval = 311.56 usrkeys = 129431 avg-key = 12.00 avg-zkey = 1.81 avg-val = 1023.99 avg-zval = 311.56 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129431 bytes = 485376 } seq expand size = 906017 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0424 GB } UnZip/Zip{ index = 6.6361 value = 3.2642 dict = 1.00 all = 3.1637 } Zip/UnZip{ index = 0.1507 value = 0.3064 dict = 1.00 all = 0.3161 } ---------------------------- total value len = 9.511298 GB avg = 0.179 KB (by entry num) total key len = 1.453764 GB avg = 0.027 KB total ukey len = 1.005644 GB avg = 0.015 KB total ukey num = 0.066197595 Billion total entry num = 0.053005324 Billion write speed all = 0.378388867 MB/sec (with seq num) write speed all = 0.363755753 MB/sec (without seq num) 2024/11/23-16:58:10.559391 139957248734784 [compaction_job.cc:1948] [default] [JOB 31311] Generated table #270927: 129431 keys, 42424754 bytes, temperature: kWarm 2024/11/23-16:58:10.559470 139957248734784 EVENT_LOG_v1 {"time_micros": 1732352290559425, "cf_name": "default", "job": 31311, "event": "table_file_creation", "file_number": 270927, "file_size": 42424754, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237869923, "largest_seqno": 4128741354, "table_properties": {"data_size": 40325360, "index_size": 234048, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588620, "raw_average_key_size": 20, "raw_value_size": 131629757, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129431, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732352288, "oldest_key_time": 0, "file_creation_time": 1732352288, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 270927, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:58:10.596822 139957248734784 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270928.sst) /dev/shm/ToplingTemp/Topling-123765-wbDEZG 2024/11/23-16:58:11.249484 139957248734784 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270928.sst): first pass time = 0.65's, 205.660'MB/sec 2024/11/23-16:58:12.040157 139957248734784 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270928.sst): old prealloc_size = 147639500, real_size = 40584896 2024/11/23-16:58:12.040313 139957248734784 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270928.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129431 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.81 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1016.99 avg-zval = 311.50 2024/11/23-16:58:12.040488 139957248734784 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270928.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:58:12.203778 139957248734784 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270928.sst): second pass time = 0.79's, 166.846'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 259.277'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1754.588'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.276'MB/sec write SST data time = 0.05's, 920.468'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 47481.707'MB/sec zip my value time = 0.79's, unzip length = 0.132'GB zip my value throughput = 166.846'MB/sec zip pipeline throughput = 166.846'MB/sec entries = 129431 avg-key = 20.00 avg-zkey = 1.81 avg-val = 1016.99 avg-zval = 311.50 usrkeys = 129431 avg-key = 12.00 avg-zkey = 1.81 avg-val = 1023.99 avg-zval = 311.50 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129431 bytes = 485376 } seq expand size = 906017 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0424 GB } UnZip/Zip{ index = 6.6361 value = 3.2648 dict = 1.00 all = 3.1642 } Zip/UnZip{ index = 0.1507 value = 0.3063 dict = 1.00 all = 0.3160 } ---------------------------- total value len = 9.643834 GB avg = 0.181 KB (by entry num) total key len = 1.456353 GB avg = 0.027 KB total ukey len = 1.007197 GB avg = 0.015 KB total ukey num = 0.066327026 Billion total entry num = 0.053134755 Billion write speed all = 0.383029354 MB/sec (with seq num) write speed all = 0.368361369 MB/sec (without seq num) 2024/11/23-16:58:12.255253 139957248734784 [compaction_job.cc:1948] [default] [JOB 31311] Generated table #270928: 129431 keys, 42417978 bytes, temperature: kWarm 2024/11/23-16:58:12.255328 139957248734784 EVENT_LOG_v1 {"time_micros": 1732352292255286, "cf_name": "default", "job": 31311, "event": "table_file_creation", "file_number": 270928, "file_size": 42417978, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237881756, "largest_seqno": 4128744548, "table_properties": {"data_size": 40318320, "index_size": 234048, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588620, "raw_average_key_size": 20, "raw_value_size": 131630035, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129431, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732352290, "oldest_key_time": 0, "file_creation_time": 1732352290, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 270928, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:58:12.293807 139957248734784 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270929.sst) /dev/shm/ToplingTemp/Topling-123765-2BL6zI 2024/11/23-16:58:12.913798 139957248734784 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270929.sst): first pass time = 0.62's, 216.497'MB/sec 2024/11/23-16:58:13.915433 139957248734784 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270929.sst): old prealloc_size = 147639500, real_size = 41076912 2024/11/23-16:58:13.915562 139957248734784 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270929.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129428 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.72 raw-val = 0.1316 GB zip-val = 0.0408 GB avg-val =1017.01 avg-zval = 315.40 2024/11/23-16:58:13.915721 139957248734784 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270929.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:58:14.078781 139957248734784 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270929.sst): second pass time = 1.00's, 131.629'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 262.728'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2262.038'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.272'MB/sec write SST data time = 0.04's, 969.581'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 47900.233'MB/sec zip my value time = 1.00's, unzip length = 0.132'GB zip my value throughput = 131.629'MB/sec zip pipeline throughput = 161.987'MB/sec entries = 129428 avg-key = 20.00 avg-zkey = 1.72 avg-val = 1017.01 avg-zval = 315.40 usrkeys = 129428 avg-key = 12.00 avg-zkey = 1.72 avg-val = 1024.01 avg-zval = 315.40 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129428 bytes = 485376 } seq expand size = 905996 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0408 GB dict = 1.38 MB all = 0.0429 GB } UnZip/Zip{ index = 6.9795 value = 3.2245 dict = 1.00 all = 3.1279 } Zip/UnZip{ index = 0.1433 value = 0.3101 dict = 1.00 all = 0.3197 } ---------------------------- total value len = 9.776369 GB avg = 0.184 KB (by entry num) total key len = 1.458941 GB avg = 0.027 KB total ukey len = 1.008750 GB avg = 0.015 KB total ukey num = 0.066456454 Billion total entry num = 0.053264183 Billion write speed all = 0.387666937 MB/sec (with seq num) write speed all = 0.372964175 MB/sec (without seq num) 2024/11/23-16:58:14.132631 139957248734784 [compaction_job.cc:1948] [default] [JOB 31311] Generated table #270929: 129428 keys, 42910136 bytes, temperature: kWarm 2024/11/23-16:58:14.132695 139957248734784 EVENT_LOG_v1 {"time_micros": 1732352294132659, "cf_name": "default", "job": 31311, "event": "table_file_creation", "file_number": 270929, "file_size": 42910136, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237882779, "largest_seqno": 4128739330, "table_properties": {"data_size": 40821856, "index_size": 222528, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588560, "raw_average_key_size": 20, "raw_value_size": 131629421, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129428, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732352292, "oldest_key_time": 0, "file_creation_time": 1732352292, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 270929, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:58:14.169999 139957248734784 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270930.sst) /dev/shm/ToplingTemp/Topling-123765-j7yVgJ 2024/11/23-16:58:14.903676 139957248734784 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270930.sst): first pass time = 0.73's, 182.948'MB/sec 2024/11/23-16:58:15.739719 139957248734784 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270930.sst): old prealloc_size = 147639500, real_size = 40919408 2024/11/23-16:58:15.739833 139957248734784 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270930.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129430 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.73 raw-val = 0.1316 GB zip-val = 0.0407 GB avg-val =1016.99 avg-zval = 314.17 2024/11/23-16:58:15.740012 139957248734784 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270930.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:58:15.914508 139957248734784 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270930.sst): second pass time = 0.84's, 157.591'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.17's, 244.631'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2358.402'MB/sec (index lex order gen) rebuild zvType time = 0.13's, 0.256'MB/sec write SST data time = 0.05's, 886.213'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 44903.213'MB/sec zip my value time = 0.84's, unzip length = 0.132'GB zip my value throughput = 157.591'MB/sec zip pipeline throughput = 157.591'MB/sec entries = 129430 avg-key = 20.00 avg-zkey = 1.73 avg-val = 1016.99 avg-zval = 314.17 usrkeys = 129430 avg-key = 12.00 avg-zkey = 1.73 avg-val = 1023.99 avg-zval = 314.17 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129430 bytes = 485376 } seq expand size = 906010 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0407 GB dict = 1.38 MB all = 0.0428 GB } UnZip/Zip{ index = 6.9417 value = 3.2371 dict = 1.00 all = 3.1394 } Zip/UnZip{ index = 0.1441 value = 0.3089 dict = 1.00 all = 0.3185 } ---------------------------- total value len = 9.908904 GB avg = 0.186 KB (by entry num) total key len = 1.461530 GB avg = 0.027 KB total ukey len = 1.010303 GB avg = 0.015 KB total ukey num = 0.066585884 Billion total entry num = 0.053393613 Billion write speed all = 0.392304444 MB/sec (with seq num) write speed all = 0.377566888 MB/sec (without seq num) 2024/11/23-16:58:15.969073 139957248734784 [compaction_job.cc:1948] [default] [JOB 31311] Generated table #270930: 129430 keys, 42752107 bytes, temperature: kWarm 2024/11/23-16:58:15.969147 139957248734784 EVENT_LOG_v1 {"time_micros": 1732352295969112, "cf_name": "default", "job": 31311, "event": "table_file_creation", "file_number": 270930, "file_size": 42752107, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237868290, "largest_seqno": 4128748937, "table_properties": {"data_size": 40663136, "index_size": 223744, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588600, "raw_average_key_size": 20, "raw_value_size": 131629143, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129430, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732352294, "oldest_key_time": 0, "file_creation_time": 1732352294, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 270930, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:58:16.014600 139957248734784 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270931.sst) /dev/shm/ToplingTemp/Topling-123765-M43PqL 2024/11/23-16:58:16.607188 139957248734784 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270931.sst): first pass time = 0.59's, 226.510'MB/sec 2024/11/23-16:58:17.544953 139957248734784 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270931.sst): old prealloc_size = 147639500, real_size = 40927712 2024/11/23-16:58:17.545110 139957248734784 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270931.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129432 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.74 raw-val = 0.1316 GB zip-val = 0.0407 GB avg-val =1016.98 avg-zval = 314.22 2024/11/23-16:58:17.545294 139957248734784 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270931.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:58:17.757213 139957248734784 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270931.sst): second pass time = 0.94's, 140.500'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.21's, 201.466'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1801.466'MB/sec (index lex order gen) rebuild zvType time = 0.17's, 0.194'MB/sec write SST data time = 0.04's, 951.966'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 44645.957'MB/sec zip my value time = 0.94's, unzip length = 0.132'GB zip my value throughput = 140.500'MB/sec zip pipeline throughput = 156.056'MB/sec entries = 129432 avg-key = 20.00 avg-zkey = 1.74 avg-val = 1016.98 avg-zval = 314.22 usrkeys = 129432 avg-key = 12.00 avg-zkey = 1.74 avg-val = 1023.98 avg-zval = 314.22 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129432 bytes = 485392 } seq expand size = 906024 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0407 GB dict = 1.38 MB all = 0.0428 GB } UnZip/Zip{ index = 6.9082 value = 3.2365 dict = 1.00 all = 3.1389 } Zip/UnZip{ index = 0.1448 value = 0.3090 dict = 1.00 all = 0.3186 } ---------------------------- total value len = 10.041440 GB avg = 0.188 KB (by entry num) total key len = 1.464119 GB avg = 0.027 KB total ukey len = 1.011857 GB avg = 0.015 KB total ukey num = 0.066715316 Billion total entry num = 0.053523045 Billion write speed all = 0.396941291 MB/sec (with seq num) write speed all = 0.382168948 MB/sec (without seq num) 2024/11/23-16:58:17.808323 139957248734784 [compaction_job.cc:1948] [default] [JOB 31311] Generated table #270931: 129432 keys, 42760014 bytes, temperature: kWarm 2024/11/23-16:58:17.808395 139957248734784 EVENT_LOG_v1 {"time_micros": 1732352297808359, "cf_name": "default", "job": 31311, "event": "table_file_creation", "file_number": 270931, "file_size": 42760014, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237911757, "largest_seqno": 4128749151, "table_properties": {"data_size": 40670352, "index_size": 224832, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588640, "raw_average_key_size": 20, "raw_value_size": 131629764, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129432, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732352295, "oldest_key_time": 0, "file_creation_time": 1732352295, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 270931, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:58:17.845711 139957248734784 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270932.sst) /dev/shm/ToplingTemp/Topling-123765-8oOY3J 2024/11/23-16:58:18.482938 139957248734784 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270932.sst): first pass time = 0.64's, 210.641'MB/sec 2024/11/23-16:58:19.261471 139957248734784 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270932.sst): old prealloc_size = 147639500, real_size = 40584768 2024/11/23-16:58:19.261587 139957248734784 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270932.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129430 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.81 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1016.99 avg-zval = 311.51 2024/11/23-16:58:19.261743 139957248734784 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270932.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:58:19.426262 139957248734784 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270932.sst): second pass time = 0.78's, 169.427'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 257.420'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2363.524'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.266'MB/sec write SST data time = 0.04's, 985.981'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 44421.148'MB/sec zip my value time = 0.78's, unzip length = 0.132'GB zip my value throughput = 169.427'MB/sec zip pipeline throughput = 169.427'MB/sec entries = 129430 avg-key = 20.00 avg-zkey = 1.81 avg-val = 1016.99 avg-zval = 311.51 usrkeys = 129430 avg-key = 12.00 avg-zkey = 1.81 avg-val = 1023.99 avg-zval = 311.51 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129430 bytes = 485376 } seq expand size = 906010 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0424 GB } UnZip/Zip{ index = 6.6361 value = 3.2648 dict = 1.00 all = 3.1642 } Zip/UnZip{ index = 0.1507 value = 0.3063 dict = 1.00 all = 0.3160 } ---------------------------- total value len = 10.173975 GB avg = 0.190 KB (by entry num) total key len = 1.466707 GB avg = 0.027 KB total ukey len = 1.013410 GB avg = 0.015 KB total ukey num = 0.066844746 Billion total entry num = 0.053652475 Billion write speed all = 0.401579937 MB/sec (with seq num) write speed all = 0.386772724 MB/sec (without seq num) 2024/11/23-16:58:19.477108 139957248734784 [compaction_job.cc:1948] [default] [JOB 31311] Generated table #270932: 129430 keys, 42417495 bytes, temperature: kWarm 2024/11/23-16:58:19.477174 139957248734784 EVENT_LOG_v1 {"time_micros": 1732352299477139, "cf_name": "default", "job": 31311, "event": "table_file_creation", "file_number": 270932, "file_size": 42417495, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237873877, "largest_seqno": 4128731511, "table_properties": {"data_size": 40318192, "index_size": 234048, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588600, "raw_average_key_size": 20, "raw_value_size": 131629314, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129430, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732352297, "oldest_key_time": 0, "file_creation_time": 1732352297, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 270932, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:58:19.518579 139957248734784 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270933.sst) /dev/shm/ToplingTemp/Topling-123765-DBd9XK 2024/11/23-16:58:20.086265 139957248734784 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270933.sst): first pass time = 0.57's, 236.446'MB/sec 2024/11/23-16:58:20.884879 139957248734784 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270933.sst): old prealloc_size = 147639500, real_size = 40587760 2024/11/23-16:58:20.885019 139957248734784 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270933.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129430 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.81 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1016.99 avg-zval = 311.53 2024/11/23-16:58:20.885182 139957248734784 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270933.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:58:21.047799 139957248734784 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270933.sst): second pass time = 0.80's, 164.966'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 260.395'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1894.800'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.270'MB/sec write SST data time = 0.04's, 987.851'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.377'MB, throughput = 46571.834'MB/sec zip my value time = 0.80's, unzip length = 0.132'GB zip my value throughput = 164.966'MB/sec zip pipeline throughput = 164.966'MB/sec entries = 129430 avg-key = 20.00 avg-zkey = 1.81 avg-val = 1016.99 avg-zval = 311.53 usrkeys = 129430 avg-key = 12.00 avg-zkey = 1.81 avg-val = 1023.99 avg-zval = 311.53 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129430 bytes = 485376 } seq expand size = 906010 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0424 GB } UnZip/Zip{ index = 6.6343 value = 3.2645 dict = 1.00 all = 3.1640 } Zip/UnZip{ index = 0.1507 value = 0.3063 dict = 1.00 all = 0.3161 } ---------------------------- total value len = 10.306511 GB avg = 0.192 KB (by entry num) total key len = 1.469296 GB avg = 0.027 KB total ukey len = 1.014963 GB avg = 0.015 KB total ukey num = 0.066974176 Billion total entry num = 0.053781905 Billion write speed all = 0.406218712 MB/sec (with seq num) write speed all = 0.391376609 MB/sec (without seq num) 2024/11/23-16:58:21.101028 139957248734784 [compaction_job.cc:1948] [default] [JOB 31311] Generated table #270933: 129430 keys, 42419921 bytes, temperature: kWarm 2024/11/23-16:58:21.101094 139957248734784 EVENT_LOG_v1 {"time_micros": 1732352301101055, "cf_name": "default", "job": 31311, "event": "table_file_creation", "file_number": 270933, "file_size": 42419921, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237872082, "largest_seqno": 4128739870, "table_properties": {"data_size": 40321120, "index_size": 234112, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588600, "raw_average_key_size": 20, "raw_value_size": 131629251, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129430, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732352299, "oldest_key_time": 0, "file_creation_time": 1732352299, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 270933, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:58:21.138591 139957248734784 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270934.sst) /dev/shm/ToplingTemp/Topling-123765-zx23nH 2024/11/23-16:58:21.873434 139957248734784 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270934.sst): first pass time = 0.73's, 182.657'MB/sec 2024/11/23-16:58:22.690563 139957248734784 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270934.sst): old prealloc_size = 147639500, real_size = 41044976 2024/11/23-16:58:22.690680 139957248734784 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270934.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129431 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.73 raw-val = 0.1316 GB zip-val = 0.0408 GB avg-val =1016.99 avg-zval = 315.14 2024/11/23-16:58:22.690857 139957248734784 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270934.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:58:22.854384 139957248734784 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270934.sst): second pass time = 0.82's, 161.254'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 261.778'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2321.636'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.272'MB/sec write SST data time = 0.04's, 954.912'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 37489.403'MB/sec zip my value time = 0.82's, unzip length = 0.132'GB zip my value throughput = 161.254'MB/sec zip pipeline throughput = 161.254'MB/sec entries = 129431 avg-key = 20.00 avg-zkey = 1.73 avg-val = 1016.99 avg-zval = 315.14 usrkeys = 129431 avg-key = 12.00 avg-zkey = 1.73 avg-val = 1023.99 avg-zval = 315.14 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129431 bytes = 485376 } seq expand size = 906017 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0408 GB dict = 1.38 MB all = 0.0429 GB } UnZip/Zip{ index = 6.9398 value = 3.2271 dict = 1.00 all = 3.1303 } Zip/UnZip{ index = 0.1441 value = 0.3099 dict = 1.00 all = 0.3195 } ---------------------------- total value len = 10.439046 GB avg = 0.194 KB (by entry num) total key len = 1.471885 GB avg = 0.027 KB total ukey len = 1.016516 GB avg = 0.015 KB total ukey num = 0.067103607 Billion total entry num = 0.053911336 Billion write speed all = 0.410854363 MB/sec (with seq num) write speed all = 0.395977468 MB/sec (without seq num) 2024/11/23-16:58:22.905432 139957248734784 [compaction_job.cc:1948] [default] [JOB 31311] Generated table #270934: 129431 keys, 42877773 bytes, temperature: kWarm 2024/11/23-16:58:22.905511 139957248734784 EVENT_LOG_v1 {"time_micros": 1732352302905475, "cf_name": "default", "job": 31311, "event": "table_file_creation", "file_number": 270934, "file_size": 42877773, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237888398, "largest_seqno": 4128747998, "table_properties": {"data_size": 40788640, "index_size": 223808, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588620, "raw_average_key_size": 20, "raw_value_size": 131629719, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129431, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732352301, "oldest_key_time": 0, "file_creation_time": 1732352301, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 270934, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:58:22.943590 139957248734784 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270935.sst) /dev/shm/ToplingTemp/Topling-123765-pb4l1J 2024/11/23-16:58:23.670462 139957248734784 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270935.sst): first pass time = 0.73's, 184.662'MB/sec 2024/11/23-16:58:24.430499 139957248734784 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270935.sst): old prealloc_size = 147639500, real_size = 40666480 2024/11/23-16:58:24.430620 139957248734784 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270935.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129424 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.80 raw-val = 0.1316 GB zip-val = 0.0404 GB avg-val =1017.04 avg-zval = 312.16 2024/11/23-16:58:24.430794 139957248734784 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270935.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:58:24.591866 139957248734784 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270935.sst): second pass time = 0.76's, 173.367'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 263.399'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2359.127'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.274'MB/sec write SST data time = 0.04's, 982.613'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 43493.215'MB/sec zip my value time = 0.76's, unzip length = 0.132'GB zip my value throughput = 173.367'MB/sec zip pipeline throughput = 173.367'MB/sec entries = 129424 avg-key = 20.00 avg-zkey = 1.80 avg-val = 1017.04 avg-zval = 312.16 usrkeys = 129424 avg-key = 12.00 avg-zkey = 1.80 avg-val = 1024.04 avg-zval = 312.16 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129424 bytes = 485360 } seq expand size = 905968 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0404 GB dict = 1.38 MB all = 0.0425 GB } UnZip/Zip{ index = 6.6723 value = 3.2581 dict = 1.00 all = 3.1581 } Zip/UnZip{ index = 0.1499 value = 0.3069 dict = 1.00 all = 0.3166 } ---------------------------- total value len = 10.571582 GB avg = 0.196 KB (by entry num) total key len = 1.474473 GB avg = 0.027 KB total ukey len = 1.018069 GB avg = 0.015 KB total ukey num = 0.067233031 Billion total entry num = 0.054040760 Billion write speed all = 0.415490418 MB/sec (with seq num) write speed all = 0.400578702 MB/sec (without seq num) 2024/11/23-16:58:24.642625 139957248734784 [compaction_job.cc:1948] [default] [JOB 31311] Generated table #270935: 129424 keys, 42499428 bytes, temperature: kWarm 2024/11/23-16:58:24.642697 139957248734784 EVENT_LOG_v1 {"time_micros": 1732352304642660, "cf_name": "default", "job": 31311, "event": "table_file_creation", "file_number": 270935, "file_size": 42499428, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237871365, "largest_seqno": 4128745928, "table_properties": {"data_size": 40401184, "index_size": 232768, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588480, "raw_average_key_size": 20, "raw_value_size": 131629656, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129424, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732352302, "oldest_key_time": 0, "file_creation_time": 1732352302, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 270935, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:58:24.680020 139957248734784 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270936.sst) /dev/shm/ToplingTemp/Topling-123765-BaThDH 2024/11/23-16:58:25.399103 139957248734784 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270936.sst): first pass time = 0.72's, 186.660'MB/sec 2024/11/23-16:58:26.171588 139957248734784 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270936.sst): old prealloc_size = 147639500, real_size = 40499344 2024/11/23-16:58:26.171717 139957248734784 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270936.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129429 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.73 raw-val = 0.1316 GB zip-val = 0.0402 GB avg-val =1017.00 avg-zval = 310.93 2024/11/23-16:58:26.171824 139957248734784 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270936.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:58:26.332564 139957248734784 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270936.sst): second pass time = 0.77's, 170.723'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 261.187'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2158.484'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.276'MB/sec write SST data time = 0.04's, 964.851'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 46480.623'MB/sec zip my value time = 0.77's, unzip length = 0.132'GB zip my value throughput = 170.723'MB/sec zip pipeline throughput = 170.723'MB/sec entries = 129429 avg-key = 20.00 avg-zkey = 1.73 avg-val = 1017.00 avg-zval = 310.93 usrkeys = 129429 avg-key = 12.00 avg-zkey = 1.73 avg-val = 1019.47 avg-zval = 310.93 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 45694 bytes = 171360 } seq expand size = 319858 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0402 GB dict = 1.38 MB all = 0.0420 GB } UnZip/Zip{ index = 6.9476 value = 3.2708 dict = 1.00 all = 3.1927 } Zip/UnZip{ index = 0.1439 value = 0.3057 dict = 1.00 all = 0.3132 } ---------------------------- total value len = 10.703531 GB avg = 0.198 KB (by entry num) total key len = 1.477062 GB avg = 0.027 KB total ukey len = 1.019622 GB avg = 0.015 KB total ukey num = 0.067362460 Billion total entry num = 0.054170189 Billion write speed all = 0.420105656 MB/sec (with seq num) write speed all = 0.405159124 MB/sec (without seq num) 2024/11/23-16:58:26.385765 139957248734784 [compaction_job.cc:1948] [default] [JOB 31311] Generated table #270936: 129429 keys, 42038519 bytes, temperature: kWarm 2024/11/23-16:58:26.385838 139957248734784 EVENT_LOG_v1 {"time_micros": 1732352306385801, "cf_name": "default", "job": 31311, "event": "table_file_creation", "file_number": 270936, "file_size": 42038519, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4128707115, "table_properties": {"data_size": 40243264, "index_size": 223552, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588580, "raw_average_key_size": 20, "raw_value_size": 131629561, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129429, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732352304, "oldest_key_time": 0, "file_creation_time": 1732352304, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 270936, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:58:26.433280 139957248734784 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270937.sst) /dev/shm/ToplingTemp/Topling-123765-6M0wYK 2024/11/23-16:58:27.076815 139957248734784 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270937.sst): first pass time = 0.64's, 208.578'MB/sec 2024/11/23-16:58:27.868473 139957248734784 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270937.sst): old prealloc_size = 147639500, real_size = 41037008 2024/11/23-16:58:27.868592 139957248734784 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270937.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129433 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.70 raw-val = 0.1316 GB zip-val = 0.0408 GB avg-val =1016.97 avg-zval = 315.10 2024/11/23-16:58:27.868741 139957248734784 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270937.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:58:28.030493 139957248734784 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270937.sst): second pass time = 0.79's, 166.428'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 264.315'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2349.550'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.274'MB/sec write SST data time = 0.04's, 980.732'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 43178.155'MB/sec zip my value time = 0.79's, unzip length = 0.132'GB zip my value throughput = 166.428'MB/sec zip pipeline throughput = 166.428'MB/sec entries = 129433 avg-key = 20.00 avg-zkey = 1.70 avg-val = 1016.97 avg-zval = 315.10 usrkeys = 129433 avg-key = 12.00 avg-zkey = 1.70 avg-val = 1022.96 avg-zval = 315.10 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 110631 bytes = 414880 } seq expand size = 774417 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0408 GB dict = 1.38 MB all = 0.0428 GB } UnZip/Zip{ index = 7.0467 value = 3.2275 dict = 1.00 all = 3.1345 } Zip/UnZip{ index = 0.1419 value = 0.3098 dict = 1.00 all = 0.3190 } ---------------------------- total value len = 10.835936 GB avg = 0.200 KB (by entry num) total key len = 1.479650 GB avg = 0.027 KB total ukey len = 1.021176 GB avg = 0.015 KB total ukey num = 0.067491893 Billion total entry num = 0.054299622 Billion write speed all = 0.424736663 MB/sec (with seq num) write speed all = 0.409755295 MB/sec (without seq num) 2024/11/23-16:58:28.082077 139957248734784 [compaction_job.cc:1948] [default] [JOB 31311] Generated table #270937: 129433 keys, 42819673 bytes, temperature: kWarm 2024/11/23-16:58:28.082149 139957248734784 EVENT_LOG_v1 {"time_micros": 1732352308082113, "cf_name": "default", "job": 31311, "event": "table_file_creation", "file_number": 270937, "file_size": 42819673, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4128666405, "table_properties": {"data_size": 40784064, "index_size": 220416, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588660, "raw_average_key_size": 20, "raw_value_size": 131630045, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129433, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732352306, "oldest_key_time": 0, "file_creation_time": 1732352306, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 270937, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:58:28.122180 139957248734784 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270938.sst) /dev/shm/ToplingTemp/Topling-123765-kRGbgH 2024/11/23-16:58:28.627705 139957248734784 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270938.sst): first pass time = 0.51's, 265.526'MB/sec 2024/11/23-16:58:29.391218 139957248734784 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270938.sst): old prealloc_size = 147639500, real_size = 40640336 2024/11/23-16:58:29.391344 139957248734784 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270938.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129429 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.75 raw-val = 0.1316 GB zip-val = 0.0404 GB avg-val =1017.00 avg-zval = 312.00 2024/11/23-16:58:29.391477 139957248734784 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270938.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:58:29.551934 139957248734784 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270938.sst): second pass time = 0.76's, 172.565'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 263.233'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2168.380'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.275'MB/sec write SST data time = 0.04's, 989.340'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 45512.735'MB/sec zip my value time = 0.76's, unzip length = 0.132'GB zip my value throughput = 172.565'MB/sec zip pipeline throughput = 172.565'MB/sec entries = 129429 avg-key = 20.00 avg-zkey = 1.75 avg-val = 1017.00 avg-zval = 312.00 usrkeys = 129429 avg-key = 12.00 avg-zkey = 1.75 avg-val = 1021.24 avg-zval = 312.00 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 78269 bytes = 293520 } seq expand size = 547883 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0404 GB dict = 1.38 MB all = 0.0423 GB } UnZip/Zip{ index = 6.8573 value = 3.2597 dict = 1.00 all = 3.1729 } Zip/UnZip{ index = 0.1458 value = 0.3068 dict = 1.00 all = 0.3152 } ---------------------------- total value len = 10.968113 GB avg = 0.202 KB (by entry num) total key len = 1.482239 GB avg = 0.027 KB total ukey len = 1.022729 GB avg = 0.015 KB total ukey num = 0.067621322 Billion total entry num = 0.054429051 Billion write speed all = 0.429361914 MB/sec (with seq num) write speed all = 0.414345625 MB/sec (without seq num) 2024/11/23-16:58:29.605319 139957248734784 [compaction_job.cc:1948] [default] [JOB 31311] Generated table #270938: 129429 keys, 42301235 bytes, temperature: kWarm 2024/11/23-16:58:29.605390 139957248734784 EVENT_LOG_v1 {"time_micros": 1732352309605354, "cf_name": "default", "job": 31311, "event": "table_file_creation", "file_number": 270938, "file_size": 42301235, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4128731191, "table_properties": {"data_size": 40381312, "index_size": 226496, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588580, "raw_average_key_size": 20, "raw_value_size": 131629738, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129429, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732352308, "oldest_key_time": 0, "file_creation_time": 1732352308, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 270938, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:58:29.642560 139957248734784 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270939.sst) /dev/shm/ToplingTemp/Topling-123765-7r0IwL 2024/11/23-16:58:30.328430 139957248734784 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270939.sst): first pass time = 0.69's, 195.701'MB/sec 2024/11/23-16:58:31.127413 139957248734784 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270939.sst): old prealloc_size = 147639500, real_size = 41026080 2024/11/23-16:58:31.127552 139957248734784 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270939.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129425 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.73 raw-val = 0.1316 GB zip-val = 0.0408 GB avg-val =1017.03 avg-zval = 315.01 2024/11/23-16:58:31.127713 139957248734784 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270939.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:58:31.289037 139957248734784 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270939.sst): second pass time = 0.80's, 165.049'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 265.201'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2021.619'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.273'MB/sec write SST data time = 0.04's, 993.600'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.379'MB, throughput = 44638.250'MB/sec zip my value time = 0.80's, unzip length = 0.132'GB zip my value throughput = 165.049'MB/sec zip pipeline throughput = 165.049'MB/sec entries = 129425 avg-key = 20.00 avg-zkey = 1.73 avg-val = 1017.03 avg-zval = 315.01 usrkeys = 129425 avg-key = 12.00 avg-zkey = 1.73 avg-val = 1023.58 avg-zval = 315.01 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 121076 bytes = 454048 } seq expand size = 847532 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0408 GB dict = 1.38 MB all = 0.0428 GB } UnZip/Zip{ index = 6.9494 value = 3.2286 dict = 1.00 all = 3.1324 } Zip/UnZip{ index = 0.1439 value = 0.3097 dict = 1.00 all = 0.3192 } ---------------------------- total value len = 11.100590 GB avg = 0.203 KB (by entry num) total key len = 1.484827 GB avg = 0.027 KB total ukey len = 1.024282 GB avg = 0.015 KB total ukey num = 0.067750747 Billion total entry num = 0.054558476 Billion write speed all = 0.433993769 MB/sec (with seq num) write speed all = 0.418942675 MB/sec (without seq num) 2024/11/23-16:58:31.347326 139957248734784 [compaction_job.cc:1948] [default] [JOB 31311] Generated table #270939: 129425 keys, 42848648 bytes, temperature: kWarm 2024/11/23-16:58:31.347409 139957248734784 EVENT_LOG_v1 {"time_micros": 1732352311347370, "cf_name": "default", "job": 31311, "event": "table_file_creation", "file_number": 270939, "file_size": 42848648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4128728794, "table_properties": {"data_size": 40770064, "index_size": 223488, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588500, "raw_average_key_size": 20, "raw_value_size": 131629314, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129425, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732352309, "oldest_key_time": 0, "file_creation_time": 1732352309, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 270939, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:58:31.384070 139957248734784 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270940.sst) /dev/shm/ToplingTemp/Topling-123765-RA77qH 2024/11/23-16:58:32.072259 139957248734784 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270940.sst): first pass time = 0.69's, 195.042'MB/sec 2024/11/23-16:58:32.836085 139957248734784 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270940.sst): old prealloc_size = 147639500, real_size = 40530304 2024/11/23-16:58:32.836228 139957248734784 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270940.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129429 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.75 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1017.00 avg-zval = 311.15 2024/11/23-16:58:32.836341 139957248734784 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270940.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:58:32.996461 139957248734784 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270940.sst): second pass time = 0.76's, 172.510'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 262.772'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1895.705'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.276'MB/sec write SST data time = 0.04's, 977.689'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 46401.152'MB/sec zip my value time = 0.76's, unzip length = 0.132'GB zip my value throughput = 172.510'MB/sec zip pipeline throughput = 172.510'MB/sec entries = 129429 avg-key = 20.00 avg-zkey = 1.75 avg-val = 1017.00 avg-zval = 311.15 usrkeys = 129429 avg-key = 12.00 avg-zkey = 1.75 avg-val = 1020.42 avg-zval = 311.15 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 63169 bytes = 236896 } seq expand size = 442183 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0421 GB } UnZip/Zip{ index = 6.8612 value = 3.2686 dict = 1.00 all = 3.1854 } Zip/UnZip{ index = 0.1457 value = 0.3059 dict = 1.00 all = 0.3139 } ---------------------------- total value len = 11.232662 GB avg = 0.205 KB (by entry num) total key len = 1.487416 GB avg = 0.027 KB total ukey len = 1.025835 GB avg = 0.015 KB total ukey num = 0.067880176 Billion total entry num = 0.054687905 Billion write speed all = 0.438611549 MB/sec (with seq num) write speed all = 0.423525637 MB/sec (without seq num) 2024/11/23-16:58:33.051331 139957248734784 [compaction_job.cc:1948] [default] [JOB 31311] Generated table #270940: 129429 keys, 42134902 bytes, temperature: kWarm 2024/11/23-16:58:33.051403 139957248734784 EVENT_LOG_v1 {"time_micros": 1732352313051366, "cf_name": "default", "job": 31311, "event": "table_file_creation", "file_number": 270940, "file_size": 42134902, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4128739606, "table_properties": {"data_size": 40271408, "index_size": 226368, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588580, "raw_average_key_size": 20, "raw_value_size": 131629483, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129429, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732352311, "oldest_key_time": 0, "file_creation_time": 1732352311, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 270940, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:58:33.088709 139957248734784 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270941.sst) /dev/shm/ToplingTemp/Topling-123765-UKoFoH 2024/11/23-16:58:33.581499 139957248734784 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270941.sst): first pass time = 0.49's, 272.385'MB/sec 2024/11/23-16:58:34.346837 139957248734784 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270941.sst): old prealloc_size = 147639500, real_size = 40609968 2024/11/23-16:58:34.346961 139957248734784 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270941.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129427 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.72 raw-val = 0.1316 GB zip-val = 0.0404 GB avg-val =1017.02 avg-zval = 311.79 2024/11/23-16:58:34.347089 139957248734784 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270941.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:58:34.509963 139957248734784 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270941.sst): second pass time = 0.76's, 172.160'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 258.249'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1842.693'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.269'MB/sec write SST data time = 0.04's, 982.053'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 47585.307'MB/sec zip my value time = 0.76's, unzip length = 0.132'GB zip my value throughput = 172.160'MB/sec zip pipeline throughput = 172.160'MB/sec entries = 129427 avg-key = 20.00 avg-zkey = 1.72 avg-val = 1017.02 avg-zval = 311.79 usrkeys = 129427 avg-key = 12.00 avg-zkey = 1.72 avg-val = 1019.09 avg-zval = 311.79 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 38303 bytes = 143648 } seq expand size = 268121 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0404 GB dict = 1.38 MB all = 0.0421 GB } UnZip/Zip{ index = 6.9614 value = 3.2618 dict = 1.00 all = 3.1864 } Zip/UnZip{ index = 0.1436 value = 0.3066 dict = 1.00 all = 0.3138 } ---------------------------- total value len = 11.364560 GB avg = 0.207 KB (by entry num) total key len = 1.490004 GB avg = 0.027 KB total ukey len = 1.027388 GB avg = 0.015 KB total ukey num = 0.068009603 Billion total entry num = 0.054817332 Billion write speed all = 0.443225746 MB/sec (with seq num) write speed all = 0.428104920 MB/sec (without seq num) 2024/11/23-16:58:34.563329 139957248734784 [compaction_job.cc:1948] [default] [JOB 31311] Generated table #270941: 129427 keys, 42121715 bytes, temperature: kWarm 2024/11/23-16:58:34.563397 139957248734784 EVENT_LOG_v1 {"time_micros": 1732352314563362, "cf_name": "default", "job": 31311, "event": "table_file_creation", "file_number": 270941, "file_size": 42121715, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4128711798, "table_properties": {"data_size": 40354336, "index_size": 223104, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588540, "raw_average_key_size": 20, "raw_value_size": 131629485, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129427, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732352313, "oldest_key_time": 0, "file_creation_time": 1732352313, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 270941, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:58:34.599188 139957248734784 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270942.sst) /dev/shm/ToplingTemp/Topling-123765-RVv6wI 2024/11/23-16:58:35.247165 139957248734784 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270942.sst): first pass time = 0.65's, 207.146'MB/sec 2024/11/23-16:58:36.023481 139957248734784 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270942.sst): old prealloc_size = 147639500, real_size = 40460864 2024/11/23-16:58:36.023609 139957248734784 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270942.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129432 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.72 raw-val = 0.1316 GB zip-val = 0.0402 GB avg-val =1016.98 avg-zval = 310.64 2024/11/23-16:58:36.023692 139957248734784 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270942.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:58:36.181605 139957248734784 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270942.sst): second pass time = 0.78's, 169.706'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 265.256'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2118.478'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.278'MB/sec write SST data time = 0.04's, 1010.949'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 46026.086'MB/sec zip my value time = 0.78's, unzip length = 0.132'GB zip my value throughput = 169.706'MB/sec zip pipeline throughput = 169.706'MB/sec entries = 129432 avg-key = 20.00 avg-zkey = 1.72 avg-val = 1016.98 avg-zval = 310.64 usrkeys = 129432 avg-key = 12.00 avg-zkey = 1.72 avg-val = 1018.58 avg-zval = 310.64 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 29503 bytes = 110656 } seq expand size = 206521 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0402 GB dict = 1.38 MB all = 0.0419 GB } UnZip/Zip{ index = 6.9938 value = 3.2739 dict = 1.00 all = 3.2003 } Zip/UnZip{ index = 0.1430 value = 0.3054 dict = 1.00 all = 0.3125 } ---------------------------- total value len = 11.496396 GB avg = 0.209 KB (by entry num) total key len = 1.492593 GB avg = 0.027 KB total ukey len = 1.028941 GB avg = 0.015 KB total ukey num = 0.068139035 Billion total entry num = 0.054946764 Billion write speed all = 0.447834915 MB/sec (with seq num) write speed all = 0.432679260 MB/sec (without seq num) 2024/11/23-16:58:36.234961 139957248734784 [compaction_job.cc:1948] [default] [JOB 31311] Generated table #270942: 129432 keys, 41939236 bytes, temperature: kWarm 2024/11/23-16:58:36.235034 139957248734784 EVENT_LOG_v1 {"time_micros": 1732352316234999, "cf_name": "default", "job": 31311, "event": "table_file_creation", "file_number": 270942, "file_size": 41939236, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4128747888, "table_properties": {"data_size": 40206256, "index_size": 222080, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588640, "raw_average_key_size": 20, "raw_value_size": 131629920, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129432, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732352314, "oldest_key_time": 0, "file_creation_time": 1732352314, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 270942, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:58:36.272769 139957248734784 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270943.sst) /dev/shm/ToplingTemp/Topling-123765-1qsKyI 2024/11/23-16:58:36.817030 139957248734784 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270943.sst): first pass time = 0.54's, 246.622'MB/sec 2024/11/23-16:58:37.595038 139957248734784 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270943.sst): old prealloc_size = 147639500, real_size = 40463488 2024/11/23-16:58:37.595163 139957248734784 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270943.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129428 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.72 raw-val = 0.1316 GB zip-val = 0.0402 GB avg-val =1017.01 avg-zval = 310.67 2024/11/23-16:58:37.595247 139957248734784 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270943.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:58:37.754856 139957248734784 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270943.sst): second pass time = 0.78's, 169.378'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 262.452'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2197.833'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.277'MB/sec write SST data time = 0.04's, 982.207'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 45172.972'MB/sec zip my value time = 0.78's, unzip length = 0.132'GB zip my value throughput = 169.378'MB/sec zip pipeline throughput = 169.378'MB/sec entries = 129428 avg-key = 20.00 avg-zkey = 1.72 avg-val = 1017.01 avg-zval = 310.67 usrkeys = 129428 avg-key = 12.00 avg-zkey = 1.72 avg-val = 1018.59 avg-zval = 310.67 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 29221 bytes = 109600 } seq expand size = 204547 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0402 GB dict = 1.38 MB all = 0.0419 GB } UnZip/Zip{ index = 6.9936 value = 3.2736 dict = 1.00 all = 3.2002 } Zip/UnZip{ index = 0.1430 value = 0.3055 dict = 1.00 all = 0.3125 } ---------------------------- total value len = 11.628230 GB avg = 0.211 KB (by entry num) total key len = 1.495182 GB avg = 0.027 KB total ukey len = 1.030494 GB avg = 0.015 KB total ukey num = 0.068268463 Billion total entry num = 0.055076192 Billion write speed all = 0.452444999 MB/sec (with seq num) write speed all = 0.437254468 MB/sec (without seq num) 2024/11/23-16:58:37.808326 139957248734784 [compaction_job.cc:1948] [default] [JOB 31311] Generated table #270943: 129428 keys, 41940681 bytes, temperature: kWarm 2024/11/23-16:58:37.808398 139957248734784 EVENT_LOG_v1 {"time_micros": 1732352317808364, "cf_name": "default", "job": 31311, "event": "table_file_creation", "file_number": 270943, "file_size": 41940681, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4128748624, "table_properties": {"data_size": 40208880, "index_size": 222080, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588560, "raw_average_key_size": 20, "raw_value_size": 131629430, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129428, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732352316, "oldest_key_time": 0, "file_creation_time": 1732352316, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 270943, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:58:37.846785 139957248734784 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270944.sst) /dev/shm/ToplingTemp/Topling-123765-oKLmWJ 2024/11/23-16:58:38.585851 139957248734784 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270944.sst): first pass time = 0.74's, 181.617'MB/sec 2024/11/23-16:58:39.422144 139957248734784 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270944.sst): old prealloc_size = 147639500, real_size = 41125728 2024/11/23-16:58:39.422266 139957248734784 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270944.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129431 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0409 GB avg-val =1016.99 avg-zval = 315.80 2024/11/23-16:58:39.422423 139957248734784 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270944.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:58:39.583424 139957248734784 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270944.sst): second pass time = 0.83's, 157.674'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 266.466'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2188.815'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.275'MB/sec write SST data time = 0.04's, 988.964'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 45877.177'MB/sec zip my value time = 0.83's, unzip length = 0.132'GB zip my value throughput = 157.674'MB/sec zip pipeline throughput = 157.674'MB/sec entries = 129431 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1016.99 avg-zval = 315.80 usrkeys = 129431 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1023.89 avg-zval = 315.80 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 127552 bytes = 478336 } seq expand size = 892864 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0409 GB dict = 1.38 MB all = 0.0430 GB } UnZip/Zip{ index = 7.0815 value = 3.2204 dict = 1.00 all = 3.1234 } Zip/UnZip{ index = 0.1412 value = 0.3105 dict = 1.00 all = 0.3202 } ---------------------------- total value len = 11.760753 GB avg = 0.213 KB (by entry num) total key len = 1.497770 GB avg = 0.027 KB total ukey len = 1.032048 GB avg = 0.015 KB total ukey num = 0.068397894 Billion total entry num = 0.055205623 Billion write speed all = 0.457074311 MB/sec (with seq num) write speed all = 0.441849042 MB/sec (without seq num) 2024/11/23-16:58:39.636897 139957248734784 [compaction_job.cc:1948] [default] [JOB 31311] Generated table #270944: 129431 keys, 42971281 bytes, temperature: kWarm 2024/11/23-16:58:39.636969 139957248734784 EVENT_LOG_v1 {"time_micros": 1732352319636932, "cf_name": "default", "job": 31311, "event": "table_file_creation", "file_number": 270944, "file_size": 42971281, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4128749128, "table_properties": {"data_size": 40873872, "index_size": 219328, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588620, "raw_average_key_size": 20, "raw_value_size": 131630001, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129431, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732352317, "oldest_key_time": 0, "file_creation_time": 1732352317, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 270944, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:58:39.674690 139957248734784 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270945.sst) /dev/shm/ToplingTemp/Topling-123765-HAp8kL 2024/11/23-16:58:39.682925 139957248734784 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270945.sst): first pass time = 0.01's, 358.730'MB/sec 2024/11/23-16:58:39.713136 139957248734784 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270945.sst): old prealloc_size = 147639500, real_size = 934728 2024/11/23-16:58:39.713169 139957248734784 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270945.sst): index type = UintIndex_IL_256_32 , store type = DictZipBlobStore usrkeys = 2836 prefix = 4 raw-key = 0.0000 GB zip-key = 0.0000 GB avg-key = 8.00 avg-zkey = 0.27 raw-val = 0.0029 GB zip-val = 0.0009 GB avg-val =1017.15 avg-zval = 329.00 2024/11/23-16:58:39.716436 139957248734784 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00/270945.sst): second pass time = 0.03's, 96.909'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.00's, 298.313'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 36.966'MB/sec (index lex order gen) rebuild zvType time = 0.00's, 0.303'MB/sec write SST data time = 0.00's, 1062.571'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.033'MB, throughput = 1432.413'MB/sec zip my value time = 0.03's, unzip length = 0.003'GB zip my value throughput = 96.909'MB/sec zip pipeline throughput = 96.909'MB/sec entries = 2836 avg-key = 20.00 avg-zkey = 0.27 avg-val = 1017.15 avg-zval = 329.00 usrkeys = 2836 avg-key = 12.00 avg-zkey = 0.27 avg-val = 1024.15 avg-zval = 329.00 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 2836 bytes = 10656 } seq expand size = 19852 multi value expand size = 0 cnt WriteAppend = 11 UnZipSize{ index = 0.0000 GB value = 0.0029 GB dict = 0.03 MB all = 0.0029 GB } __ZipSize{ index = 0.0000 GB value = 0.0009 GB dict = 0.03 MB all = 0.0010 GB } UnZip/Zip{ index = 44.3125 value = 3.0916 dict = 1.00 all = 3.0069 } Zip/UnZip{ index = 0.0226 value = 0.3235 dict = 1.00 all = 0.3326 } ---------------------------- total value len = 11.763657 GB avg = 0.213 KB (by entry num) total key len = 1.497827 GB avg = 0.027 KB total ukey len = 1.032082 GB avg = 0.015 KB total ukey num = 0.068400730 Billion total entry num = 0.055208459 Billion write speed all = 0.457174299 MB/sec (with seq num) write speed all = 0.441948318 MB/sec (without seq num) 2024/11/23-16:58:39.724744 139957248734784 [compaction_job.cc:1948] [default] [JOB 31311] Generated table #270945: 2836 keys, 978208 bytes, temperature: kWarm 2024/11/23-16:58:39.724790 139957248734784 EVENT_LOG_v1 {"time_micros": 1732352319724764, "cf_name": "default", "job": 31311, "event": "table_file_creation", "file_number": 270945, "file_size": 978208, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3354446150, "largest_seqno": 4128748915, "table_properties": {"data_size": 933056, "index_size": 768, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 56720, "raw_average_key_size": 20, "raw_value_size": 2884644, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 2836, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-UintIndex_IL_256_32-DictZipBlobStore", "creation_time": 1732352319, "oldest_key_time": 0, "file_creation_time": 1732352319, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 270945, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:58:39.735014 139957248734784 [compaction_job.cc:703] job-31311: subcompact[0], size: 0.935833 G, files: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31311/att-00 [270923,270924,270925,270926,270927,270928,270929,270930,270931,270932,270933,270934,270935,270936,270937,270938,270939,270940,270941,270942,270943,270944,270945] 2024/11/23-16:58:39.869028 139957248734784 (Original Log Time 2024/11/23-16:57:59.248762) EVENT_LOG_v1 {"time_micros": 1732352279248721, "job": 31311, "event": "compaction_started", "compaction_reason": "FilesMarkedForCompaction", "files_L2": [270905], "files_L3": [270826, 270827, 270828, 270829, 270830, 270831, 270832, 270833, 270834, 270835, 270836, 270837, 270838, 270839, 270840, 270841, 270842, 270843, 270844, 270845, 270846, 270917], "score": 0.998397, "input_data_size": 967509683, "oldest_snapshot_seqno": 4128827937} 2024/11/23-16:58:39.869032 139957248734784 (Original Log Time 2024/11/23-16:58:39.867365) [compaction_job.cc:2022] [default] [JOB 31311] Compacted 1@2 + 22@3 files to L3 => 935832959 bytes 2024/11/23-16:58:39.869033 139957248734784 (Original Log Time 2024/11/23-16:58:39.868936) [compaction_job.cc:1224] [default] compacted to: files[0 0 0 23 0 0 0] max score 0.03, MB/sec: 23.9 rd, 23.1 wr, level 3, files in(1, 22) out(23 +0 blob) MB in(31.2, 891.5 +0.0 blob) out(892.5 +0.0 blob), read-write-amplify(58.2) write-amplify(28.6) OK, records in: 2879369, records dropped: 29074 output_compression: Snappy 2024/11/23-16:58:39.869036 139957248734784 (Original Log Time 2024/11/23-16:58:39.869001) EVENT_LOG_v1 {"time_micros": 1732352319868966, "cf": "default", "job": 31311, "event": "compaction_finished", "compaction_time_micros": 40486255, "compaction_time_cpu_micros": 8313336, "output_level": 3, "num_output_files": 23, "total_output_size": 935832959, "num_input_records": 2879369, "num_output_records": 2850295, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "file_write_nanos": 634535812, "file_range_sync_nanos": 0, "file_fsync_nanos": 15435, "file_prepare_write_nanos": 44950, "lsm_state": [0, 0, 0, 23, 0, 0, 0]} 2024/11/23-16:58:40.001761 139957248734784 DEBG dcompact_worker.cpp:240: HttpPost: 200 OK: url = http://nlb-7zny4kaa1poal01o64.cn-shenzhen.nlb.aliyuncs.com:8443, body = {"instanceId":"nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137","labourId":"","dbId":"d89b4006-2803-486e-b7a2-759bcf348921","dbStarts":1732256054,"starts":1732352279,"executesMs":40801,"compactionJobId":31311,"attempt":0,"compactionInputRawBytes":2985890247,"compactionInputZipBytes":967509683,"compactionOutputRawBytes":0,"compactionOutputZipBytes":935832959,"headers":{"Accept":"*/*","Connection":"close","Host":"aliyun-topling-saas.topling.cn:18443","RemoteIp":"120.24.192.169","X-Forwarded-For":"120.24.192.169","region":"cn-shenzhen","token":"e6474c481bd4415abc537135cc03626b","instance-token":"e6474c481bd4415abc537135cc03626b","provider":"aliyun","CloudMarketInstanceId":"si-59c0ae5c955845588903","MeteringAssit":"","Transfer-Encoding":"chunked","traceparent":"00-4f390603223969f8e4bd69d76e369828-469204c5c936ac3d-00"}}, response = 2024/11/23-16:58:40.001836 139957248734784 INFO dcompact_worker.cpp:1459: finish /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-31311/att-00: olev 3, work 40.801 s, result 5.956 ms, install 1.687 ms, input{raw 2.781 GiB zip 922.689 MiB}