2024/11/23-20:07:44.046567 139957651584576 DEBG dcompact_worker.cpp:2214: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00: fork to child time = 0.009128 sec 2024/11/23-20:07:44.047250 139957651584576 DEBG dcompact_worker.cpp:1013: Beg SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00 2024/11/23-20:07:44.056031 139957651584576 DEBG dcompact_worker.cpp:1033: End SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00 2024/11/23-20:07:44.056914 139957651584576 TRAC dcompact_worker.cpp:1083: INFO_LOG_LEVEL: rpc = INFO_LEVEL, env_var = undefined 2024/11/23-20:07:44.057160 139957651584576 [WARN] [column_family.cc:386] multiple cf_paths/db_paths and level_compaction_dynamic_level_bytes can't be used together 2024/11/23-20:07:44.110480 139957651584576 [version_set.cc:6208] Recovering from manifest file: /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-34855/att-00/MANIFEST-206347 2024/11/23-20:07:44.142735 139957651584576 [version_set.cc:6251] Recovered from manifest file:/worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-34855/att-00/MANIFEST-206347 succeeded,manifest_file_number is 206347, next_file_number is 278631, last_sequence is 4235049342, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 278477 2024/11/23-20:07:44.142743 139957651584576 [version_set.cc:6266] Column family [default] (ID 0), log number is 0 2024/11/23-20:07:44.142966 139957651584576 [version_set.cc:5721] Creating manifest 278631 2024/11/23-20:07:44.177660 139957651584576 DEBG dcompact_worker.cpp:1218: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00: bottommost_level: fake = 1, rpc = 0 2024/11/23-20:07:44.203835 139957651584576 [compaction_job.cc:2437] [default] [JOB 34855] Compacting 1@2 + 22@3 files to L3, score 1.00, subcompactions 1 : 1 2024/11/23-20:07:44.203851 139957651584576 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 26091 Base level 2, inputs: [278625(31MB)], [278550(40MB) 278551(40MB) 278552(40MB) 278553(40MB) 278554(40MB) 278555(40MB) 278556(40MB) 278557(40MB) 278558(40MB) 278559(40MB) 278560(40MB) 278561(40MB) 278562(40MB) 278563(40MB) 278564(40MB) 278565(40MB) 278566(40MB) 278567(40MB) 278568(40MB) 278569(40MB) 278570(40MB) 278571(40MB)] 2024/11/23-20:07:44.211094 139957651584576 [top_zip_table.cc:59] core git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-20:07:44.211121 139957651584576 [top_zip_table.cc:60] fsa git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-20:07:44.211139 139957651584576 [top_zip_table.cc:61] zbs git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-20:07:44.211144 139957651584576 [top_zip_table.cc:62] topling-zip_table_reader: git_version_hash_info_is: commit a4a382006cb82713acf5b3425835f22711877681 Author: leipeng Date: 2024-04-11 19:44:14 +0800 fixed_len_hole_index.cc: Add env bool FixedLenHoleIndexUseAVX512 for ut & debug 1. FixedLenHoleIndexUseAVX512 is only in unit tests or debug 2. In release mode, use avx512 by compile options(-march=) g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/23-20:07:44.211156 139957651584576 [top_zip_table.cc:64] topling-rocks git_version_hash_info_is: commit feab587e468621ba0204d47b4ffacc52e7c4290d Author: leipeng Date: 2024-03-22 13:35:06 +0800 ToplingZipTableBuilder::Add: immediately return after error This function returns void, and caller does not check builder->status() after calling this function and graceful abandon. So immediately return after error, and return error status in Finish(). g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/23-20:07:44.937488 139957651584576 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278632.sst) /dev/shm/ToplingTemp/Topling-175297-0Ycqal 2024/11/23-20:07:45.373356 139957651584576 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278632.sst): first pass time = 0.44's, 307.979'MB/sec 2024/11/23-20:07:47.102816 139957651584576 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278632.sst): old prealloc_size = 147639500, real_size = 40582096 2024/11/23-20:07:47.102956 139957651584576 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278632.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129431 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.79 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1016.99 avg-zval = 311.50 2024/11/23-20:07:47.103151 139957651584576 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278632.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-20:07:47.274602 139957651584576 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278632.sst): second pass time = 1.73's, 76.148'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.17's, 246.918'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2026.677'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.262'MB/sec write SST data time = 0.05's, 884.634'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 42628.943'MB/sec zip my value time = 1.73's, unzip length = 0.132'GB zip my value throughput = 76.148'MB/sec zip pipeline throughput = 111.356'MB/sec entries = 129431 avg-key = 20.00 avg-zkey = 1.79 avg-val = 1016.99 avg-zval = 311.50 usrkeys = 129431 avg-key = 12.00 avg-zkey = 1.79 avg-val = 1023.99 avg-zval = 311.50 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129431 bytes = 485376 } seq expand size = 906017 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0424 GB } UnZip/Zip{ index = 6.6855 value = 3.2649 dict = 1.00 all = 3.1644 } Zip/UnZip{ index = 0.1496 value = 0.3063 dict = 1.00 all = 0.3160 } ---------------------------- total value len = 8.981156 GB avg = 0.171 KB (by entry num) total key len = 1.443410 GB avg = 0.028 KB total ukey len = 0.999431 GB avg = 0.015 KB total ukey num = 0.065679866 Billion total entry num = 0.052487595 Billion write speed all = 0.258321148 MB/sec (with seq num) write speed all = 0.247915990 MB/sec (without seq num) 2024/11/23-20:07:47.329141 139957651584576 [compaction_job.cc:1948] [default] [JOB 34855] Generated table #278632: 129431 keys, 42415142 bytes, temperature: kWarm 2024/11/23-20:07:47.329229 139957651584576 EVENT_LOG_v1 {"time_micros": 1732363667329173, "cf_name": "default", "job": 34855, "event": "table_file_creation", "file_number": 278632, "file_size": 42415142, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237877277, "largest_seqno": 4235020452, "table_properties": {"data_size": 40317248, "index_size": 232320, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588620, "raw_average_key_size": 20, "raw_value_size": 131629890, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129431, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732363664, "oldest_key_time": 0, "file_creation_time": 1732363664, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 278632, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-20:07:47.370202 139957651584576 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278633.sst) /dev/shm/ToplingTemp/Topling-175297-9NDgKm 2024/11/23-20:07:48.013891 139957651584576 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278633.sst): first pass time = 0.64's, 208.529'MB/sec 2024/11/23-20:07:48.988655 139957651584576 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278633.sst): old prealloc_size = 147639500, real_size = 40868928 2024/11/23-20:07:48.988805 139957651584576 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278633.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129433 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.73 raw-val = 0.1316 GB zip-val = 0.0406 GB avg-val =1016.97 avg-zval = 313.77 2024/11/23-20:07:48.989006 139957651584576 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278633.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-20:07:49.293527 139957651584576 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278633.sst): second pass time = 0.97's, 135.163'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.30's, 140.070'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1786.909'MB/sec (index lex order gen) rebuild zvType time = 0.21's, 0.155'MB/sec write SST data time = 0.10's, 443.075'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 50756.711'MB/sec zip my value time = 0.97's, unzip length = 0.132'GB zip my value throughput = 135.163'MB/sec zip pipeline throughput = 135.163'MB/sec entries = 129433 avg-key = 20.00 avg-zkey = 1.73 avg-val = 1016.97 avg-zval = 313.77 usrkeys = 129433 avg-key = 12.00 avg-zkey = 1.73 avg-val = 1023.97 avg-zval = 313.77 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129433 bytes = 485392 } seq expand size = 906031 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0406 GB dict = 1.38 MB all = 0.0427 GB } UnZip/Zip{ index = 6.9220 value = 3.2411 dict = 1.00 all = 3.1431 } Zip/UnZip{ index = 0.1445 value = 0.3085 dict = 1.00 all = 0.3182 } ---------------------------- total value len = 9.113691 GB avg = 0.173 KB (by entry num) total key len = 1.445998 GB avg = 0.027 KB total ukey len = 1.000984 GB avg = 0.015 KB total ukey num = 0.065809299 Billion total entry num = 0.052617028 Billion write speed all = 0.261656440 MB/sec (with seq num) write speed all = 0.251226145 MB/sec (without seq num) 2024/11/23-20:07:49.347511 139957651584576 [compaction_job.cc:1948] [default] [JOB 34855] Generated table #278633: 129433 keys, 42702111 bytes, temperature: kWarm 2024/11/23-20:07:49.347578 139957651584576 EVENT_LOG_v1 {"time_micros": 1732363669347545, "cf_name": "default", "job": 34855, "event": "table_file_creation", "file_number": 278633, "file_size": 42702111, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237868195, "largest_seqno": 4235011882, "table_properties": {"data_size": 40612016, "index_size": 224384, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588660, "raw_average_key_size": 20, "raw_value_size": 131629484, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129433, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732363667, "oldest_key_time": 0, "file_creation_time": 1732363667, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 278633, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-20:07:49.391966 139957651584576 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278634.sst) /dev/shm/ToplingTemp/Topling-175297-ikbxPk 2024/11/23-20:07:50.178243 139957651584576 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278634.sst): first pass time = 0.79's, 170.714'MB/sec 2024/11/23-20:07:51.836010 139957651584576 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278634.sst): old prealloc_size = 147639500, real_size = 40582880 2024/11/23-20:07:51.836148 139957651584576 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278634.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129433 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.79 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1016.97 avg-zval = 311.50 2024/11/23-20:07:51.836323 139957651584576 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278634.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-20:07:52.009719 139957651584576 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278634.sst): second pass time = 1.66's, 79.486'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.17's, 244.193'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1965.549'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.262'MB/sec write SST data time = 0.05's, 850.983'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 36791.022'MB/sec zip my value time = 1.66's, unzip length = 0.132'GB zip my value throughput = 79.486'MB/sec zip pipeline throughput = 115.765'MB/sec entries = 129433 avg-key = 20.00 avg-zkey = 1.79 avg-val = 1016.97 avg-zval = 311.50 usrkeys = 129433 avg-key = 12.00 avg-zkey = 1.79 avg-val = 1023.97 avg-zval = 311.50 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129433 bytes = 485392 } seq expand size = 906031 multi value expand size = 0 cnt WriteAppend = 11 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0424 GB } UnZip/Zip{ index = 6.6856 value = 3.2648 dict = 1.00 all = 3.1644 } Zip/UnZip{ index = 0.1496 value = 0.3063 dict = 1.00 all = 0.3160 } ---------------------------- total value len = 9.246226 GB avg = 0.175 KB (by entry num) total key len = 1.448587 GB avg = 0.027 KB total ukey len = 1.002538 GB avg = 0.015 KB total ukey num = 0.065938732 Billion total entry num = 0.052746461 Billion write speed all = 0.264986812 MB/sec (with seq num) write speed all = 0.254531563 MB/sec (without seq num) 2024/11/23-20:07:52.064524 139957651584576 [compaction_job.cc:1948] [default] [JOB 34855] Generated table #278634: 129433 keys, 42415418 bytes, temperature: kWarm 2024/11/23-20:07:52.064586 139957651584576 EVENT_LOG_v1 {"time_micros": 1732363672064551, "cf_name": "default", "job": 34855, "event": "table_file_creation", "file_number": 278634, "file_size": 42415418, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237874654, "largest_seqno": 4235018371, "table_properties": {"data_size": 40318032, "index_size": 232320, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588660, "raw_average_key_size": 20, "raw_value_size": 131629155, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129433, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732363669, "oldest_key_time": 0, "file_creation_time": 1732363669, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 278634, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-20:07:52.117317 139957651584576 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278635.sst) /dev/shm/ToplingTemp/Topling-175297-w4cDVk 2024/11/23-20:07:52.667321 139957651584576 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278635.sst): first pass time = 0.55's, 244.051'MB/sec 2024/11/23-20:07:53.700674 139957651584576 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278635.sst): old prealloc_size = 147639500, real_size = 40860368 2024/11/23-20:07:53.700819 139957651584576 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278635.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129435 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.74 raw-val = 0.1316 GB zip-val = 0.0406 GB avg-val =1016.95 avg-zval = 313.69 2024/11/23-20:07:53.701030 139957651584576 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278635.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-20:07:53.943083 139957651584576 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278635.sst): second pass time = 1.03's, 127.643'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.24's, 176.144'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1842.663'MB/sec (index lex order gen) rebuild zvType time = 0.17's, 0.188'MB/sec write SST data time = 0.07's, 608.860'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 42660.700'MB/sec zip my value time = 1.03's, unzip length = 0.132'GB zip my value throughput = 127.643'MB/sec zip pipeline throughput = 168.354'MB/sec entries = 129435 avg-key = 20.00 avg-zkey = 1.74 avg-val = 1016.95 avg-zval = 313.69 usrkeys = 129435 avg-key = 12.00 avg-zkey = 1.74 avg-val = 1023.95 avg-zval = 313.69 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129435 bytes = 485392 } seq expand size = 906045 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0406 GB dict = 1.38 MB all = 0.0427 GB } UnZip/Zip{ index = 6.9103 value = 3.2419 dict = 1.00 all = 3.1438 } Zip/UnZip{ index = 0.1447 value = 0.3085 dict = 1.00 all = 0.3181 } ---------------------------- total value len = 9.378762 GB avg = 0.177 KB (by entry num) total key len = 1.451176 GB avg = 0.027 KB total ukey len = 1.004091 GB avg = 0.015 KB total ukey num = 0.066068167 Billion total entry num = 0.052875896 Billion write speed all = 0.268321941 MB/sec (with seq num) write speed all = 0.257841538 MB/sec (without seq num) 2024/11/23-20:07:54.000613 139957651584576 [compaction_job.cc:1948] [default] [JOB 34855] Generated table #278635: 129435 keys, 42692777 bytes, temperature: kWarm 2024/11/23-20:07:54.000700 139957651584576 EVENT_LOG_v1 {"time_micros": 1732363674000654, "cf_name": "default", "job": 34855, "event": "table_file_creation", "file_number": 278635, "file_size": 42692777, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237868596, "largest_seqno": 4235011371, "table_properties": {"data_size": 40603072, "index_size": 224768, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588700, "raw_average_key_size": 20, "raw_value_size": 131629147, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129435, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732363672, "oldest_key_time": 0, "file_creation_time": 1732363672, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 278635, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-20:07:54.070188 139957651584576 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278636.sst) /dev/shm/ToplingTemp/Topling-175297-WPdM4k 2024/11/23-20:07:54.919044 139957651584576 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278636.sst): first pass time = 0.85's, 158.129'MB/sec 2024/11/23-20:07:56.117440 139957651584576 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278636.sst): old prealloc_size = 147639500, real_size = 40603360 2024/11/23-20:07:56.117572 139957651584576 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278636.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129433 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.79 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1016.97 avg-zval = 311.66 2024/11/23-20:07:56.117739 139957651584576 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278636.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-20:07:56.286372 139957651584576 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278636.sst): second pass time = 1.20's, 109.915'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.17's, 251.234'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2494.597'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.259'MB/sec write SST data time = 0.04's, 967.676'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 21029.280'MB/sec zip my value time = 1.20's, unzip length = 0.132'GB zip my value throughput = 109.915'MB/sec zip pipeline throughput = 118.157'MB/sec entries = 129433 avg-key = 20.00 avg-zkey = 1.79 avg-val = 1016.97 avg-zval = 311.66 usrkeys = 129433 avg-key = 12.00 avg-zkey = 1.79 avg-val = 1023.97 avg-zval = 311.66 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129433 bytes = 485392 } seq expand size = 906031 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0424 GB } UnZip/Zip{ index = 6.6948 value = 3.2631 dict = 1.00 all = 3.1628 } Zip/UnZip{ index = 0.1494 value = 0.3065 dict = 1.00 all = 0.3162 } ---------------------------- total value len = 9.511297 GB avg = 0.179 KB (by entry num) total key len = 1.453764 GB avg = 0.027 KB total ukey len = 1.005644 GB avg = 0.015 KB total ukey num = 0.066197600 Billion total entry num = 0.053005329 Billion write speed all = 0.271654005 MB/sec (with seq num) write speed all = 0.261148558 MB/sec (without seq num) 2024/11/23-20:07:56.344159 139957651584576 [compaction_job.cc:1948] [default] [JOB 34855] Generated table #278636: 129433 keys, 42436370 bytes, temperature: kWarm 2024/11/23-20:07:56.344225 139957651584576 EVENT_LOG_v1 {"time_micros": 1732363676344191, "cf_name": "default", "job": 34855, "event": "table_file_creation", "file_number": 278636, "file_size": 42436370, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237869923, "largest_seqno": 4235019037, "table_properties": {"data_size": 40338832, "index_size": 232000, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588660, "raw_average_key_size": 20, "raw_value_size": 131629755, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129433, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732363674, "oldest_key_time": 0, "file_creation_time": 1732363674, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 278636, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-20:07:56.382098 139957651584576 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278637.sst) /dev/shm/ToplingTemp/Topling-175297-ktoWQm 2024/11/23-20:07:57.033839 139957651584576 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278637.sst): first pass time = 0.65's, 205.948'MB/sec 2024/11/23-20:07:57.856569 139957651584576 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278637.sst): old prealloc_size = 147639500, real_size = 40585008 2024/11/23-20:07:57.856721 139957651584576 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278637.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129430 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.79 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1016.99 avg-zval = 311.52 2024/11/23-20:07:57.856898 139957651584576 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278637.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-20:07:58.031013 139957651584576 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278637.sst): second pass time = 0.82's, 160.129'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.17's, 243.211'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1665.257'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.266'MB/sec write SST data time = 0.05's, 804.426'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 46796.142'MB/sec zip my value time = 0.82's, unzip length = 0.132'GB zip my value throughput = 160.129'MB/sec zip pipeline throughput = 160.129'MB/sec entries = 129430 avg-key = 20.00 avg-zkey = 1.79 avg-val = 1016.99 avg-zval = 311.52 usrkeys = 129430 avg-key = 12.00 avg-zkey = 1.79 avg-val = 1023.99 avg-zval = 311.52 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129430 bytes = 485376 } seq expand size = 906010 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0424 GB } UnZip/Zip{ index = 6.6854 value = 3.2646 dict = 1.00 all = 3.1642 } Zip/UnZip{ index = 0.1496 value = 0.3063 dict = 1.00 all = 0.3160 } ---------------------------- total value len = 9.643833 GB avg = 0.181 KB (by entry num) total key len = 1.456353 GB avg = 0.027 KB total ukey len = 1.007197 GB avg = 0.015 KB total ukey num = 0.066327030 Billion total entry num = 0.053134759 Billion write speed all = 0.274989749 MB/sec (with seq num) write speed all = 0.264459104 MB/sec (without seq num) 2024/11/23-20:07:58.087292 139957651584576 [compaction_job.cc:1948] [default] [JOB 34855] Generated table #278637: 129430 keys, 42417579 bytes, temperature: kWarm 2024/11/23-20:07:58.087356 139957651584576 EVENT_LOG_v1 {"time_micros": 1732363678087321, "cf_name": "default", "job": 34855, "event": "table_file_creation", "file_number": 278637, "file_size": 42417579, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237872175, "largest_seqno": 4235015134, "table_properties": {"data_size": 40320160, "index_size": 232320, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588600, "raw_average_key_size": 20, "raw_value_size": 131629335, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129430, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732363676, "oldest_key_time": 0, "file_creation_time": 1732363676, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 278637, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-20:07:58.130694 139957651584576 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278638.sst) /dev/shm/ToplingTemp/Topling-175297-JzKxAj 2024/11/23-20:07:58.753910 139957651584576 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278638.sst): first pass time = 0.62's, 215.383'MB/sec 2024/11/23-20:07:59.687373 139957651584576 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278638.sst): old prealloc_size = 147639500, real_size = 40814656 2024/11/23-20:07:59.687505 139957651584576 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278638.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129429 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.77 raw-val = 0.1316 GB zip-val = 0.0406 GB avg-val =1017.00 avg-zval = 313.33 2024/11/23-20:07:59.687665 139957651584576 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278638.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-20:07:59.851467 139957651584576 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278638.sst): second pass time = 0.93's, 141.115'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 259.937'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2081.576'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.275'MB/sec write SST data time = 0.05's, 920.489'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 46605.606'MB/sec zip my value time = 0.93's, unzip length = 0.132'GB zip my value throughput = 141.115'MB/sec zip pipeline throughput = 141.115'MB/sec entries = 129429 avg-key = 20.00 avg-zkey = 1.77 avg-val = 1017.00 avg-zval = 313.33 usrkeys = 129429 avg-key = 12.00 avg-zkey = 1.77 avg-val = 1024.00 avg-zval = 313.33 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129429 bytes = 485376 } seq expand size = 906003 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0406 GB dict = 1.38 MB all = 0.0426 GB } UnZip/Zip{ index = 6.7977 value = 3.2458 dict = 1.00 all = 3.1471 } Zip/UnZip{ index = 0.1471 value = 0.3081 dict = 1.00 all = 0.3177 } ---------------------------- total value len = 9.776369 GB avg = 0.184 KB (by entry num) total key len = 1.458942 GB avg = 0.027 KB total ukey len = 1.008750 GB avg = 0.015 KB total ukey num = 0.066456459 Billion total entry num = 0.053264188 Billion write speed all = 0.278324695 MB/sec (with seq num) write speed all = 0.267768875 MB/sec (without seq num) 2024/11/23-20:07:59.904939 139957651584576 [compaction_job.cc:1948] [default] [JOB 34855] Generated table #278638: 129429 keys, 42647893 bytes, temperature: kWarm 2024/11/23-20:07:59.905019 139957651584576 EVENT_LOG_v1 {"time_micros": 1732363679904972, "cf_name": "default", "job": 34855, "event": "table_file_creation", "file_number": 278638, "file_size": 42647893, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237885133, "largest_seqno": 4235016743, "table_properties": {"data_size": 40553648, "index_size": 228480, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588580, "raw_average_key_size": 20, "raw_value_size": 131629927, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129429, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732363678, "oldest_key_time": 0, "file_creation_time": 1732363678, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 278638, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-20:07:59.946871 139957651584576 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278639.sst) /dev/shm/ToplingTemp/Topling-175297-JGzivl 2024/11/23-20:08:00.487776 139957651584576 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278639.sst): first pass time = 0.54's, 248.154'MB/sec 2024/11/23-20:08:01.388063 139957651584576 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278639.sst): old prealloc_size = 147639500, real_size = 40997056 2024/11/23-20:08:01.388210 139957651584576 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278639.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129427 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.73 raw-val = 0.1316 GB zip-val = 0.0407 GB avg-val =1017.02 avg-zval = 314.78 2024/11/23-20:08:01.388410 139957651584576 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278639.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-20:08:01.568075 139957651584576 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278639.sst): second pass time = 0.90's, 146.347'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.18's, 237.935'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1857.251'MB/sec (index lex order gen) rebuild zvType time = 0.13's, 0.246'MB/sec write SST data time = 0.05's, 884.736'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.379'MB, throughput = 43515.182'MB/sec zip my value time = 0.90's, unzip length = 0.132'GB zip my value throughput = 146.347'MB/sec zip pipeline throughput = 146.347'MB/sec entries = 129427 avg-key = 20.00 avg-zkey = 1.73 avg-val = 1017.02 avg-zval = 314.78 usrkeys = 129427 avg-key = 12.00 avg-zkey = 1.73 avg-val = 1024.02 avg-zval = 314.78 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129427 bytes = 485360 } seq expand size = 905989 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0407 GB dict = 1.38 MB all = 0.0428 GB } UnZip/Zip{ index = 6.9395 value = 3.2309 dict = 1.00 all = 3.1337 } Zip/UnZip{ index = 0.1441 value = 0.3095 dict = 1.00 all = 0.3191 } ---------------------------- total value len = 9.908904 GB avg = 0.186 KB (by entry num) total key len = 1.461530 GB avg = 0.027 KB total ukey len = 1.010303 GB avg = 0.015 KB total ukey num = 0.066585886 Billion total entry num = 0.053393615 Billion write speed all = 0.281660050 MB/sec (with seq num) write speed all = 0.271079031 MB/sec (without seq num) 2024/11/23-20:08:01.624083 139957651584576 [compaction_job.cc:1948] [default] [JOB 34855] Generated table #278639: 129427 keys, 42830423 bytes, temperature: kWarm 2024/11/23-20:08:01.624150 139957651584576 EVENT_LOG_v1 {"time_micros": 1732363681624117, "cf_name": "default", "job": 34855, "event": "table_file_creation", "file_number": 278639, "file_size": 42830423, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237880987, "largest_seqno": 4234944391, "table_properties": {"data_size": 40740720, "index_size": 223808, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588540, "raw_average_key_size": 20, "raw_value_size": 131629370, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129427, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732363679, "oldest_key_time": 0, "file_creation_time": 1732363679, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 278639, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-20:08:01.661927 139957651584576 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278640.sst) /dev/shm/ToplingTemp/Topling-175297-v59jYj 2024/11/23-20:08:02.249082 139957651584576 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278640.sst): first pass time = 0.59's, 228.608'MB/sec 2024/11/23-20:08:03.196727 139957651584576 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278640.sst): old prealloc_size = 147639500, real_size = 41020512 2024/11/23-20:08:03.196849 139957651584576 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278640.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129431 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.71 raw-val = 0.1316 GB zip-val = 0.0408 GB avg-val =1016.99 avg-zval = 314.97 2024/11/23-20:08:03.197028 139957651584576 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278640.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-20:08:03.358740 139957651584576 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278640.sst): second pass time = 0.95's, 138.992'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 264.542'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2199.225'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.273'MB/sec write SST data time = 0.04's, 991.937'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 49758.646'MB/sec zip my value time = 0.95's, unzip length = 0.132'GB zip my value throughput = 138.992'MB/sec zip pipeline throughput = 138.992'MB/sec entries = 129431 avg-key = 20.00 avg-zkey = 1.71 avg-val = 1016.99 avg-zval = 314.97 usrkeys = 129431 avg-key = 12.00 avg-zkey = 1.71 avg-val = 1023.99 avg-zval = 314.97 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129431 bytes = 485376 } seq expand size = 906017 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0408 GB dict = 1.38 MB all = 0.0429 GB } UnZip/Zip{ index = 7.0343 value = 3.2288 dict = 1.00 all = 3.1320 } Zip/UnZip{ index = 0.1422 value = 0.3097 dict = 1.00 all = 0.3193 } ---------------------------- total value len = 10.041440 GB avg = 0.188 KB (by entry num) total key len = 1.464119 GB avg = 0.027 KB total ukey len = 1.011857 GB avg = 0.015 KB total ukey num = 0.066715317 Billion total entry num = 0.053523046 Billion write speed all = 0.284994614 MB/sec (with seq num) write speed all = 0.274388415 MB/sec (without seq num) 2024/11/23-20:08:03.411197 139957651584576 [compaction_job.cc:1948] [default] [JOB 34855] Generated table #278640: 129431 keys, 42853677 bytes, temperature: kWarm 2024/11/23-20:08:03.411278 139957651584576 EVENT_LOG_v1 {"time_micros": 1732363683411233, "cf_name": "default", "job": 34855, "event": "table_file_creation", "file_number": 278640, "file_size": 42853677, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237868290, "largest_seqno": 4235020486, "table_properties": {"data_size": 40767184, "index_size": 220800, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588620, "raw_average_key_size": 20, "raw_value_size": 131629866, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129431, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732363681, "oldest_key_time": 0, "file_creation_time": 1732363681, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 278640, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-20:08:03.448158 139957651584576 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278641.sst) /dev/shm/ToplingTemp/Topling-175297-glVZbk 2024/11/23-20:08:03.958519 139957651584576 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278641.sst): first pass time = 0.51's, 263.008'MB/sec 2024/11/23-20:08:04.775729 139957651584576 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278641.sst): old prealloc_size = 147639500, real_size = 40804528 2024/11/23-20:08:04.775852 139957651584576 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278641.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129432 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.76 raw-val = 0.1316 GB zip-val = 0.0405 GB avg-val =1016.98 avg-zval = 313.24 2024/11/23-20:08:04.776039 139957651584576 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278641.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-20:08:04.937318 139957651584576 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278641.sst): second pass time = 0.82's, 161.212'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 263.896'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2297.086'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.274'MB/sec write SST data time = 0.04's, 987.158'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 44569.918'MB/sec zip my value time = 0.82's, unzip length = 0.132'GB zip my value throughput = 161.212'MB/sec zip pipeline throughput = 161.212'MB/sec entries = 129432 avg-key = 20.00 avg-zkey = 1.76 avg-val = 1016.98 avg-zval = 313.24 usrkeys = 129432 avg-key = 12.00 avg-zkey = 1.76 avg-val = 1023.98 avg-zval = 313.24 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129432 bytes = 485392 } seq expand size = 906024 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0405 GB dict = 1.38 MB all = 0.0426 GB } UnZip/Zip{ index = 6.8093 value = 3.2466 dict = 1.00 all = 3.1479 } Zip/UnZip{ index = 0.1469 value = 0.3080 dict = 1.00 all = 0.3177 } ---------------------------- total value len = 10.173976 GB avg = 0.190 KB (by entry num) total key len = 1.466707 GB avg = 0.027 KB total ukey len = 1.013410 GB avg = 0.015 KB total ukey num = 0.066844749 Billion total entry num = 0.053652478 Billion write speed all = 0.288330393 MB/sec (with seq num) write speed all = 0.277698961 MB/sec (without seq num) 2024/11/23-20:08:04.989355 139957651584576 [compaction_job.cc:1948] [default] [JOB 34855] Generated table #278641: 129432 keys, 42637518 bytes, temperature: kWarm 2024/11/23-20:08:04.989428 139957651584576 EVENT_LOG_v1 {"time_micros": 1732363684989391, "cf_name": "default", "job": 34855, "event": "table_file_creation", "file_number": 278641, "file_size": 42637518, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237874127, "largest_seqno": 4235020488, "table_properties": {"data_size": 40543904, "index_size": 228096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588640, "raw_average_key_size": 20, "raw_value_size": 131629699, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129432, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732363683, "oldest_key_time": 0, "file_creation_time": 1732363683, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 278641, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-20:08:05.029455 139957651584576 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278642.sst) /dev/shm/ToplingTemp/Topling-175297-9A46Xm 2024/11/23-20:08:05.531278 139957651584576 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278642.sst): first pass time = 0.50's, 267.486'MB/sec 2024/11/23-20:08:06.501643 139957651584576 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278642.sst): old prealloc_size = 147639500, real_size = 40586128 2024/11/23-20:08:06.501773 139957651584576 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278642.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129431 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.79 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1016.98 avg-zval = 311.53 2024/11/23-20:08:06.502175 139957651584576 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278642.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-20:08:06.660806 139957651584576 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278642.sst): second pass time = 0.97's, 135.749'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 266.558'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2178.606'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.279'MB/sec write SST data time = 0.04's, 989.334'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.379'MB, throughput = 34689.304'MB/sec zip my value time = 0.97's, unzip length = 0.132'GB zip my value throughput = 135.749'MB/sec zip pipeline throughput = 201.882'MB/sec entries = 129431 avg-key = 20.00 avg-zkey = 1.79 avg-val = 1016.98 avg-zval = 311.53 usrkeys = 129431 avg-key = 12.00 avg-zkey = 1.79 avg-val = 1023.98 avg-zval = 311.53 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129431 bytes = 485376 } seq expand size = 906017 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0424 GB } UnZip/Zip{ index = 6.6855 value = 3.2645 dict = 1.00 all = 3.1641 } Zip/UnZip{ index = 0.1496 value = 0.3063 dict = 1.00 all = 0.3160 } ---------------------------- total value len = 10.306511 GB avg = 0.192 KB (by entry num) total key len = 1.469296 GB avg = 0.027 KB total ukey len = 1.014963 GB avg = 0.015 KB total ukey num = 0.066974180 Billion total entry num = 0.053781909 Billion write speed all = 0.291664852 MB/sec (with seq num) write speed all = 0.281008228 MB/sec (without seq num) 2024/11/23-20:08:06.712458 139957651584576 [compaction_job.cc:1948] [default] [JOB 34855] Generated table #278642: 129431 keys, 42419552 bytes, temperature: kWarm 2024/11/23-20:08:06.712526 139957651584576 EVENT_LOG_v1 {"time_micros": 1732363686712489, "cf_name": "default", "job": 34855, "event": "table_file_creation", "file_number": 278642, "file_size": 42419552, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237873877, "largest_seqno": 4235013729, "table_properties": {"data_size": 40321280, "index_size": 232320, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588620, "raw_average_key_size": 20, "raw_value_size": 131629245, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129431, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732363685, "oldest_key_time": 0, "file_creation_time": 1732363685, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 278642, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-20:08:06.747794 139957651584576 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278643.sst) /dev/shm/ToplingTemp/Topling-175297-QhotVi 2024/11/23-20:08:07.378443 139957651584576 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278643.sst): first pass time = 0.63's, 212.835'MB/sec 2024/11/23-20:08:08.196144 139957651584576 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278643.sst): old prealloc_size = 147639500, real_size = 40585408 2024/11/23-20:08:08.196279 139957651584576 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278643.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129428 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.79 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1017.01 avg-zval = 311.53 2024/11/23-20:08:08.196433 139957651584576 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278643.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-20:08:08.357481 139957651584576 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278643.sst): second pass time = 0.82's, 161.308'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 262.958'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2045.413'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.272'MB/sec write SST data time = 0.04's, 999.754'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.379'MB, throughput = 36928.506'MB/sec zip my value time = 0.82's, unzip length = 0.132'GB zip my value throughput = 161.308'MB/sec zip pipeline throughput = 161.308'MB/sec entries = 129428 avg-key = 20.00 avg-zkey = 1.79 avg-val = 1017.01 avg-zval = 311.53 usrkeys = 129428 avg-key = 12.00 avg-zkey = 1.79 avg-val = 1024.01 avg-zval = 311.53 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129428 bytes = 485376 } seq expand size = 905996 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0424 GB } UnZip/Zip{ index = 6.6853 value = 3.2646 dict = 1.00 all = 3.1641 } Zip/UnZip{ index = 0.1496 value = 0.3063 dict = 1.00 all = 0.3160 } ---------------------------- total value len = 10.439046 GB avg = 0.194 KB (by entry num) total key len = 1.471885 GB avg = 0.027 KB total ukey len = 1.016516 GB avg = 0.015 KB total ukey num = 0.067103608 Billion total entry num = 0.053911337 Billion write speed all = 0.294999224 MB/sec (with seq num) write speed all = 0.284317404 MB/sec (without seq num) 2024/11/23-20:08:08.416248 139957651584576 [compaction_job.cc:1948] [default] [JOB 34855] Generated table #278643: 129428 keys, 42418806 bytes, temperature: kWarm 2024/11/23-20:08:08.416307 139957651584576 EVENT_LOG_v1 {"time_micros": 1732363688416274, "cf_name": "default", "job": 34855, "event": "table_file_creation", "file_number": 278643, "file_size": 42418806, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237872082, "largest_seqno": 4235019249, "table_properties": {"data_size": 40320560, "index_size": 232320, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588560, "raw_average_key_size": 20, "raw_value_size": 131629378, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129428, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732363686, "oldest_key_time": 0, "file_creation_time": 1732363686, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 278643, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-20:08:08.451575 139957651584576 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278644.sst) /dev/shm/ToplingTemp/Topling-175297-sQ8yRi 2024/11/23-20:08:09.056088 139957651584576 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278644.sst): first pass time = 0.60's, 222.039'MB/sec 2024/11/23-20:08:09.964225 139957651584576 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278644.sst): old prealloc_size = 147639500, real_size = 41023024 2024/11/23-20:08:09.964389 139957651584576 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278644.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129429 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.73 raw-val = 0.1316 GB zip-val = 0.0408 GB avg-val =1017.00 avg-zval = 314.97 2024/11/23-20:08:09.964572 139957651584576 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278644.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-20:08:10.184581 139957651584576 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278644.sst): second pass time = 0.91's, 145.074'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.22's, 194.498'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1755.977'MB/sec (index lex order gen) rebuild zvType time = 0.17's, 0.185'MB/sec write SST data time = 0.05's, 940.866'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 43352.157'MB/sec zip my value time = 0.91's, unzip length = 0.132'GB zip my value throughput = 145.074'MB/sec zip pipeline throughput = 151.499'MB/sec entries = 129429 avg-key = 20.00 avg-zkey = 1.73 avg-val = 1017.00 avg-zval = 314.97 usrkeys = 129429 avg-key = 12.00 avg-zkey = 1.73 avg-val = 1024.00 avg-zval = 314.97 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129429 bytes = 485376 } seq expand size = 906003 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0408 GB dict = 1.38 MB all = 0.0429 GB } UnZip/Zip{ index = 6.9396 value = 3.2288 dict = 1.00 all = 3.1318 } Zip/UnZip{ index = 0.1441 value = 0.3097 dict = 1.00 all = 0.3193 } ---------------------------- total value len = 10.571581 GB avg = 0.196 KB (by entry num) total key len = 1.474473 GB avg = 0.027 KB total ukey len = 1.018069 GB avg = 0.015 KB total ukey num = 0.067233037 Billion total entry num = 0.054040766 Billion write speed all = 0.298332349 MB/sec (with seq num) write speed all = 0.287625369 MB/sec (without seq num) 2024/11/23-20:08:10.237789 139957651584576 [compaction_job.cc:1948] [default] [JOB 34855] Generated table #278644: 129429 keys, 42855858 bytes, temperature: kWarm 2024/11/23-20:08:10.237856 139957651584576 EVENT_LOG_v1 {"time_micros": 1732363690237821, "cf_name": "default", "job": 34855, "event": "table_file_creation", "file_number": 278644, "file_size": 42855858, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237888398, "largest_seqno": 4235012413, "table_properties": {"data_size": 40766688, "index_size": 223808, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588580, "raw_average_key_size": 20, "raw_value_size": 131629233, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129429, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732363688, "oldest_key_time": 0, "file_creation_time": 1732363688, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 278644, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-20:08:10.274153 139957651584576 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278645.sst) /dev/shm/ToplingTemp/Topling-175297-qps1uk 2024/11/23-20:08:10.907737 139957651584576 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278645.sst): first pass time = 0.63's, 211.853'MB/sec 2024/11/23-20:08:11.692059 139957651584576 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278645.sst): old prealloc_size = 147639500, real_size = 40694640 2024/11/23-20:08:11.692176 139957651584576 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278645.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129424 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.78 raw-val = 0.1316 GB zip-val = 0.0404 GB avg-val =1017.04 avg-zval = 312.40 2024/11/23-20:08:11.692348 139957651584576 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278645.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-20:08:11.857544 139957651584576 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278645.sst): second pass time = 0.78's, 168.184'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.17's, 257.022'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2354.950'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.267'MB/sec write SST data time = 0.04's, 958.133'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 47411.662'MB/sec zip my value time = 0.78's, unzip length = 0.132'GB zip my value throughput = 168.184'MB/sec zip pipeline throughput = 168.184'MB/sec entries = 129424 avg-key = 20.00 avg-zkey = 1.78 avg-val = 1017.04 avg-zval = 312.40 usrkeys = 129424 avg-key = 12.00 avg-zkey = 1.78 avg-val = 1024.04 avg-zval = 312.40 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129424 bytes = 485360 } seq expand size = 905968 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0404 GB dict = 1.38 MB all = 0.0425 GB } UnZip/Zip{ index = 6.7352 value = 3.2556 dict = 1.00 all = 3.1560 } Zip/UnZip{ index = 0.1485 value = 0.3072 dict = 1.00 all = 0.3169 } ---------------------------- total value len = 10.704117 GB avg = 0.198 KB (by entry num) total key len = 1.477062 GB avg = 0.027 KB total ukey len = 1.019622 GB avg = 0.015 KB total ukey num = 0.067362461 Billion total entry num = 0.054170190 Billion write speed all = 0.301666338 MB/sec (with seq num) write speed all = 0.290934160 MB/sec (without seq num) 2024/11/23-20:08:11.910646 139957651584576 [compaction_job.cc:1948] [default] [JOB 34855] Generated table #278645: 129424 keys, 42527632 bytes, temperature: kWarm 2024/11/23-20:08:11.910715 139957651584576 EVENT_LOG_v1 {"time_micros": 1732363691910677, "cf_name": "default", "job": 34855, "event": "table_file_creation", "file_number": 278645, "file_size": 42527632, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237871365, "largest_seqno": 4235019870, "table_properties": {"data_size": 40431520, "index_size": 230592, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588480, "raw_average_key_size": 20, "raw_value_size": 131629933, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129424, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732363690, "oldest_key_time": 0, "file_creation_time": 1732363690, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 278645, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-20:08:11.952175 139957651584576 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278646.sst) /dev/shm/ToplingTemp/Topling-175297-T32bMj 2024/11/23-20:08:12.572531 139957651584576 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278646.sst): first pass time = 0.62's, 216.370'MB/sec 2024/11/23-20:08:13.348417 139957651584576 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278646.sst): old prealloc_size = 147639500, real_size = 40539840 2024/11/23-20:08:13.348537 139957651584576 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278646.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129431 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.74 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1016.99 avg-zval = 311.22 2024/11/23-20:08:13.348661 139957651584576 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278646.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-20:08:13.510531 139957651584576 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278646.sst): second pass time = 0.78's, 169.804'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 260.172'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2247.302'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.276'MB/sec write SST data time = 0.04's, 939.166'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 49313.827'MB/sec zip my value time = 0.78's, unzip length = 0.132'GB zip my value throughput = 169.804'MB/sec zip pipeline throughput = 169.804'MB/sec entries = 129431 avg-key = 20.00 avg-zkey = 1.74 avg-val = 1016.99 avg-zval = 311.22 usrkeys = 129431 avg-key = 12.00 avg-zkey = 1.74 avg-val = 1020.80 avg-zval = 311.22 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 70586 bytes = 264720 } seq expand size = 494102 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0422 GB } UnZip/Zip{ index = 6.8807 value = 3.2677 dict = 1.00 all = 3.1826 } Zip/UnZip{ index = 0.1453 value = 0.3060 dict = 1.00 all = 0.3142 } ---------------------------- total value len = 10.836241 GB avg = 0.200 KB (by entry num) total key len = 1.479650 GB avg = 0.027 KB total ukey len = 1.021175 GB avg = 0.015 KB total ukey num = 0.067491892 Billion total entry num = 0.054299621 Billion write speed all = 0.304990000 MB/sec (with seq num) write speed all = 0.294232619 MB/sec (without seq num) 2024/11/23-20:08:13.569384 139957651584576 [compaction_job.cc:1948] [default] [JOB 34855] Generated table #278646: 129431 keys, 42172018 bytes, temperature: kWarm 2024/11/23-20:08:13.569442 139957651584576 EVENT_LOG_v1 {"time_micros": 1732363693569410, "cf_name": "default", "job": 34855, "event": "table_file_creation", "file_number": 278646, "file_size": 42172018, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4235019307, "table_properties": {"data_size": 40281584, "index_size": 225728, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588620, "raw_average_key_size": 20, "raw_value_size": 131629706, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129431, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732363691, "oldest_key_time": 0, "file_creation_time": 1732363691, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 278646, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-20:08:13.605465 139957651584576 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278647.sst) /dev/shm/ToplingTemp/Topling-175297-F9yl9m 2024/11/23-20:08:14.321572 139957651584576 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278647.sst): first pass time = 0.72's, 187.437'MB/sec 2024/11/23-20:08:15.109795 139957651584576 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278647.sst): old prealloc_size = 147639500, real_size = 40612784 2024/11/23-20:08:15.109920 139957651584576 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278647.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129427 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.73 raw-val = 0.1316 GB zip-val = 0.0404 GB avg-val =1017.02 avg-zval = 311.81 2024/11/23-20:08:15.110050 139957651584576 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278647.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-20:08:15.276530 139957651584576 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278647.sst): second pass time = 0.79's, 167.147'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.17's, 253.253'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2178.999'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.269'MB/sec write SST data time = 0.05's, 909.737'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 50418.105'MB/sec zip my value time = 0.79's, unzip length = 0.132'GB zip my value throughput = 167.147'MB/sec zip pipeline throughput = 167.152'MB/sec entries = 129427 avg-key = 20.00 avg-zkey = 1.73 avg-val = 1017.02 avg-zval = 311.81 usrkeys = 129427 avg-key = 12.00 avg-zkey = 1.73 avg-val = 1020.47 avg-zval = 311.81 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 63723 bytes = 238976 } seq expand size = 446061 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0404 GB dict = 1.38 MB all = 0.0422 GB } UnZip/Zip{ index = 6.9257 value = 3.2617 dict = 1.00 all = 3.1790 } Zip/UnZip{ index = 0.1444 value = 0.3066 dict = 1.00 all = 0.3146 } ---------------------------- total value len = 10.968317 GB avg = 0.202 KB (by entry num) total key len = 1.482239 GB avg = 0.027 KB total ukey len = 1.022729 GB avg = 0.015 KB total ukey num = 0.067621319 Billion total entry num = 0.054429048 Billion write speed all = 0.308311347 MB/sec (with seq num) write speed all = 0.297528797 MB/sec (without seq num) 2024/11/23-20:08:15.331142 139957651584576 [compaction_job.cc:1948] [default] [JOB 34855] Generated table #278647: 129427 keys, 42219902 bytes, temperature: kWarm 2024/11/23-20:08:15.331212 139957651584576 EVENT_LOG_v1 {"time_micros": 1732363695331175, "cf_name": "default", "job": 34855, "event": "table_file_creation", "file_number": 278647, "file_size": 42219902, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4235017513, "table_properties": {"data_size": 40356000, "index_size": 224256, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588540, "raw_average_key_size": 20, "raw_value_size": 131630164, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129427, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732363693, "oldest_key_time": 0, "file_creation_time": 1732363693, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 278647, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-20:08:15.370902 139957651584576 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278648.sst) /dev/shm/ToplingTemp/Topling-175297-lzoD0i 2024/11/23-20:08:16.046936 139957651584576 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278648.sst): first pass time = 0.68's, 198.551'MB/sec 2024/11/23-20:08:17.192257 139957651584576 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278648.sst): old prealloc_size = 147639500, real_size = 41073552 2024/11/23-20:08:17.192402 139957651584576 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278648.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129426 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.71 raw-val = 0.1316 GB zip-val = 0.0408 GB avg-val =1017.03 avg-zval = 315.39 2024/11/23-20:08:17.192580 139957651584576 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278648.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-20:08:17.446902 139957651584576 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278648.sst): second pass time = 1.14's, 115.014'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.25's, 168.467'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1773.868'MB/sec (index lex order gen) rebuild zvType time = 0.19's, 0.167'MB/sec write SST data time = 0.06's, 706.374'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 34748.097'MB/sec zip my value time = 1.14's, unzip length = 0.132'GB zip my value throughput = 115.014'MB/sec zip pipeline throughput = 204.299'MB/sec entries = 129426 avg-key = 20.00 avg-zkey = 1.71 avg-val = 1017.03 avg-zval = 315.39 usrkeys = 129426 avg-key = 12.00 avg-zkey = 1.71 avg-val = 1023.62 avg-zval = 315.39 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 121741 bytes = 456544 } seq expand size = 852187 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0408 GB dict = 1.38 MB all = 0.0429 GB } UnZip/Zip{ index = 7.0016 value = 3.2247 dict = 1.00 all = 3.1288 } Zip/UnZip{ index = 0.1428 value = 0.3101 dict = 1.00 all = 0.3196 } ---------------------------- total value len = 11.100800 GB avg = 0.203 KB (by entry num) total key len = 1.484827 GB avg = 0.027 KB total ukey len = 1.024282 GB avg = 0.015 KB total ukey num = 0.067750745 Billion total entry num = 0.054558474 Billion write speed all = 0.311639340 MB/sec (with seq num) write speed all = 0.300831731 MB/sec (without seq num) 2024/11/23-20:08:17.499174 139957651584576 [compaction_job.cc:1948] [default] [JOB 34855] Generated table #278648: 129426 keys, 42898125 bytes, temperature: kWarm 2024/11/23-20:08:17.499250 139957651584576 EVENT_LOG_v1 {"time_micros": 1732363697499210, "cf_name": "default", "job": 34855, "event": "table_file_creation", "file_number": 278648, "file_size": 42898125, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4235016186, "table_properties": {"data_size": 40819200, "index_size": 221824, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588520, "raw_average_key_size": 20, "raw_value_size": 131630225, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129426, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732363695, "oldest_key_time": 0, "file_creation_time": 1732363695, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 278648, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-20:08:17.537700 139957651584576 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278649.sst) /dev/shm/ToplingTemp/Topling-175297-dp7wuk 2024/11/23-20:08:18.057150 139957651584576 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278649.sst): first pass time = 0.52's, 258.404'MB/sec 2024/11/23-20:08:18.895618 139957651584576 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278649.sst): old prealloc_size = 147639500, real_size = 40567776 2024/11/23-20:08:18.895740 139957651584576 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278649.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129430 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.77 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1017.00 avg-zval = 311.42 2024/11/23-20:08:18.895877 139957651584576 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278649.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-20:08:19.069139 139957651584576 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278649.sst): second pass time = 0.84's, 157.125'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.17's, 243.670'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2303.745'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.260'MB/sec write SST data time = 0.05's, 866.395'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 33822.595'MB/sec zip my value time = 0.84's, unzip length = 0.132'GB zip my value throughput = 157.125'MB/sec zip pipeline throughput = 157.125'MB/sec entries = 129430 avg-key = 20.00 avg-zkey = 1.77 avg-val = 1017.00 avg-zval = 311.42 usrkeys = 129430 avg-key = 12.00 avg-zkey = 1.77 avg-val = 1021.96 avg-zval = 311.42 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 91752 bytes = 344080 } seq expand size = 642264 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0423 GB } UnZip/Zip{ index = 6.7921 value = 3.2657 dict = 1.00 all = 3.1745 } Zip/UnZip{ index = 0.1472 value = 0.3062 dict = 1.00 all = 0.3150 } ---------------------------- total value len = 11.233072 GB avg = 0.205 KB (by entry num) total key len = 1.487416 GB avg = 0.027 KB total ukey len = 1.025835 GB avg = 0.015 KB total ukey num = 0.067880175 Billion total entry num = 0.054687904 Billion write speed all = 0.314966050 MB/sec (with seq num) write speed all = 0.304133238 MB/sec (without seq num) 2024/11/23-20:08:19.120931 139957651584576 [compaction_job.cc:1948] [default] [JOB 34855] Generated table #278649: 129430 keys, 42279665 bytes, temperature: kWarm 2024/11/23-20:08:19.121013 139957651584576 EVENT_LOG_v1 {"time_micros": 1732363699120961, "cf_name": "default", "job": 34855, "event": "table_file_creation", "file_number": 278649, "file_size": 42279665, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4235020127, "table_properties": {"data_size": 40306576, "index_size": 228672, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588600, "raw_average_key_size": 20, "raw_value_size": 131630067, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129430, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732363697, "oldest_key_time": 0, "file_creation_time": 1732363697, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 278649, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-20:08:19.162292 139957651584576 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278650.sst) /dev/shm/ToplingTemp/Topling-175297-NKbCzm 2024/11/23-20:08:19.686464 139957651584576 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278650.sst): first pass time = 0.52's, 256.078'MB/sec 2024/11/23-20:08:20.529507 139957651584576 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278650.sst): old prealloc_size = 147639500, real_size = 40507584 2024/11/23-20:08:20.529637 139957651584576 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278650.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129428 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.72 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1017.01 avg-zval = 311.01 2024/11/23-20:08:20.529723 139957651584576 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278650.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-20:08:20.693438 139957651584576 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278650.sst): second pass time = 0.84's, 156.262'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 256.265'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2037.712'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.274'MB/sec write SST data time = 0.05's, 921.532'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 40467.640'MB/sec zip my value time = 0.84's, unzip length = 0.132'GB zip my value throughput = 156.262'MB/sec zip pipeline throughput = 156.262'MB/sec entries = 129428 avg-key = 20.00 avg-zkey = 1.72 avg-val = 1017.01 avg-zval = 311.01 usrkeys = 129428 avg-key = 12.00 avg-zkey = 1.72 avg-val = 1018.86 avg-zval = 311.01 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 34181 bytes = 128192 } seq expand size = 239267 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0420 GB } UnZip/Zip{ index = 6.9936 value = 3.2701 dict = 1.00 all = 3.1954 } Zip/UnZip{ index = 0.1430 value = 0.3058 dict = 1.00 all = 0.3129 } ---------------------------- total value len = 11.364941 GB avg = 0.207 KB (by entry num) total key len = 1.490004 GB avg = 0.027 KB total ukey len = 1.027388 GB avg = 0.015 KB total ukey num = 0.068009603 Billion total entry num = 0.054817332 Billion write speed all = 0.318282486 MB/sec (with seq num) write speed all = 0.307424473 MB/sec (without seq num) 2024/11/23-20:08:20.744729 139957651584576 [compaction_job.cc:1948] [default] [JOB 34855] Generated table #278650: 129428 keys, 42003556 bytes, temperature: kWarm 2024/11/23-20:08:20.744802 139957651584576 EVENT_LOG_v1 {"time_micros": 1732363700744765, "cf_name": "default", "job": 34855, "event": "table_file_creation", "file_number": 278650, "file_size": 42003556, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4234980462, "table_properties": {"data_size": 40252976, "index_size": 222080, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588560, "raw_average_key_size": 20, "raw_value_size": 131629577, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129428, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732363699, "oldest_key_time": 0, "file_creation_time": 1732363699, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 278650, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-20:08:20.785381 139957651584576 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278651.sst) /dev/shm/ToplingTemp/Topling-175297-knVnql 2024/11/23-20:08:21.314945 139957651584576 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278651.sst): first pass time = 0.53's, 253.469'MB/sec 2024/11/23-20:08:22.090533 139957651584576 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278651.sst): old prealloc_size = 147639500, real_size = 40578224 2024/11/23-20:08:22.090659 139957651584576 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278651.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129427 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.72 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1017.02 avg-zval = 311.55 2024/11/23-20:08:22.090745 139957651584576 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278651.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-20:08:22.251675 139957651584576 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278651.sst): second pass time = 0.77's, 169.865'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 261.134'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2159.471'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.276'MB/sec write SST data time = 0.04's, 960.547'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 44333.998'MB/sec zip my value time = 0.77's, unzip length = 0.132'GB zip my value throughput = 169.865'MB/sec zip pipeline throughput = 169.865'MB/sec entries = 129427 avg-key = 20.00 avg-zkey = 1.72 avg-val = 1017.02 avg-zval = 311.55 usrkeys = 129427 avg-key = 12.00 avg-zkey = 1.72 avg-val = 1018.85 avg-zval = 311.55 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 33887 bytes = 127088 } seq expand size = 237209 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0421 GB } UnZip/Zip{ index = 6.9935 value = 3.2643 dict = 1.00 all = 3.1901 } Zip/UnZip{ index = 0.1430 value = 0.3063 dict = 1.00 all = 0.3135 } ---------------------------- total value len = 11.496808 GB avg = 0.209 KB (by entry num) total key len = 1.492593 GB avg = 0.027 KB total ukey len = 1.028941 GB avg = 0.015 KB total ukey num = 0.068139030 Billion total entry num = 0.054946759 Billion write speed all = 0.321599143 MB/sec (with seq num) write speed all = 0.310715913 MB/sec (without seq num) 2024/11/23-20:08:22.303550 139957651584576 [compaction_job.cc:1948] [default] [JOB 34855] Generated table #278651: 129427 keys, 42072984 bytes, temperature: kWarm 2024/11/23-20:08:22.303618 139957651584576 EVENT_LOG_v1 {"time_micros": 1732363702303582, "cf_name": "default", "job": 34855, "event": "table_file_creation", "file_number": 278651, "file_size": 42072984, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4235009539, "table_properties": {"data_size": 40323616, "index_size": 222080, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588540, "raw_average_key_size": 20, "raw_value_size": 131630085, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129427, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732363700, "oldest_key_time": 0, "file_creation_time": 1732363700, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 278651, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-20:08:22.356551 139957651584576 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278652.sst) /dev/shm/ToplingTemp/Topling-175297-cYEfTk 2024/11/23-20:08:22.966613 139957651584576 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278652.sst): first pass time = 0.61's, 220.022'MB/sec 2024/11/23-20:08:23.802669 139957651584576 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278652.sst): old prealloc_size = 147639500, real_size = 40469328 2024/11/23-20:08:23.802793 139957651584576 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278652.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129431 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.72 raw-val = 0.1316 GB zip-val = 0.0402 GB avg-val =1016.98 avg-zval = 310.70 2024/11/23-20:08:23.802879 139957651584576 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278652.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-20:08:23.965153 139957651584576 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278652.sst): second pass time = 0.84's, 157.586'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 258.286'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2179.991'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.277'MB/sec write SST data time = 0.05's, 917.848'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 45383.062'MB/sec zip my value time = 0.84's, unzip length = 0.132'GB zip my value throughput = 157.586'MB/sec zip pipeline throughput = 157.586'MB/sec entries = 129431 avg-key = 20.00 avg-zkey = 1.72 avg-val = 1016.98 avg-zval = 310.70 usrkeys = 129431 avg-key = 12.00 avg-zkey = 1.72 avg-val = 1018.79 avg-zval = 310.70 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 33356 bytes = 125104 } seq expand size = 233492 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0402 GB dict = 1.38 MB all = 0.0420 GB } UnZip/Zip{ index = 6.9938 value = 3.2732 dict = 1.00 all = 3.1986 } Zip/UnZip{ index = 0.1430 value = 0.3055 dict = 1.00 all = 0.3126 } ---------------------------- total value len = 11.628671 GB avg = 0.211 KB (by entry num) total key len = 1.495182 GB avg = 0.027 KB total ukey len = 1.030494 GB avg = 0.015 KB total ukey num = 0.068268461 Billion total entry num = 0.055076190 Billion write speed all = 0.324914185 MB/sec (with seq num) write speed all = 0.314005781 MB/sec (without seq num) 2024/11/23-20:08:24.019211 139957651584576 [compaction_job.cc:1948] [default] [JOB 34855] Generated table #278652: 129431 keys, 41961866 bytes, temperature: kWarm 2024/11/23-20:08:24.019287 139957651584576 EVENT_LOG_v1 {"time_micros": 1732363704019251, "cf_name": "default", "job": 34855, "event": "table_file_creation", "file_number": 278652, "file_size": 41961866, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4235014980, "table_properties": {"data_size": 40214720, "index_size": 222080, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588620, "raw_average_key_size": 20, "raw_value_size": 131629303, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129431, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732363702, "oldest_key_time": 0, "file_creation_time": 1732363702, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 278652, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-20:08:24.056753 139957651584576 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278653.sst) /dev/shm/ToplingTemp/Topling-175297-hgBN0i 2024/11/23-20:08:24.830263 139957651584576 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278653.sst): first pass time = 0.77's, 173.528'MB/sec 2024/11/23-20:08:25.779067 139957651584576 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278653.sst): old prealloc_size = 147639500, real_size = 41004944 2024/11/23-20:08:25.779183 139957651584576 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278653.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129432 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.72 raw-val = 0.1316 GB zip-val = 0.0407 GB avg-val =1016.98 avg-zval = 314.84 2024/11/23-20:08:25.779340 139957651584576 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278653.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-20:08:25.941003 139957651584576 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278653.sst): second pass time = 0.95's, 138.851'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 264.373'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2363.372'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.274'MB/sec write SST data time = 0.04's, 982.208'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 46905.882'MB/sec zip my value time = 0.95's, unzip length = 0.132'GB zip my value throughput = 138.851'MB/sec zip pipeline throughput = 138.851'MB/sec entries = 129432 avg-key = 20.00 avg-zkey = 1.72 avg-val = 1016.98 avg-zval = 314.84 usrkeys = 129432 avg-key = 12.00 avg-zkey = 1.72 avg-val = 1023.16 avg-zval = 314.84 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 114241 bytes = 428416 } seq expand size = 799687 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0407 GB dict = 1.38 MB all = 0.0428 GB } UnZip/Zip{ index = 6.9797 value = 3.2302 dict = 1.00 all = 3.1359 } Zip/UnZip{ index = 0.1433 value = 0.3096 dict = 1.00 all = 0.3189 } ---------------------------- total value len = 11.761101 GB avg = 0.213 KB (by entry num) total key len = 1.497770 GB avg = 0.027 KB total ukey len = 1.032048 GB avg = 0.015 KB total ukey num = 0.068397893 Billion total entry num = 0.055205622 Billion write speed all = 0.328240844 MB/sec (with seq num) write speed all = 0.317307340 MB/sec (without seq num) 2024/11/23-20:08:25.992397 139957651584576 [compaction_job.cc:1948] [default] [JOB 34855] Generated table #278653: 129432 keys, 42801040 bytes, temperature: kWarm 2024/11/23-20:08:25.992464 139957651584576 EVENT_LOG_v1 {"time_micros": 1732363705992430, "cf_name": "default", "job": 34855, "event": "table_file_creation", "file_number": 278653, "file_size": 42801040, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4235017434, "table_properties": {"data_size": 40749888, "index_size": 222528, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588640, "raw_average_key_size": 20, "raw_value_size": 131629816, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129432, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732363704, "oldest_key_time": 0, "file_creation_time": 1732363704, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 278653, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-20:08:26.032142 139957651584576 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278654.sst) /dev/shm/ToplingTemp/Topling-175297-jtOXvj 2024/11/23-20:08:26.039934 139957651584576 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278654.sst): first pass time = 0.01's, 342.928'MB/sec 2024/11/23-20:08:26.070147 139957651584576 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278654.sst): old prealloc_size = 147639500, real_size = 847112 2024/11/23-20:08:26.070187 139957651584576 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278654.sst): index type = UintIndex_IL_256_32 , store type = DictZipBlobStore usrkeys = 2566 prefix = 4 raw-key = 0.0000 GB zip-key = 0.0000 GB avg-key = 8.00 avg-zkey = 0.27 raw-val = 0.0026 GB zip-val = 0.0008 GB avg-val =1016.91 avg-zval = 329.53 2024/11/23-20:08:26.073269 139957651584576 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00/278654.sst): second pass time = 0.03's, 87.794'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.00's, 286.798'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 26.959'MB/sec (index lex order gen) rebuild zvType time = 0.00's, 0.308'MB/sec write SST data time = 0.00's, 898.526'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.033'MB, throughput = 1304.707'MB/sec zip my value time = 0.03's, unzip length = 0.003'GB zip my value throughput = 87.794'MB/sec zip pipeline throughput = 87.794'MB/sec entries = 2566 avg-key = 20.00 avg-zkey = 0.27 avg-val = 1016.91 avg-zval = 329.53 usrkeys = 2566 avg-key = 12.00 avg-zkey = 0.27 avg-val = 1023.91 avg-zval = 329.53 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 2566 bytes = 8032 } seq expand size = 17962 multi value expand size = 0 cnt WriteAppend = 10 UnZipSize{ index = 0.0000 GB value = 0.0026 GB dict = 0.03 MB all = 0.0027 GB } __ZipSize{ index = 0.0000 GB value = 0.0008 GB dict = 0.03 MB all = 0.0009 GB } UnZip/Zip{ index = 43.7386 value = 3.0859 dict = 1.00 all = 2.9963 } Zip/UnZip{ index = 0.0229 value = 0.3241 dict = 1.00 all = 0.3337 } ---------------------------- total value len = 11.763728 GB avg = 0.213 KB (by entry num) total key len = 1.497822 GB avg = 0.027 KB total ukey len = 1.032078 GB avg = 0.015 KB total ukey num = 0.068400459 Billion total entry num = 0.055208188 Billion write speed all = 0.328306084 MB/sec (with seq num) write speed all = 0.317372107 MB/sec (without seq num) 2024/11/23-20:08:26.081393 139957651584576 [compaction_job.cc:1948] [default] [JOB 34855] Generated table #278654: 2566 keys, 888001 bytes, temperature: kWarm 2024/11/23-20:08:26.081440 139957651584576 EVENT_LOG_v1 {"time_micros": 1732363706081413, "cf_name": "default", "job": 34855, "event": "table_file_creation", "file_number": 278654, "file_size": 888001, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4205967020, "largest_seqno": 4233517872, "table_properties": {"data_size": 845584, "index_size": 704, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 51320, "raw_average_key_size": 20, "raw_value_size": 2609397, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 2566, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-UintIndex_IL_256_32-DictZipBlobStore", "creation_time": 1732363706, "oldest_key_time": 0, "file_creation_time": 1732363706, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 278654, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-20:08:26.090438 139957651584576 [compaction_job.cc:703] job-34855: subcompact[0], size: 0.935568 G, files: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34855/att-00 [278632,278633,278634,278635,278636,278637,278638,278639,278640,278641,278642,278643,278644,278645,278646,278647,278648,278649,278650,278651,278652,278653,278654] 2024/11/23-20:08:26.227266 139957651584576 (Original Log Time 2024/11/23-20:07:44.203897) EVENT_LOG_v1 {"time_micros": 1732363664203862, "job": 34855, "event": "compaction_started", "compaction_reason": "FilesMarkedForCompaction", "files_L2": [278625], "files_L3": [278550, 278551, 278552, 278553, 278554, 278555, 278556, 278557, 278558, 278559, 278560, 278561, 278562, 278563, 278564, 278565, 278566, 278567, 278568, 278569, 278570, 278571], "score": 0.999782, "input_data_size": 967401877, "oldest_snapshot_seqno": 4235049337} 2024/11/23-20:08:26.227270 139957651584576 (Original Log Time 2024/11/23-20:08:26.225659) [compaction_job.cc:2022] [default] [JOB 34855] Compacted 1@2 + 22@3 files to L3 => 935567913 bytes 2024/11/23-20:08:26.227272 139957651584576 (Original Log Time 2024/11/23-20:08:26.227188) [compaction_job.cc:1224] [default] compacted to: files[0 0 0 23 0 0 0] max score 0.03, MB/sec: 23.1 rd, 22.3 wr, level 3, files in(1, 22) out(23 +0 blob) MB in(31.2, 891.4 +0.0 blob) out(892.2 +0.0 blob), read-write-amplify(58.2) write-amplify(28.6) OK, records in: 2879369, records dropped: 29345 output_compression: Snappy 2024/11/23-20:08:26.227275 139957651584576 (Original Log Time 2024/11/23-20:08:26.227232) EVENT_LOG_v1 {"time_micros": 1732363706227211, "cf": "default", "job": 34855, "event": "compaction_finished", "compaction_time_micros": 41886546, "compaction_time_cpu_micros": 8788381, "output_level": 3, "num_output_files": 23, "total_output_size": 935567913, "num_input_records": 2879369, "num_output_records": 2850024, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "file_write_nanos": 699645809, "file_range_sync_nanos": 0, "file_fsync_nanos": 21927, "file_prepare_write_nanos": 58341, "lsm_state": [0, 0, 0, 23, 0, 0, 0]} 2024/11/23-20:08:26.355735 139957651584576 DEBG dcompact_worker.cpp:240: HttpPost: 200 OK: url = http://nlb-7zny4kaa1poal01o64.cn-shenzhen.nlb.aliyuncs.com:8443, body = {"instanceId":"nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137","labourId":"","dbId":"d89b4006-2803-486e-b7a2-759bcf348921","dbStarts":1732256054,"starts":1732363664,"executesMs":42172,"compactionJobId":34855,"attempt":0,"compactionInputRawBytes":2985892634,"compactionInputZipBytes":967401877,"compactionOutputRawBytes":0,"compactionOutputZipBytes":935567913,"headers":{"Accept":"*/*","Connection":"close","Host":"aliyun-topling-saas.topling.cn:18443","RemoteIp":"120.24.192.169","X-Forwarded-For":"120.24.192.169","region":"cn-shenzhen","token":"e6474c481bd4415abc537135cc03626b","instance-token":"e6474c481bd4415abc537135cc03626b","provider":"aliyun","CloudMarketInstanceId":"si-59c0ae5c955845588903","MeteringAssit":"","Transfer-Encoding":"chunked","traceparent":"00-36c81dcfa96133050813dfcf0a660c6d-4e697739805e9483-00"}}, response = 2024/11/23-20:08:26.355835 139957651584576 INFO dcompact_worker.cpp:1459: finish /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-34855/att-00: olev 3, work 42.173 s, result 6.049 ms, install 1.631 ms, input{raw 2.781 GiB zip 922.586 MiB}