2024/11/23-18:09:51.204766 139957634799168 DEBG dcompact_worker.cpp:2214: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00: fork to child time = 0.008200 sec 2024/11/23-18:09:51.205533 139957634799168 DEBG dcompact_worker.cpp:1013: Beg SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00 2024/11/23-18:09:51.214596 139957634799168 DEBG dcompact_worker.cpp:1033: End SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00 2024/11/23-18:09:51.215511 139957634799168 TRAC dcompact_worker.cpp:1083: INFO_LOG_LEVEL: rpc = INFO_LEVEL, env_var = undefined 2024/11/23-18:09:51.215780 139957634799168 [WARN] [column_family.cc:386] multiple cf_paths/db_paths and level_compaction_dynamic_level_bytes can't be used together 2024/11/23-18:09:51.271069 139957634799168 [version_set.cc:6208] Recovering from manifest file: /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-32760/att-00/MANIFEST-206347 2024/11/23-18:09:51.308466 139957634799168 [version_set.cc:6251] Recovered from manifest file:/worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-32760/att-00/MANIFEST-206347 succeeded,manifest_file_number is 206347, next_file_number is 274072, last_sequence is 4172615527, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 273922 2024/11/23-18:09:51.308478 139957634799168 [version_set.cc:6266] Column family [default] (ID 0), log number is 0 2024/11/23-18:09:51.308632 139957634799168 [version_set.cc:5721] Creating manifest 274072 2024/11/23-18:09:51.347533 139957634799168 DEBG dcompact_worker.cpp:1218: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00: bottommost_level: fake = 1, rpc = 0 2024/11/23-18:09:51.373240 139957634799168 [compaction_job.cc:2437] [default] [JOB 32760] Compacting 1@2 + 22@3 files to L3, score 1.00, subcompactions 1 : 1 2024/11/23-18:09:51.373272 139957634799168 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 24523 Base level 2, inputs: [274066(31MB)], [273970(40MB) 273971(40MB) 273972(40MB) 273973(40MB) 273974(40MB) 273975(40MB) 273976(40MB) 273977(40MB) 273978(40MB) 273979(40MB) 273980(40MB) 273981(40MB) 273982(40MB) 273983(40MB) 273984(40MB) 273985(40MB) 273986(40MB) 273987(40MB) 273988(40MB) 273989(40MB) 273990(40MB) 274069(40MB)] 2024/11/23-18:09:51.380475 139957634799168 [top_zip_table.cc:59] core git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-18:09:51.380506 139957634799168 [top_zip_table.cc:60] fsa git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-18:09:51.380526 139957634799168 [top_zip_table.cc:61] zbs git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-18:09:51.380531 139957634799168 [top_zip_table.cc:62] topling-zip_table_reader: git_version_hash_info_is: commit a4a382006cb82713acf5b3425835f22711877681 Author: leipeng Date: 2024-04-11 19:44:14 +0800 fixed_len_hole_index.cc: Add env bool FixedLenHoleIndexUseAVX512 for ut & debug 1. FixedLenHoleIndexUseAVX512 is only in unit tests or debug 2. In release mode, use avx512 by compile options(-march=) g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/23-18:09:51.380541 139957634799168 [top_zip_table.cc:64] topling-rocks git_version_hash_info_is: commit feab587e468621ba0204d47b4ffacc52e7c4290d Author: leipeng Date: 2024-03-22 13:35:06 +0800 ToplingZipTableBuilder::Add: immediately return after error This function returns void, and caller does not check builder->status() after calling this function and graceful abandon. So immediately return after error, and return error status in Finish(). g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/23-18:09:52.271413 139957634799168 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274073.sst) /dev/shm/ToplingTemp/Topling-144794-sgALcP 2024/11/23-18:09:52.704126 139957634799168 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274073.sst): first pass time = 0.43's, 310.219'MB/sec 2024/11/23-18:09:53.839899 139957634799168 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274073.sst): old prealloc_size = 147639500, real_size = 40586032 2024/11/23-18:09:53.840054 139957634799168 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274073.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129430 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.80 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1016.99 avg-zval = 311.52 2024/11/23-18:09:53.840275 139957634799168 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274073.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-18:09:54.004687 139957634799168 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274073.sst): second pass time = 1.12's, 117.164'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 257.443'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1739.455'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.270'MB/sec write SST data time = 0.04's, 944.210'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.379'MB, throughput = 43239.233'MB/sec zip my value time = 1.12's, unzip length = 0.132'GB zip my value throughput = 117.164'MB/sec zip pipeline throughput = 126.823'MB/sec entries = 129430 avg-key = 20.00 avg-zkey = 1.80 avg-val = 1016.99 avg-zval = 311.52 usrkeys = 129430 avg-key = 12.00 avg-zkey = 1.80 avg-val = 1023.99 avg-zval = 311.52 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129430 bytes = 485376 } seq expand size = 906010 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0424 GB } UnZip/Zip{ index = 6.6579 value = 3.2646 dict = 1.00 all = 3.1641 } Zip/UnZip{ index = 0.1502 value = 0.3063 dict = 1.00 all = 0.3160 } ---------------------------- total value len = 8.981155 GB avg = 0.171 KB (by entry num) total key len = 1.443410 GB avg = 0.028 KB total ukey len = 0.999431 GB avg = 0.015 KB total ukey num = 0.065679865 Billion total entry num = 0.052487594 Billion write speed all = 0.313221279 MB/sec (with seq num) write speed all = 0.300604748 MB/sec (without seq num) 2024/11/23-18:09:54.056772 139957634799168 [compaction_job.cc:1948] [default] [JOB 32760] Generated table #274073: 129430 keys, 42419341 bytes, temperature: kWarm 2024/11/23-18:09:54.056870 139957634799168 EVENT_LOG_v1 {"time_micros": 1732356594056811, "cf_name": "default", "job": 32760, "event": "table_file_creation", "file_number": 274073, "file_size": 42419341, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237877277, "largest_seqno": 4172458357, "table_properties": {"data_size": 40320224, "index_size": 233280, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588600, "raw_average_key_size": 20, "raw_value_size": 131629373, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129430, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732356592, "oldest_key_time": 0, "file_creation_time": 1732356592, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 274073, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-18:09:54.100408 139957634799168 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274074.sst) /dev/shm/ToplingTemp/Topling-144794-k7oxNR 2024/11/23-18:09:54.797183 139957634799168 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274074.sst): first pass time = 0.70's, 192.639'MB/sec 2024/11/23-18:09:55.822230 139957634799168 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274074.sst): old prealloc_size = 147639500, real_size = 40875136 2024/11/23-18:09:55.822363 139957634799168 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274074.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129433 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.74 raw-val = 0.1316 GB zip-val = 0.0406 GB avg-val =1016.97 avg-zval = 313.81 2024/11/23-18:09:55.822527 139957634799168 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274074.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-18:09:55.984584 139957634799168 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274074.sst): second pass time = 1.02's, 128.517'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 263.073'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2278.277'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.276'MB/sec write SST data time = 0.05's, 945.412'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 44190.852'MB/sec zip my value time = 1.02's, unzip length = 0.132'GB zip my value throughput = 128.517'MB/sec zip pipeline throughput = 128.517'MB/sec entries = 129433 avg-key = 20.00 avg-zkey = 1.74 avg-val = 1016.97 avg-zval = 313.81 usrkeys = 129433 avg-key = 12.00 avg-zkey = 1.74 avg-val = 1023.97 avg-zval = 313.81 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129433 bytes = 485392 } seq expand size = 906031 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0406 GB dict = 1.38 MB all = 0.0427 GB } UnZip/Zip{ index = 6.9102 value = 3.2407 dict = 1.00 all = 3.1427 } Zip/UnZip{ index = 0.1447 value = 0.3086 dict = 1.00 all = 0.3182 } ---------------------------- total value len = 9.113691 GB avg = 0.173 KB (by entry num) total key len = 1.445998 GB avg = 0.027 KB total ukey len = 1.000984 GB avg = 0.015 KB total ukey num = 0.065809298 Billion total entry num = 0.052617027 Billion write speed all = 0.317262420 MB/sec (with seq num) write speed all = 0.304615529 MB/sec (without seq num) 2024/11/23-18:09:56.036341 139957634799168 [compaction_job.cc:1948] [default] [JOB 32760] Generated table #274074: 129433 keys, 42707613 bytes, temperature: kWarm 2024/11/23-18:09:56.036407 139957634799168 EVENT_LOG_v1 {"time_micros": 1732356596036372, "cf_name": "default", "job": 32760, "event": "table_file_creation", "file_number": 274074, "file_size": 42707613, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237868195, "largest_seqno": 4172465748, "table_properties": {"data_size": 40617840, "index_size": 224768, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588660, "raw_average_key_size": 20, "raw_value_size": 131629853, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129433, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732356594, "oldest_key_time": 0, "file_creation_time": 1732356594, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 274074, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-18:09:56.086944 139957634799168 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274075.sst) /dev/shm/ToplingTemp/Topling-144794-9QyTqS 2024/11/23-18:09:57.119335 139957634799168 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274075.sst): first pass time = 1.03's, 130.015'MB/sec 2024/11/23-18:09:58.253555 139957634799168 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274075.sst): old prealloc_size = 147639500, real_size = 40587312 2024/11/23-18:09:58.253678 139957634799168 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274075.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129434 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.80 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1016.96 avg-zval = 311.52 2024/11/23-18:09:58.253838 139957634799168 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274075.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-18:09:58.423237 139957634799168 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274075.sst): second pass time = 1.13's, 116.130'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.17's, 250.016'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2288.966'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.262'MB/sec write SST data time = 0.05's, 917.981'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 36161.131'MB/sec zip my value time = 1.13's, unzip length = 0.132'GB zip my value throughput = 116.130'MB/sec zip pipeline throughput = 125.170'MB/sec entries = 129434 avg-key = 20.00 avg-zkey = 1.80 avg-val = 1016.96 avg-zval = 311.52 usrkeys = 129434 avg-key = 12.00 avg-zkey = 1.80 avg-val = 1023.96 avg-zval = 311.52 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129434 bytes = 485392 } seq expand size = 906038 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0424 GB } UnZip/Zip{ index = 6.6581 value = 3.2645 dict = 1.00 all = 3.1640 } Zip/UnZip{ index = 0.1502 value = 0.3063 dict = 1.00 all = 0.3161 } ---------------------------- total value len = 9.246227 GB avg = 0.175 KB (by entry num) total key len = 1.448587 GB avg = 0.027 KB total ukey len = 1.002538 GB avg = 0.015 KB total ukey num = 0.065938732 Billion total entry num = 0.052746461 Billion write speed all = 0.321298640 MB/sec (with seq num) write speed all = 0.308621567 MB/sec (without seq num) 2024/11/23-18:09:58.478416 139957634799168 [compaction_job.cc:1948] [default] [JOB 32760] Generated table #274075: 129434 keys, 42420501 bytes, temperature: kWarm 2024/11/23-18:09:58.478468 139957634799168 EVENT_LOG_v1 {"time_micros": 1732356598478436, "cf_name": "default", "job": 32760, "event": "table_file_creation", "file_number": 274075, "file_size": 42420501, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237873554, "largest_seqno": 4172456006, "table_properties": {"data_size": 40321504, "index_size": 233280, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588680, "raw_average_key_size": 20, "raw_value_size": 131629429, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129434, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732356596, "oldest_key_time": 0, "file_creation_time": 1732356596, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 274075, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-18:09:58.518208 139957634799168 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274076.sst) /dev/shm/ToplingTemp/Topling-144794-G9DJ0Q 2024/11/23-18:09:59.319836 139957634799168 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274076.sst): first pass time = 0.80's, 167.439'MB/sec 2024/11/23-18:10:00.146619 139957634799168 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274076.sst): old prealloc_size = 147639500, real_size = 40870768 2024/11/23-18:10:00.146745 139957634799168 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274076.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129434 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.74 raw-val = 0.1316 GB zip-val = 0.0406 GB avg-val =1016.96 avg-zval = 313.78 2024/11/23-18:10:00.146902 139957634799168 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274076.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-18:10:00.307043 139957634799168 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274076.sst): second pass time = 0.83's, 159.511'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 266.226'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2225.007'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.276'MB/sec write SST data time = 0.04's, 987.875'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 39834.932'MB/sec zip my value time = 0.83's, unzip length = 0.132'GB zip my value throughput = 159.511'MB/sec zip pipeline throughput = 159.511'MB/sec entries = 129434 avg-key = 20.00 avg-zkey = 1.74 avg-val = 1016.96 avg-zval = 313.78 usrkeys = 129434 avg-key = 12.00 avg-zkey = 1.74 avg-val = 1023.96 avg-zval = 313.78 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129434 bytes = 485392 } seq expand size = 906038 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0406 GB dict = 1.38 MB all = 0.0427 GB } UnZip/Zip{ index = 6.9103 value = 3.2410 dict = 1.00 all = 3.1430 } Zip/UnZip{ index = 0.1447 value = 0.3085 dict = 1.00 all = 0.3182 } ---------------------------- total value len = 9.378762 GB avg = 0.177 KB (by entry num) total key len = 1.451176 GB avg = 0.027 KB total ukey len = 1.004091 GB avg = 0.015 KB total ukey num = 0.066068166 Billion total entry num = 0.052875895 Billion write speed all = 0.325339680 MB/sec (with seq num) write speed all = 0.312632218 MB/sec (without seq num) 2024/11/23-18:10:00.358348 139957634799168 [compaction_job.cc:1948] [default] [JOB 32760] Generated table #274076: 129434 keys, 42704015 bytes, temperature: kWarm 2024/11/23-18:10:00.358418 139957634799168 EVENT_LOG_v1 {"time_micros": 1732356600358384, "cf_name": "default", "job": 32760, "event": "table_file_creation", "file_number": 274076, "file_size": 42704015, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237868596, "largest_seqno": 4172466129, "table_properties": {"data_size": 40613472, "index_size": 224768, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588680, "raw_average_key_size": 20, "raw_value_size": 131629056, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129434, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732356598, "oldest_key_time": 0, "file_creation_time": 1732356598, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 274076, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-18:10:00.394098 139957634799168 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274077.sst) /dev/shm/ToplingTemp/Topling-144794-z7PggO 2024/11/23-18:10:01.107931 139957634799168 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274077.sst): first pass time = 0.71's, 188.034'MB/sec 2024/11/23-18:10:01.889967 139957634799168 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274077.sst): old prealloc_size = 147639500, real_size = 40587616 2024/11/23-18:10:01.890115 139957634799168 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274077.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129430 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.80 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1016.99 avg-zval = 311.53 2024/11/23-18:10:01.890291 139957634799168 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274077.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-18:10:02.058944 139957634799168 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274077.sst): second pass time = 0.78's, 168.585'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.17's, 251.071'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2309.435'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.269'MB/sec write SST data time = 0.05's, 873.706'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 50423.773'MB/sec zip my value time = 0.78's, unzip length = 0.132'GB zip my value throughput = 168.585'MB/sec zip pipeline throughput = 168.585'MB/sec entries = 129430 avg-key = 20.00 avg-zkey = 1.80 avg-val = 1016.99 avg-zval = 311.53 usrkeys = 129430 avg-key = 12.00 avg-zkey = 1.80 avg-val = 1023.99 avg-zval = 311.53 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129430 bytes = 485376 } seq expand size = 906010 multi value expand size = 0 cnt WriteAppend = 11 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0424 GB } UnZip/Zip{ index = 6.6597 value = 3.2645 dict = 1.00 all = 3.1640 } Zip/UnZip{ index = 0.1502 value = 0.3063 dict = 1.00 all = 0.3161 } ---------------------------- total value len = 9.511297 GB avg = 0.179 KB (by entry num) total key len = 1.453764 GB avg = 0.027 KB total ukey len = 1.005644 GB avg = 0.015 KB total ukey num = 0.066197596 Billion total entry num = 0.053005325 Billion write speed all = 0.329381578 MB/sec (with seq num) write speed all = 0.316643681 MB/sec (without seq num) 2024/11/23-18:10:02.113084 139957634799168 [compaction_job.cc:1948] [default] [JOB 32760] Generated table #274077: 129430 keys, 42420600 bytes, temperature: kWarm 2024/11/23-18:10:02.113159 139957634799168 EVENT_LOG_v1 {"time_micros": 1732356602113119, "cf_name": "default", "job": 32760, "event": "table_file_creation", "file_number": 274077, "file_size": 42420600, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237869923, "largest_seqno": 4172466352, "table_properties": {"data_size": 40321872, "index_size": 233216, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588600, "raw_average_key_size": 20, "raw_value_size": 131629523, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129430, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732356600, "oldest_key_time": 0, "file_creation_time": 1732356600, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 274077, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-18:10:02.153733 139957634799168 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274078.sst) /dev/shm/ToplingTemp/Topling-144794-xy05rO 2024/11/23-18:10:02.731651 139957634799168 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274078.sst): first pass time = 0.58's, 232.264'MB/sec 2024/11/23-18:10:03.512184 139957634799168 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274078.sst): old prealloc_size = 147639500, real_size = 40587104 2024/11/23-18:10:03.512330 139957634799168 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274078.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129431 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.80 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1016.99 avg-zval = 311.53 2024/11/23-18:10:03.512495 139957634799168 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274078.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-18:10:03.693458 139957634799168 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274078.sst): second pass time = 0.78's, 168.831'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.18's, 234.033'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1907.878'MB/sec (index lex order gen) rebuild zvType time = 0.14's, 0.237'MB/sec write SST data time = 0.04's, 951.109'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 46273.466'MB/sec zip my value time = 0.78's, unzip length = 0.132'GB zip my value throughput = 168.831'MB/sec zip pipeline throughput = 168.831'MB/sec entries = 129431 avg-key = 20.00 avg-zkey = 1.80 avg-val = 1016.99 avg-zval = 311.53 usrkeys = 129431 avg-key = 12.00 avg-zkey = 1.80 avg-val = 1023.99 avg-zval = 311.53 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129431 bytes = 485376 } seq expand size = 906017 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0424 GB } UnZip/Zip{ index = 6.6580 value = 3.2645 dict = 1.00 all = 3.1641 } Zip/UnZip{ index = 0.1502 value = 0.3063 dict = 1.00 all = 0.3160 } ---------------------------- total value len = 9.643833 GB avg = 0.181 KB (by entry num) total key len = 1.456353 GB avg = 0.027 KB total ukey len = 1.007197 GB avg = 0.015 KB total ukey num = 0.066327027 Billion total entry num = 0.053134756 Billion write speed all = 0.333424241 MB/sec (with seq num) write speed all = 0.320655867 MB/sec (without seq num) 2024/11/23-18:10:03.745033 139957634799168 [compaction_job.cc:1948] [default] [JOB 32760] Generated table #274078: 129431 keys, 42419740 bytes, temperature: kWarm 2024/11/23-18:10:03.745102 139957634799168 EVENT_LOG_v1 {"time_micros": 1732356603745068, "cf_name": "default", "job": 32760, "event": "table_file_creation", "file_number": 274078, "file_size": 42419740, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237872175, "largest_seqno": 4172463777, "table_properties": {"data_size": 40321296, "index_size": 233280, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588620, "raw_average_key_size": 20, "raw_value_size": 131629949, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129431, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732356602, "oldest_key_time": 0, "file_creation_time": 1732356602, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 274078, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-18:10:03.783140 139957634799168 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274079.sst) /dev/shm/ToplingTemp/Topling-144794-mTBSFS 2024/11/23-18:10:04.564006 139957634799168 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274079.sst): first pass time = 0.78's, 171.893'MB/sec 2024/11/23-18:10:05.406287 139957634799168 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274079.sst): old prealloc_size = 147639500, real_size = 41022432 2024/11/23-18:10:05.406411 139957634799168 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274079.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129428 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.73 raw-val = 0.1316 GB zip-val = 0.0408 GB avg-val =1017.01 avg-zval = 314.97 2024/11/23-18:10:05.406569 139957634799168 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274079.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-18:10:05.568276 139957634799168 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274079.sst): second pass time = 0.84's, 156.423'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 264.564'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2256.404'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.275'MB/sec write SST data time = 0.04's, 971.516'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 44113.423'MB/sec zip my value time = 0.84's, unzip length = 0.132'GB zip my value throughput = 156.423'MB/sec zip pipeline throughput = 156.423'MB/sec entries = 129428 avg-key = 20.00 avg-zkey = 1.73 avg-val = 1017.01 avg-zval = 314.97 usrkeys = 129428 avg-key = 12.00 avg-zkey = 1.73 avg-val = 1024.01 avg-zval = 314.97 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129428 bytes = 485376 } seq expand size = 905996 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0408 GB dict = 1.38 MB all = 0.0429 GB } UnZip/Zip{ index = 6.9336 value = 3.2289 dict = 1.00 all = 3.1319 } Zip/UnZip{ index = 0.1442 value = 0.3097 dict = 1.00 all = 0.3193 } ---------------------------- total value len = 9.776369 GB avg = 0.184 KB (by entry num) total key len = 1.458941 GB avg = 0.027 KB total ukey len = 1.008750 GB avg = 0.015 KB total ukey num = 0.066456455 Billion total entry num = 0.053264184 Billion write speed all = 0.337464069 MB/sec (with seq num) write speed all = 0.324665314 MB/sec (without seq num) 2024/11/23-18:10:05.620067 139957634799168 [compaction_job.cc:1948] [default] [JOB 32760] Generated table #274079: 129428 keys, 42855154 bytes, temperature: kWarm 2024/11/23-18:10:05.620138 139957634799168 EVENT_LOG_v1 {"time_micros": 1732356605620102, "cf_name": "default", "job": 32760, "event": "table_file_creation", "file_number": 274079, "file_size": 42855154, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237946515, "largest_seqno": 4172466030, "table_properties": {"data_size": 40765904, "index_size": 224000, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588560, "raw_average_key_size": 20, "raw_value_size": 131629991, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129428, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732356603, "oldest_key_time": 0, "file_creation_time": 1732356603, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 274079, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-18:10:05.658339 139957634799168 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274080.sst) /dev/shm/ToplingTemp/Topling-144794-Lpf9qQ 2024/11/23-18:10:06.378655 139957634799168 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274080.sst): first pass time = 0.72's, 186.342'MB/sec 2024/11/23-18:10:07.194493 139957634799168 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274080.sst): old prealloc_size = 147639500, real_size = 40936896 2024/11/23-18:10:07.194619 139957634799168 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274080.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129430 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.73 raw-val = 0.1316 GB zip-val = 0.0407 GB avg-val =1017.00 avg-zval = 314.30 2024/11/23-18:10:07.194776 139957634799168 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274080.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-18:10:07.356848 139957634799168 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274080.sst): second pass time = 0.82's, 161.484'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 263.467'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2269.614'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.273'MB/sec write SST data time = 0.04's, 976.094'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 37577.208'MB/sec zip my value time = 0.82's, unzip length = 0.132'GB zip my value throughput = 161.484'MB/sec zip pipeline throughput = 161.484'MB/sec entries = 129430 avg-key = 20.00 avg-zkey = 1.73 avg-val = 1017.00 avg-zval = 314.30 usrkeys = 129430 avg-key = 12.00 avg-zkey = 1.73 avg-val = 1024.00 avg-zval = 314.30 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129430 bytes = 485376 } seq expand size = 906010 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0407 GB dict = 1.38 MB all = 0.0428 GB } UnZip/Zip{ index = 6.9357 value = 3.2357 dict = 1.00 all = 3.1381 } Zip/UnZip{ index = 0.1442 value = 0.3091 dict = 1.00 all = 0.3187 } ---------------------------- total value len = 9.908905 GB avg = 0.186 KB (by entry num) total key len = 1.461530 GB avg = 0.027 KB total ukey len = 1.010303 GB avg = 0.015 KB total ukey num = 0.066585885 Billion total entry num = 0.053393614 Billion write speed all = 0.341504329 MB/sec (with seq num) write speed all = 0.328675163 MB/sec (without seq num) 2024/11/23-18:10:07.410077 139957634799168 [compaction_job.cc:1948] [default] [JOB 32760] Generated table #274080: 129430 keys, 42770011 bytes, temperature: kWarm 2024/11/23-18:10:07.410144 139957634799168 EVENT_LOG_v1 {"time_micros": 1732356607410108, "cf_name": "default", "job": 32760, "event": "table_file_creation", "file_number": 274080, "file_size": 42770011, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237868290, "largest_seqno": 4172466060, "table_properties": {"data_size": 40680432, "index_size": 223936, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588600, "raw_average_key_size": 20, "raw_value_size": 131630010, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129430, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732356605, "oldest_key_time": 0, "file_creation_time": 1732356605, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 274080, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-18:10:07.448769 139957634799168 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274081.sst) /dev/shm/ToplingTemp/Topling-144794-2YjcrS 2024/11/23-18:10:08.095829 139957634799168 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274081.sst): first pass time = 0.65's, 207.442'MB/sec 2024/11/23-18:10:09.109267 139957634799168 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274081.sst): old prealloc_size = 147639500, real_size = 41015936 2024/11/23-18:10:09.109403 139957634799168 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274081.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129431 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.72 raw-val = 0.1316 GB zip-val = 0.0408 GB avg-val =1016.99 avg-zval = 314.93 2024/11/23-18:10:09.109570 139957634799168 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274081.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-18:10:09.269681 139957634799168 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274081.sst): second pass time = 1.01's, 130.124'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 267.143'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2107.221'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.274'MB/sec write SST data time = 0.04's, 1017.684'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 48903.719'MB/sec zip my value time = 1.01's, unzip length = 0.132'GB zip my value throughput = 130.124'MB/sec zip pipeline throughput = 130.124'MB/sec entries = 129431 avg-key = 20.00 avg-zkey = 1.72 avg-val = 1016.99 avg-zval = 314.93 usrkeys = 129431 avg-key = 12.00 avg-zkey = 1.72 avg-val = 1023.99 avg-zval = 314.93 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129431 bytes = 485376 } seq expand size = 906017 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0408 GB dict = 1.38 MB all = 0.0428 GB } UnZip/Zip{ index = 6.9938 value = 3.2293 dict = 1.00 all = 3.1324 } Zip/UnZip{ index = 0.1430 value = 0.3097 dict = 1.00 all = 0.3192 } ---------------------------- total value len = 10.041441 GB avg = 0.188 KB (by entry num) total key len = 1.464119 GB avg = 0.027 KB total ukey len = 1.011857 GB avg = 0.015 KB total ukey num = 0.066715316 Billion total entry num = 0.053523045 Billion write speed all = 0.345542861 MB/sec (with seq num) write speed all = 0.332683334 MB/sec (without seq num) 2024/11/23-18:10:09.321621 139957634799168 [compaction_job.cc:1948] [default] [JOB 32760] Generated table #274081: 129431 keys, 42848728 bytes, temperature: kWarm 2024/11/23-18:10:09.321690 139957634799168 EVENT_LOG_v1 {"time_micros": 1732356609321654, "cf_name": "default", "job": 32760, "event": "table_file_creation", "file_number": 274081, "file_size": 42848728, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237874784, "largest_seqno": 4172466222, "table_properties": {"data_size": 40761328, "index_size": 222080, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588620, "raw_average_key_size": 20, "raw_value_size": 131629802, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129431, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732356607, "oldest_key_time": 0, "file_creation_time": 1732356607, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 274081, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-18:10:09.360069 139957634799168 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274082.sst) /dev/shm/ToplingTemp/Topling-144794-RaoqVP 2024/11/23-18:10:10.090276 139957634799168 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274082.sst): first pass time = 0.73's, 183.818'MB/sec 2024/11/23-18:10:10.886434 139957634799168 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274082.sst): old prealloc_size = 147639500, real_size = 40577248 2024/11/23-18:10:10.886564 139957634799168 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274082.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129432 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.80 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1016.98 avg-zval = 311.45 2024/11/23-18:10:10.886725 139957634799168 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274082.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-18:10:11.052661 139957634799168 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274082.sst): second pass time = 0.80's, 165.480'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.17's, 255.158'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2209.888'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.269'MB/sec write SST data time = 0.05's, 927.222'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 42168.732'MB/sec zip my value time = 0.80's, unzip length = 0.132'GB zip my value throughput = 165.480'MB/sec zip pipeline throughput = 165.480'MB/sec entries = 129432 avg-key = 20.00 avg-zkey = 1.80 avg-val = 1016.98 avg-zval = 311.45 usrkeys = 129432 avg-key = 12.00 avg-zkey = 1.80 avg-val = 1023.98 avg-zval = 311.45 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129432 bytes = 485392 } seq expand size = 906024 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0424 GB } UnZip/Zip{ index = 6.6617 value = 3.2653 dict = 1.00 all = 3.1648 } Zip/UnZip{ index = 0.1501 value = 0.3063 dict = 1.00 all = 0.3160 } ---------------------------- total value len = 10.173976 GB avg = 0.190 KB (by entry num) total key len = 1.466707 GB avg = 0.027 KB total ukey len = 1.013410 GB avg = 0.015 KB total ukey num = 0.066844748 Billion total entry num = 0.053652477 Billion write speed all = 0.349582281 MB/sec (with seq num) write speed all = 0.336692347 MB/sec (without seq num) 2024/11/23-18:10:11.103889 139957634799168 [compaction_job.cc:1948] [default] [JOB 32760] Generated table #274082: 129432 keys, 42410284 bytes, temperature: kWarm 2024/11/23-18:10:11.103962 139957634799168 EVENT_LOG_v1 {"time_micros": 1732356611103923, "cf_name": "default", "job": 32760, "event": "table_file_creation", "file_number": 274082, "file_size": 42410284, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237874127, "largest_seqno": 4172460828, "table_properties": {"data_size": 40311568, "index_size": 233152, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588640, "raw_average_key_size": 20, "raw_value_size": 131629447, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129432, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732356609, "oldest_key_time": 0, "file_creation_time": 1732356609, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 274082, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-18:10:11.142887 139957634799168 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274083.sst) /dev/shm/ToplingTemp/Topling-144794-GmKbjS 2024/11/23-18:10:11.891532 139957634799168 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274083.sst): first pass time = 0.75's, 179.291'MB/sec 2024/11/23-18:10:12.846678 139957634799168 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274083.sst): old prealloc_size = 147639500, real_size = 40587376 2024/11/23-18:10:12.846806 139957634799168 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274083.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129430 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.80 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1017.00 avg-zval = 311.53 2024/11/23-18:10:12.846962 139957634799168 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274083.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-18:10:13.010931 139957634799168 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274083.sst): second pass time = 0.95's, 137.942'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 258.284'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2247.356'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.270'MB/sec write SST data time = 0.04's, 953.039'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 34382.139'MB/sec zip my value time = 0.95's, unzip length = 0.132'GB zip my value throughput = 137.942'MB/sec zip pipeline throughput = 137.942'MB/sec entries = 129430 avg-key = 20.00 avg-zkey = 1.80 avg-val = 1017.00 avg-zval = 311.53 usrkeys = 129430 avg-key = 12.00 avg-zkey = 1.80 avg-val = 1024.00 avg-zval = 311.53 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129430 bytes = 485376 } seq expand size = 906010 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0424 GB } UnZip/Zip{ index = 6.6579 value = 3.2645 dict = 1.00 all = 3.1640 } Zip/UnZip{ index = 0.1502 value = 0.3063 dict = 1.00 all = 0.3161 } ---------------------------- total value len = 10.306512 GB avg = 0.192 KB (by entry num) total key len = 1.469296 GB avg = 0.027 KB total ukey len = 1.014963 GB avg = 0.015 KB total ukey num = 0.066974178 Billion total entry num = 0.053781907 Billion write speed all = 0.353619424 MB/sec (with seq num) write speed all = 0.340699155 MB/sec (without seq num) 2024/11/23-18:10:13.064035 139957634799168 [compaction_job.cc:1948] [default] [JOB 32760] Generated table #274083: 129430 keys, 42420108 bytes, temperature: kWarm 2024/11/23-18:10:13.064107 139957634799168 EVENT_LOG_v1 {"time_micros": 1732356613064073, "cf_name": "default", "job": 32760, "event": "table_file_creation", "file_number": 274083, "file_size": 42420108, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237873605, "largest_seqno": 4172458538, "table_properties": {"data_size": 40321568, "index_size": 233280, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588600, "raw_average_key_size": 20, "raw_value_size": 131630037, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129430, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732356611, "oldest_key_time": 0, "file_creation_time": 1732356611, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 274083, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-18:10:13.106143 139957634799168 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274084.sst) /dev/shm/ToplingTemp/Topling-144794-OwIS3P 2024/11/23-18:10:13.841809 139957634799168 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274084.sst): first pass time = 0.74's, 182.454'MB/sec 2024/11/23-18:10:14.643425 139957634799168 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274084.sst): old prealloc_size = 147639500, real_size = 40780032 2024/11/23-18:10:14.643552 139957634799168 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274084.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129429 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.78 raw-val = 0.1316 GB zip-val = 0.0405 GB avg-val =1017.00 avg-zval = 313.05 2024/11/23-18:10:14.644004 139957634799168 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274084.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-18:10:14.805092 139957634799168 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274084.sst): second pass time = 0.80's, 164.350'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 263.619'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2187.602'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.276'MB/sec write SST data time = 0.04's, 965.171'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 43438.339'MB/sec zip my value time = 0.80's, unzip length = 0.132'GB zip my value throughput = 164.350'MB/sec zip pipeline throughput = 164.350'MB/sec entries = 129429 avg-key = 20.00 avg-zkey = 1.78 avg-val = 1017.00 avg-zval = 313.05 usrkeys = 129429 avg-key = 12.00 avg-zkey = 1.78 avg-val = 1024.00 avg-zval = 313.05 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129429 bytes = 485376 } seq expand size = 906003 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0405 GB dict = 1.38 MB all = 0.0426 GB } UnZip/Zip{ index = 6.7542 value = 3.2487 dict = 1.00 all = 3.1497 } Zip/UnZip{ index = 0.1481 value = 0.3078 dict = 1.00 all = 0.3175 } ---------------------------- total value len = 10.439048 GB avg = 0.194 KB (by entry num) total key len = 1.471885 GB avg = 0.027 KB total ukey len = 1.016516 GB avg = 0.015 KB total ukey num = 0.067103607 Billion total entry num = 0.053911336 Billion write speed all = 0.357657837 MB/sec (with seq num) write speed all = 0.344707172 MB/sec (without seq num) 2024/11/23-18:10:14.856317 139957634799168 [compaction_job.cc:1948] [default] [JOB 32760] Generated table #274084: 129429 keys, 42612766 bytes, temperature: kWarm 2024/11/23-18:10:14.856387 139957634799168 EVENT_LOG_v1 {"time_micros": 1732356614856349, "cf_name": "default", "job": 32760, "event": "table_file_creation", "file_number": 274084, "file_size": 42612766, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237872082, "largest_seqno": 4172466470, "table_properties": {"data_size": 40517552, "index_size": 229952, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588580, "raw_average_key_size": 20, "raw_value_size": 131629469, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129429, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732356613, "oldest_key_time": 0, "file_creation_time": 1732356613, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 274084, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-18:10:14.892550 139957634799168 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274085.sst) /dev/shm/ToplingTemp/Topling-144794-QhaDpQ 2024/11/23-18:10:15.698933 139957634799168 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274085.sst): first pass time = 0.81's, 166.452'MB/sec 2024/11/23-18:10:16.589162 139957634799168 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274085.sst): old prealloc_size = 147639500, real_size = 40961264 2024/11/23-18:10:16.589268 139957634799168 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274085.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129428 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.74 raw-val = 0.1316 GB zip-val = 0.0407 GB avg-val =1017.01 avg-zval = 314.48 2024/11/23-18:10:16.589424 139957634799168 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274085.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-18:10:16.749128 139957634799168 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274085.sst): second pass time = 0.89's, 148.095'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 267.563'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2320.558'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.275'MB/sec write SST data time = 0.04's, 1013.040'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 44988.019'MB/sec zip my value time = 0.89's, unzip length = 0.132'GB zip my value throughput = 148.095'MB/sec zip pipeline throughput = 148.095'MB/sec entries = 129428 avg-key = 20.00 avg-zkey = 1.74 avg-val = 1017.01 avg-zval = 314.48 usrkeys = 129428 avg-key = 12.00 avg-zkey = 1.74 avg-val = 1024.01 avg-zval = 314.48 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129428 bytes = 485376 } seq expand size = 905996 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0407 GB dict = 1.38 MB all = 0.0428 GB } UnZip/Zip{ index = 6.8845 value = 3.2339 dict = 1.00 all = 3.1364 } Zip/UnZip{ index = 0.1453 value = 0.3092 dict = 1.00 all = 0.3188 } ---------------------------- total value len = 10.571583 GB avg = 0.196 KB (by entry num) total key len = 1.474473 GB avg = 0.027 KB total ukey len = 1.018069 GB avg = 0.015 KB total ukey num = 0.067233035 Billion total entry num = 0.054040764 Billion write speed all = 0.361694178 MB/sec (with seq num) write speed all = 0.348713180 MB/sec (without seq num) 2024/11/23-18:10:16.800482 139957634799168 [compaction_job.cc:1948] [default] [JOB 32760] Generated table #274085: 129428 keys, 42794181 bytes, temperature: kWarm 2024/11/23-18:10:16.800550 139957634799168 EVENT_LOG_v1 {"time_micros": 1732356616800515, "cf_name": "default", "job": 32760, "event": "table_file_creation", "file_number": 274085, "file_size": 42794181, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237871365, "largest_seqno": 4172444977, "table_properties": {"data_size": 40703136, "index_size": 225600, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588560, "raw_average_key_size": 20, "raw_value_size": 131629218, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129428, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732356614, "oldest_key_time": 0, "file_creation_time": 1732356614, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 274085, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-18:10:16.837528 139957634799168 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274086.sst) /dev/shm/ToplingTemp/Topling-144794-3npVsS 2024/11/23-18:10:17.547229 139957634799168 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274086.sst): first pass time = 0.71's, 189.128'MB/sec 2024/11/23-18:10:18.311512 139957634799168 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274086.sst): old prealloc_size = 147639500, real_size = 40580192 2024/11/23-18:10:18.311635 139957634799168 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274086.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129427 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.78 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1017.02 avg-zval = 311.50 2024/11/23-18:10:18.311784 139957634799168 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274086.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-18:10:18.474853 139957634799168 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274086.sst): second pass time = 0.76's, 172.584'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 259.336'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2203.693'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.274'MB/sec write SST data time = 0.04's, 942.656'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 49313.043'MB/sec zip my value time = 0.76's, unzip length = 0.132'GB zip my value throughput = 172.584'MB/sec zip pipeline throughput = 172.584'MB/sec entries = 129427 avg-key = 20.00 avg-zkey = 1.78 avg-val = 1017.02 avg-zval = 311.50 usrkeys = 129427 avg-key = 12.00 avg-zkey = 1.78 avg-val = 1022.89 avg-zval = 311.50 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 108453 bytes = 406720 } seq expand size = 759171 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0424 GB } UnZip/Zip{ index = 6.7316 value = 3.2649 dict = 1.00 all = 3.1689 } Zip/UnZip{ index = 0.1486 value = 0.3063 dict = 1.00 all = 0.3156 } ---------------------------- total value len = 10.703972 GB avg = 0.198 KB (by entry num) total key len = 1.477062 GB avg = 0.027 KB total ukey len = 1.019622 GB avg = 0.015 KB total ukey num = 0.067362462 Billion total entry num = 0.054170191 Billion write speed all = 0.365728062 MB/sec (with seq num) write speed all = 0.352716648 MB/sec (without seq num) 2024/11/23-18:10:18.525670 139957634799168 [compaction_job.cc:1948] [default] [JOB 32760] Generated table #274086: 129427 keys, 42354628 bytes, temperature: kWarm 2024/11/23-18:10:18.525747 139957634799168 EVENT_LOG_v1 {"time_micros": 1732356618525706, "cf_name": "default", "job": 32760, "event": "table_file_creation", "file_number": 274086, "file_size": 42354628, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4172446160, "table_properties": {"data_size": 40316944, "index_size": 230720, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588540, "raw_average_key_size": 20, "raw_value_size": 131630050, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129427, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732356616, "oldest_key_time": 0, "file_creation_time": 1732356616, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 274086, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-18:10:18.565418 139957634799168 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274087.sst) /dev/shm/ToplingTemp/Topling-144794-y106oS 2024/11/23-18:10:19.317589 139957634799168 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274087.sst): first pass time = 0.75's, 178.450'MB/sec 2024/11/23-18:10:20.237328 139957634799168 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274087.sst): old prealloc_size = 147639500, real_size = 40645936 2024/11/23-18:10:20.237442 139957634799168 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274087.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129433 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.70 raw-val = 0.1316 GB zip-val = 0.0404 GB avg-val =1016.97 avg-zval = 312.08 2024/11/23-18:10:20.237537 139957634799168 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274087.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-18:10:20.396472 139957634799168 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274087.sst): second pass time = 0.92's, 143.429'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 265.179'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2377.350'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.276'MB/sec write SST data time = 0.04's, 1011.689'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 49923.623'MB/sec zip my value time = 0.92's, unzip length = 0.132'GB zip my value throughput = 143.429'MB/sec zip pipeline throughput = 143.429'MB/sec entries = 129433 avg-key = 20.00 avg-zkey = 1.70 avg-val = 1016.97 avg-zval = 312.08 usrkeys = 129433 avg-key = 12.00 avg-zkey = 1.70 avg-val = 1019.58 avg-zval = 312.08 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 48157 bytes = 180608 } seq expand size = 337099 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0404 GB dict = 1.38 MB all = 0.0422 GB } UnZip/Zip{ index = 7.0467 value = 3.2587 dict = 1.00 all = 3.1810 } Zip/UnZip{ index = 0.1419 value = 0.3069 dict = 1.00 all = 0.3144 } ---------------------------- total value len = 10.835939 GB avg = 0.200 KB (by entry num) total key len = 1.479650 GB avg = 0.027 KB total ukey len = 1.021176 GB avg = 0.015 KB total ukey num = 0.067491895 Billion total entry num = 0.054299624 Billion write speed all = 0.369746677 MB/sec (with seq num) write speed all = 0.356704927 MB/sec (without seq num) 2024/11/23-18:10:20.449033 139957634799168 [compaction_job.cc:1948] [default] [JOB 32760] Generated table #274087: 129433 keys, 42194147 bytes, temperature: kWarm 2024/11/23-18:10:20.449098 139957634799168 EVENT_LOG_v1 {"time_micros": 1732356620449065, "cf_name": "default", "job": 32760, "event": "table_file_creation", "file_number": 274087, "file_size": 42194147, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4172448536, "table_properties": {"data_size": 40392992, "index_size": 220416, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588660, "raw_average_key_size": 20, "raw_value_size": 131629794, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129433, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732356618, "oldest_key_time": 0, "file_creation_time": 1732356618, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 274087, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-18:10:20.486080 139957634799168 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274088.sst) /dev/shm/ToplingTemp/Topling-144794-btxWLP 2024/11/23-18:10:21.226604 139957634799168 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274088.sst): first pass time = 0.74's, 181.258'MB/sec 2024/11/23-18:10:22.013305 139957634799168 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274088.sst): old prealloc_size = 147639500, real_size = 40944016 2024/11/23-18:10:22.013428 139957634799168 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274088.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129428 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.73 raw-val = 0.1316 GB zip-val = 0.0407 GB avg-val =1017.01 avg-zval = 314.37 2024/11/23-18:10:22.013568 139957634799168 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274088.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-18:10:22.178113 139957634799168 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274088.sst): second pass time = 0.79's, 167.471'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 259.226'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2247.704'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.271'MB/sec write SST data time = 0.05's, 939.717'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 47237.862'MB/sec zip my value time = 0.79's, unzip length = 0.132'GB zip my value throughput = 167.471'MB/sec zip pipeline throughput = 167.471'MB/sec entries = 129428 avg-key = 20.00 avg-zkey = 1.73 avg-val = 1017.01 avg-zval = 314.37 usrkeys = 129428 avg-key = 12.00 avg-zkey = 1.73 avg-val = 1022.92 avg-zval = 314.37 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 109356 bytes = 410096 } seq expand size = 765492 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0407 GB dict = 1.38 MB all = 0.0427 GB } UnZip/Zip{ index = 6.9515 value = 3.2351 dict = 1.00 all = 3.1417 } Zip/UnZip{ index = 0.1439 value = 0.3091 dict = 1.00 all = 0.3183 } ---------------------------- total value len = 10.968334 GB avg = 0.202 KB (by entry num) total key len = 1.482239 GB avg = 0.027 KB total ukey len = 1.022729 GB avg = 0.015 KB total ukey num = 0.067621323 Billion total entry num = 0.054429052 Billion write speed all = 0.373779250 MB/sec (with seq num) write speed all = 0.360707112 MB/sec (without seq num) 2024/11/23-18:10:22.235303 139957634799168 [compaction_job.cc:1948] [default] [JOB 32760] Generated table #274088: 129428 keys, 42721452 bytes, temperature: kWarm 2024/11/23-18:10:22.235366 139957634799168 EVENT_LOG_v1 {"time_micros": 1732356622235333, "cf_name": "default", "job": 32760, "event": "table_file_creation", "file_number": 274088, "file_size": 42721452, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4172457765, "table_properties": {"data_size": 40688064, "index_size": 223424, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588560, "raw_average_key_size": 20, "raw_value_size": 131629553, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129428, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732356620, "oldest_key_time": 0, "file_creation_time": 1732356620, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 274088, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-18:10:22.272208 139957634799168 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274089.sst) /dev/shm/ToplingTemp/Topling-144794-3mhpLQ 2024/11/23-18:10:22.783605 139957634799168 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274089.sst): first pass time = 0.51's, 262.473'MB/sec 2024/11/23-18:10:23.756655 139957634799168 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274089.sst): old prealloc_size = 147639500, real_size = 40928080 2024/11/23-18:10:23.756776 139957634799168 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274089.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129427 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.71 raw-val = 0.1316 GB zip-val = 0.0407 GB avg-val =1017.02 avg-zval = 314.26 2024/11/23-18:10:23.756932 139957634799168 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274089.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-18:10:23.917106 139957634799168 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274089.sst): second pass time = 0.97's, 135.443'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 265.929'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2200.462'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.275'MB/sec write SST data time = 0.04's, 1004.262'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 47569.929'MB/sec zip my value time = 0.97's, unzip length = 0.132'GB zip my value throughput = 135.443'MB/sec zip pipeline throughput = 190.000'MB/sec entries = 129427 avg-key = 20.00 avg-zkey = 1.71 avg-val = 1017.02 avg-zval = 314.26 usrkeys = 129427 avg-key = 12.00 avg-zkey = 1.71 avg-val = 1022.31 avg-zval = 314.26 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 97862 bytes = 366992 } seq expand size = 685034 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0407 GB dict = 1.38 MB all = 0.0427 GB } UnZip/Zip{ index = 6.9996 value = 3.2362 dict = 1.00 all = 3.1461 } Zip/UnZip{ index = 0.1429 value = 0.3090 dict = 1.00 all = 0.3179 } ---------------------------- total value len = 11.100649 GB avg = 0.203 KB (by entry num) total key len = 1.484827 GB avg = 0.027 KB total ukey len = 1.024282 GB avg = 0.015 KB total ukey num = 0.067750750 Billion total entry num = 0.054558479 Billion write speed all = 0.377809463 MB/sec (with seq num) write speed all = 0.364706925 MB/sec (without seq num) 2024/11/23-18:10:23.970899 139957634799168 [compaction_job.cc:1948] [default] [JOB 32760] Generated table #274089: 129427 keys, 42662265 bytes, temperature: kWarm 2024/11/23-18:10:23.970973 139957634799168 EVENT_LOG_v1 {"time_micros": 1732356623970935, "cf_name": "default", "job": 32760, "event": "table_file_creation", "file_number": 274089, "file_size": 42662265, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4172460766, "table_properties": {"data_size": 40673664, "index_size": 221888, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588540, "raw_average_key_size": 20, "raw_value_size": 131629688, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129427, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732356622, "oldest_key_time": 0, "file_creation_time": 1732356622, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 274089, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-18:10:24.006706 139957634799168 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274090.sst) /dev/shm/ToplingTemp/Topling-144794-L74CbP 2024/11/23-18:10:24.687599 139957634799168 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274090.sst): first pass time = 0.68's, 197.130'MB/sec 2024/11/23-18:10:25.496064 139957634799168 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274090.sst): old prealloc_size = 147639500, real_size = 40741248 2024/11/23-18:10:25.496183 139957634799168 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274090.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129427 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.77 raw-val = 0.1316 GB zip-val = 0.0405 GB avg-val =1017.02 avg-zval = 312.76 2024/11/23-18:10:25.496341 139957634799168 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274090.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-18:10:25.659251 139957634799168 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274090.sst): second pass time = 0.81's, 162.950'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 260.631'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2387.626'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.270'MB/sec write SST data time = 0.04's, 985.268'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 43296.695'MB/sec zip my value time = 0.81's, unzip length = 0.132'GB zip my value throughput = 162.950'MB/sec zip pipeline throughput = 162.950'MB/sec entries = 129427 avg-key = 20.00 avg-zkey = 1.77 avg-val = 1017.02 avg-zval = 312.76 usrkeys = 129427 avg-key = 12.00 avg-zkey = 1.77 avg-val = 1023.03 avg-zval = 312.76 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 111135 bytes = 416768 } seq expand size = 777945 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0405 GB dict = 1.38 MB all = 0.0425 GB } UnZip/Zip{ index = 6.7843 value = 3.2517 dict = 1.00 all = 3.1561 } Zip/UnZip{ index = 0.1474 value = 0.3075 dict = 1.00 all = 0.3168 } ---------------------------- total value len = 11.233056 GB avg = 0.205 KB (by entry num) total key len = 1.487416 GB avg = 0.027 KB total ukey len = 1.025835 GB avg = 0.015 KB total ukey num = 0.067880177 Billion total entry num = 0.054687906 Billion write speed all = 0.381841999 MB/sec (with seq num) write speed all = 0.368709065 MB/sec (without seq num) 2024/11/23-18:10:25.715451 139957634799168 [compaction_job.cc:1948] [default] [JOB 32760] Generated table #274090: 129427 keys, 42526146 bytes, temperature: kWarm 2024/11/23-18:10:25.715517 139957634799168 EVENT_LOG_v1 {"time_micros": 1732356625715483, "cf_name": "default", "job": 32760, "event": "table_file_creation", "file_number": 274090, "file_size": 42526146, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4172459189, "table_properties": {"data_size": 40479792, "index_size": 228928, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588540, "raw_average_key_size": 20, "raw_value_size": 131629375, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129427, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732356623, "oldest_key_time": 0, "file_creation_time": 1732356623, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 274090, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-18:10:25.757205 139957634799168 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274091.sst) /dev/shm/ToplingTemp/Topling-144794-RKt94P 2024/11/23-18:10:26.381544 139957634799168 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274091.sst): first pass time = 0.62's, 214.988'MB/sec 2024/11/23-18:10:27.249086 139957634799168 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274091.sst): old prealloc_size = 147639500, real_size = 40465840 2024/11/23-18:10:27.249234 139957634799168 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274091.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129430 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.72 raw-val = 0.1316 GB zip-val = 0.0402 GB avg-val =1016.99 avg-zval = 310.68 2024/11/23-18:10:27.249353 139957634799168 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274091.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-18:10:27.468792 139957634799168 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274091.sst): second pass time = 0.87's, 151.879'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.22's, 190.969'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1755.823'MB/sec (index lex order gen) rebuild zvType time = 0.18's, 0.185'MB/sec write SST data time = 0.04's, 944.915'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 45441.330'MB/sec zip my value time = 0.87's, unzip length = 0.132'GB zip my value throughput = 151.879'MB/sec zip pipeline throughput = 159.366'MB/sec entries = 129430 avg-key = 20.00 avg-zkey = 1.72 avg-val = 1016.99 avg-zval = 310.68 usrkeys = 129430 avg-key = 12.00 avg-zkey = 1.72 avg-val = 1018.72 avg-zval = 310.68 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 31904 bytes = 119648 } seq expand size = 223328 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0402 GB dict = 1.38 MB all = 0.0420 GB } UnZip/Zip{ index = 6.9937 value = 3.2734 dict = 1.00 all = 3.1992 } Zip/UnZip{ index = 0.1430 value = 0.3055 dict = 1.00 all = 0.3126 } ---------------------------- total value len = 11.364909 GB avg = 0.207 KB (by entry num) total key len = 1.490005 GB avg = 0.027 KB total ukey len = 1.027388 GB avg = 0.015 KB total ukey num = 0.068009607 Billion total entry num = 0.054817336 Billion write speed all = 0.385856685 MB/sec (with seq num) write speed all = 0.372693385 MB/sec (without seq num) 2024/11/23-18:10:27.521117 139957634799168 [compaction_job.cc:1948] [default] [JOB 32760] Generated table #274091: 129430 keys, 41953103 bytes, temperature: kWarm 2024/11/23-18:10:27.521188 139957634799168 EVENT_LOG_v1 {"time_micros": 1732356627521151, "cf_name": "default", "job": 32760, "event": "table_file_creation", "file_number": 274091, "file_size": 41953103, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4172400795, "table_properties": {"data_size": 40211232, "index_size": 222080, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588600, "raw_average_key_size": 20, "raw_value_size": 131629324, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129430, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732356625, "oldest_key_time": 0, "file_creation_time": 1732356625, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 274091, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-18:10:27.565933 139957634799168 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274092.sst) /dev/shm/ToplingTemp/Topling-144794-wPouDQ 2024/11/23-18:10:28.194229 139957634799168 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274092.sst): first pass time = 0.63's, 213.635'MB/sec 2024/11/23-18:10:28.999499 139957634799168 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274092.sst): old prealloc_size = 147639500, real_size = 40600864 2024/11/23-18:10:28.999615 139957634799168 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274092.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129426 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.72 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1017.03 avg-zval = 311.73 2024/11/23-18:10:28.999700 139957634799168 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274092.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-18:10:29.162129 139957634799168 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274092.sst): second pass time = 0.80's, 163.594'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 258.831'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2293.362'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.270'MB/sec write SST data time = 0.04's, 987.123'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 46184.643'MB/sec zip my value time = 0.80's, unzip length = 0.132'GB zip my value throughput = 163.594'MB/sec zip pipeline throughput = 163.594'MB/sec entries = 129426 avg-key = 20.00 avg-zkey = 1.72 avg-val = 1017.03 avg-zval = 311.73 usrkeys = 129426 avg-key = 12.00 avg-zkey = 1.72 avg-val = 1018.73 avg-zval = 311.73 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 31564 bytes = 118384 } seq expand size = 220948 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0421 GB } UnZip/Zip{ index = 6.9935 value = 3.2625 dict = 1.00 all = 3.1891 } Zip/UnZip{ index = 0.1430 value = 0.3065 dict = 1.00 all = 0.3136 } ---------------------------- total value len = 11.496760 GB avg = 0.209 KB (by entry num) total key len = 1.492593 GB avg = 0.027 KB total ukey len = 1.028941 GB avg = 0.015 KB total ukey num = 0.068139033 Billion total entry num = 0.054946762 Billion write speed all = 0.389872232 MB/sec (with seq num) write speed all = 0.376678524 MB/sec (without seq num) 2024/11/23-18:10:29.214928 139957634799168 [compaction_job.cc:1948] [default] [JOB 32760] Generated table #274092: 129426 keys, 42086892 bytes, temperature: kWarm 2024/11/23-18:10:29.215005 139957634799168 EVENT_LOG_v1 {"time_micros": 1732356629214953, "cf_name": "default", "job": 32760, "event": "table_file_creation", "file_number": 274092, "file_size": 42086892, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4172453927, "table_properties": {"data_size": 40346256, "index_size": 222080, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588520, "raw_average_key_size": 20, "raw_value_size": 131629699, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129426, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732356627, "oldest_key_time": 0, "file_creation_time": 1732356627, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 274092, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-18:10:29.254835 139957634799168 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274093.sst) /dev/shm/ToplingTemp/Topling-144794-C5rUyQ 2024/11/23-18:10:29.849873 139957634799168 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274093.sst): first pass time = 0.60's, 225.577'MB/sec 2024/11/23-18:10:30.672121 139957634799168 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274093.sst): old prealloc_size = 147639500, real_size = 40465248 2024/11/23-18:10:30.672244 139957634799168 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274093.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129431 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.72 raw-val = 0.1316 GB zip-val = 0.0402 GB avg-val =1016.99 avg-zval = 310.67 2024/11/23-18:10:30.672346 139957634799168 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274093.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-18:10:30.888409 139957634799168 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274093.sst): second pass time = 0.82's, 160.231'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.22's, 193.983'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2199.465'MB/sec (index lex order gen) rebuild zvType time = 0.15's, 0.211'MB/sec write SST data time = 0.06's, 670.040'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 46488.381'MB/sec zip my value time = 0.82's, unzip length = 0.132'GB zip my value throughput = 160.231'MB/sec zip pipeline throughput = 160.231'MB/sec entries = 129431 avg-key = 20.00 avg-zkey = 1.72 avg-val = 1016.99 avg-zval = 310.67 usrkeys = 129431 avg-key = 12.00 avg-zkey = 1.72 avg-val = 1018.67 avg-zval = 310.67 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 31109 bytes = 116672 } seq expand size = 217763 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0402 GB dict = 1.38 MB all = 0.0419 GB } UnZip/Zip{ index = 6.9938 value = 3.2735 dict = 1.00 all = 3.1995 } Zip/UnZip{ index = 0.1430 value = 0.3055 dict = 1.00 all = 0.3125 } ---------------------------- total value len = 11.628608 GB avg = 0.211 KB (by entry num) total key len = 1.495182 GB avg = 0.027 KB total ukey len = 1.030494 GB avg = 0.015 KB total ukey num = 0.068268464 Billion total entry num = 0.055076193 Billion write speed all = 0.393886903 MB/sec (with seq num) write speed all = 0.380662801 MB/sec (without seq num) 2024/11/23-18:10:30.944209 139957634799168 [compaction_job.cc:1948] [default] [JOB 32760] Generated table #274093: 129431 keys, 41949917 bytes, temperature: kWarm 2024/11/23-18:10:30.944309 139957634799168 EVENT_LOG_v1 {"time_micros": 1732356630944252, "cf_name": "default", "job": 32760, "event": "table_file_creation", "file_number": 274093, "file_size": 41949917, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4172461116, "table_properties": {"data_size": 40210640, "index_size": 222080, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588620, "raw_average_key_size": 20, "raw_value_size": 131630135, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129431, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732356629, "oldest_key_time": 0, "file_creation_time": 1732356629, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 274093, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-18:10:30.995123 139957634799168 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274094.sst) /dev/shm/ToplingTemp/Topling-144794-m0OZXQ 2024/11/23-18:10:31.620024 139957634799168 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274094.sst): first pass time = 0.62's, 214.802'MB/sec 2024/11/23-18:10:32.405864 139957634799168 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274094.sst): old prealloc_size = 147639500, real_size = 40864224 2024/11/23-18:10:32.406002 139957634799168 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274094.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129430 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.72 raw-val = 0.1316 GB zip-val = 0.0406 GB avg-val =1017.00 avg-zval = 313.76 2024/11/23-18:10:32.406151 139957634799168 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274094.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-18:10:32.572284 139957634799168 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274094.sst): second pass time = 0.78's, 167.825'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.17's, 255.915'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1873.118'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.267'MB/sec write SST data time = 0.05's, 943.353'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 42862.275'MB/sec zip my value time = 0.78's, unzip length = 0.132'GB zip my value throughput = 167.825'MB/sec zip pipeline throughput = 167.825'MB/sec entries = 129430 avg-key = 20.00 avg-zkey = 1.72 avg-val = 1017.00 avg-zval = 313.76 usrkeys = 129430 avg-key = 12.00 avg-zkey = 1.72 avg-val = 1022.04 avg-zval = 313.76 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 93241 bytes = 349664 } seq expand size = 652687 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0406 GB dict = 1.38 MB all = 0.0426 GB } UnZip/Zip{ index = 6.9897 value = 3.2414 dict = 1.00 all = 3.1520 } Zip/UnZip{ index = 0.1431 value = 0.3085 dict = 1.00 all = 0.3173 } ---------------------------- total value len = 11.760890 GB avg = 0.213 KB (by entry num) total key len = 1.497770 GB avg = 0.027 KB total ukey len = 1.032048 GB avg = 0.015 KB total ukey num = 0.068397894 Billion total entry num = 0.055205623 Billion write speed all = 0.397914702 MB/sec (with seq num) write speed all = 0.384660193 MB/sec (without seq num) 2024/11/23-18:10:32.628785 139957634799168 [compaction_job.cc:1948] [default] [JOB 32760] Generated table #274094: 129430 keys, 42581648 bytes, temperature: kWarm 2024/11/23-18:10:32.628854 139957634799168 EVENT_LOG_v1 {"time_micros": 1732356632628814, "cf_name": "default", "job": 32760, "event": "table_file_creation", "file_number": 274094, "file_size": 42581648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4172466475, "table_properties": {"data_size": 40609488, "index_size": 222208, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588600, "raw_average_key_size": 20, "raw_value_size": 131629685, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129430, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732356630, "oldest_key_time": 0, "file_creation_time": 1732356630, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 274094, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-18:10:32.670818 139957634799168 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274095.sst) /dev/shm/ToplingTemp/Topling-144794-P1t39Q 2024/11/23-18:10:32.678949 139957634799168 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274095.sst): first pass time = 0.01's, 349.032'MB/sec 2024/11/23-18:10:32.710411 139957634799168 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274095.sst): old prealloc_size = 147639500, real_size = 897960 2024/11/23-18:10:32.710451 139957634799168 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274095.sst): index type = UintIndex_IL_256_32 , store type = DictZipBlobStore usrkeys = 2726 prefix = 4 raw-key = 0.0000 GB zip-key = 0.0000 GB avg-key = 8.00 avg-zkey = 0.28 raw-val = 0.0028 GB zip-val = 0.0009 GB avg-val =1016.83 avg-zval = 328.82 2024/11/23-18:10:32.713629 139957634799168 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00/274095.sst): second pass time = 0.03's, 89.402'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.00's, 293.392'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 31.399'MB/sec (index lex order gen) rebuild zvType time = 0.00's, 0.311'MB/sec write SST data time = 0.00's, 952.288'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.033'MB, throughput = 1285.088'MB/sec zip my value time = 0.03's, unzip length = 0.003'GB zip my value throughput = 89.402'MB/sec zip pipeline throughput = 89.402'MB/sec entries = 2726 avg-key = 20.00 avg-zkey = 0.28 avg-val = 1016.83 avg-zval = 328.82 usrkeys = 2726 avg-key = 12.00 avg-zkey = 0.28 avg-val = 1023.83 avg-zval = 328.82 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 2726 bytes = 8880 } seq expand size = 19082 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0000 GB value = 0.0028 GB dict = 0.03 MB all = 0.0028 GB } __ZipSize{ index = 0.0000 GB value = 0.0009 GB dict = 0.03 MB all = 0.0009 GB } UnZip/Zip{ index = 42.5938 value = 3.0924 dict = 1.00 all = 3.0077 } Zip/UnZip{ index = 0.0235 value = 0.3234 dict = 1.00 all = 0.3325 } ---------------------------- total value len = 11.763681 GB avg = 0.213 KB (by entry num) total key len = 1.497825 GB avg = 0.027 KB total ukey len = 1.032080 GB avg = 0.015 KB total ukey num = 0.068400620 Billion total entry num = 0.055208349 Billion write speed all = 0.397998411 MB/sec (with seq num) write speed all = 0.384743304 MB/sec (without seq num) 2024/11/23-18:10:32.722060 139957634799168 [compaction_job.cc:1948] [default] [JOB 32760] Generated table #274095: 2726 keys, 939715 bytes, temperature: kWarm 2024/11/23-18:10:32.722105 139957634799168 EVENT_LOG_v1 {"time_micros": 1732356632722080, "cf_name": "default", "job": 32760, "event": "table_file_creation", "file_number": 274095, "file_size": 939715, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4137795880, "largest_seqno": 4172466040, "table_properties": {"data_size": 896352, "index_size": 768, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 54520, "raw_average_key_size": 20, "raw_value_size": 2771877, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 2726, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-UintIndex_IL_256_32-DictZipBlobStore", "creation_time": 1732356632, "oldest_key_time": 0, "file_creation_time": 1732356632, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 274095, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-18:10:32.732501 139957634799168 [compaction_job.cc:703] job-32760: subcompact[0], size: 0.935773 G, files: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32760/att-00 [274073,274074,274075,274076,274077,274078,274079,274080,274081,274082,274083,274084,274085,274086,274087,274088,274089,274090,274091,274092,274093,274094,274095] 2024/11/23-18:10:32.882526 139957634799168 (Original Log Time 2024/11/23-18:09:51.373340) EVENT_LOG_v1 {"time_micros": 1732356591373291, "job": 32760, "event": "compaction_started", "compaction_reason": "FilesMarkedForCompaction", "files_L2": [274066], "files_L3": [273970, 273971, 273972, 273973, 273974, 273975, 273976, 273977, 273978, 273979, 273980, 273981, 273982, 273983, 273984, 273985, 273986, 273987, 273988, 273989, 273990, 274069], "score": 0.997425, "input_data_size": 967526595, "oldest_snapshot_seqno": 4172615490} 2024/11/23-18:10:32.882530 139957634799168 (Original Log Time 2024/11/23-18:10:32.880859) [compaction_job.cc:2022] [default] [JOB 32760] Compacted 1@2 + 22@3 files to L3 => 935772955 bytes 2024/11/23-18:10:32.882532 139957634799168 (Original Log Time 2024/11/23-18:10:32.882447) [compaction_job.cc:1224] [default] compacted to: files[0 0 0 23 0 0 0] max score 0.03, MB/sec: 23.4 rd, 22.6 wr, level 3, files in(1, 22) out(23 +0 blob) MB in(31.2, 891.5 +0.0 blob) out(892.4 +0.0 blob), read-write-amplify(58.2) write-amplify(28.6) OK, records in: 2879371, records dropped: 29186 output_compression: Snappy 2024/11/23-18:10:32.882535 139957634799168 (Original Log Time 2024/11/23-18:10:32.882500) EVENT_LOG_v1 {"time_micros": 1732356632882476, "cf": "default", "job": 32760, "event": "compaction_finished", "compaction_time_micros": 41359164, "compaction_time_cpu_micros": 8459163, "output_level": 3, "num_output_files": 23, "total_output_size": 935772955, "num_input_records": 2879371, "num_output_records": 2850185, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "file_write_nanos": 650824977, "file_range_sync_nanos": 0, "file_fsync_nanos": 16596, "file_prepare_write_nanos": 47250, "lsm_state": [0, 0, 0, 23, 0, 0, 0]} 2024/11/23-18:10:33.021094 139957634799168 DEBG dcompact_worker.cpp:240: HttpPost: 200 OK: url = http://nlb-7zny4kaa1poal01o64.cn-shenzhen.nlb.aliyuncs.com:8443, body = {"instanceId":"nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137","labourId":"","dbId":"d89b4006-2803-486e-b7a2-759bcf348921","dbStarts":1732256054,"starts":1732356591,"executesMs":41666,"compactionJobId":32760,"attempt":0,"compactionInputRawBytes":2985893370,"compactionInputZipBytes":967526595,"compactionOutputRawBytes":0,"compactionOutputZipBytes":935772955,"headers":{"Accept":"*/*","Connection":"close","Host":"aliyun-topling-saas.topling.cn:18443","RemoteIp":"120.24.192.169","X-Forwarded-For":"120.24.192.169","region":"cn-shenzhen","token":"e6474c481bd4415abc537135cc03626b","instance-token":"e6474c481bd4415abc537135cc03626b","provider":"aliyun","CloudMarketInstanceId":"si-59c0ae5c955845588903","MeteringAssit":"","Transfer-Encoding":"chunked","traceparent":"00-134984af4e15cff0808bd833b50aca2d-27ec57c943096656-00"}}, response = 2024/11/23-18:10:33.021181 139957634799168 INFO dcompact_worker.cpp:1459: finish /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-32760/att-00: olev 3, work 41.666 s, result 9.734 ms, install 1.692 ms, input{raw 2.781 GiB zip 922.705 MiB}