2024/11/22-14:14:51.838959 140024701470272 DEBG dcompact_worker.cpp:2214: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00: fork to child time = 0.009420 sec 2024/11/22-14:14:51.839834 140024701470272 DEBG dcompact_worker.cpp:1013: Beg SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00 2024/11/22-14:14:51.846792 140024701470272 DEBG dcompact_worker.cpp:1033: End SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00 2024/11/22-14:14:51.847883 140024701470272 TRAC dcompact_worker.cpp:1083: INFO_LOG_LEVEL: rpc = INFO_LEVEL, env_var = undefined 2024/11/22-14:14:51.848151 140024701470272 [WARN] [column_family.cc:386] multiple cf_paths/db_paths and level_compaction_dynamic_level_bytes can't be used together 2024/11/22-14:14:51.902448 140024701470272 [version_set.cc:6208] Recovering from manifest file: /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-00048/att-00/MANIFEST-206347 2024/11/22-14:14:51.933250 140024701470272 [version_set.cc:6251] Recovered from manifest file:/worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-00048/att-00/MANIFEST-206347 succeeded,manifest_file_number is 206347, next_file_number is 206417, last_sequence is 3274116843, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 206336 2024/11/22-14:14:51.933261 140024701470272 [version_set.cc:6266] Column family [default] (ID 0), log number is 0 2024/11/22-14:14:51.933418 140024701470272 [version_set.cc:5721] Creating manifest 206417 2024/11/22-14:14:51.971184 140024701470272 DEBG dcompact_worker.cpp:1218: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00: bottommost_level: fake = 1, rpc = 1 2024/11/22-14:14:51.991931 140024701470272 [compaction_job.cc:2437] [default] [JOB 48] Compacting 1@2 + 19@3 files to L3, score 0.80, subcompactions 1 : 1 2024/11/22-14:14:51.991954 140024701470272 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 38 Base level 2, inputs: [206413(17MB)], [206394(39MB) 206395(39MB) 206396(39MB) 206397(39MB) 206398(39MB) 206399(39MB) 206400(39MB) 206401(39MB) 206402(39MB) 206403(39MB) 206404(39MB) 206405(39MB) 206406(39MB) 206407(39MB) 206408(39MB) 206409(39MB) 206410(39MB) 206411(39MB) 206412(13MB)] 2024/11/22-14:14:51.996808 140024701470272 [top_zip_table.cc:59] core git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/22-14:14:51.996842 140024701470272 [top_zip_table.cc:60] fsa git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/22-14:14:51.996863 140024701470272 [top_zip_table.cc:61] zbs git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/22-14:14:51.996869 140024701470272 [top_zip_table.cc:62] topling-zip_table_reader: git_version_hash_info_is: commit a4a382006cb82713acf5b3425835f22711877681 Author: leipeng Date: 2024-04-11 19:44:14 +0800 fixed_len_hole_index.cc: Add env bool FixedLenHoleIndexUseAVX512 for ut & debug 1. FixedLenHoleIndexUseAVX512 is only in unit tests or debug 2. In release mode, use avx512 by compile options(-march=) g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/22-14:14:51.996881 140024701470272 [top_zip_table.cc:64] topling-rocks git_version_hash_info_is: commit feab587e468621ba0204d47b4ffacc52e7c4290d Author: leipeng Date: 2024-03-22 13:35:06 +0800 ToplingZipTableBuilder::Add: immediately return after error This function returns void, and caller does not check builder->status() after calling this function and graceful abandon. So immediately return after error, and return error status in Finish(). g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/22-14:14:52.457694 140024701470272 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206418.sst) /dev/shm/ToplingTemp/Topling-132588-n98NwQ 2024/11/22-14:14:53.191315 140024701470272 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206418.sst): first pass time = 0.73's, 182.968'MB/sec 2024/11/22-14:14:54.006945 140024701470272 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206418.sst): old prealloc_size = 147639500, real_size = 40587488 2024/11/22-14:14:54.007061 140024701470272 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206418.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129428 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1017.01 avg-zval = 311.65 2024/11/22-14:14:54.007101 140024701470272 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206418.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-14:14:54.163106 140024701470272 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206418.sst): second pass time = 0.81's, 161.675'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 268.540'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2334.012'MB/sec (index lex order gen) rebuild zvType time = 0.11's, 0.305'MB/sec write SST data time = 0.05's, 841.929'MB/sec dict compress time = 0.00's, 1378164.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 45523.023'MB/sec zip my value time = 0.81's, unzip length = 0.132'GB zip my value throughput = 161.675'MB/sec zip pipeline throughput = 161.675'MB/sec entries = 129428 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1017.01 avg-zval = 311.65 usrkeys = 129428 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1017.01 avg-zval = 311.65 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 8 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0419 GB } UnZip/Zip{ index = 7.0979 value = 3.2633 dict = 1.00 all = 3.2006 } Zip/UnZip{ index = 0.1409 value = 0.3064 dict = 1.00 all = 0.3124 } ---------------------------- total value len = 0.131630 GB avg = 1.017 KB (by entry num) total key len = 0.002589 GB avg = 0.020 KB total ukey len = 0.001553 GB avg = 0.012 KB total ukey num = 0.000129428 Billion total entry num = 0.000129428 Billion write speed all = 0.006935973 MB/sec (with seq num) write speed all = 0.006882465 MB/sec (without seq num) 2024/11/22-14:14:54.200445 140024701470272 [compaction_job.cc:1948] [default] [JOB 48] Generated table #206418: 129428 keys, 41934950 bytes, temperature: kWarm 2024/11/22-14:14:54.200534 140024701470272 EVENT_LOG_v1 {"time_micros": 1732256094200481, "cf_name": "default", "job": 48, "event": "table_file_creation", "file_number": 206418, "file_size": 41934950, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 40336144, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588560, "raw_average_key_size": 20, "raw_value_size": 131629911, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129428, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732256092, "oldest_key_time": 0, "file_creation_time": 1732256092, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 206418, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-14:14:54.237365 140024701470272 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206419.sst) /dev/shm/ToplingTemp/Topling-132588-d7Ln7R 2024/11/22-14:14:54.779379 140024701470272 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206419.sst): first pass time = 0.54's, 247.647'MB/sec 2024/11/22-14:14:55.591090 140024701470272 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206419.sst): old prealloc_size = 147639500, real_size = 40549984 2024/11/22-14:14:55.591226 140024701470272 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206419.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129432 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1016.98 avg-zval = 311.35 2024/11/22-14:14:55.591263 140024701470272 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206419.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-14:14:55.745584 140024701470272 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206419.sst): second pass time = 0.81's, 162.383'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.15's, 271.207'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1959.927'MB/sec (index lex order gen) rebuild zvType time = 0.10's, 0.310'MB/sec write SST data time = 0.05's, 836.633'MB/sec dict compress time = 0.00's, 1377954.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 42437.758'MB/sec zip my value time = 0.81's, unzip length = 0.132'GB zip my value throughput = 162.383'MB/sec zip pipeline throughput = 162.383'MB/sec entries = 129432 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1016.98 avg-zval = 311.35 usrkeys = 129432 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1016.98 avg-zval = 311.35 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 8 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0419 GB } UnZip/Zip{ index = 7.0981 value = 3.2663 dict = 1.00 all = 3.2035 } Zip/UnZip{ index = 0.1409 value = 0.3062 dict = 1.00 all = 0.3122 } ---------------------------- total value len = 0.263259 GB avg = 1.017 KB (by entry num) total key len = 0.005177 GB avg = 0.020 KB total ukey len = 0.003106 GB avg = 0.012 KB total ukey num = 0.000258860 Billion total entry num = 0.000258860 Billion write speed all = 0.013870789 MB/sec (with seq num) write speed all = 0.013763782 MB/sec (without seq num) 2024/11/22-14:14:55.784099 140024701470272 [compaction_job.cc:1948] [default] [JOB 48] Generated table #206419: 129432 keys, 41897236 bytes, temperature: kWarm 2024/11/22-14:14:55.784164 140024701470272 EVENT_LOG_v1 {"time_micros": 1732256095784132, "cf_name": "default", "job": 48, "event": "table_file_creation", "file_number": 206419, "file_size": 41897236, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 40298640, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588640, "raw_average_key_size": 20, "raw_value_size": 131629409, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129432, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732256094, "oldest_key_time": 0, "file_creation_time": 1732256094, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 206419, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-14:14:55.829009 140024701470272 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206420.sst) /dev/shm/ToplingTemp/Topling-132588-zYsVrT 2024/11/22-14:14:56.365986 140024701470272 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206420.sst): first pass time = 0.54's, 249.972'MB/sec 2024/11/22-14:14:57.334241 140024701470272 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206420.sst): old prealloc_size = 147639500, real_size = 40355472 2024/11/22-14:14:57.334356 140024701470272 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206420.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129428 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1017.01 avg-zval = 309.86 2024/11/22-14:14:57.334387 140024701470272 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206420.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-14:14:57.488625 140024701470272 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206420.sst): second pass time = 0.97's, 136.025'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.15's, 270.141'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2448.373'MB/sec (index lex order gen) rebuild zvType time = 0.10's, 0.312'MB/sec write SST data time = 0.05's, 825.242'MB/sec dict compress time = 0.00's, 1377771.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 38090.487'MB/sec zip my value time = 0.97's, unzip length = 0.132'GB zip my value throughput = 136.025'MB/sec zip pipeline throughput = 167.901'MB/sec entries = 129428 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1017.01 avg-zval = 309.86 usrkeys = 129428 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1017.01 avg-zval = 309.86 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0979 value = 3.2822 dict = 1.00 all = 3.2185 } Zip/UnZip{ index = 0.1409 value = 0.3047 dict = 1.00 all = 0.3107 } ---------------------------- total value len = 0.394889 GB avg = 1.017 KB (by entry num) total key len = 0.007766 GB avg = 0.020 KB total ukey len = 0.004659 GB avg = 0.012 KB total ukey num = 0.000388288 Billion total entry num = 0.000388288 Billion write speed all = 0.020804299 MB/sec (with seq num) write speed all = 0.020643803 MB/sec (without seq num) 2024/11/22-14:14:57.523323 140024701470272 [compaction_job.cc:1948] [default] [JOB 48] Generated table #206420: 129428 keys, 41702557 bytes, temperature: kWarm 2024/11/22-14:14:57.523386 140024701470272 EVENT_LOG_v1 {"time_micros": 1732256097523355, "cf_name": "default", "job": 48, "event": "table_file_creation", "file_number": 206420, "file_size": 41702557, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 40104128, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588560, "raw_average_key_size": 20, "raw_value_size": 131629499, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129428, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732256095, "oldest_key_time": 0, "file_creation_time": 1732256095, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 206420, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-14:14:57.560150 140024701470272 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206421.sst) /dev/shm/ToplingTemp/Topling-132588-CpRPLQ 2024/11/22-14:14:58.067620 140024701470272 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206421.sst): first pass time = 0.51's, 264.511'MB/sec 2024/11/22-14:14:58.865965 140024701470272 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206421.sst): old prealloc_size = 147639500, real_size = 40356240 2024/11/22-14:14:58.866084 140024701470272 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206421.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129428 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1017.01 avg-zval = 309.86 2024/11/22-14:14:58.866115 140024701470272 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206421.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-14:14:59.021469 140024701470272 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206421.sst): second pass time = 0.80's, 165.022'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 268.206'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2272.327'MB/sec (index lex order gen) rebuild zvType time = 0.11's, 0.308'MB/sec write SST data time = 0.05's, 828.624'MB/sec dict compress time = 0.00's, 1378275.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 43410.236'MB/sec zip my value time = 0.80's, unzip length = 0.132'GB zip my value throughput = 165.022'MB/sec zip pipeline throughput = 165.022'MB/sec entries = 129428 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1017.01 avg-zval = 309.86 usrkeys = 129428 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1017.01 avg-zval = 309.86 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0979 value = 3.2821 dict = 1.00 all = 3.2184 } Zip/UnZip{ index = 0.1409 value = 0.3047 dict = 1.00 all = 0.3107 } ---------------------------- total value len = 0.526519 GB avg = 1.017 KB (by entry num) total key len = 0.010354 GB avg = 0.020 KB total ukey len = 0.006213 GB avg = 0.012 KB total ukey num = 0.000517716 Billion total entry num = 0.000517716 Billion write speed all = 0.027736884 MB/sec (with seq num) write speed all = 0.027522907 MB/sec (without seq num) 2024/11/22-14:14:59.058383 140024701470272 [compaction_job.cc:1948] [default] [JOB 48] Generated table #206421: 129428 keys, 41703829 bytes, temperature: kWarm 2024/11/22-14:14:59.058448 140024701470272 EVENT_LOG_v1 {"time_micros": 1732256099058415, "cf_name": "default", "job": 48, "event": "table_file_creation", "file_number": 206421, "file_size": 41703829, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 40104896, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588560, "raw_average_key_size": 20, "raw_value_size": 131629919, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129428, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732256097, "oldest_key_time": 0, "file_creation_time": 1732256097, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 206421, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-14:14:59.095824 140024701470272 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206422.sst) /dev/shm/ToplingTemp/Topling-132588-NCNzNQ 2024/11/22-14:14:59.541984 140024701470272 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206422.sst): first pass time = 0.45's, 300.857'MB/sec 2024/11/22-14:15:00.344811 140024701470272 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206422.sst): old prealloc_size = 147639500, real_size = 40354720 2024/11/22-14:15:00.344927 140024701470272 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206422.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129428 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1017.01 avg-zval = 309.85 2024/11/22-14:15:00.344957 140024701470272 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206422.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-14:15:00.500748 140024701470272 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206422.sst): second pass time = 0.80's, 164.081'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 267.432'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2367.703'MB/sec (index lex order gen) rebuild zvType time = 0.10's, 0.309'MB/sec write SST data time = 0.05's, 816.710'MB/sec dict compress time = 0.00's, 1377981.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 41551.759'MB/sec zip my value time = 0.80's, unzip length = 0.132'GB zip my value throughput = 164.081'MB/sec zip pipeline throughput = 164.081'MB/sec entries = 129428 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1017.01 avg-zval = 309.85 usrkeys = 129428 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1017.01 avg-zval = 309.85 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 8 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0979 value = 3.2823 dict = 1.00 all = 3.2185 } Zip/UnZip{ index = 0.1409 value = 0.3047 dict = 1.00 all = 0.3107 } ---------------------------- total value len = 0.658148 GB avg = 1.017 KB (by entry num) total key len = 0.012943 GB avg = 0.020 KB total ukey len = 0.007766 GB avg = 0.012 KB total ukey num = 0.000647144 Billion total entry num = 0.000647144 Billion write speed all = 0.034668457 MB/sec (with seq num) write speed all = 0.034401006 MB/sec (without seq num) 2024/11/22-14:15:00.539321 140024701470272 [compaction_job.cc:1948] [default] [JOB 48] Generated table #206422: 129428 keys, 41701999 bytes, temperature: kWarm 2024/11/22-14:15:00.539409 140024701470272 EVENT_LOG_v1 {"time_micros": 1732256100539365, "cf_name": "default", "job": 48, "event": "table_file_creation", "file_number": 206422, "file_size": 41701999, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 40103376, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588560, "raw_average_key_size": 20, "raw_value_size": 131629725, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129428, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732256099, "oldest_key_time": 0, "file_creation_time": 1732256099, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 206422, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-14:15:00.589121 140024701470272 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206423.sst) /dev/shm/ToplingTemp/Topling-132588-jVyGxQ 2024/11/22-14:15:01.175612 140024701470272 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206423.sst): first pass time = 0.59's, 228.878'MB/sec 2024/11/22-14:15:01.983399 140024701470272 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206423.sst): old prealloc_size = 147639500, real_size = 40351344 2024/11/22-14:15:01.983519 140024701470272 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206423.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129431 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1016.99 avg-zval = 309.82 2024/11/22-14:15:01.983559 140024701470272 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206423.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-14:15:02.141047 140024701470272 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206423.sst): second pass time = 0.81's, 163.210'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 264.522'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2363.892'MB/sec (index lex order gen) rebuild zvType time = 0.10's, 0.312'MB/sec write SST data time = 0.05's, 774.400'MB/sec dict compress time = 0.00's, 1377983.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 44511.370'MB/sec zip my value time = 0.81's, unzip length = 0.132'GB zip my value throughput = 163.210'MB/sec zip pipeline throughput = 163.210'MB/sec entries = 129431 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1016.99 avg-zval = 309.82 usrkeys = 129431 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1016.99 avg-zval = 309.82 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0981 value = 3.2825 dict = 1.00 all = 3.2188 } Zip/UnZip{ index = 0.1409 value = 0.3046 dict = 1.00 all = 0.3107 } ---------------------------- total value len = 0.789778 GB avg = 1.017 KB (by entry num) total key len = 0.015532 GB avg = 0.020 KB total ukey len = 0.009319 GB avg = 0.012 KB total ukey num = 0.000776575 Billion total entry num = 0.000776575 Billion write speed all = 0.041598640 MB/sec (with seq num) write speed all = 0.041277725 MB/sec (without seq num) 2024/11/22-14:15:02.201952 140024701470272 [compaction_job.cc:1948] [default] [JOB 48] Generated table #206423: 129431 keys, 41698673 bytes, temperature: kWarm 2024/11/22-14:15:02.202009 140024701470272 EVENT_LOG_v1 {"time_micros": 1732256102201979, "cf_name": "default", "job": 48, "event": "table_file_creation", "file_number": 206423, "file_size": 41698673, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 40100000, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588620, "raw_average_key_size": 20, "raw_value_size": 131629979, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129431, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732256100, "oldest_key_time": 0, "file_creation_time": 1732256100, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 206423, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-14:15:02.248518 140024701470272 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206424.sst) /dev/shm/ToplingTemp/Topling-132588-CPW2dT 2024/11/22-14:15:02.726876 140024701470272 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206424.sst): first pass time = 0.48's, 280.604'MB/sec 2024/11/22-14:15:03.562053 140024701470272 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206424.sst): old prealloc_size = 147639500, real_size = 40350992 2024/11/22-14:15:03.562187 140024701470272 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206424.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129434 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1016.96 avg-zval = 309.81 2024/11/22-14:15:03.562220 140024701470272 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206424.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-14:15:03.717585 140024701470272 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206424.sst): second pass time = 0.83's, 157.818'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 268.118'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2064.380'MB/sec (index lex order gen) rebuild zvType time = 0.10's, 0.310'MB/sec write SST data time = 0.05's, 816.567'MB/sec dict compress time = 0.00's, 1377908.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 41352.540'MB/sec zip my value time = 0.83's, unzip length = 0.132'GB zip my value throughput = 157.818'MB/sec zip pipeline throughput = 157.818'MB/sec entries = 129434 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1016.96 avg-zval = 309.81 usrkeys = 129434 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1016.96 avg-zval = 309.81 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0982 value = 3.2826 dict = 1.00 all = 3.2188 } Zip/UnZip{ index = 0.1409 value = 0.3046 dict = 1.00 all = 0.3107 } ---------------------------- total value len = 0.921408 GB avg = 1.017 KB (by entry num) total key len = 0.018120 GB avg = 0.020 KB total ukey len = 0.010872 GB avg = 0.012 KB total ukey num = 0.000906009 Billion total entry num = 0.000906009 Billion write speed all = 0.048527790 MB/sec (with seq num) write speed all = 0.048153418 MB/sec (without seq num) 2024/11/22-14:15:03.752741 140024701470272 [compaction_job.cc:1948] [default] [JOB 48] Generated table #206424: 129434 keys, 41698214 bytes, temperature: kWarm 2024/11/22-14:15:03.752813 140024701470272 EVENT_LOG_v1 {"time_micros": 1732256103752774, "cf_name": "default", "job": 48, "event": "table_file_creation", "file_number": 206424, "file_size": 41698214, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 40099648, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588680, "raw_average_key_size": 20, "raw_value_size": 131629548, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129434, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732256102, "oldest_key_time": 0, "file_creation_time": 1732256102, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 206424, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-14:15:03.794052 140024701470272 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206425.sst) /dev/shm/ToplingTemp/Topling-132588-Wi3QlU 2024/11/22-14:15:04.259217 140024701470272 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206425.sst): first pass time = 0.47's, 288.573'MB/sec 2024/11/22-14:15:05.143681 140024701470272 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206425.sst): old prealloc_size = 147639500, real_size = 40354912 2024/11/22-14:15:05.143811 140024701470272 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206425.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129429 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1017.00 avg-zval = 309.85 2024/11/22-14:15:05.143848 140024701470272 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206425.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-14:15:05.300492 140024701470272 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206425.sst): second pass time = 0.88's, 148.935'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 265.959'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2103.029'MB/sec (index lex order gen) rebuild zvType time = 0.11's, 0.307'MB/sec write SST data time = 0.05's, 815.591'MB/sec dict compress time = 0.00's, 1377648.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 42970.930'MB/sec zip my value time = 0.88's, unzip length = 0.132'GB zip my value throughput = 148.935'MB/sec zip pipeline throughput = 148.935'MB/sec entries = 129429 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1017.00 avg-zval = 309.85 usrkeys = 129429 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1017.00 avg-zval = 309.85 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 7 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0980 value = 3.2822 dict = 1.00 all = 3.2185 } Zip/UnZip{ index = 0.1409 value = 0.3047 dict = 1.00 all = 0.3107 } ---------------------------- total value len = 1.053038 GB avg = 1.017 KB (by entry num) total key len = 0.020709 GB avg = 0.020 KB total ukey len = 0.012425 GB avg = 0.012 KB total ukey num = 0.001035438 Billion total entry num = 0.001035438 Billion write speed all = 0.055455794 MB/sec (with seq num) write speed all = 0.055027976 MB/sec (without seq num) 2024/11/22-14:15:05.337792 140024701470272 [compaction_job.cc:1948] [default] [JOB 48] Generated table #206425: 129429 keys, 41701858 bytes, temperature: kWarm 2024/11/22-14:15:05.337857 140024701470272 EVENT_LOG_v1 {"time_micros": 1732256105337824, "cf_name": "default", "job": 48, "event": "table_file_creation", "file_number": 206425, "file_size": 41701858, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 40103568, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588580, "raw_average_key_size": 20, "raw_value_size": 131629669, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129429, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732256103, "oldest_key_time": 0, "file_creation_time": 1732256103, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 206425, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-14:15:05.373712 140024701470272 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206426.sst) /dev/shm/ToplingTemp/Topling-132588-Vk8y9T 2024/11/22-14:15:05.823947 140024701470272 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206426.sst): first pass time = 0.45's, 298.134'MB/sec 2024/11/22-14:15:06.633401 140024701470272 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206426.sst): old prealloc_size = 147639500, real_size = 40352896 2024/11/22-14:15:06.633519 140024701470272 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206426.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129430 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1016.99 avg-zval = 309.83 2024/11/22-14:15:06.633554 140024701470272 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206426.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-14:15:06.789805 140024701470272 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206426.sst): second pass time = 0.81's, 162.742'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 266.659'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2369.780'MB/sec (index lex order gen) rebuild zvType time = 0.10's, 0.309'MB/sec write SST data time = 0.05's, 809.557'MB/sec dict compress time = 0.00's, 1378151.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 42882.289'MB/sec zip my value time = 0.81's, unzip length = 0.132'GB zip my value throughput = 162.742'MB/sec zip pipeline throughput = 162.742'MB/sec entries = 129430 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1016.99 avg-zval = 309.83 usrkeys = 129430 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1016.99 avg-zval = 309.83 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 8 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0980 value = 3.2824 dict = 1.00 all = 3.2186 } Zip/UnZip{ index = 0.1409 value = 0.3047 dict = 1.00 all = 0.3107 } ---------------------------- total value len = 1.184667 GB avg = 1.017 KB (by entry num) total key len = 0.023297 GB avg = 0.020 KB total ukey len = 0.013978 GB avg = 0.012 KB total ukey num = 0.001164868 Billion total entry num = 0.001164868 Billion write speed all = 0.062382950 MB/sec (with seq num) write speed all = 0.061901692 MB/sec (without seq num) 2024/11/22-14:15:06.826216 140024701470272 [compaction_job.cc:1948] [default] [JOB 48] Generated table #206426: 129430 keys, 41700377 bytes, temperature: kWarm 2024/11/22-14:15:06.826275 140024701470272 EVENT_LOG_v1 {"time_micros": 1732256106826244, "cf_name": "default", "job": 48, "event": "table_file_creation", "file_number": 206426, "file_size": 41700377, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 40101552, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588600, "raw_average_key_size": 20, "raw_value_size": 131629323, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129430, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732256105, "oldest_key_time": 0, "file_creation_time": 1732256105, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 206426, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-14:15:06.861686 140024701470272 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206427.sst) /dev/shm/ToplingTemp/Topling-132588-l1ooNR 2024/11/22-14:15:07.427766 140024701470272 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206427.sst): first pass time = 0.57's, 237.120'MB/sec 2024/11/22-14:15:08.413637 140024701470272 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206427.sst): old prealloc_size = 147639500, real_size = 40354912 2024/11/22-14:15:08.413758 140024701470272 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206427.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129427 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1017.02 avg-zval = 309.85 2024/11/22-14:15:08.413801 140024701470272 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206427.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-14:15:08.569427 140024701470272 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206427.sst): second pass time = 0.99's, 133.606'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 267.710'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2306.969'MB/sec (index lex order gen) rebuild zvType time = 0.11's, 0.308'MB/sec write SST data time = 0.05's, 826.453'MB/sec dict compress time = 0.00's, 1378329.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 35358.995'MB/sec zip my value time = 0.99's, unzip length = 0.132'GB zip my value throughput = 133.606'MB/sec zip pipeline throughput = 182.883'MB/sec entries = 129427 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1017.02 avg-zval = 309.85 usrkeys = 129427 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1017.02 avg-zval = 309.85 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 8 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0979 value = 3.2823 dict = 1.00 all = 3.2185 } Zip/UnZip{ index = 0.1409 value = 0.3047 dict = 1.00 all = 0.3107 } ---------------------------- total value len = 1.316297 GB avg = 1.017 KB (by entry num) total key len = 0.025886 GB avg = 0.020 KB total ukey len = 0.015532 GB avg = 0.012 KB total ukey num = 0.001294295 Billion total entry num = 0.001294295 Billion write speed all = 0.069308045 MB/sec (with seq num) write speed all = 0.068773364 MB/sec (without seq num) 2024/11/22-14:15:08.605293 140024701470272 [compaction_job.cc:1948] [default] [JOB 48] Generated table #206427: 129427 keys, 41702539 bytes, temperature: kWarm 2024/11/22-14:15:08.605361 140024701470272 EVENT_LOG_v1 {"time_micros": 1732256108605326, "cf_name": "default", "job": 48, "event": "table_file_creation", "file_number": 206427, "file_size": 41702539, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 40103568, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588540, "raw_average_key_size": 20, "raw_value_size": 131630217, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129427, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732256106, "oldest_key_time": 0, "file_creation_time": 1732256106, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 206427, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-14:15:08.652572 140024701470272 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206428.sst) /dev/shm/ToplingTemp/Topling-132588-vdVdLQ 2024/11/22-14:15:09.120520 140024701470272 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206428.sst): first pass time = 0.47's, 286.850'MB/sec 2024/11/22-14:15:09.916257 140024701470272 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206428.sst): old prealloc_size = 147639500, real_size = 40353760 2024/11/22-14:15:09.916380 140024701470272 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206428.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129432 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1016.98 avg-zval = 309.83 2024/11/22-14:15:09.916412 140024701470272 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206428.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-14:15:10.072223 140024701470272 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206428.sst): second pass time = 0.79's, 165.738'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 267.388'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2290.380'MB/sec (index lex order gen) rebuild zvType time = 0.10's, 0.308'MB/sec write SST data time = 0.05's, 818.479'MB/sec dict compress time = 0.00's, 1377402.000'MB/sec z-dict build time = 0.00's, sample length = 1.377'MB, throughput = 45847.685'MB/sec zip my value time = 0.79's, unzip length = 0.132'GB zip my value throughput = 165.738'MB/sec zip pipeline throughput = 165.738'MB/sec entries = 129432 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1016.98 avg-zval = 309.83 usrkeys = 129432 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1016.98 avg-zval = 309.83 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 8 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0981 value = 3.2823 dict = 1.00 all = 3.2186 } Zip/UnZip{ index = 0.1409 value = 0.3047 dict = 1.00 all = 0.3107 } ---------------------------- total value len = 1.447927 GB avg = 1.017 KB (by entry num) total key len = 0.028475 GB avg = 0.020 KB total ukey len = 0.017085 GB avg = 0.012 KB total ukey num = 0.001423727 Billion total entry num = 0.001423727 Billion write speed all = 0.076232951 MB/sec (with seq num) write speed all = 0.075644846 MB/sec (without seq num) 2024/11/22-14:15:10.109626 140024701470272 [compaction_job.cc:1948] [default] [JOB 48] Generated table #206428: 129432 keys, 41700460 bytes, temperature: kWarm 2024/11/22-14:15:10.109691 140024701470272 EVENT_LOG_v1 {"time_micros": 1732256110109659, "cf_name": "default", "job": 48, "event": "table_file_creation", "file_number": 206428, "file_size": 41700460, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 40102416, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588640, "raw_average_key_size": 20, "raw_value_size": 131630007, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129432, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732256108, "oldest_key_time": 0, "file_creation_time": 1732256108, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 206428, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-14:15:10.156571 140024701470272 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206429.sst) /dev/shm/ToplingTemp/Topling-132588-nnUvvQ 2024/11/22-14:15:10.656024 140024701470272 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206429.sst): first pass time = 0.50's, 268.751'MB/sec 2024/11/22-14:15:11.550174 140024701470272 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206429.sst): old prealloc_size = 147639500, real_size = 40350832 2024/11/22-14:15:11.550307 140024701470272 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206429.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129433 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1016.97 avg-zval = 309.81 2024/11/22-14:15:11.550350 140024701470272 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206429.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-14:15:11.790224 140024701470272 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206429.sst): second pass time = 0.89's, 147.334'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.24's, 173.711'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2091.131'MB/sec (index lex order gen) rebuild zvType time = 0.18's, 0.175'MB/sec write SST data time = 0.06's, 750.861'MB/sec dict compress time = 0.00's, 1377942.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 36935.213'MB/sec zip my value time = 0.89's, unzip length = 0.132'GB zip my value throughput = 147.334'MB/sec zip pipeline throughput = 160.248'MB/sec entries = 129433 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1016.97 avg-zval = 309.81 usrkeys = 129433 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1016.97 avg-zval = 309.81 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0982 value = 3.2826 dict = 1.00 all = 3.2188 } Zip/UnZip{ index = 0.1409 value = 0.3046 dict = 1.00 all = 0.3107 } ---------------------------- total value len = 1.579557 GB avg = 1.017 KB (by entry num) total key len = 0.031063 GB avg = 0.020 KB total ukey len = 0.018638 GB avg = 0.012 KB total ukey num = 0.001553160 Billion total entry num = 0.001553160 Billion write speed all = 0.083155834 MB/sec (with seq num) write speed all = 0.082514321 MB/sec (without seq num) 2024/11/22-14:15:11.829905 140024701470272 [compaction_job.cc:1948] [default] [JOB 48] Generated table #206429: 129433 keys, 41698120 bytes, temperature: kWarm 2024/11/22-14:15:11.829969 140024701470272 EVENT_LOG_v1 {"time_micros": 1732256111829938, "cf_name": "default", "job": 48, "event": "table_file_creation", "file_number": 206429, "file_size": 41698120, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 40099488, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588660, "raw_average_key_size": 20, "raw_value_size": 131629513, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129433, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732256110, "oldest_key_time": 0, "file_creation_time": 1732256110, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 206429, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-14:15:11.877132 140024701470272 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206430.sst) /dev/shm/ToplingTemp/Topling-132588-cy0I9R 2024/11/22-14:15:12.439949 140024701470272 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206430.sst): first pass time = 0.56's, 238.495'MB/sec 2024/11/22-14:15:13.245368 140024701470272 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206430.sst): old prealloc_size = 147639500, real_size = 40356240 2024/11/22-14:15:13.245491 140024701470272 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206430.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129427 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1017.02 avg-zval = 309.86 2024/11/22-14:15:13.245526 140024701470272 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206430.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-14:15:13.402890 140024701470272 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206430.sst): second pass time = 0.80's, 163.738'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 264.765'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2285.380'MB/sec (index lex order gen) rebuild zvType time = 0.11's, 0.305'MB/sec write SST data time = 0.05's, 809.761'MB/sec dict compress time = 0.00's, 1377918.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 31147.837'MB/sec zip my value time = 0.80's, unzip length = 0.132'GB zip my value throughput = 163.738'MB/sec zip pipeline throughput = 163.738'MB/sec entries = 129427 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1017.02 avg-zval = 309.86 usrkeys = 129427 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1017.02 avg-zval = 309.86 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0979 value = 3.2821 dict = 1.00 all = 3.2184 } Zip/UnZip{ index = 0.1409 value = 0.3047 dict = 1.00 all = 0.3107 } ---------------------------- total value len = 1.711187 GB avg = 1.017 KB (by entry num) total key len = 0.033652 GB avg = 0.020 KB total ukey len = 0.020191 GB avg = 0.012 KB total ukey num = 0.001682587 Billion total entry num = 0.001682587 Billion write speed all = 0.090077988 MB/sec (with seq num) write speed all = 0.089383074 MB/sec (without seq num) 2024/11/22-14:15:13.440648 140024701470272 [compaction_job.cc:1948] [default] [JOB 48] Generated table #206430: 129427 keys, 41703472 bytes, temperature: kWarm 2024/11/22-14:15:13.440713 140024701470272 EVENT_LOG_v1 {"time_micros": 1732256113440680, "cf_name": "default", "job": 48, "event": "table_file_creation", "file_number": 206430, "file_size": 41703472, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 40104896, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588540, "raw_average_key_size": 20, "raw_value_size": 131629801, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129427, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732256111, "oldest_key_time": 0, "file_creation_time": 1732256111, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 206430, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-14:15:13.480171 140024701470272 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206431.sst) /dev/shm/ToplingTemp/Topling-132588-gyYAqT 2024/11/22-14:15:14.057849 140024701470272 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206431.sst): first pass time = 0.58's, 232.359'MB/sec 2024/11/22-14:15:14.871925 140024701470272 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206431.sst): old prealloc_size = 147639500, real_size = 40356256 2024/11/22-14:15:14.872060 140024701470272 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206431.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129429 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1017.01 avg-zval = 309.86 2024/11/22-14:15:14.872093 140024701470272 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206431.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-14:15:15.045030 140024701470272 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206431.sst): second pass time = 0.81's, 161.825'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.17's, 240.962'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2420.263'MB/sec (index lex order gen) rebuild zvType time = 0.11's, 0.305'MB/sec write SST data time = 0.07's, 622.397'MB/sec dict compress time = 0.00's, 1377844.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 42799.491'MB/sec zip my value time = 0.81's, unzip length = 0.132'GB zip my value throughput = 161.825'MB/sec zip pipeline throughput = 161.825'MB/sec entries = 129429 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1017.01 avg-zval = 309.86 usrkeys = 129429 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1017.01 avg-zval = 309.86 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 8 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0980 value = 3.2821 dict = 1.00 all = 3.2184 } Zip/UnZip{ index = 0.1409 value = 0.3047 dict = 1.00 all = 0.3107 } ---------------------------- total value len = 1.842817 GB avg = 1.017 KB (by entry num) total key len = 0.036240 GB avg = 0.020 KB total ukey len = 0.021744 GB avg = 0.012 KB total ukey num = 0.001812016 Billion total entry num = 0.001812016 Billion write speed all = 0.096998862 MB/sec (with seq num) write speed all = 0.096250557 MB/sec (without seq num) 2024/11/22-14:15:15.083915 140024701470272 [compaction_job.cc:1948] [default] [JOB 48] Generated table #206431: 129429 keys, 41703398 bytes, temperature: kWarm 2024/11/22-14:15:15.084006 140024701470272 EVENT_LOG_v1 {"time_micros": 1732256115083964, "cf_name": "default", "job": 48, "event": "table_file_creation", "file_number": 206431, "file_size": 41703398, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 40104912, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588580, "raw_average_key_size": 20, "raw_value_size": 131630164, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129429, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732256113, "oldest_key_time": 0, "file_creation_time": 1732256113, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 206431, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-14:15:15.136327 140024701470272 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206432.sst) /dev/shm/ToplingTemp/Topling-132588-NBlsvQ 2024/11/22-14:15:15.775690 140024701470272 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206432.sst): first pass time = 0.64's, 209.942'MB/sec 2024/11/22-14:15:16.587071 140024701470272 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206432.sst): old prealloc_size = 147639500, real_size = 40356544 2024/11/22-14:15:16.587193 140024701470272 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206432.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129426 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1017.03 avg-zval = 309.87 2024/11/22-14:15:16.587226 140024701470272 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206432.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-14:15:16.742999 140024701470272 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206432.sst): second pass time = 0.81's, 162.349'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 267.479'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2263.021'MB/sec (index lex order gen) rebuild zvType time = 0.10's, 0.308'MB/sec write SST data time = 0.05's, 819.843'MB/sec dict compress time = 0.00's, 1377825.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 41973.588'MB/sec zip my value time = 0.81's, unzip length = 0.132'GB zip my value throughput = 162.349'MB/sec zip pipeline throughput = 162.349'MB/sec entries = 129426 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1017.03 avg-zval = 309.87 usrkeys = 129426 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1017.03 avg-zval = 309.87 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0978 value = 3.2821 dict = 1.00 all = 3.2184 } Zip/UnZip{ index = 0.1409 value = 0.3047 dict = 1.00 all = 0.3107 } ---------------------------- total value len = 1.974446 GB avg = 1.017 KB (by entry num) total key len = 0.038829 GB avg = 0.020 KB total ukey len = 0.023297 GB avg = 0.012 KB total ukey num = 0.001941442 Billion total entry num = 0.001941442 Billion write speed all = 0.103918228 MB/sec (with seq num) write speed all = 0.103116544 MB/sec (without seq num) 2024/11/22-14:15:16.786927 140024701470272 [compaction_job.cc:1948] [default] [JOB 48] Generated table #206432: 129426 keys, 41703699 bytes, temperature: kWarm 2024/11/22-14:15:16.786990 140024701470272 EVENT_LOG_v1 {"time_micros": 1732256116786959, "cf_name": "default", "job": 48, "event": "table_file_creation", "file_number": 206432, "file_size": 41703699, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 40105200, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588520, "raw_average_key_size": 20, "raw_value_size": 131629527, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129426, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732256115, "oldest_key_time": 0, "file_creation_time": 1732256115, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 206432, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-14:15:16.825141 140024701470272 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206433.sst) /dev/shm/ToplingTemp/Topling-132588-Pr4b1S 2024/11/22-14:15:17.296769 140024701470272 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206433.sst): first pass time = 0.47's, 284.610'MB/sec 2024/11/22-14:15:18.082162 140024701470272 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206433.sst): old prealloc_size = 147639500, real_size = 40347360 2024/11/22-14:15:18.082276 140024701470272 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206433.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129437 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1016.94 avg-zval = 309.77 2024/11/22-14:15:18.082308 140024701470272 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206433.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-14:15:18.238758 140024701470272 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206433.sst): second pass time = 0.78's, 167.721'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 266.286'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2399.535'MB/sec (index lex order gen) rebuild zvType time = 0.10's, 0.309'MB/sec write SST data time = 0.05's, 807.597'MB/sec dict compress time = 0.00's, 1378244.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 43357.368'MB/sec zip my value time = 0.78's, unzip length = 0.132'GB zip my value throughput = 167.721'MB/sec zip pipeline throughput = 167.721'MB/sec entries = 129437 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1016.94 avg-zval = 309.77 usrkeys = 129437 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1016.94 avg-zval = 309.77 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 8 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0984 value = 3.2829 dict = 1.00 all = 3.2191 } Zip/UnZip{ index = 0.1409 value = 0.3046 dict = 1.00 all = 0.3106 } ---------------------------- total value len = 2.106076 GB avg = 1.017 KB (by entry num) total key len = 0.041418 GB avg = 0.020 KB total ukey len = 0.024851 GB avg = 0.012 KB total ukey num = 0.002070879 Billion total entry num = 0.002070879 Billion write speed all = 0.110837566 MB/sec (with seq num) write speed all = 0.109982500 MB/sec (without seq num) 2024/11/22-14:15:18.274300 140024701470272 [compaction_job.cc:1948] [default] [JOB 48] Generated table #206433: 129437 keys, 41694902 bytes, temperature: kWarm 2024/11/22-14:15:18.274365 140024701470272 EVENT_LOG_v1 {"time_micros": 1732256118274332, "cf_name": "default", "job": 48, "event": "table_file_creation", "file_number": 206433, "file_size": 41694902, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 40096016, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588740, "raw_average_key_size": 20, "raw_value_size": 131629875, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129437, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732256116, "oldest_key_time": 0, "file_creation_time": 1732256116, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 206433, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-14:15:18.311175 140024701470272 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206434.sst) /dev/shm/ToplingTemp/Topling-132588-HvNxgR 2024/11/22-14:15:18.875360 140024701470272 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206434.sst): first pass time = 0.56's, 237.918'MB/sec 2024/11/22-14:15:19.670708 140024701470272 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206434.sst): old prealloc_size = 147639500, real_size = 40353840 2024/11/22-14:15:19.670839 140024701470272 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206434.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129430 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1017.00 avg-zval = 309.84 2024/11/22-14:15:19.670887 140024701470272 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206434.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-14:15:19.827453 140024701470272 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206434.sst): second pass time = 0.79's, 165.628'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 266.071'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2080.752'MB/sec (index lex order gen) rebuild zvType time = 0.11's, 0.307'MB/sec write SST data time = 0.05's, 814.581'MB/sec dict compress time = 0.00's, 1377920.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 43997.701'MB/sec zip my value time = 0.79's, unzip length = 0.132'GB zip my value throughput = 165.628'MB/sec zip pipeline throughput = 165.628'MB/sec entries = 129430 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1017.00 avg-zval = 309.84 usrkeys = 129430 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1017.00 avg-zval = 309.84 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 8 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0980 value = 3.2823 dict = 1.00 all = 3.2186 } Zip/UnZip{ index = 0.1409 value = 0.3047 dict = 1.00 all = 0.3107 } ---------------------------- total value len = 2.237706 GB avg = 1.017 KB (by entry num) total key len = 0.044006 GB avg = 0.020 KB total ukey len = 0.026404 GB avg = 0.012 KB total ukey num = 0.002200309 Billion total entry num = 0.002200309 Billion write speed all = 0.117755261 MB/sec (with seq num) write speed all = 0.116846827 MB/sec (without seq num) 2024/11/22-14:15:19.865454 140024701470272 [compaction_job.cc:1948] [default] [JOB 48] Generated table #206434: 129430 keys, 41701106 bytes, temperature: kWarm 2024/11/22-14:15:19.865518 140024701470272 EVENT_LOG_v1 {"time_micros": 1732256119865487, "cf_name": "default", "job": 48, "event": "table_file_creation", "file_number": 206434, "file_size": 41701106, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 40102496, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588600, "raw_average_key_size": 20, "raw_value_size": 131629788, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129430, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732256118, "oldest_key_time": 0, "file_creation_time": 1732256118, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 206434, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-14:15:19.903635 140024701470272 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206435.sst) /dev/shm/ToplingTemp/Topling-132588-Lmj8ZT 2024/11/22-14:15:20.223046 140024701470272 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206435.sst): first pass time = 0.32's, 420.266'MB/sec 2024/11/22-14:15:21.036036 140024701470272 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206435.sst): old prealloc_size = 147639500, real_size = 40354928 2024/11/22-14:15:21.036158 140024701470272 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206435.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129426 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1017.03 avg-zval = 309.86 2024/11/22-14:15:21.036192 140024701470272 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206435.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-14:15:21.191763 140024701470272 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206435.sst): second pass time = 0.81's, 162.185'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 267.811'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2263.419'MB/sec (index lex order gen) rebuild zvType time = 0.10's, 0.312'MB/sec write SST data time = 0.05's, 802.408'MB/sec dict compress time = 0.00's, 1378481.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 34105.621'MB/sec zip my value time = 0.81's, unzip length = 0.132'GB zip my value throughput = 162.185'MB/sec zip pipeline throughput = 162.185'MB/sec entries = 129426 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1017.03 avg-zval = 309.86 usrkeys = 129426 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1017.03 avg-zval = 309.86 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0978 value = 3.2822 dict = 1.00 all = 3.2185 } Zip/UnZip{ index = 0.1409 value = 0.3047 dict = 1.00 all = 0.3107 } ---------------------------- total value len = 2.369336 GB avg = 1.017 KB (by entry num) total key len = 0.046595 GB avg = 0.020 KB total ukey len = 0.027957 GB avg = 0.012 KB total ukey num = 0.002329735 Billion total entry num = 0.002329735 Billion write speed all = 0.124673259 MB/sec (with seq num) write speed all = 0.123711457 MB/sec (without seq num) 2024/11/22-14:15:21.227797 140024701470272 [compaction_job.cc:1948] [default] [JOB 48] Generated table #206435: 129426 keys, 41702755 bytes, temperature: kWarm 2024/11/22-14:15:21.227867 140024701470272 EVENT_LOG_v1 {"time_micros": 1732256121227827, "cf_name": "default", "job": 48, "event": "table_file_creation", "file_number": 206435, "file_size": 41702755, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 40103584, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588520, "raw_average_key_size": 20, "raw_value_size": 131629761, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129426, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732256119, "oldest_key_time": 0, "file_creation_time": 1732256119, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 206435, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-14:15:21.268176 140024701470272 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206436.sst) /dev/shm/ToplingTemp/Topling-132588-AbDcnS 2024/11/22-14:15:21.323342 140024701470272 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206436.sst): first pass time = 0.06's, 854.669'MB/sec 2024/11/22-14:15:21.683337 140024701470272 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206436.sst): old prealloc_size = 147639500, real_size = 14188376 2024/11/22-14:15:21.683382 140024701470272 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206436.sst): index type = UintIndex_AllOne , store type = DictZipBlobStore usrkeys = 45434 prefix = 4 raw-key = 0.0004 GB zip-key = 0.0000 GB avg-key = 8.00 avg-zkey = 0.00 raw-val = 0.0462 GB zip-val = 0.0142 GB avg-val =1017.05 avg-zval = 312.03 2024/11/22-14:15:21.711131 140024701470272 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00/206436.sst): second pass time = 0.36's, 128.551'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.03's, 526.887'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 8.466'MB/sec (index lex order gen) rebuild zvType time = 0.01's, 1.063'MB/sec write SST data time = 0.02's, 857.144'MB/sec dict compress time = 0.00's, 462640.000'MB/sec z-dict build time = 0.00's, sample length = 0.463'MB, throughput = 14409.768'MB/sec zip my value time = 0.36's, unzip length = 0.046'GB zip my value throughput = 128.551'MB/sec zip pipeline throughput = 128.551'MB/sec entries = 45434 avg-key = 20.00 avg-zkey = 0.00 avg-val = 1017.05 avg-zval = 312.03 usrkeys = 45434 avg-key = 12.00 avg-zkey = 0.00 avg-val = 1017.05 avg-zval = 312.03 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 4 UnZipSize{ index = 0.0005 GB value = 0.0462 GB dict = 0.46 MB all = 0.0471 GB } __ZipSize{ index = 0.0000 GB value = 0.0142 GB dict = 0.46 MB all = 0.0146 GB } UnZip/Zip{ index =2839.6250 value = 3.2595 dict = 1.00 all = 3.2182 } Zip/UnZip{ index = 0.0004 value = 0.3068 dict = 1.00 all = 0.3107 } ---------------------------- total value len = 2.415544 GB avg = 1.017 KB (by entry num) total key len = 0.047503 GB avg = 0.020 KB total ukey len = 0.028502 GB avg = 0.012 KB total ukey num = 0.002375169 Billion total entry num = 0.002375169 Billion write speed all = 0.127101321 MB/sec (with seq num) write speed all = 0.126120789 MB/sec (without seq num) 2024/11/22-14:15:21.729415 140024701470272 [compaction_job.cc:1948] [default] [JOB 48] Generated table #206436: 45434 keys, 14640679 bytes, temperature: kWarm 2024/11/22-14:15:21.729474 140024701470272 EVENT_LOG_v1 {"time_micros": 1732256121729443, "cf_name": "default", "job": 48, "event": "table_file_creation", "file_number": 206436, "file_size": 14640679, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 14176672, "index_size": 192, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 908680, "raw_average_key_size": 20, "raw_value_size": 46208554, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 45434, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-UintIndex_AllOne-DictZipBlobStore", "creation_time": 1732256121, "oldest_key_time": 0, "file_creation_time": 1732256121, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 206436, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-14:15:21.745051 140024701470272 [compaction_job.cc:703] job-00048: subcompact[0], size: 0.765691 G, files: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-00048/att-00 [206418,206419,206420,206421,206422,206423,206424,206425,206426,206427,206428,206429,206430,206431,206432,206433,206434,206435,206436] 2024/11/22-14:15:21.868672 140024701470272 (Original Log Time 2024/11/22-14:14:51.992015) EVENT_LOG_v1 {"time_micros": 1732256091991971, "job": 48, "event": "compaction_started", "compaction_reason": "FilesMarkedForCompaction", "files_L2": [206413], "files_L3": [206394, 206395, 206396, 206397, 206398, 206399, 206400, 206401, 206402, 206403, 206404, 206405, 206406, 206407, 206408, 206409, 206410, 206411, 206412], "score": 0.803017, "input_data_size": 784532068, "oldest_snapshot_seqno": 3274116843} 2024/11/22-14:15:21.868675 140024701470272 (Original Log Time 2024/11/22-14:15:21.867709) [compaction_job.cc:2022] [default] [JOB 48] Compacted 1@2 + 19@3 files to L3 => 765690823 bytes 2024/11/22-14:15:21.868676 140024701470272 (Original Log Time 2024/11/22-14:15:21.868598) [compaction_job.cc:1224] [default] compacted to: files[0 0 0 19 0 0 0] max score 0.03, MB/sec: 26.4 rd, 25.7 wr, level 3, files in(1, 19) out(19 +0 blob) MB in(18.0, 730.2 +0.0 blob) out(730.2 +0.0 blob), read-write-amplify(82.3) write-amplify(40.6) OK, records in: 2393562, records dropped: 18393 output_compression: Snappy 2024/11/22-14:15:21.868679 140024701470272 (Original Log Time 2024/11/22-14:15:21.868648) EVENT_LOG_v1 {"time_micros": 1732256121868623, "cf": "default", "job": 48, "event": "compaction_finished", "compaction_time_micros": 29753046, "compaction_time_cpu_micros": 6584393, "output_level": 3, "num_output_files": 19, "total_output_size": 765690823, "num_input_records": 2393562, "num_output_records": 2375169, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "file_write_nanos": 501533335, "file_range_sync_nanos": 0, "file_fsync_nanos": 27209, "file_prepare_write_nanos": 33869, "lsm_state": [0, 0, 0, 19, 0, 0, 0]} 2024/11/22-14:15:22.016469 140024701470272 DEBG dcompact_worker.cpp:240: HttpPost: 200 OK: url = http://nlb-7zny4kaa1poal01o64.cn-shenzhen.nlb.aliyuncs.com:8443, body = {"instanceId":"nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137","labourId":"","dbId":"d89b4006-2803-486e-b7a2-759bcf348921","dbStarts":1732256054,"starts":1732256091,"executesMs":30023,"compactionJobId":48,"attempt":0,"compactionInputRawBytes":2482122796,"compactionInputZipBytes":784532068,"compactionOutputRawBytes":0,"compactionOutputZipBytes":765690823,"headers":{"Accept":"*/*","Connection":"close","Host":"aliyun-topling-saas.topling.cn:18443","RemoteIp":"120.24.192.169","X-Forwarded-For":"120.24.192.169","region":"cn-shenzhen","token":"e6474c481bd4415abc537135cc03626b","instance-token":"e6474c481bd4415abc537135cc03626b","provider":"aliyun","CloudMarketInstanceId":"si-59c0ae5c955845588903","MeteringAssit":"","Transfer-Encoding":"chunked","traceparent":"00-5276cdf69bc9a6cb6e3307f323c33140-58601c97506a5232-00"}}, response = 2024/11/22-14:15:22.016544 140024701470272 INFO dcompact_worker.cpp:1459: finish /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-00048/att-00: olev 3, work 30.024 s, result 4.901 ms, install 0.991 ms, input{raw 2.312 GiB zip 748.188 MiB}