2024/11/23-16:34:37.008171 139957341054528 DEBG dcompact_worker.cpp:2214: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00: fork to child time = 0.008044 sec 2024/11/23-16:34:37.008917 139957341054528 DEBG dcompact_worker.cpp:1013: Beg SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00 2024/11/23-16:34:37.016154 139957341054528 DEBG dcompact_worker.cpp:1033: End SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00 2024/11/23-16:34:37.017068 139957341054528 TRAC dcompact_worker.cpp:1083: INFO_LOG_LEVEL: rpc = INFO_LEVEL, env_var = undefined 2024/11/23-16:34:37.017331 139957341054528 [WARN] [column_family.cc:386] multiple cf_paths/db_paths and level_compaction_dynamic_level_bytes can't be used together 2024/11/23-16:34:37.097009 139957341054528 [version_set.cc:6208] Recovering from manifest file: /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-30791/att-00/MANIFEST-206347 2024/11/23-16:34:37.113077 139957341054528 [version_set.cc:6251] Recovered from manifest file:/worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-30791/att-00/MANIFEST-206347 succeeded,manifest_file_number is 206347, next_file_number is 269807, last_sequence is 4113738275, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 269669 2024/11/23-16:34:37.113086 139957341054528 [version_set.cc:6266] Column family [default] (ID 0), log number is 0 2024/11/23-16:34:37.113231 139957341054528 [version_set.cc:5721] Creating manifest 269807 2024/11/23-16:34:37.158345 139957341054528 DEBG dcompact_worker.cpp:1218: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00: bottommost_level: fake = 1, rpc = 0 2024/11/23-16:34:37.187023 139957341054528 [compaction_job.cc:2437] [default] [JOB 30791] Compacting 1@2 + 21@3 files to L3, score 1.00, subcompactions 1 : 1 2024/11/23-16:34:37.187040 139957341054528 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 23019 Base level 2, inputs: [269804(31MB)], [269730(40MB) 269731(40MB) 269732(40MB) 269733(40MB) 269734(40MB) 269735(40MB) 269736(40MB) 269737(40MB) 269738(40MB) 269739(40MB) 269740(40MB) 269741(40MB) 269742(40MB) 269743(39MB) 269744(40MB) 269745(40MB) 269746(40MB) 269747(40MB) 269748(40MB) 269749(39MB) 269750(40MB)] 2024/11/23-16:34:37.194352 139957341054528 [top_zip_table.cc:59] core git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-16:34:37.194388 139957341054528 [top_zip_table.cc:60] fsa git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-16:34:37.194407 139957341054528 [top_zip_table.cc:61] zbs git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-16:34:37.194414 139957341054528 [top_zip_table.cc:62] topling-zip_table_reader: git_version_hash_info_is: commit a4a382006cb82713acf5b3425835f22711877681 Author: leipeng Date: 2024-04-11 19:44:14 +0800 fixed_len_hole_index.cc: Add env bool FixedLenHoleIndexUseAVX512 for ut & debug 1. FixedLenHoleIndexUseAVX512 is only in unit tests or debug 2. In release mode, use avx512 by compile options(-march=) g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/23-16:34:37.194427 139957341054528 [top_zip_table.cc:64] topling-rocks git_version_hash_info_is: commit feab587e468621ba0204d47b4ffacc52e7c4290d Author: leipeng Date: 2024-03-22 13:35:06 +0800 ToplingZipTableBuilder::Add: immediately return after error This function returns void, and caller does not check builder->status() after calling this function and graceful abandon. So immediately return after error, and return error status in Finish(). g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/23-16:34:37.818090 139957341054528 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269808.sst) /dev/shm/ToplingTemp/Topling-115949-JDA1UH 2024/11/23-16:34:38.038041 139957341054528 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269808.sst): first pass time = 0.22's, 610.346'MB/sec 2024/11/23-16:34:39.554549 139957341054528 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269808.sst): old prealloc_size = 147639500, real_size = 40618656 2024/11/23-16:34:39.554696 139957341054528 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269808.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129431 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.81 raw-val = 0.1316 GB zip-val = 0.0404 GB avg-val =1016.99 avg-zval = 311.77 2024/11/23-16:34:39.554903 139957341054528 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269808.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:34:39.906577 139957341054528 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269808.sst): second pass time = 1.52's, 86.842'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.35's, 120.597'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1784.267'MB/sec (index lex order gen) rebuild zvType time = 0.22's, 0.149'MB/sec write SST data time = 0.14's, 314.199'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 44380.833'MB/sec zip my value time = 1.52's, unzip length = 0.132'GB zip my value throughput = 86.842'MB/sec zip pipeline throughput = 193.611'MB/sec entries = 129431 avg-key = 20.00 avg-zkey = 1.81 avg-val = 1016.99 avg-zval = 311.77 usrkeys = 129431 avg-key = 12.00 avg-zkey = 1.81 avg-val = 1023.99 avg-zval = 311.77 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129431 bytes = 485376 } seq expand size = 906017 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0404 GB dict = 1.38 MB all = 0.0425 GB } UnZip/Zip{ index = 6.6470 value = 3.2620 dict = 1.00 all = 3.1617 } Zip/UnZip{ index = 0.1504 value = 0.3066 dict = 1.00 all = 0.3163 } ---------------------------- total value len = 8.981156 GB avg = 0.171 KB (by entry num) total key len = 1.443410 GB avg = 0.028 KB total ukey len = 0.999431 GB avg = 0.015 KB total ukey num = 0.065679866 Billion total entry num = 0.052487595 Billion write speed all = 0.378144299 MB/sec (with seq num) write speed all = 0.362912674 MB/sec (without seq num) 2024/11/23-16:34:39.963629 139957341054528 [compaction_job.cc:1948] [default] [JOB 30791] Generated table #269808: 129431 keys, 42451565 bytes, temperature: kWarm 2024/11/23-16:34:39.963743 139957341054528 EVENT_LOG_v1 {"time_micros": 1732350879963666, "cf_name": "default", "job": 30791, "event": "table_file_creation", "file_number": 269808, "file_size": 42451565, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237877277, "largest_seqno": 4113700548, "table_properties": {"data_size": 40352464, "index_size": 233664, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588620, "raw_average_key_size": 20, "raw_value_size": 131630033, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129431, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732350877, "oldest_key_time": 0, "file_creation_time": 1732350877, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 269808, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:34:40.047443 139957341054528 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269809.sst) /dev/shm/ToplingTemp/Topling-115949-kKsZrJ 2024/11/23-16:34:40.699678 139957341054528 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269809.sst): first pass time = 0.65's, 205.794'MB/sec 2024/11/23-16:34:41.657725 139957341054528 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269809.sst): old prealloc_size = 147639500, real_size = 40859040 2024/11/23-16:34:41.657850 139957341054528 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269809.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129433 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.75 raw-val = 0.1316 GB zip-val = 0.0406 GB avg-val =1016.97 avg-zval = 313.68 2024/11/23-16:34:41.658028 139957341054528 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269809.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:34:41.826362 139957341054528 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269809.sst): second pass time = 0.96's, 137.481'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.17's, 253.183'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2258.658'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.271'MB/sec write SST data time = 0.05's, 872.773'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 48358.063'MB/sec zip my value time = 0.96's, unzip length = 0.132'GB zip my value throughput = 137.481'MB/sec zip pipeline throughput = 137.481'MB/sec entries = 129433 avg-key = 20.00 avg-zkey = 1.75 avg-val = 1016.97 avg-zval = 313.68 usrkeys = 129433 avg-key = 12.00 avg-zkey = 1.75 avg-val = 1023.97 avg-zval = 313.68 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129433 bytes = 485392 } seq expand size = 906031 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0406 GB dict = 1.38 MB all = 0.0427 GB } UnZip/Zip{ index = 6.8750 value = 3.2421 dict = 1.00 all = 3.1439 } Zip/UnZip{ index = 0.1455 value = 0.3084 dict = 1.00 all = 0.3181 } ---------------------------- total value len = 9.113692 GB avg = 0.173 KB (by entry num) total key len = 1.445998 GB avg = 0.027 KB total ukey len = 1.000984 GB avg = 0.015 KB total ukey num = 0.065809299 Billion total entry num = 0.052617028 Billion write speed all = 0.383019189 MB/sec (with seq num) write speed all = 0.367751066 MB/sec (without seq num) 2024/11/23-16:34:41.879870 139957341054528 [compaction_job.cc:1948] [default] [JOB 30791] Generated table #269809: 129433 keys, 42691754 bytes, temperature: kWarm 2024/11/23-16:34:41.879950 139957341054528 EVENT_LOG_v1 {"time_micros": 1732350881879906, "cf_name": "default", "job": 30791, "event": "table_file_creation", "file_number": 269809, "file_size": 42691754, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237868195, "largest_seqno": 4113710640, "table_properties": {"data_size": 40600592, "index_size": 225920, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588660, "raw_average_key_size": 20, "raw_value_size": 131630098, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129433, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732350880, "oldest_key_time": 0, "file_creation_time": 1732350880, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 269809, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:34:41.936496 139957341054528 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269810.sst) /dev/shm/ToplingTemp/Topling-115949-JHNjwK 2024/11/23-16:34:42.538331 139957341054528 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269810.sst): first pass time = 0.60's, 223.031'MB/sec 2024/11/23-16:34:43.407379 139957341054528 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269810.sst): old prealloc_size = 147639500, real_size = 40579184 2024/11/23-16:34:43.407496 139957341054528 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269810.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129433 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.81 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1016.97 avg-zval = 311.45 2024/11/23-16:34:43.407646 139957341054528 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269810.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:34:43.578013 139957341054528 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269810.sst): second pass time = 0.87's, 151.714'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.17's, 248.606'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2424.463'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.266'MB/sec write SST data time = 0.05's, 867.061'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 45250.969'MB/sec zip my value time = 0.87's, unzip length = 0.132'GB zip my value throughput = 151.714'MB/sec zip pipeline throughput = 151.714'MB/sec entries = 129433 avg-key = 20.00 avg-zkey = 1.81 avg-val = 1016.97 avg-zval = 311.45 usrkeys = 129433 avg-key = 12.00 avg-zkey = 1.81 avg-val = 1023.97 avg-zval = 311.45 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129433 bytes = 485392 } seq expand size = 906031 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0424 GB } UnZip/Zip{ index = 6.6272 value = 3.2652 dict = 1.00 all = 3.1646 } Zip/UnZip{ index = 0.1509 value = 0.3063 dict = 1.00 all = 0.3160 } ---------------------------- total value len = 9.246228 GB avg = 0.175 KB (by entry num) total key len = 1.448587 GB avg = 0.027 KB total ukey len = 1.002538 GB avg = 0.015 KB total ukey num = 0.065938732 Billion total entry num = 0.052746461 Billion write speed all = 0.387895751 MB/sec (with seq num) write speed all = 0.372591042 MB/sec (without seq num) 2024/11/23-16:34:43.638297 139957341054528 [compaction_job.cc:1948] [default] [JOB 30791] Generated table #269810: 129433 keys, 42411875 bytes, temperature: kWarm 2024/11/23-16:34:43.638384 139957341054528 EVENT_LOG_v1 {"time_micros": 1732350883638337, "cf_name": "default", "job": 30791, "event": "table_file_creation", "file_number": 269810, "file_size": 42411875, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237873554, "largest_seqno": 4113707472, "table_properties": {"data_size": 40312288, "index_size": 234368, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588660, "raw_average_key_size": 20, "raw_value_size": 131629660, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129433, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732350881, "oldest_key_time": 0, "file_creation_time": 1732350881, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 269810, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:34:43.714180 139957341054528 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269811.sst) /dev/shm/ToplingTemp/Topling-115949-asEOgK 2024/11/23-16:34:44.288732 139957341054528 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269811.sst): first pass time = 0.57's, 233.627'MB/sec 2024/11/23-16:34:45.195159 139957341054528 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269811.sst): old prealloc_size = 147639500, real_size = 40874880 2024/11/23-16:34:45.195291 139957341054528 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269811.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129434 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.74 raw-val = 0.1316 GB zip-val = 0.0406 GB avg-val =1016.96 avg-zval = 313.81 2024/11/23-16:34:45.195447 139957341054528 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269811.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:34:45.358031 139957341054528 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269811.sst): second pass time = 0.91's, 145.344'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 262.257'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2229.596'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.273'MB/sec write SST data time = 0.04's, 969.259'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 44599.353'MB/sec zip my value time = 0.91's, unzip length = 0.132'GB zip my value throughput = 145.344'MB/sec zip pipeline throughput = 145.344'MB/sec entries = 129434 avg-key = 20.00 avg-zkey = 1.74 avg-val = 1016.96 avg-zval = 313.81 usrkeys = 129434 avg-key = 12.00 avg-zkey = 1.74 avg-val = 1023.96 avg-zval = 313.81 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129434 bytes = 485392 } seq expand size = 906038 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0406 GB dict = 1.38 MB all = 0.0427 GB } UnZip/Zip{ index = 6.8965 value = 3.2407 dict = 1.00 all = 3.1427 } Zip/UnZip{ index = 0.1450 value = 0.3086 dict = 1.00 all = 0.3182 } ---------------------------- total value len = 9.378763 GB avg = 0.177 KB (by entry num) total key len = 1.451176 GB avg = 0.027 KB total ukey len = 1.004091 GB avg = 0.015 KB total ukey num = 0.066068166 Billion total entry num = 0.052875895 Billion write speed all = 0.392771270 MB/sec (with seq num) write speed all = 0.377429996 MB/sec (without seq num) 2024/11/23-16:34:45.411532 139957341054528 [compaction_job.cc:1948] [default] [JOB 30791] Generated table #269811: 129434 keys, 42707337 bytes, temperature: kWarm 2024/11/23-16:34:45.411601 139957341054528 EVENT_LOG_v1 {"time_micros": 1732350885411567, "cf_name": "default", "job": 30791, "event": "table_file_creation", "file_number": 269811, "file_size": 42707337, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237868596, "largest_seqno": 4113702301, "table_properties": {"data_size": 40617136, "index_size": 225216, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588680, "raw_average_key_size": 20, "raw_value_size": 131629145, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129434, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732350883, "oldest_key_time": 0, "file_creation_time": 1732350883, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 269811, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:34:45.451661 139957341054528 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269812.sst) /dev/shm/ToplingTemp/Topling-115949-reE80H 2024/11/23-16:34:46.043189 139957341054528 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269812.sst): first pass time = 0.59's, 226.917'MB/sec 2024/11/23-16:34:46.876559 139957341054528 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269812.sst): old prealloc_size = 147639500, real_size = 40592944 2024/11/23-16:34:46.876689 139957341054528 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269812.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129430 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.81 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1016.99 avg-zval = 311.57 2024/11/23-16:34:46.876847 139957341054528 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269812.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:34:47.049012 139957341054528 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269812.sst): second pass time = 0.83's, 158.069'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.17's, 246.062'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2270.238'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.262'MB/sec write SST data time = 0.05's, 867.849'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 45180.185'MB/sec zip my value time = 0.83's, unzip length = 0.132'GB zip my value throughput = 158.069'MB/sec zip pipeline throughput = 158.069'MB/sec entries = 129430 avg-key = 20.00 avg-zkey = 1.81 avg-val = 1016.99 avg-zval = 311.57 usrkeys = 129430 avg-key = 12.00 avg-zkey = 1.81 avg-val = 1023.99 avg-zval = 311.57 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129430 bytes = 485376 } seq expand size = 906010 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0424 GB } UnZip/Zip{ index = 6.6270 value = 3.2641 dict = 1.00 all = 3.1636 } Zip/UnZip{ index = 0.1509 value = 0.3064 dict = 1.00 all = 0.3161 } ---------------------------- total value len = 9.511298 GB avg = 0.179 KB (by entry num) total key len = 1.453764 GB avg = 0.027 KB total ukey len = 1.005644 GB avg = 0.015 KB total ukey num = 0.066197596 Billion total entry num = 0.053005325 Billion write speed all = 0.397647440 MB/sec (with seq num) write speed all = 0.382269557 MB/sec (without seq num) 2024/11/23-16:34:47.103316 139957341054528 [compaction_job.cc:1948] [default] [JOB 30791] Generated table #269812: 129430 keys, 42425829 bytes, temperature: kWarm 2024/11/23-16:34:47.103385 139957341054528 EVENT_LOG_v1 {"time_micros": 1732350887103349, "cf_name": "default", "job": 30791, "event": "table_file_creation", "file_number": 269812, "file_size": 42425829, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237869923, "largest_seqno": 4113700877, "table_properties": {"data_size": 40326048, "index_size": 234368, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588600, "raw_average_key_size": 20, "raw_value_size": 131629143, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129430, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732350885, "oldest_key_time": 0, "file_creation_time": 1732350885, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 269812, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:34:47.145966 139957341054528 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269813.sst) /dev/shm/ToplingTemp/Topling-115949-YXD43H 2024/11/23-16:34:47.755898 139957341054528 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269813.sst): first pass time = 0.61's, 220.073'MB/sec 2024/11/23-16:34:48.615803 139957341054528 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269813.sst): old prealloc_size = 147639500, real_size = 40591504 2024/11/23-16:34:48.615927 139957341054528 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269813.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129429 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.81 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1017.00 avg-zval = 311.56 2024/11/23-16:34:48.616123 139957341054528 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269813.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:34:48.792466 139957341054528 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269813.sst): second pass time = 0.86's, 153.348'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.18's, 240.163'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2332.136'MB/sec (index lex order gen) rebuild zvType time = 0.13's, 0.250'MB/sec write SST data time = 0.05's, 896.023'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 46436.226'MB/sec zip my value time = 0.86's, unzip length = 0.132'GB zip my value throughput = 153.348'MB/sec zip pipeline throughput = 153.348'MB/sec entries = 129429 avg-key = 20.00 avg-zkey = 1.81 avg-val = 1017.00 avg-zval = 311.56 usrkeys = 129429 avg-key = 12.00 avg-zkey = 1.81 avg-val = 1024.00 avg-zval = 311.56 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129429 bytes = 485376 } seq expand size = 906003 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0424 GB } UnZip/Zip{ index = 6.6270 value = 3.2642 dict = 1.00 all = 3.1637 } Zip/UnZip{ index = 0.1509 value = 0.3063 dict = 1.00 all = 0.3161 } ---------------------------- total value len = 9.643833 GB avg = 0.181 KB (by entry num) total key len = 1.456353 GB avg = 0.027 KB total ukey len = 1.007197 GB avg = 0.015 KB total ukey num = 0.066327025 Billion total entry num = 0.053134754 Billion write speed all = 0.402522248 MB/sec (with seq num) write speed all = 0.387107789 MB/sec (without seq num) 2024/11/23-16:34:48.844150 139957341054528 [compaction_job.cc:1948] [default] [JOB 30791] Generated table #269813: 129429 keys, 42424266 bytes, temperature: kWarm 2024/11/23-16:34:48.844219 139957341054528 EVENT_LOG_v1 {"time_micros": 1732350888844183, "cf_name": "default", "job": 30791, "event": "table_file_creation", "file_number": 269813, "file_size": 42424266, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237881756, "largest_seqno": 4113708912, "table_properties": {"data_size": 40324608, "index_size": 234368, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588580, "raw_average_key_size": 20, "raw_value_size": 131629221, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129429, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732350887, "oldest_key_time": 0, "file_creation_time": 1732350887, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 269813, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:34:48.883950 139957341054528 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269814.sst) /dev/shm/ToplingTemp/Topling-115949-eErYgJ 2024/11/23-16:34:49.591339 139957341054528 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269814.sst): first pass time = 0.71's, 189.869'MB/sec 2024/11/23-16:34:50.480566 139957341054528 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269814.sst): old prealloc_size = 147639500, real_size = 41086080 2024/11/23-16:34:50.480687 139957341054528 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269814.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129430 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.72 raw-val = 0.1316 GB zip-val = 0.0408 GB avg-val =1017.00 avg-zval = 315.47 2024/11/23-16:34:50.480843 139957341054528 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269814.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:34:50.646373 139957341054528 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269814.sst): second pass time = 0.89's, 148.136'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.17's, 258.879'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2200.243'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.267'MB/sec write SST data time = 0.04's, 967.380'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 40567.934'MB/sec zip my value time = 0.89's, unzip length = 0.132'GB zip my value throughput = 148.136'MB/sec zip pipeline throughput = 148.136'MB/sec entries = 129430 avg-key = 20.00 avg-zkey = 1.72 avg-val = 1017.00 avg-zval = 315.47 usrkeys = 129430 avg-key = 12.00 avg-zkey = 1.72 avg-val = 1024.00 avg-zval = 315.47 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129430 bytes = 485376 } seq expand size = 906010 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0408 GB dict = 1.38 MB all = 0.0429 GB } UnZip/Zip{ index = 6.9776 value = 3.2238 dict = 1.00 all = 3.1272 } Zip/UnZip{ index = 0.1433 value = 0.3102 dict = 1.00 all = 0.3198 } ---------------------------- total value len = 9.776369 GB avg = 0.184 KB (by entry num) total key len = 1.458941 GB avg = 0.027 KB total ukey len = 1.008750 GB avg = 0.015 KB total ukey num = 0.066456455 Billion total entry num = 0.053264184 Billion write speed all = 0.407394838 MB/sec (with seq num) write speed all = 0.391943870 MB/sec (without seq num) 2024/11/23-16:34:50.712375 139957341054528 [compaction_job.cc:1948] [default] [JOB 30791] Generated table #269814: 129430 keys, 42919118 bytes, temperature: kWarm 2024/11/23-16:34:50.712443 139957341054528 EVENT_LOG_v1 {"time_micros": 1732350890712408, "cf_name": "default", "job": 30791, "event": "table_file_creation", "file_number": 269814, "file_size": 42919118, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237882779, "largest_seqno": 4113694221, "table_properties": {"data_size": 40830960, "index_size": 222592, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588600, "raw_average_key_size": 20, "raw_value_size": 131630018, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129430, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732350888, "oldest_key_time": 0, "file_creation_time": 1732350888, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 269814, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:34:50.761045 139957341054528 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269815.sst) /dev/shm/ToplingTemp/Topling-115949-Oyvb5G 2024/11/23-16:34:51.290308 139957341054528 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269815.sst): first pass time = 0.53's, 253.614'MB/sec 2024/11/23-16:34:52.160111 139957341054528 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269815.sst): old prealloc_size = 147639500, real_size = 40951856 2024/11/23-16:34:52.160248 139957341054528 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269815.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129431 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.72 raw-val = 0.1316 GB zip-val = 0.0407 GB avg-val =1016.99 avg-zval = 314.43 2024/11/23-16:34:52.160413 139957341054528 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269815.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:34:52.326617 139957341054528 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269815.sst): second pass time = 0.87's, 151.466'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.17's, 256.991'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2325.495'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.272'MB/sec write SST data time = 0.05's, 900.273'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 41251.512'MB/sec zip my value time = 0.87's, unzip length = 0.132'GB zip my value throughput = 151.466'MB/sec zip pipeline throughput = 151.466'MB/sec entries = 129431 avg-key = 20.00 avg-zkey = 1.72 avg-val = 1016.99 avg-zval = 314.43 usrkeys = 129431 avg-key = 12.00 avg-zkey = 1.72 avg-val = 1023.99 avg-zval = 314.43 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129431 bytes = 485376 } seq expand size = 906017 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0407 GB dict = 1.38 MB all = 0.0428 GB } UnZip/Zip{ index = 6.9897 value = 3.2344 dict = 1.00 all = 3.1371 } Zip/UnZip{ index = 0.1431 value = 0.3092 dict = 1.00 all = 0.3188 } ---------------------------- total value len = 9.908905 GB avg = 0.186 KB (by entry num) total key len = 1.461530 GB avg = 0.027 KB total ukey len = 1.010303 GB avg = 0.015 KB total ukey num = 0.066585886 Billion total entry num = 0.053393615 Billion write speed all = 0.412269372 MB/sec (with seq num) write speed all = 0.396781802 MB/sec (without seq num) 2024/11/23-16:34:52.378629 139957341054528 [compaction_job.cc:1948] [default] [JOB 30791] Generated table #269815: 129431 keys, 42784538 bytes, temperature: kWarm 2024/11/23-16:34:52.378700 139957341054528 EVENT_LOG_v1 {"time_micros": 1732350892378663, "cf_name": "default", "job": 30791, "event": "table_file_creation", "file_number": 269815, "file_size": 42784538, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237868290, "largest_seqno": 4113714908, "table_properties": {"data_size": 40697120, "index_size": 222208, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588620, "raw_average_key_size": 20, "raw_value_size": 131630077, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129431, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732350890, "oldest_key_time": 0, "file_creation_time": 1732350890, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 269815, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:34:52.418348 139957341054528 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269816.sst) /dev/shm/ToplingTemp/Topling-115949-skhKBJ 2024/11/23-16:34:53.010772 139957341054528 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269816.sst): first pass time = 0.59's, 226.576'MB/sec 2024/11/23-16:34:53.838601 139957341054528 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269816.sst): old prealloc_size = 147639500, real_size = 40876352 2024/11/23-16:34:53.838723 139957341054528 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269816.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129431 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.75 raw-val = 0.1316 GB zip-val = 0.0406 GB avg-val =1016.99 avg-zval = 313.81 2024/11/23-16:34:53.838890 139957341054528 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269816.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:34:54.000846 139957341054528 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269816.sst): second pass time = 0.83's, 159.153'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 263.274'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2322.766'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.274'MB/sec write SST data time = 0.04's, 968.992'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 45055.681'MB/sec zip my value time = 0.83's, unzip length = 0.132'GB zip my value throughput = 159.153'MB/sec zip pipeline throughput = 159.153'MB/sec entries = 129431 avg-key = 20.00 avg-zkey = 1.75 avg-val = 1016.99 avg-zval = 313.81 usrkeys = 129431 avg-key = 12.00 avg-zkey = 1.75 avg-val = 1023.99 avg-zval = 313.81 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129431 bytes = 485376 } seq expand size = 906017 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0406 GB dict = 1.38 MB all = 0.0427 GB } UnZip/Zip{ index = 6.8516 value = 3.2407 dict = 1.00 all = 3.1426 } Zip/UnZip{ index = 0.1460 value = 0.3086 dict = 1.00 all = 0.3182 } ---------------------------- total value len = 10.041441 GB avg = 0.188 KB (by entry num) total key len = 1.464119 GB avg = 0.027 KB total ukey len = 1.011857 GB avg = 0.015 KB total ukey num = 0.066715317 Billion total entry num = 0.053523046 Billion write speed all = 0.417143389 MB/sec (with seq num) write speed all = 0.401619218 MB/sec (without seq num) 2024/11/23-16:34:54.052512 139957341054528 [compaction_job.cc:1948] [default] [JOB 30791] Generated table #269816: 129431 keys, 42709163 bytes, temperature: kWarm 2024/11/23-16:34:54.052581 139957341054528 EVENT_LOG_v1 {"time_micros": 1732350894052546, "cf_name": "default", "job": 30791, "event": "table_file_creation", "file_number": 269816, "file_size": 42709163, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237874127, "largest_seqno": 4113714915, "table_properties": {"data_size": 40617136, "index_size": 226688, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588620, "raw_average_key_size": 20, "raw_value_size": 131629683, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129431, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732350892, "oldest_key_time": 0, "file_creation_time": 1732350892, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 269816, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:34:54.093601 139957341054528 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269817.sst) /dev/shm/ToplingTemp/Topling-115949-q4mIUK 2024/11/23-16:34:54.631334 139957341054528 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269817.sst): first pass time = 0.54's, 249.619'MB/sec 2024/11/23-16:34:55.458056 139957341054528 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269817.sst): old prealloc_size = 147639500, real_size = 40586816 2024/11/23-16:34:55.458212 139957341054528 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269817.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129432 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.81 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1016.98 avg-zval = 311.51 2024/11/23-16:34:55.458403 139957341054528 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269817.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:34:55.660922 139957341054528 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269817.sst): second pass time = 0.83's, 159.381'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.20's, 209.109'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1759.837'MB/sec (index lex order gen) rebuild zvType time = 0.16's, 0.207'MB/sec write SST data time = 0.05's, 907.662'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 48069.325'MB/sec zip my value time = 0.83's, unzip length = 0.132'GB zip my value throughput = 159.381'MB/sec zip pipeline throughput = 159.381'MB/sec entries = 129432 avg-key = 20.00 avg-zkey = 1.81 avg-val = 1016.98 avg-zval = 311.51 usrkeys = 129432 avg-key = 12.00 avg-zkey = 1.81 avg-val = 1023.98 avg-zval = 311.51 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129432 bytes = 485392 } seq expand size = 906024 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0424 GB } UnZip/Zip{ index = 6.6271 value = 3.2646 dict = 1.00 all = 3.1641 } Zip/UnZip{ index = 0.1509 value = 0.3063 dict = 1.00 all = 0.3160 } ---------------------------- total value len = 10.173977 GB avg = 0.190 KB (by entry num) total key len = 1.466707 GB avg = 0.027 KB total ukey len = 1.013410 GB avg = 0.015 KB total ukey num = 0.066844749 Billion total entry num = 0.053652478 Billion write speed all = 0.422017039 MB/sec (with seq num) write speed all = 0.406456263 MB/sec (without seq num) 2024/11/23-16:34:55.712219 139957341054528 [compaction_job.cc:1948] [default] [JOB 30791] Generated table #269817: 129432 keys, 42419362 bytes, temperature: kWarm 2024/11/23-16:34:55.712286 139957341054528 EVENT_LOG_v1 {"time_micros": 1732350895712253, "cf_name": "default", "job": 30791, "event": "table_file_creation", "file_number": 269817, "file_size": 42419362, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237873877, "largest_seqno": 4113711803, "table_properties": {"data_size": 40319920, "index_size": 234368, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588640, "raw_average_key_size": 20, "raw_value_size": 131629900, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129432, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732350894, "oldest_key_time": 0, "file_creation_time": 1732350894, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 269817, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:34:55.751160 139957341054528 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269818.sst) /dev/shm/ToplingTemp/Topling-115949-KanDHJ 2024/11/23-16:34:56.481083 139957341054528 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269818.sst): first pass time = 0.73's, 183.890'MB/sec 2024/11/23-16:34:57.285876 139957341054528 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269818.sst): old prealloc_size = 147639500, real_size = 40580592 2024/11/23-16:34:57.286022 139957341054528 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269818.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129430 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.81 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1017.00 avg-zval = 311.47 2024/11/23-16:34:57.286194 139957341054528 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269818.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:34:57.448539 139957341054528 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269818.sst): second pass time = 0.80's, 163.849'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 260.784'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1924.334'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.276'MB/sec write SST data time = 0.05's, 938.258'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 48166.958'MB/sec zip my value time = 0.80's, unzip length = 0.132'GB zip my value throughput = 163.849'MB/sec zip pipeline throughput = 163.849'MB/sec entries = 129430 avg-key = 20.00 avg-zkey = 1.81 avg-val = 1017.00 avg-zval = 311.47 usrkeys = 129430 avg-key = 12.00 avg-zkey = 1.81 avg-val = 1024.00 avg-zval = 311.47 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129430 bytes = 485376 } seq expand size = 906010 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0424 GB } UnZip/Zip{ index = 6.6252 value = 3.2651 dict = 1.00 all = 3.1645 } Zip/UnZip{ index = 0.1509 value = 0.3063 dict = 1.00 all = 0.3160 } ---------------------------- total value len = 10.306513 GB avg = 0.192 KB (by entry num) total key len = 1.469296 GB avg = 0.027 KB total ukey len = 1.014963 GB avg = 0.015 KB total ukey num = 0.066974179 Billion total entry num = 0.053781908 Billion write speed all = 0.426888121 MB/sec (with seq num) write speed all = 0.411290817 MB/sec (without seq num) 2024/11/23-16:34:57.500369 139957341054528 [compaction_job.cc:1948] [default] [JOB 30791] Generated table #269818: 129430 keys, 42413544 bytes, temperature: kWarm 2024/11/23-16:34:57.500436 139957341054528 EVENT_LOG_v1 {"time_micros": 1732350897500400, "cf_name": "default", "job": 30791, "event": "table_file_creation", "file_number": 269818, "file_size": 42413544, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237872082, "largest_seqno": 4113712337, "table_properties": {"data_size": 40313632, "index_size": 234432, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588600, "raw_average_key_size": 20, "raw_value_size": 131629716, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129430, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732350895, "oldest_key_time": 0, "file_creation_time": 1732350895, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 269818, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:34:57.537525 139957341054528 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269819.sst) /dev/shm/ToplingTemp/Topling-115949-SJRySI 2024/11/23-16:34:58.246527 139957341054528 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269819.sst): first pass time = 0.71's, 189.318'MB/sec 2024/11/23-16:34:59.090348 139957341054528 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269819.sst): old prealloc_size = 147639500, real_size = 41079984 2024/11/23-16:34:59.090508 139957341054528 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269819.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129429 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.72 raw-val = 0.1316 GB zip-val = 0.0408 GB avg-val =1017.00 avg-zval = 315.42 2024/11/23-16:34:59.090688 139957341054528 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269819.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:34:59.252763 139957341054528 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269819.sst): second pass time = 0.84's, 156.133'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 264.256'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1700.076'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.271'MB/sec write SST data time = 0.04's, 998.037'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.379'MB, throughput = 45617.179'MB/sec zip my value time = 0.84's, unzip length = 0.132'GB zip my value throughput = 156.133'MB/sec zip pipeline throughput = 156.133'MB/sec entries = 129429 avg-key = 20.00 avg-zkey = 1.72 avg-val = 1017.00 avg-zval = 315.42 usrkeys = 129429 avg-key = 12.00 avg-zkey = 1.72 avg-val = 1024.00 avg-zval = 315.42 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129429 bytes = 485376 } seq expand size = 906003 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0408 GB dict = 1.38 MB all = 0.0429 GB } UnZip/Zip{ index = 6.9796 value = 3.2242 dict = 1.00 all = 3.1276 } Zip/UnZip{ index = 0.1433 value = 0.3101 dict = 1.00 all = 0.3197 } ---------------------------- total value len = 10.439048 GB avg = 0.194 KB (by entry num) total key len = 1.471885 GB avg = 0.027 KB total ukey len = 1.016516 GB avg = 0.015 KB total ukey num = 0.067103608 Billion total entry num = 0.053911337 Billion write speed all = 0.431758307 MB/sec (with seq num) write speed all = 0.416124491 MB/sec (without seq num) 2024/11/23-16:34:59.303720 139957341054528 [compaction_job.cc:1948] [default] [JOB 30791] Generated table #269819: 129429 keys, 42913471 bytes, temperature: kWarm 2024/11/23-16:34:59.303788 139957341054528 EVENT_LOG_v1 {"time_micros": 1732350899303753, "cf_name": "default", "job": 30791, "event": "table_file_creation", "file_number": 269819, "file_size": 42913471, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237916889, "largest_seqno": 4113710528, "table_properties": {"data_size": 40824928, "index_size": 222528, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588580, "raw_average_key_size": 20, "raw_value_size": 131629643, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129429, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732350897, "oldest_key_time": 0, "file_creation_time": 1732350897, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 269819, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:34:59.342051 139957341054528 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269820.sst) /dev/shm/ToplingTemp/Topling-115949-B8qZFH 2024/11/23-16:35:00.039341 139957341054528 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269820.sst): first pass time = 0.70's, 192.497'MB/sec 2024/11/23-16:35:00.829847 139957341054528 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269820.sst): old prealloc_size = 147639500, real_size = 40588464 2024/11/23-16:35:00.829971 139957341054528 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269820.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129428 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.81 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1017.01 avg-zval = 311.54 2024/11/23-16:35:00.830156 139957341054528 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269820.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:35:00.993236 139957341054528 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269820.sst): second pass time = 0.79's, 166.833'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 259.663'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2057.376'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.274'MB/sec write SST data time = 0.04's, 942.880'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 37198.143'MB/sec zip my value time = 0.79's, unzip length = 0.132'GB zip my value throughput = 166.833'MB/sec zip pipeline throughput = 166.833'MB/sec entries = 129428 avg-key = 20.00 avg-zkey = 1.81 avg-val = 1017.01 avg-zval = 311.54 usrkeys = 129428 avg-key = 12.00 avg-zkey = 1.81 avg-val = 1024.01 avg-zval = 311.54 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129428 bytes = 485376 } seq expand size = 905996 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0424 GB } UnZip/Zip{ index = 6.6269 value = 3.2645 dict = 1.00 all = 3.1639 } Zip/UnZip{ index = 0.1509 value = 0.3063 dict = 1.00 all = 0.3161 } ---------------------------- total value len = 10.571584 GB avg = 0.196 KB (by entry num) total key len = 1.474473 GB avg = 0.027 KB total ukey len = 1.018069 GB avg = 0.015 KB total ukey num = 0.067233036 Billion total entry num = 0.054040765 Billion write speed all = 0.436628863 MB/sec (with seq num) write speed all = 0.420958502 MB/sec (without seq num) 2024/11/23-16:35:01.044942 139957341054528 [compaction_job.cc:1948] [default] [JOB 30791] Generated table #269820: 129428 keys, 42421231 bytes, temperature: kWarm 2024/11/23-16:35:01.045023 139957341054528 EVENT_LOG_v1 {"time_micros": 1732350901044987, "cf_name": "default", "job": 30791, "event": "table_file_creation", "file_number": 269820, "file_size": 42421231, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237871365, "largest_seqno": 4113714916, "table_properties": {"data_size": 40321568, "index_size": 234368, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588560, "raw_average_key_size": 20, "raw_value_size": 131629586, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129428, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732350899, "oldest_key_time": 0, "file_creation_time": 1732350899, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 269820, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:35:01.082312 139957341054528 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269821.sst) /dev/shm/ToplingTemp/Topling-115949-tFWarG 2024/11/23-16:35:01.792268 139957341054528 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269821.sst): first pass time = 0.71's, 189.064'MB/sec 2024/11/23-16:35:02.595365 139957341054528 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269821.sst): old prealloc_size = 147639500, real_size = 40451760 2024/11/23-16:35:02.595491 139957341054528 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269821.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129429 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.71 raw-val = 0.1316 GB zip-val = 0.0402 GB avg-val =1017.00 avg-zval = 310.58 2024/11/23-16:35:02.595588 139957341054528 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269821.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:35:02.754842 139957341054528 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269821.sst): second pass time = 0.80's, 164.262'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 262.899'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2146.572'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.279'MB/sec write SST data time = 0.04's, 967.986'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 41574.346'MB/sec zip my value time = 0.80's, unzip length = 0.132'GB zip my value throughput = 164.262'MB/sec zip pipeline throughput = 164.262'MB/sec entries = 129429 avg-key = 20.00 avg-zkey = 1.71 avg-val = 1017.00 avg-zval = 310.58 usrkeys = 129429 avg-key = 12.00 avg-zkey = 1.71 avg-val = 1018.45 avg-zval = 310.58 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 26780 bytes = 100432 } seq expand size = 187460 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0402 GB dict = 1.38 MB all = 0.0419 GB } UnZip/Zip{ index = 7.0159 value = 3.2746 dict = 1.00 all = 3.2018 } Zip/UnZip{ index = 0.1425 value = 0.3054 dict = 1.00 all = 0.3123 } ---------------------------- total value len = 10.703401 GB avg = 0.198 KB (by entry num) total key len = 1.477062 GB avg = 0.027 KB total ukey len = 1.019622 GB avg = 0.015 KB total ukey num = 0.067362465 Billion total entry num = 0.054170194 Billion write speed all = 0.441472436 MB/sec (with seq num) write speed all = 0.425765547 MB/sec (without seq num) 2024/11/23-16:35:02.805014 139957341054528 [compaction_job.cc:1948] [default] [JOB 30791] Generated table #269821: 129429 keys, 41920035 bytes, temperature: kWarm 2024/11/23-16:35:02.805084 139957341054528 EVENT_LOG_v1 {"time_micros": 1732350902805049, "cf_name": "default", "job": 30791, "event": "table_file_creation", "file_number": 269821, "file_size": 41920035, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4113690571, "table_properties": {"data_size": 40197856, "index_size": 221376, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588580, "raw_average_key_size": 20, "raw_value_size": 131629926, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129429, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732350901, "oldest_key_time": 0, "file_creation_time": 1732350901, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 269821, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:35:02.845820 139957341054528 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269822.sst) /dev/shm/ToplingTemp/Topling-115949-WFvsAK 2024/11/23-16:35:03.674347 139957341054528 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269822.sst): first pass time = 0.83's, 162.005'MB/sec 2024/11/23-16:35:04.557122 139957341054528 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269822.sst): old prealloc_size = 147639500, real_size = 41066464 2024/11/23-16:35:04.557261 139957341054528 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269822.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129430 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.71 raw-val = 0.1316 GB zip-val = 0.0408 GB avg-val =1017.00 avg-zval = 315.33 2024/11/23-16:35:04.557417 139957341054528 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269822.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:35:04.720383 139957341054528 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269822.sst): second pass time = 0.88's, 149.329'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 262.660'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2118.909'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.272'MB/sec write SST data time = 0.04's, 969.972'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 48426.774'MB/sec zip my value time = 0.88's, unzip length = 0.132'GB zip my value throughput = 149.329'MB/sec zip pipeline throughput = 149.329'MB/sec entries = 129430 avg-key = 20.00 avg-zkey = 1.71 avg-val = 1017.00 avg-zval = 315.33 usrkeys = 129430 avg-key = 12.00 avg-zkey = 1.71 avg-val = 1023.36 avg-zval = 315.33 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 117681 bytes = 441312 } seq expand size = 823767 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0408 GB dict = 1.38 MB all = 0.0429 GB } UnZip/Zip{ index = 7.0200 value = 3.2252 dict = 1.00 all = 3.1304 } Zip/UnZip{ index = 0.1425 value = 0.3101 dict = 1.00 all = 0.3194 } ---------------------------- total value len = 10.835855 GB avg = 0.200 KB (by entry num) total key len = 1.479650 GB avg = 0.027 KB total ukey len = 1.021176 GB avg = 0.015 KB total ukey num = 0.067491895 Billion total entry num = 0.054299624 Billion write speed all = 0.446335147 MB/sec (with seq num) write speed all = 0.430591851 MB/sec (without seq num) 2024/11/23-16:35:04.772189 139957341054528 [compaction_job.cc:1948] [default] [JOB 30791] Generated table #269822: 129430 keys, 42875697 bytes, temperature: kWarm 2024/11/23-16:35:04.772259 139957341054528 EVENT_LOG_v1 {"time_micros": 1732350904772222, "cf_name": "default", "job": 30791, "event": "table_file_creation", "file_number": 269822, "file_size": 42875697, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4113709771, "table_properties": {"data_size": 40812688, "index_size": 221248, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588600, "raw_average_key_size": 20, "raw_value_size": 131629758, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129430, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732350902, "oldest_key_time": 0, "file_creation_time": 1732350902, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 269822, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:35:04.809212 139957341054528 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269823.sst) /dev/shm/ToplingTemp/Topling-115949-wEN5PJ 2024/11/23-16:35:05.536564 139957341054528 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269823.sst): first pass time = 0.73's, 184.540'MB/sec 2024/11/23-16:35:06.316810 139957341054528 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269823.sst): old prealloc_size = 147639500, real_size = 40770896 2024/11/23-16:35:06.316932 139957341054528 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269823.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129428 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.74 raw-val = 0.1316 GB zip-val = 0.0405 GB avg-val =1017.01 avg-zval = 313.02 2024/11/23-16:35:06.317080 139957341054528 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269823.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:35:06.479493 139957341054528 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269823.sst): second pass time = 0.78's, 168.853'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 261.126'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2270.986'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.277'MB/sec write SST data time = 0.05's, 927.012'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 49829.397'MB/sec zip my value time = 0.78's, unzip length = 0.132'GB zip my value throughput = 168.853'MB/sec zip pipeline throughput = 168.853'MB/sec entries = 129428 avg-key = 20.00 avg-zkey = 1.74 avg-val = 1017.01 avg-zval = 313.02 usrkeys = 129428 avg-key = 12.00 avg-zkey = 1.74 avg-val = 1021.86 avg-zval = 313.02 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 89664 bytes = 336256 } seq expand size = 627648 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0405 GB dict = 1.38 MB all = 0.0425 GB } UnZip/Zip{ index = 6.8962 value = 3.2491 dict = 1.00 all = 3.1600 } Zip/UnZip{ index = 0.1450 value = 0.3078 dict = 1.00 all = 0.3165 } ---------------------------- total value len = 10.968113 GB avg = 0.202 KB (by entry num) total key len = 1.482239 GB avg = 0.027 KB total ukey len = 1.022729 GB avg = 0.015 KB total ukey num = 0.067621323 Billion total entry num = 0.054429052 Billion write speed all = 0.451193448 MB/sec (with seq num) write speed all = 0.435413633 MB/sec (without seq num) 2024/11/23-16:35:06.532907 139957341054528 [compaction_job.cc:1948] [default] [JOB 30791] Generated table #269823: 129428 keys, 42474564 bytes, temperature: kWarm 2024/11/23-16:35:06.532988 139957341054528 EVENT_LOG_v1 {"time_micros": 1732350906532940, "cf_name": "default", "job": 30791, "event": "table_file_creation", "file_number": 269823, "file_size": 42474564, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4113711702, "table_properties": {"data_size": 40513152, "index_size": 225216, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588560, "raw_average_key_size": 20, "raw_value_size": 131630190, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129428, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732350904, "oldest_key_time": 0, "file_creation_time": 1732350904, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 269823, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:35:06.575500 139957341054528 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269824.sst) /dev/shm/ToplingTemp/Topling-115949-YxqaVG 2024/11/23-16:35:07.382962 139957341054528 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269824.sst): first pass time = 0.81's, 166.230'MB/sec 2024/11/23-16:35:08.242856 139957341054528 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269824.sst): old prealloc_size = 147639500, real_size = 40923280 2024/11/23-16:35:08.242992 139957341054528 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269824.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129427 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.75 raw-val = 0.1316 GB zip-val = 0.0407 GB avg-val =1017.02 avg-zval = 314.19 2024/11/23-16:35:08.243169 139957341054528 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269824.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:35:08.404169 139957341054528 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269824.sst): second pass time = 0.86's, 153.209'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 264.905'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2010.066'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.275'MB/sec write SST data time = 0.04's, 983.332'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 46259.908'MB/sec zip my value time = 0.86's, unzip length = 0.132'GB zip my value throughput = 153.209'MB/sec zip pipeline throughput = 153.209'MB/sec entries = 129427 avg-key = 20.00 avg-zkey = 1.75 avg-val = 1017.02 avg-zval = 314.19 usrkeys = 129427 avg-key = 12.00 avg-zkey = 1.75 avg-val = 1023.28 avg-zval = 314.19 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 115765 bytes = 434128 } seq expand size = 810355 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0407 GB dict = 1.38 MB all = 0.0427 GB } UnZip/Zip{ index = 6.8708 value = 3.2369 dict = 1.00 all = 3.1414 } Zip/UnZip{ index = 0.1455 value = 0.3089 dict = 1.00 all = 0.3183 } ---------------------------- total value len = 11.100552 GB avg = 0.203 KB (by entry num) total key len = 1.484827 GB avg = 0.027 KB total ukey len = 1.024282 GB avg = 0.015 KB total ukey num = 0.067750750 Billion total entry num = 0.054558479 Billion write speed all = 0.456054986 MB/sec (with seq num) write speed all = 0.440238750 MB/sec (without seq num) 2024/11/23-16:35:08.458631 139957341054528 [compaction_job.cc:1948] [default] [JOB 30791] Generated table #269824: 129427 keys, 42725698 bytes, temperature: kWarm 2024/11/23-16:35:08.458702 139957341054528 EVENT_LOG_v1 {"time_micros": 1732350908458667, "cf_name": "default", "job": 30791, "event": "table_file_creation", "file_number": 269824, "file_size": 42725698, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4113710646, "table_properties": {"data_size": 40664704, "index_size": 226048, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588540, "raw_average_key_size": 20, "raw_value_size": 131629416, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129427, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732350906, "oldest_key_time": 0, "file_creation_time": 1732350906, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 269824, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:35:08.498194 139957341054528 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269825.sst) /dev/shm/ToplingTemp/Topling-115949-eKVIsH 2024/11/23-16:35:09.061299 139957341054528 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269825.sst): first pass time = 0.56's, 238.369'MB/sec 2024/11/23-16:35:09.887830 139957341054528 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269825.sst): old prealloc_size = 147639500, real_size = 40510784 2024/11/23-16:35:09.887964 139957341054528 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269825.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129431 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.74 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1016.99 avg-zval = 311.00 2024/11/23-16:35:09.888092 139957341054528 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269825.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:35:10.053277 139957341054528 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269825.sst): second pass time = 0.83's, 159.516'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.17's, 254.317'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1731.726'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.269'MB/sec write SST data time = 0.04's, 935.726'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 46984.487'MB/sec zip my value time = 0.83's, unzip length = 0.132'GB zip my value throughput = 159.516'MB/sec zip pipeline throughput = 159.516'MB/sec entries = 129431 avg-key = 20.00 avg-zkey = 1.74 avg-val = 1016.99 avg-zval = 311.00 usrkeys = 129431 avg-key = 12.00 avg-zkey = 1.74 avg-val = 1019.76 avg-zval = 311.00 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 51199 bytes = 192016 } seq expand size = 358393 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0421 GB } UnZip/Zip{ index = 6.9023 value = 3.2700 dict = 1.00 all = 3.1903 } Zip/UnZip{ index = 0.1449 value = 0.3058 dict = 1.00 all = 0.3134 } ---------------------------- total value len = 11.232541 GB avg = 0.205 KB (by entry num) total key len = 1.487416 GB avg = 0.027 KB total ukey len = 1.025835 GB avg = 0.015 KB total ukey num = 0.067880181 Billion total entry num = 0.054687910 Billion write speed all = 0.460904094 MB/sec (with seq num) write speed all = 0.445051284 MB/sec (without seq num) 2024/11/23-16:35:10.105817 139957341054528 [compaction_job.cc:1948] [default] [JOB 30791] Generated table #269825: 129431 keys, 42070581 bytes, temperature: kWarm 2024/11/23-16:35:10.105885 139957341054528 EVENT_LOG_v1 {"time_micros": 1732350910105850, "cf_name": "default", "job": 30791, "event": "table_file_creation", "file_number": 269825, "file_size": 42070581, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4113702929, "table_properties": {"data_size": 40253232, "index_size": 225024, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588620, "raw_average_key_size": 20, "raw_value_size": 131629970, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129431, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732350908, "oldest_key_time": 0, "file_creation_time": 1732350908, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 269825, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:35:10.143406 139957341054528 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269826.sst) /dev/shm/ToplingTemp/Topling-115949-dWjw0J 2024/11/23-16:35:10.760754 139957341054528 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269826.sst): first pass time = 0.62's, 217.424'MB/sec 2024/11/23-16:35:11.713702 139957341054528 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269826.sst): old prealloc_size = 147639500, real_size = 40595200 2024/11/23-16:35:11.713822 139957341054528 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269826.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129425 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.72 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1017.03 avg-zval = 311.69 2024/11/23-16:35:11.713902 139957341054528 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269826.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:35:11.876365 139957341054528 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269826.sst): second pass time = 0.95's, 138.239'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 258.690'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2280.925'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.268'MB/sec write SST data time = 0.04's, 1010.276'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 50817.250'MB/sec zip my value time = 0.95's, unzip length = 0.132'GB zip my value throughput = 138.239'MB/sec zip pipeline throughput = 138.239'MB/sec entries = 129425 avg-key = 20.00 avg-zkey = 1.72 avg-val = 1017.03 avg-zval = 311.69 usrkeys = 129425 avg-key = 12.00 avg-zkey = 1.72 avg-val = 1018.63 avg-zval = 311.69 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 29461 bytes = 110496 } seq expand size = 206227 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0421 GB } UnZip/Zip{ index = 6.9934 value = 3.2630 dict = 1.00 all = 3.1901 } Zip/UnZip{ index = 0.1430 value = 0.3065 dict = 1.00 all = 0.3135 } ---------------------------- total value len = 11.364377 GB avg = 0.207 KB (by entry num) total key len = 1.490004 GB avg = 0.027 KB total ukey len = 1.027388 GB avg = 0.015 KB total ukey num = 0.068009606 Billion total entry num = 0.054817335 Billion write speed all = 0.465744153 MB/sec (with seq num) write speed all = 0.449854876 MB/sec (without seq num) 2024/11/23-16:35:11.928372 139957341054528 [compaction_job.cc:1948] [default] [JOB 30791] Generated table #269826: 129425 keys, 42073536 bytes, temperature: kWarm 2024/11/23-16:35:11.928436 139957341054528 EVENT_LOG_v1 {"time_micros": 1732350911928401, "cf_name": "default", "job": 30791, "event": "table_file_creation", "file_number": 269826, "file_size": 42073536, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4113709701, "table_properties": {"data_size": 40340592, "index_size": 222080, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588500, "raw_average_key_size": 20, "raw_value_size": 131629549, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129425, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732350910, "oldest_key_time": 0, "file_creation_time": 1732350910, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 269826, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:35:11.968273 139957341054528 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269827.sst) /dev/shm/ToplingTemp/Topling-115949-2HfcdH 2024/11/23-16:35:12.598665 139957341054528 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269827.sst): first pass time = 0.63's, 212.924'MB/sec 2024/11/23-16:35:13.420970 139957341054528 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269827.sst): old prealloc_size = 147639500, real_size = 40456672 2024/11/23-16:35:13.421105 139957341054528 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269827.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129431 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.72 raw-val = 0.1316 GB zip-val = 0.0402 GB avg-val =1016.99 avg-zval = 310.61 2024/11/23-16:35:13.421201 139957341054528 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269827.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:35:13.582839 139957341054528 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269827.sst): second pass time = 0.82's, 160.201'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 259.090'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2215.019'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.275'MB/sec write SST data time = 0.04's, 955.334'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.379'MB, throughput = 48300.025'MB/sec zip my value time = 0.82's, unzip length = 0.132'GB zip my value throughput = 160.201'MB/sec zip pipeline throughput = 160.201'MB/sec entries = 129431 avg-key = 20.00 avg-zkey = 1.72 avg-val = 1016.99 avg-zval = 310.61 usrkeys = 129431 avg-key = 12.00 avg-zkey = 1.72 avg-val = 1018.55 avg-zval = 310.61 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 28783 bytes = 107952 } seq expand size = 201481 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0402 GB dict = 1.38 MB all = 0.0419 GB } UnZip/Zip{ index = 6.9938 value = 3.2742 dict = 1.00 all = 3.2008 } Zip/UnZip{ index = 0.1430 value = 0.3054 dict = 1.00 all = 0.3124 } ---------------------------- total value len = 11.496208 GB avg = 0.209 KB (by entry num) total key len = 1.492593 GB avg = 0.027 KB total ukey len = 1.028941 GB avg = 0.015 KB total ukey num = 0.068139037 Billion total entry num = 0.054946766 Billion write speed all = 0.470585405 MB/sec (with seq num) write speed all = 0.454659596 MB/sec (without seq num) 2024/11/23-16:35:13.633125 139957341054528 [compaction_job.cc:1948] [default] [JOB 30791] Generated table #269827: 129431 keys, 41933317 bytes, temperature: kWarm 2024/11/23-16:35:13.633200 139957341054528 EVENT_LOG_v1 {"time_micros": 1732350913633158, "cf_name": "default", "job": 30791, "event": "table_file_creation", "file_number": 269827, "file_size": 41933317, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4113706850, "table_properties": {"data_size": 40202064, "index_size": 222080, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588620, "raw_average_key_size": 20, "raw_value_size": 131629849, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129431, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732350911, "oldest_key_time": 0, "file_creation_time": 1732350911, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 269827, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:35:13.669867 139957341054528 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269828.sst) /dev/shm/ToplingTemp/Topling-115949-tn2vYJ 2024/11/23-16:35:14.466710 139957341054528 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269828.sst): first pass time = 0.80's, 168.445'MB/sec 2024/11/23-16:35:15.370894 139957341054528 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269828.sst): old prealloc_size = 147639500, real_size = 40628608 2024/11/23-16:35:15.371040 139957341054528 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269828.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129428 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.72 raw-val = 0.1316 GB zip-val = 0.0404 GB avg-val =1017.01 avg-zval = 311.94 2024/11/23-16:35:15.371146 139957341054528 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269828.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:35:15.535380 139957341054528 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269828.sst): second pass time = 0.90's, 145.682'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 256.585'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1881.540'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.267'MB/sec write SST data time = 0.04's, 977.037'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 44612.464'MB/sec zip my value time = 0.90's, unzip length = 0.132'GB zip my value throughput = 145.682'MB/sec zip pipeline throughput = 145.682'MB/sec entries = 129428 avg-key = 20.00 avg-zkey = 1.72 avg-val = 1017.01 avg-zval = 311.94 usrkeys = 129428 avg-key = 12.00 avg-zkey = 1.72 avg-val = 1019.94 avg-zval = 311.94 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 54132 bytes = 203008 } seq expand size = 378924 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0404 GB dict = 1.38 MB all = 0.0422 GB } UnZip/Zip{ index = 6.9936 value = 3.2602 dict = 1.00 all = 3.1806 } Zip/UnZip{ index = 0.1430 value = 0.3067 dict = 1.00 all = 0.3144 } ---------------------------- total value len = 11.628216 GB avg = 0.211 KB (by entry num) total key len = 1.495182 GB avg = 0.027 KB total ukey len = 1.030494 GB avg = 0.015 KB total ukey num = 0.068268465 Billion total entry num = 0.055076194 Billion write speed all = 0.475428226 MB/sec (with seq num) write speed all = 0.459466032 MB/sec (without seq num) 2024/11/23-16:35:15.586351 139957341054528 [compaction_job.cc:1948] [default] [JOB 30791] Generated table #269828: 129428 keys, 42199390 bytes, temperature: kWarm 2024/11/23-16:35:15.586422 139957341054528 EVENT_LOG_v1 {"time_micros": 1732350915586385, "cf_name": "default", "job": 30791, "event": "table_file_creation", "file_number": 269828, "file_size": 42199390, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4113714519, "table_properties": {"data_size": 40374000, "index_size": 222080, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588560, "raw_average_key_size": 20, "raw_value_size": 131629284, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129428, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732350913, "oldest_key_time": 0, "file_creation_time": 1732350913, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 269828, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:35:15.625176 139957341054528 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269829.sst) /dev/shm/ToplingTemp/Topling-115949-bY5nEG 2024/11/23-16:35:15.633446 139957341054528 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269829.sst): first pass time = 0.01's, 373.056'MB/sec 2024/11/23-16:35:15.664294 139957341054528 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269829.sst): old prealloc_size = 147639500, real_size = 975088 2024/11/23-16:35:15.664334 139957341054528 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269829.sst): index type = UintIndex_IL_256_32 , store type = DictZipBlobStore usrkeys = 2963 prefix = 4 raw-key = 0.0000 GB zip-key = 0.0000 GB avg-key = 8.00 avg-zkey = 0.27 raw-val = 0.0030 GB zip-val = 0.0010 GB avg-val =1016.93 avg-zval = 328.51 2024/11/23-16:35:15.667874 139957341054528 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00/269829.sst): second pass time = 0.03's, 99.114'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.00's, 285.697'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 34.861'MB/sec (index lex order gen) rebuild zvType time = 0.00's, 0.301'MB/sec write SST data time = 0.00's, 940.686'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.033'MB, throughput = 1166.661'MB/sec zip my value time = 0.03's, unzip length = 0.003'GB zip my value throughput = 99.114'MB/sec zip pipeline throughput = 99.114'MB/sec entries = 2963 avg-key = 20.00 avg-zkey = 0.28 avg-val = 1016.93 avg-zval = 328.51 usrkeys = 2963 avg-key = 12.00 avg-zkey = 0.28 avg-val = 1023.93 avg-zval = 328.51 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 2963 bytes = 10016 } seq expand size = 20741 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0000 GB value = 0.0030 GB dict = 0.03 MB all = 0.0031 GB } __ZipSize{ index = 0.0000 GB value = 0.0010 GB dict = 0.03 MB all = 0.0010 GB } UnZip/Zip{ index = 42.7356 value = 3.0956 dict = 1.00 all = 3.0183 } Zip/UnZip{ index = 0.0234 value = 0.3230 dict = 1.00 all = 0.3313 } ---------------------------- total value len = 11.631250 GB avg = 0.211 KB (by entry num) total key len = 1.495241 GB avg = 0.027 KB total ukey len = 1.030530 GB avg = 0.015 KB total ukey num = 0.068271428 Billion total entry num = 0.055079157 Billion write speed all = 0.475538001 MB/sec (with seq num) write speed all = 0.459575025 MB/sec (without seq num) 2024/11/23-16:35:15.676427 139957341054528 [compaction_job.cc:1948] [default] [JOB 30791] Generated table #269829: 2963 keys, 1017946 bytes, temperature: kWarm 2024/11/23-16:35:15.676474 139957341054528 EVENT_LOG_v1 {"time_micros": 1732350915676448, "cf_name": "default", "job": 30791, "event": "table_file_creation", "file_number": 269829, "file_size": 1017946, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4015408792, "largest_seqno": 4112206886, "table_properties": {"data_size": 973376, "index_size": 832, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 59260, "raw_average_key_size": 20, "raw_value_size": 3013176, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 2963, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-UintIndex_IL_256_32-DictZipBlobStore", "creation_time": 1732350915, "oldest_key_time": 0, "file_creation_time": 1732350915, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 269829, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:35:15.684652 139957341054528 [compaction_job.cc:703] job-30791: subcompact[0], size: 0.892984 G, files: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30791/att-00 [269808,269809,269810,269811,269812,269813,269814,269815,269816,269817,269818,269819,269820,269821,269822,269823,269824,269825,269826,269827,269828,269829] 2024/11/23-16:35:15.816315 139957341054528 (Original Log Time 2024/11/23-16:34:37.187091) EVENT_LOG_v1 {"time_micros": 1732350877187052, "job": 30791, "event": "compaction_started", "compaction_reason": "FilesMarkedForCompaction", "files_L2": [269804], "files_L3": [269730, 269731, 269732, 269733, 269734, 269735, 269736, 269737, 269738, 269739, 269740, 269741, 269742, 269743, 269744, 269745, 269746, 269747, 269748, 269749, 269750], "score": 0.998312, "input_data_size": 924675486, "oldest_snapshot_seqno": 4113738270} 2024/11/23-16:35:15.816322 139957341054528 (Original Log Time 2024/11/23-16:35:15.814299) [compaction_job.cc:2022] [default] [JOB 30791] Compacted 1@2 + 21@3 files to L3 => 892983817 bytes 2024/11/23-16:35:15.816324 139957341054528 (Original Log Time 2024/11/23-16:35:15.816243) [compaction_job.cc:1224] [default] compacted to: files[0 0 0 22 0 0 0] max score 0.03, MB/sec: 24.0 rd, 23.2 wr, level 3, files in(1, 21) out(22 +0 blob) MB in(31.2, 850.6 +0.0 blob) out(851.6 +0.0 blob), read-write-amplify(55.6) write-amplify(27.3) OK, records in: 2749944, records dropped: 28951 output_compression: Snappy 2024/11/23-16:35:15.816327 139957341054528 (Original Log Time 2024/11/23-16:35:15.816290) EVENT_LOG_v1 {"time_micros": 1732350915816266, "cf": "default", "job": 30791, "event": "compaction_finished", "compaction_time_micros": 38497565, "compaction_time_cpu_micros": 8173985, "output_level": 3, "num_output_files": 22, "total_output_size": 892983817, "num_input_records": 2749944, "num_output_records": 2720993, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "file_write_nanos": 646782522, "file_range_sync_nanos": 0, "file_fsync_nanos": 15802, "file_prepare_write_nanos": 50967, "lsm_state": [0, 0, 0, 22, 0, 0, 0]} 2024/11/23-16:35:15.954195 139957341054528 DEBG dcompact_worker.cpp:240: HttpPost: 200 OK: url = http://nlb-7zny4kaa1poal01o64.cn-shenzhen.nlb.aliyuncs.com:8443, body = {"instanceId":"nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137","labourId":"","dbId":"d89b4006-2803-486e-b7a2-759bcf348921","dbStarts":1732256054,"starts":1732350876,"executesMs":38798,"compactionJobId":30791,"attempt":0,"compactionInputRawBytes":2851678836,"compactionInputZipBytes":924675486,"compactionOutputRawBytes":0,"compactionOutputZipBytes":892983817,"headers":{"Accept":"*/*","Connection":"close","Host":"aliyun-topling-saas.topling.cn:18443","RemoteIp":"120.24.192.169","X-Forwarded-For":"120.24.192.169","region":"cn-shenzhen","token":"e6474c481bd4415abc537135cc03626b","instance-token":"e6474c481bd4415abc537135cc03626b","provider":"aliyun","CloudMarketInstanceId":"si-59c0ae5c955845588903","MeteringAssit":"","Transfer-Encoding":"chunked","traceparent":"00-ba2a32be74040350cee9bbea369eb862-71fb994a82887964-00"}}, response = 2024/11/23-16:35:15.954285 139957341054528 INFO dcompact_worker.cpp:1459: finish /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-30791/att-00: olev 3, work 38.798 s, result 7.716 ms, install 2.043 ms, input{raw 2.656 GiB zip 881.839 MiB}