2024/11/23-21:06:25.129023 139957433374272 DEBG dcompact_worker.cpp:2214: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00: fork to child time = 0.007923 sec 2024/11/23-21:06:25.129827 139957433374272 DEBG dcompact_worker.cpp:1013: Beg SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00 2024/11/23-21:06:25.138864 139957433374272 DEBG dcompact_worker.cpp:1033: End SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00 2024/11/23-21:06:25.139769 139957433374272 TRAC dcompact_worker.cpp:1083: INFO_LOG_LEVEL: rpc = INFO_LEVEL, env_var = undefined 2024/11/23-21:06:25.140030 139957433374272 [WARN] [column_family.cc:386] multiple cf_paths/db_paths and level_compaction_dynamic_level_bytes can't be used together 2024/11/23-21:06:25.193717 139957433374272 [version_set.cc:6208] Recovering from manifest file: /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-35792/att-00/MANIFEST-206347 2024/11/23-21:06:25.217261 139957433374272 [version_set.cc:6251] Recovered from manifest file:/worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-35792/att-00/MANIFEST-206347 succeeded,manifest_file_number is 206347, next_file_number is 280656, last_sequence is 4262394438, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 280534 2024/11/23-21:06:25.217271 139957433374272 [version_set.cc:6266] Column family [default] (ID 0), log number is 0 2024/11/23-21:06:25.217524 139957433374272 [version_set.cc:5721] Creating manifest 280656 2024/11/23-21:06:25.251074 139957433374272 DEBG dcompact_worker.cpp:1218: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00: bottommost_level: fake = 1, rpc = 0 2024/11/23-21:06:25.274958 139957433374272 [compaction_job.cc:2437] [default] [JOB 35792] Compacting 1@2 + 21@3 files to L3, score 1.00, subcompactions 1 : 1 2024/11/23-21:06:25.274998 139957433374272 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 26788 Base level 2, inputs: [280581(31MB)], [280510(40MB) 280511(40MB) 280512(40MB) 280513(40MB) 280514(40MB) 280515(40MB) 280516(40MB) 280517(40MB) 280518(40MB) 280519(40MB) 280520(40MB) 280521(40MB) 280522(40MB) 280523(40MB) 280524(40MB) 280525(40MB) 280526(40MB) 280527(40MB) 280528(40MB) 280529(40MB) 280595(40MB)] 2024/11/23-21:06:25.282334 139957433374272 [top_zip_table.cc:59] core git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-21:06:25.282364 139957433374272 [top_zip_table.cc:60] fsa git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-21:06:25.282384 139957433374272 [top_zip_table.cc:61] zbs git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-21:06:25.282389 139957433374272 [top_zip_table.cc:62] topling-zip_table_reader: git_version_hash_info_is: commit a4a382006cb82713acf5b3425835f22711877681 Author: leipeng Date: 2024-04-11 19:44:14 +0800 fixed_len_hole_index.cc: Add env bool FixedLenHoleIndexUseAVX512 for ut & debug 1. FixedLenHoleIndexUseAVX512 is only in unit tests or debug 2. In release mode, use avx512 by compile options(-march=) g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/23-21:06:25.282400 139957433374272 [top_zip_table.cc:64] topling-rocks git_version_hash_info_is: commit feab587e468621ba0204d47b4ffacc52e7c4290d Author: leipeng Date: 2024-03-22 13:35:06 +0800 ToplingZipTableBuilder::Add: immediately return after error This function returns void, and caller does not check builder->status() after calling this function and graceful abandon. So immediately return after error, and return error status in Finish(). g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/23-21:06:25.908363 139957433374272 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280657.sst) /dev/shm/ToplingTemp/Topling-188820-i4dsXT 2024/11/23-21:06:26.102666 139957433374272 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280657.sst): first pass time = 0.19's, 690.920'MB/sec 2024/11/23-21:06:27.743170 139957433374272 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280657.sst): old prealloc_size = 147639500, real_size = 40583984 2024/11/23-21:06:27.743331 139957433374272 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280657.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129430 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.79 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1017.00 avg-zval = 311.52 2024/11/23-21:06:27.743550 139957433374272 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280657.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-21:06:28.090790 139957433374272 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280657.sst): second pass time = 1.64's, 80.287'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.35's, 122.027'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1686.684'MB/sec (index lex order gen) rebuild zvType time = 0.27's, 0.118'MB/sec write SST data time = 0.07's, 581.265'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 23765.436'MB/sec zip my value time = 1.64's, unzip length = 0.132'GB zip my value throughput = 80.287'MB/sec zip pipeline throughput = 170.427'MB/sec entries = 129430 avg-key = 20.00 avg-zkey = 1.79 avg-val = 1017.00 avg-zval = 311.52 usrkeys = 129430 avg-key = 12.00 avg-zkey = 1.79 avg-val = 1024.00 avg-zval = 311.52 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129430 bytes = 485376 } seq expand size = 906010 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0424 GB } UnZip/Zip{ index = 6.6947 value = 3.2647 dict = 1.00 all = 3.1643 } Zip/UnZip{ index = 0.1494 value = 0.3063 dict = 1.00 all = 0.3160 } ---------------------------- total value len = 8.981156 GB avg = 0.171 KB (by entry num) total key len = 1.443410 GB avg = 0.028 KB total ukey len = 0.999431 GB avg = 0.015 KB total ukey num = 0.065679865 Billion total entry num = 0.052487594 Billion write speed all = 0.237592189 MB/sec (with seq num) write speed all = 0.228021993 MB/sec (without seq num) 2024/11/23-21:06:28.151385 139957433374272 [compaction_job.cc:1948] [default] [JOB 35792] Generated table #280657: 129430 keys, 42417107 bytes, temperature: kWarm 2024/11/23-21:06:28.151511 139957433374272 EVENT_LOG_v1 {"time_micros": 1732367188151434, "cf_name": "default", "job": 35792, "event": "table_file_creation", "file_number": 280657, "file_size": 42417107, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237877277, "largest_seqno": 4261171625, "table_properties": {"data_size": 40319456, "index_size": 232000, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588600, "raw_average_key_size": 20, "raw_value_size": 131629982, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129430, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367185, "oldest_key_time": 0, "file_creation_time": 1732367185, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 280657, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:06:28.205073 139957433374272 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280658.sst) /dev/shm/ToplingTemp/Topling-188820-gD73rT 2024/11/23-21:06:28.928178 139957433374272 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280658.sst): first pass time = 0.72's, 185.631'MB/sec 2024/11/23-21:06:29.824545 139957433374272 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280658.sst): old prealloc_size = 147639500, real_size = 40873184 2024/11/23-21:06:29.824664 139957433374272 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280658.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129432 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.73 raw-val = 0.1316 GB zip-val = 0.0406 GB avg-val =1016.98 avg-zval = 313.80 2024/11/23-21:06:29.824821 139957433374272 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280658.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-21:06:29.995278 139957433374272 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280658.sst): second pass time = 0.90's, 146.963'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.17's, 250.172'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2289.284'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.265'MB/sec write SST data time = 0.05's, 882.603'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 46209.759'MB/sec zip my value time = 0.90's, unzip length = 0.132'GB zip my value throughput = 146.963'MB/sec zip pipeline throughput = 146.963'MB/sec entries = 129432 avg-key = 20.00 avg-zkey = 1.73 avg-val = 1016.98 avg-zval = 313.80 usrkeys = 129432 avg-key = 12.00 avg-zkey = 1.73 avg-val = 1023.98 avg-zval = 313.80 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129432 bytes = 485392 } seq expand size = 906024 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0406 GB dict = 1.38 MB all = 0.0427 GB } UnZip/Zip{ index = 6.9259 value = 3.2408 dict = 1.00 all = 3.1428 } Zip/UnZip{ index = 0.1444 value = 0.3086 dict = 1.00 all = 0.3182 } ---------------------------- total value len = 9.113691 GB avg = 0.173 KB (by entry num) total key len = 1.445998 GB avg = 0.027 KB total ukey len = 1.000984 GB avg = 0.015 KB total ukey num = 0.065809297 Billion total entry num = 0.052617026 Billion write speed all = 0.240661434 MB/sec (with seq num) write speed all = 0.231068054 MB/sec (without seq num) 2024/11/23-21:06:30.049837 139957433374272 [compaction_job.cc:1948] [default] [JOB 35792] Generated table #280658: 129432 keys, 42705910 bytes, temperature: kWarm 2024/11/23-21:06:30.049911 139957433374272 EVENT_LOG_v1 {"time_micros": 1732367190049872, "cf_name": "default", "job": 35792, "event": "table_file_creation", "file_number": 280658, "file_size": 42705910, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237868195, "largest_seqno": 4261173065, "table_properties": {"data_size": 40616400, "index_size": 224256, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588640, "raw_average_key_size": 20, "raw_value_size": 131629460, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129432, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367188, "oldest_key_time": 0, "file_creation_time": 1732367188, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 280658, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:06:30.092221 139957433374272 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280659.sst) /dev/shm/ToplingTemp/Topling-188820-afowjU 2024/11/23-21:06:30.888315 139957433374272 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280659.sst): first pass time = 0.80's, 168.608'MB/sec 2024/11/23-21:06:31.832265 139957433374272 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280659.sst): old prealloc_size = 147639500, real_size = 40585872 2024/11/23-21:06:31.832388 139957433374272 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280659.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129433 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.79 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1016.97 avg-zval = 311.52 2024/11/23-21:06:31.832563 139957433374272 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280659.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-21:06:32.016027 139957433374272 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280659.sst): second pass time = 0.93's, 141.823'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.18's, 230.914'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2260.387'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.274'MB/sec write SST data time = 0.07's, 648.894'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 55023.595'MB/sec zip my value time = 0.93's, unzip length = 0.132'GB zip my value throughput = 141.823'MB/sec zip pipeline throughput = 141.823'MB/sec entries = 129433 avg-key = 20.00 avg-zkey = 1.79 avg-val = 1016.97 avg-zval = 311.52 usrkeys = 129433 avg-key = 12.00 avg-zkey = 1.79 avg-val = 1023.97 avg-zval = 311.52 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129433 bytes = 485392 } seq expand size = 906031 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0424 GB } UnZip/Zip{ index = 6.6967 value = 3.2645 dict = 1.00 all = 3.1641 } Zip/UnZip{ index = 0.1493 value = 0.3063 dict = 1.00 all = 0.3160 } ---------------------------- total value len = 9.246227 GB avg = 0.175 KB (by entry num) total key len = 1.448587 GB avg = 0.027 KB total ukey len = 1.002538 GB avg = 0.015 KB total ukey num = 0.065938730 Billion total entry num = 0.052746459 Billion write speed all = 0.243729763 MB/sec (with seq num) write speed all = 0.234113228 MB/sec (without seq num) 2024/11/23-21:06:32.074231 139957433374272 [compaction_job.cc:1948] [default] [JOB 35792] Generated table #280659: 129433 keys, 42418870 bytes, temperature: kWarm 2024/11/23-21:06:32.074320 139957433374272 EVENT_LOG_v1 {"time_micros": 1732367192074272, "cf_name": "default", "job": 35792, "event": "table_file_creation", "file_number": 280659, "file_size": 42418870, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237874654, "largest_seqno": 4261175594, "table_properties": {"data_size": 40321408, "index_size": 231936, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588660, "raw_average_key_size": 20, "raw_value_size": 131629319, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129433, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367190, "oldest_key_time": 0, "file_creation_time": 1732367190, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 280659, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:06:32.145447 139957433374272 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280660.sst) /dev/shm/ToplingTemp/Topling-188820-3yZwwU 2024/11/23-21:06:32.894996 139957433374272 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280660.sst): first pass time = 0.75's, 179.079'MB/sec 2024/11/23-21:06:33.812419 139957433374272 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280660.sst): old prealloc_size = 147639500, real_size = 40835232 2024/11/23-21:06:33.812559 139957433374272 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280660.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129436 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.74 raw-val = 0.1316 GB zip-val = 0.0406 GB avg-val =1016.95 avg-zval = 313.49 2024/11/23-21:06:33.812728 139957433374272 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280660.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-21:06:33.987027 139957433374272 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280660.sst): second pass time = 0.92's, 143.599'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.17's, 244.396'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1929.010'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.271'MB/sec write SST data time = 0.05's, 777.421'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 44138.130'MB/sec zip my value time = 0.92's, unzip length = 0.132'GB zip my value throughput = 143.599'MB/sec zip pipeline throughput = 143.599'MB/sec entries = 129436 avg-key = 20.00 avg-zkey = 1.74 avg-val = 1016.95 avg-zval = 313.49 usrkeys = 129436 avg-key = 12.00 avg-zkey = 1.74 avg-val = 1023.95 avg-zval = 313.49 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129436 bytes = 485392 } seq expand size = 906052 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0406 GB dict = 1.38 MB all = 0.0427 GB } UnZip/Zip{ index = 6.8868 value = 3.2439 dict = 1.00 all = 3.1457 } Zip/UnZip{ index = 0.1452 value = 0.3083 dict = 1.00 all = 0.3179 } ---------------------------- total value len = 9.378762 GB avg = 0.177 KB (by entry num) total key len = 1.451176 GB avg = 0.027 KB total ukey len = 1.004091 GB avg = 0.015 KB total ukey num = 0.066068166 Billion total entry num = 0.052875895 Billion write speed all = 0.246798098 MB/sec (with seq num) write speed all = 0.237158397 MB/sec (without seq num) 2024/11/23-21:06:34.039859 139957433374272 [compaction_job.cc:1948] [default] [JOB 35792] Generated table #280660: 129436 keys, 42667843 bytes, temperature: kWarm 2024/11/23-21:06:34.039925 139957433374272 EVENT_LOG_v1 {"time_micros": 1732367194039892, "cf_name": "default", "job": 35792, "event": "table_file_creation", "file_number": 280660, "file_size": 42667843, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237868596, "largest_seqno": 4261171699, "table_properties": {"data_size": 40577168, "index_size": 225536, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588720, "raw_average_key_size": 20, "raw_value_size": 131629567, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129436, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367192, "oldest_key_time": 0, "file_creation_time": 1732367192, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 280660, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:06:34.079173 139957433374272 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280661.sst) /dev/shm/ToplingTemp/Topling-188820-Bk8WtU 2024/11/23-21:06:34.644514 139957433374272 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280661.sst): first pass time = 0.57's, 237.428'MB/sec 2024/11/23-21:06:35.530469 139957433374272 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280661.sst): old prealloc_size = 147639500, real_size = 40645328 2024/11/23-21:06:35.530586 139957433374272 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280661.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129433 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.78 raw-val = 0.1316 GB zip-val = 0.0404 GB avg-val =1016.97 avg-zval = 311.99 2024/11/23-21:06:35.530744 139957433374272 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280661.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-21:06:35.699190 139957433374272 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280661.sst): second pass time = 0.88's, 148.821'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.17's, 251.797'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2400.591'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.269'MB/sec write SST data time = 0.05's, 882.939'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 45170.322'MB/sec zip my value time = 0.88's, unzip length = 0.132'GB zip my value throughput = 148.821'MB/sec zip pipeline throughput = 148.821'MB/sec entries = 129433 avg-key = 20.00 avg-zkey = 1.78 avg-val = 1016.97 avg-zval = 311.99 usrkeys = 129433 avg-key = 12.00 avg-zkey = 1.78 avg-val = 1023.97 avg-zval = 311.99 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129433 bytes = 485392 } seq expand size = 906031 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0404 GB dict = 1.38 MB all = 0.0425 GB } UnZip/Zip{ index = 6.7338 value = 3.2596 dict = 1.00 all = 3.1597 } Zip/UnZip{ index = 0.1485 value = 0.3068 dict = 1.00 all = 0.3165 } ---------------------------- total value len = 9.511298 GB avg = 0.179 KB (by entry num) total key len = 1.453764 GB avg = 0.027 KB total ukey len = 1.005644 GB avg = 0.015 KB total ukey num = 0.066197599 Billion total entry num = 0.053005328 Billion write speed all = 0.249867636 MB/sec (with seq num) write speed all = 0.240204715 MB/sec (without seq num) 2024/11/23-21:06:35.751338 139957433374272 [compaction_job.cc:1948] [default] [JOB 35792] Generated table #280661: 129433 keys, 42478106 bytes, temperature: kWarm 2024/11/23-21:06:35.751403 139957433374272 EVENT_LOG_v1 {"time_micros": 1732367195751371, "cf_name": "default", "job": 35792, "event": "table_file_creation", "file_number": 280661, "file_size": 42478106, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237869923, "largest_seqno": 4261174086, "table_properties": {"data_size": 40382144, "index_size": 230656, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588660, "raw_average_key_size": 20, "raw_value_size": 131629904, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129433, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367194, "oldest_key_time": 0, "file_creation_time": 1732367194, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 280661, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:06:35.790060 139957433374272 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280662.sst) /dev/shm/ToplingTemp/Topling-188820-tOzRkS 2024/11/23-21:06:36.621054 139957433374272 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280662.sst): first pass time = 0.83's, 161.523'MB/sec 2024/11/23-21:06:37.511938 139957433374272 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280662.sst): old prealloc_size = 147639500, real_size = 40579744 2024/11/23-21:06:37.512078 139957433374272 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280662.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129429 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.79 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1017.00 avg-zval = 311.49 2024/11/23-21:06:37.512266 139957433374272 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280662.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-21:06:37.674787 139957433374272 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280662.sst): second pass time = 0.89's, 148.037'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 260.474'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2201.701'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.274'MB/sec write SST data time = 0.04's, 951.650'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 48079.792'MB/sec zip my value time = 0.89's, unzip length = 0.132'GB zip my value throughput = 148.037'MB/sec zip pipeline throughput = 148.037'MB/sec entries = 129429 avg-key = 20.00 avg-zkey = 1.79 avg-val = 1017.00 avg-zval = 311.49 usrkeys = 129429 avg-key = 12.00 avg-zkey = 1.79 avg-val = 1024.00 avg-zval = 311.49 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129429 bytes = 485376 } seq expand size = 906003 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0424 GB } UnZip/Zip{ index = 6.6965 value = 3.2650 dict = 1.00 all = 3.1646 } Zip/UnZip{ index = 0.1493 value = 0.3063 dict = 1.00 all = 0.3160 } ---------------------------- total value len = 9.643833 GB avg = 0.181 KB (by entry num) total key len = 1.456353 GB avg = 0.027 KB total ukey len = 1.007197 GB avg = 0.015 KB total ukey num = 0.066327028 Billion total entry num = 0.053134757 Billion write speed all = 0.252935397 MB/sec (with seq num) write speed all = 0.243249318 MB/sec (without seq num) 2024/11/23-21:06:37.727172 139957433374272 [compaction_job.cc:1948] [default] [JOB 35792] Generated table #280662: 129429 keys, 42412558 bytes, temperature: kWarm 2024/11/23-21:06:37.727248 139957433374272 EVENT_LOG_v1 {"time_micros": 1732367197727207, "cf_name": "default", "job": 35792, "event": "table_file_creation", "file_number": 280662, "file_size": 42412558, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237872175, "largest_seqno": 4261175823, "table_properties": {"data_size": 40315280, "index_size": 231936, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588580, "raw_average_key_size": 20, "raw_value_size": 131629176, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129429, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367195, "oldest_key_time": 0, "file_creation_time": 1732367195, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 280662, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:06:37.769573 139957433374272 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280663.sst) /dev/shm/ToplingTemp/Topling-188820-FP0xNR 2024/11/23-21:06:38.333177 139957433374272 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280663.sst): first pass time = 0.56's, 238.162'MB/sec 2024/11/23-21:06:39.215957 139957433374272 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280663.sst): old prealloc_size = 147639500, real_size = 40710464 2024/11/23-21:06:39.216097 139957433374272 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280663.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129430 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.78 raw-val = 0.1316 GB zip-val = 0.0404 GB avg-val =1017.00 avg-zval = 312.51 2024/11/23-21:06:39.216254 139957433374272 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280663.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-21:06:39.378985 139957433374272 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280663.sst): second pass time = 0.88's, 149.233'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 261.016'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2131.200'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.274'MB/sec write SST data time = 0.04's, 947.022'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 54427.257'MB/sec zip my value time = 0.88's, unzip length = 0.132'GB zip my value throughput = 149.233'MB/sec zip pipeline throughput = 149.233'MB/sec entries = 129430 avg-key = 20.00 avg-zkey = 1.78 avg-val = 1017.00 avg-zval = 312.51 usrkeys = 129430 avg-key = 12.00 avg-zkey = 1.78 avg-val = 1024.00 avg-zval = 312.51 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129430 bytes = 485376 } seq expand size = 906010 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0404 GB dict = 1.38 MB all = 0.0425 GB } UnZip/Zip{ index = 6.7486 value = 3.2543 dict = 1.00 all = 3.1549 } Zip/UnZip{ index = 0.1482 value = 0.3073 dict = 1.00 all = 0.3170 } ---------------------------- total value len = 9.776369 GB avg = 0.184 KB (by entry num) total key len = 1.458942 GB avg = 0.027 KB total ukey len = 1.008750 GB avg = 0.015 KB total ukey num = 0.066456458 Billion total entry num = 0.053264187 Billion write speed all = 0.256004488 MB/sec (with seq num) write speed all = 0.246295191 MB/sec (without seq num) 2024/11/23-21:06:39.430348 139957433374272 [compaction_job.cc:1948] [default] [JOB 35792] Generated table #280663: 129430 keys, 42543454 bytes, temperature: kWarm 2024/11/23-21:06:39.430416 139957433374272 EVENT_LOG_v1 {"time_micros": 1732367199430382, "cf_name": "default", "job": 35792, "event": "table_file_creation", "file_number": 280663, "file_size": 42543454, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237881756, "largest_seqno": 4261171593, "table_properties": {"data_size": 40447792, "index_size": 230144, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588600, "raw_average_key_size": 20, "raw_value_size": 131630131, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129430, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367197, "oldest_key_time": 0, "file_creation_time": 1732367197, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 280663, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:06:39.469372 139957433374272 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280664.sst) /dev/shm/ToplingTemp/Topling-188820-dXBHxR 2024/11/23-21:06:40.170725 139957433374272 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280664.sst): first pass time = 0.70's, 191.380'MB/sec 2024/11/23-21:06:41.041659 139957433374272 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280664.sst): old prealloc_size = 147639500, real_size = 41013904 2024/11/23-21:06:41.041785 139957433374272 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280664.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129429 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.73 raw-val = 0.1316 GB zip-val = 0.0408 GB avg-val =1017.00 avg-zval = 314.90 2024/11/23-21:06:41.041939 139957433374272 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280664.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-21:06:41.204672 139957433374272 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280664.sst): second pass time = 0.87's, 151.453'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 262.878'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2220.604'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.275'MB/sec write SST data time = 0.05's, 949.076'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 51968.583'MB/sec zip my value time = 0.87's, unzip length = 0.132'GB zip my value throughput = 151.453'MB/sec zip pipeline throughput = 151.453'MB/sec entries = 129429 avg-key = 20.00 avg-zkey = 1.73 avg-val = 1017.00 avg-zval = 314.90 usrkeys = 129429 avg-key = 12.00 avg-zkey = 1.73 avg-val = 1024.00 avg-zval = 314.90 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129429 bytes = 485376 } seq expand size = 906003 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0408 GB dict = 1.38 MB all = 0.0428 GB } UnZip/Zip{ index = 6.9396 value = 3.2296 dict = 1.00 all = 3.1325 } Zip/UnZip{ index = 0.1441 value = 0.3096 dict = 1.00 all = 0.3192 } ---------------------------- total value len = 9.908905 GB avg = 0.186 KB (by entry num) total key len = 1.461530 GB avg = 0.027 KB total ukey len = 1.010303 GB avg = 0.015 KB total ukey num = 0.066585887 Billion total entry num = 0.053393616 Billion write speed all = 0.259072612 MB/sec (with seq num) write speed all = 0.249340127 MB/sec (without seq num) 2024/11/23-21:06:41.255913 139957433374272 [compaction_job.cc:1948] [default] [JOB 35792] Generated table #280664: 129429 keys, 42846566 bytes, temperature: kWarm 2024/11/23-21:06:41.255999 139957433374272 EVENT_LOG_v1 {"time_micros": 1732367201255946, "cf_name": "default", "job": 35792, "event": "table_file_creation", "file_number": 280664, "file_size": 42846566, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237880987, "largest_seqno": 4261129238, "table_properties": {"data_size": 40757568, "index_size": 223808, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588580, "raw_average_key_size": 20, "raw_value_size": 131629663, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129429, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367199, "oldest_key_time": 0, "file_creation_time": 1732367199, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 280664, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:06:41.296288 139957433374272 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280665.sst) /dev/shm/ToplingTemp/Topling-188820-gscZhS 2024/11/23-21:06:41.978592 139957433374272 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280665.sst): first pass time = 0.68's, 196.724'MB/sec 2024/11/23-21:06:42.846187 139957433374272 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280665.sst): old prealloc_size = 147639500, real_size = 40994608 2024/11/23-21:06:42.846309 139957433374272 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280665.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129430 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.71 raw-val = 0.1316 GB zip-val = 0.0407 GB avg-val =1016.99 avg-zval = 314.77 2024/11/23-21:06:42.846463 139957433374272 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280665.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-21:06:43.010050 139957433374272 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280665.sst): second pass time = 0.87's, 151.994'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 261.393'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2237.037'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.275'MB/sec write SST data time = 0.05's, 925.894'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.379'MB, throughput = 45239.728'MB/sec zip my value time = 0.87's, unzip length = 0.132'GB zip my value throughput = 151.994'MB/sec zip pipeline throughput = 151.994'MB/sec entries = 129430 avg-key = 20.00 avg-zkey = 1.71 avg-val = 1016.99 avg-zval = 314.77 usrkeys = 129430 avg-key = 12.00 avg-zkey = 1.71 avg-val = 1023.99 avg-zval = 314.77 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129430 bytes = 485376 } seq expand size = 906010 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0407 GB dict = 1.38 MB all = 0.0428 GB } UnZip/Zip{ index = 7.0342 value = 3.2309 dict = 1.00 all = 3.1339 } Zip/UnZip{ index = 0.1422 value = 0.3095 dict = 1.00 all = 0.3191 } ---------------------------- total value len = 10.041440 GB avg = 0.188 KB (by entry num) total key len = 1.464119 GB avg = 0.027 KB total ukey len = 1.011857 GB avg = 0.015 KB total ukey num = 0.066715317 Billion total entry num = 0.053523046 Billion write speed all = 0.262140593 MB/sec (with seq num) write speed all = 0.252384917 MB/sec (without seq num) 2024/11/23-21:06:43.061318 139957433374272 [compaction_job.cc:1948] [default] [JOB 35792] Generated table #280665: 129430 keys, 42827952 bytes, temperature: kWarm 2024/11/23-21:06:43.061388 139957433374272 EVENT_LOG_v1 {"time_micros": 1732367203061353, "cf_name": "default", "job": 35792, "event": "table_file_creation", "file_number": 280665, "file_size": 42827952, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237868290, "largest_seqno": 4261176524, "table_properties": {"data_size": 40741280, "index_size": 220800, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588600, "raw_average_key_size": 20, "raw_value_size": 131629240, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129430, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367201, "oldest_key_time": 0, "file_creation_time": 1732367201, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 280665, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:06:43.102623 139957433374272 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280666.sst) /dev/shm/ToplingTemp/Topling-188820-LMYolS 2024/11/23-21:06:43.841770 139957433374272 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280666.sst): first pass time = 0.74's, 181.595'MB/sec 2024/11/23-21:06:44.669262 139957433374272 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280666.sst): old prealloc_size = 147639500, real_size = 40897408 2024/11/23-21:06:44.669384 139957433374272 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280666.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129432 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.74 raw-val = 0.1316 GB zip-val = 0.0406 GB avg-val =1016.98 avg-zval = 313.98 2024/11/23-21:06:44.669538 139957433374272 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280666.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-21:06:44.828032 139957433374272 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280666.sst): second pass time = 0.83's, 159.331'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 269.190'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2278.790'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.279'MB/sec write SST data time = 0.04's, 1002.191'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 44214.996'MB/sec zip my value time = 0.83's, unzip length = 0.132'GB zip my value throughput = 159.331'MB/sec zip pipeline throughput = 159.331'MB/sec entries = 129432 avg-key = 20.00 avg-zkey = 1.74 avg-val = 1016.98 avg-zval = 313.98 usrkeys = 129432 avg-key = 12.00 avg-zkey = 1.74 avg-val = 1023.98 avg-zval = 313.98 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129432 bytes = 485392 } seq expand size = 906024 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0406 GB dict = 1.38 MB all = 0.0427 GB } UnZip/Zip{ index = 6.8827 value = 3.2390 dict = 1.00 all = 3.1411 } Zip/UnZip{ index = 0.1453 value = 0.3087 dict = 1.00 all = 0.3184 } ---------------------------- total value len = 10.173976 GB avg = 0.190 KB (by entry num) total key len = 1.466707 GB avg = 0.027 KB total ukey len = 1.013410 GB avg = 0.015 KB total ukey num = 0.066844749 Billion total entry num = 0.053652478 Billion write speed all = 0.265208250 MB/sec (with seq num) write speed all = 0.255429388 MB/sec (without seq num) 2024/11/23-21:06:44.879128 139957433374272 [compaction_job.cc:1948] [default] [JOB 35792] Generated table #280666: 129432 keys, 42730284 bytes, temperature: kWarm 2024/11/23-21:06:44.879207 139957433374272 EVENT_LOG_v1 {"time_micros": 1732367204879172, "cf_name": "default", "job": 35792, "event": "table_file_creation", "file_number": 280666, "file_size": 42730284, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237874127, "largest_seqno": 4261176528, "table_properties": {"data_size": 40639216, "index_size": 225664, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588640, "raw_average_key_size": 20, "raw_value_size": 131629404, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129432, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367203, "oldest_key_time": 0, "file_creation_time": 1732367203, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 280666, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:06:44.923012 139957433374272 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280667.sst) /dev/shm/ToplingTemp/Topling-188820-KVtByU 2024/11/23-21:06:45.636042 139957433374272 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280667.sst): first pass time = 0.71's, 188.245'MB/sec 2024/11/23-21:06:46.457104 139957433374272 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280667.sst): old prealloc_size = 147639500, real_size = 40580864 2024/11/23-21:06:46.457243 139957433374272 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280667.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129430 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.79 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1016.99 avg-zval = 311.49 2024/11/23-21:06:46.457402 139957433374272 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280667.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-21:06:46.620512 139957433374272 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280667.sst): second pass time = 0.82's, 160.905'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 259.588'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2247.224'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.275'MB/sec write SST data time = 0.05's, 927.166'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.379'MB, throughput = 49934.980'MB/sec zip my value time = 0.82's, unzip length = 0.132'GB zip my value throughput = 160.905'MB/sec zip pipeline throughput = 160.905'MB/sec entries = 129430 avg-key = 20.00 avg-zkey = 1.79 avg-val = 1016.99 avg-zval = 311.49 usrkeys = 129430 avg-key = 12.00 avg-zkey = 1.79 avg-val = 1023.99 avg-zval = 311.49 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129430 bytes = 485376 } seq expand size = 906010 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0424 GB } UnZip/Zip{ index = 6.6965 value = 3.2649 dict = 1.00 all = 3.1645 } Zip/UnZip{ index = 0.1493 value = 0.3063 dict = 1.00 all = 0.3160 } ---------------------------- total value len = 10.306511 GB avg = 0.192 KB (by entry num) total key len = 1.469296 GB avg = 0.027 KB total ukey len = 1.014963 GB avg = 0.015 KB total ukey num = 0.066974179 Billion total entry num = 0.053781908 Billion write speed all = 0.268275808 MB/sec (with seq num) write speed all = 0.258473756 MB/sec (without seq num) 2024/11/23-21:06:46.671644 139957433374272 [compaction_job.cc:1948] [default] [JOB 35792] Generated table #280667: 129430 keys, 42414202 bytes, temperature: kWarm 2024/11/23-21:06:46.671712 139957433374272 EVENT_LOG_v1 {"time_micros": 1732367206671677, "cf_name": "default", "job": 35792, "event": "table_file_creation", "file_number": 280667, "file_size": 42414202, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237873877, "largest_seqno": 4261175948, "table_properties": {"data_size": 40316400, "index_size": 231936, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588600, "raw_average_key_size": 20, "raw_value_size": 131629393, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129430, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367204, "oldest_key_time": 0, "file_creation_time": 1732367204, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 280667, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:06:46.707381 139957433374272 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280668.sst) /dev/shm/ToplingTemp/Topling-188820-dBWHDT 2024/11/23-21:06:47.526790 139957433374272 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280668.sst): first pass time = 0.82's, 163.805'MB/sec 2024/11/23-21:06:48.308460 139957433374272 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280668.sst): old prealloc_size = 147639500, real_size = 40587360 2024/11/23-21:06:48.308585 139957433374272 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280668.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129429 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.79 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1017.00 avg-zval = 311.54 2024/11/23-21:06:48.308751 139957433374272 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280668.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-21:06:48.471748 139957433374272 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280668.sst): second pass time = 0.78's, 168.696'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 259.817'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2309.883'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.269'MB/sec write SST data time = 0.04's, 991.361'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 45537.348'MB/sec zip my value time = 0.78's, unzip length = 0.132'GB zip my value throughput = 168.696'MB/sec zip pipeline throughput = 168.696'MB/sec entries = 129429 avg-key = 20.00 avg-zkey = 1.79 avg-val = 1017.00 avg-zval = 311.54 usrkeys = 129429 avg-key = 12.00 avg-zkey = 1.79 avg-val = 1024.00 avg-zval = 311.54 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129429 bytes = 485376 } seq expand size = 906003 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0424 GB } UnZip/Zip{ index = 6.6946 value = 3.2644 dict = 1.00 all = 3.1640 } Zip/UnZip{ index = 0.1494 value = 0.3063 dict = 1.00 all = 0.3161 } ---------------------------- total value len = 10.439047 GB avg = 0.194 KB (by entry num) total key len = 1.471885 GB avg = 0.027 KB total ukey len = 1.016516 GB avg = 0.015 KB total ukey num = 0.067103608 Billion total entry num = 0.053911337 Billion write speed all = 0.271342753 MB/sec (with seq num) write speed all = 0.261517525 MB/sec (without seq num) 2024/11/23-21:06:48.522999 139957433374272 [compaction_job.cc:1948] [default] [JOB 35792] Generated table #280668: 129429 keys, 42420481 bytes, temperature: kWarm 2024/11/23-21:06:48.523071 139957433374272 EVENT_LOG_v1 {"time_micros": 1732367208523034, "cf_name": "default", "job": 35792, "event": "table_file_creation", "file_number": 280668, "file_size": 42420481, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237873605, "largest_seqno": 4261167208, "table_properties": {"data_size": 40322832, "index_size": 232000, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588580, "raw_average_key_size": 20, "raw_value_size": 131629444, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129429, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367206, "oldest_key_time": 0, "file_creation_time": 1732367206, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 280668, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:06:48.566220 139957433374272 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280669.sst) /dev/shm/ToplingTemp/Topling-188820-tLUgvR 2024/11/23-21:06:49.146193 139957433374272 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280669.sst): first pass time = 0.58's, 231.434'MB/sec 2024/11/23-21:06:49.958655 139957433374272 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280669.sst): old prealloc_size = 147639500, real_size = 40886624 2024/11/23-21:06:49.958779 139957433374272 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280669.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129428 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.75 raw-val = 0.1316 GB zip-val = 0.0406 GB avg-val =1017.01 avg-zval = 313.90 2024/11/23-21:06:49.958965 139957433374272 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280669.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-21:06:50.125381 139957433374272 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280669.sst): second pass time = 0.81's, 162.357'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.17's, 256.258'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2226.977'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.265'MB/sec write SST data time = 0.04's, 956.403'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 45147.907'MB/sec zip my value time = 0.81's, unzip length = 0.132'GB zip my value throughput = 162.357'MB/sec zip pipeline throughput = 162.357'MB/sec entries = 129428 avg-key = 20.00 avg-zkey = 1.75 avg-val = 1017.01 avg-zval = 313.90 usrkeys = 129428 avg-key = 12.00 avg-zkey = 1.75 avg-val = 1024.01 avg-zval = 313.90 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129428 bytes = 485376 } seq expand size = 905996 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0406 GB dict = 1.38 MB all = 0.0427 GB } UnZip/Zip{ index = 6.8456 value = 3.2399 dict = 1.00 all = 3.1418 } Zip/UnZip{ index = 0.1461 value = 0.3086 dict = 1.00 all = 0.3183 } ---------------------------- total value len = 10.571582 GB avg = 0.196 KB (by entry num) total key len = 1.474473 GB avg = 0.027 KB total ukey len = 1.018069 GB avg = 0.015 KB total ukey num = 0.067233036 Billion total entry num = 0.054040765 Billion write speed all = 0.274410667 MB/sec (with seq num) write speed all = 0.264562223 MB/sec (without seq num) 2024/11/23-21:06:50.177633 139957433374272 [compaction_job.cc:1948] [default] [JOB 35792] Generated table #280669: 129428 keys, 42719560 bytes, temperature: kWarm 2024/11/23-21:06:50.177703 139957433374272 EVENT_LOG_v1 {"time_micros": 1732367210177665, "cf_name": "default", "job": 35792, "event": "table_file_creation", "file_number": 280669, "file_size": 42719560, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237872082, "largest_seqno": 4261174858, "table_properties": {"data_size": 40627216, "index_size": 226880, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588560, "raw_average_key_size": 20, "raw_value_size": 131629174, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129428, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367208, "oldest_key_time": 0, "file_creation_time": 1732367208, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 280669, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:06:50.214716 139957433374272 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280670.sst) /dev/shm/ToplingTemp/Topling-188820-HMy9TT 2024/11/23-21:06:50.831012 139957433374272 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280670.sst): first pass time = 0.62's, 217.793'MB/sec 2024/11/23-21:06:51.775674 139957433374272 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280670.sst): old prealloc_size = 147639500, real_size = 40866624 2024/11/23-21:06:51.775783 139957433374272 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280670.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129427 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.75 raw-val = 0.1316 GB zip-val = 0.0406 GB avg-val =1017.02 avg-zval = 313.74 2024/11/23-21:06:51.775937 139957433374272 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280670.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-21:06:51.935060 139957433374272 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280670.sst): second pass time = 0.94's, 139.540'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 267.942'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2473.117'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.276'MB/sec write SST data time = 0.04's, 1014.582'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 50771.895'MB/sec zip my value time = 0.94's, unzip length = 0.132'GB zip my value throughput = 139.540'MB/sec zip pipeline throughput = 139.540'MB/sec entries = 129427 avg-key = 20.00 avg-zkey = 1.75 avg-val = 1017.02 avg-zval = 313.74 usrkeys = 129427 avg-key = 12.00 avg-zkey = 1.75 avg-val = 1024.02 avg-zval = 313.74 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129427 bytes = 485360 } seq expand size = 905989 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0406 GB dict = 1.38 MB all = 0.0427 GB } UnZip/Zip{ index = 6.8379 value = 3.2415 dict = 1.00 all = 3.1433 } Zip/UnZip{ index = 0.1462 value = 0.3085 dict = 1.00 all = 0.3181 } ---------------------------- total value len = 10.704117 GB avg = 0.198 KB (by entry num) total key len = 1.477062 GB avg = 0.027 KB total ukey len = 1.019622 GB avg = 0.015 KB total ukey num = 0.067362463 Billion total entry num = 0.054170192 Billion write speed all = 0.277477370 MB/sec (with seq num) write speed all = 0.267605746 MB/sec (without seq num) 2024/11/23-21:06:51.985928 139957433374272 [compaction_job.cc:1948] [default] [JOB 35792] Generated table #280670: 129427 keys, 42699343 bytes, temperature: kWarm 2024/11/23-21:06:51.986022 139957433374272 EVENT_LOG_v1 {"time_micros": 1732367211985963, "cf_name": "default", "job": 35792, "event": "table_file_creation", "file_number": 280670, "file_size": 42699343, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237871365, "largest_seqno": 4261162538, "table_properties": {"data_size": 40606960, "index_size": 227136, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588540, "raw_average_key_size": 20, "raw_value_size": 131629488, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129427, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367210, "oldest_key_time": 0, "file_creation_time": 1732367210, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 280670, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:06:52.023511 139957433374272 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280671.sst) /dev/shm/ToplingTemp/Topling-188820-BdwhlT 2024/11/23-21:06:52.578829 139957433374272 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280671.sst): first pass time = 0.56's, 241.710'MB/sec 2024/11/23-21:06:53.358094 139957433374272 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280671.sst): old prealloc_size = 147639500, real_size = 40581760 2024/11/23-21:06:53.358225 139957433374272 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280671.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129427 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.77 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1017.02 avg-zval = 311.53 2024/11/23-21:06:53.358380 139957433374272 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280671.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-21:06:53.525854 139957433374272 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280671.sst): second pass time = 0.78's, 169.267'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.17's, 252.430'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2126.210'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.266'MB/sec write SST data time = 0.05's, 924.382'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 46504.996'MB/sec zip my value time = 0.78's, unzip length = 0.132'GB zip my value throughput = 169.267'MB/sec zip pipeline throughput = 169.267'MB/sec entries = 129427 avg-key = 20.00 avg-zkey = 1.77 avg-val = 1017.02 avg-zval = 311.53 usrkeys = 129427 avg-key = 12.00 avg-zkey = 1.77 avg-val = 1022.67 avg-zval = 311.53 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 104593 bytes = 392240 } seq expand size = 732151 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0423 GB } UnZip/Zip{ index = 6.7749 value = 3.2646 dict = 1.00 all = 3.1699 } Zip/UnZip{ index = 0.1476 value = 0.3063 dict = 1.00 all = 0.3155 } ---------------------------- total value len = 10.836479 GB avg = 0.200 KB (by entry num) total key len = 1.479650 GB avg = 0.027 KB total ukey len = 1.021175 GB avg = 0.015 KB total ukey num = 0.067491890 Billion total entry num = 0.054299619 Billion write speed all = 0.280541262 MB/sec (with seq num) write speed all = 0.270646411 MB/sec (without seq num) 2024/11/23-21:06:53.577352 139957433374272 [compaction_job.cc:1948] [default] [JOB 35792] Generated table #280671: 129427 keys, 42341468 bytes, temperature: kWarm 2024/11/23-21:06:53.577426 139957433374272 EVENT_LOG_v1 {"time_micros": 1732367213577389, "cf_name": "default", "job": 35792, "event": "table_file_creation", "file_number": 280671, "file_size": 42341468, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4261152027, "table_properties": {"data_size": 40319984, "index_size": 229248, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588540, "raw_average_key_size": 20, "raw_value_size": 131629586, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129427, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367212, "oldest_key_time": 0, "file_creation_time": 1732367212, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 280671, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:06:53.617552 139957433374272 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280672.sst) /dev/shm/ToplingTemp/Topling-188820-sBfqTU 2024/11/23-21:06:54.345703 139957433374272 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280672.sst): first pass time = 0.73's, 184.338'MB/sec 2024/11/23-21:06:55.230393 139957433374272 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280672.sst): old prealloc_size = 147639500, real_size = 40613696 2024/11/23-21:06:55.230517 139957433374272 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280672.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129427 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.73 raw-val = 0.1316 GB zip-val = 0.0404 GB avg-val =1017.02 avg-zval = 311.81 2024/11/23-21:06:55.230628 139957433374272 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280672.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-21:06:55.400318 139957433374272 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280672.sst): second pass time = 0.88's, 149.068'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.17's, 248.471'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2164.782'MB/sec (index lex order gen) rebuild zvType time = 0.13's, 0.258'MB/sec write SST data time = 0.04's, 951.716'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 48404.664'MB/sec zip my value time = 0.88's, unzip length = 0.132'GB zip my value throughput = 149.068'MB/sec zip pipeline throughput = 149.068'MB/sec entries = 129427 avg-key = 20.00 avg-zkey = 1.73 avg-val = 1017.02 avg-zval = 311.81 usrkeys = 129427 avg-key = 12.00 avg-zkey = 1.73 avg-val = 1020.39 avg-zval = 311.81 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 62382 bytes = 233952 } seq expand size = 436674 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0404 GB dict = 1.38 MB all = 0.0422 GB } UnZip/Zip{ index = 6.9217 value = 3.2617 dict = 1.00 all = 3.1794 } Zip/UnZip{ index = 0.1445 value = 0.3066 dict = 1.00 all = 0.3145 } ---------------------------- total value len = 10.968546 GB avg = 0.202 KB (by entry num) total key len = 1.482239 GB avg = 0.027 KB total ukey len = 1.022729 GB avg = 0.015 KB total ukey num = 0.067621317 Billion total entry num = 0.054429046 Billion write speed all = 0.283596378 MB/sec (with seq num) write speed all = 0.273678365 MB/sec (without seq num) 2024/11/23-21:06:55.452312 139957433374272 [compaction_job.cc:1948] [default] [JOB 35792] Generated table #280672: 129427 keys, 42215601 bytes, temperature: kWarm 2024/11/23-21:06:55.452380 139957433374272 EVENT_LOG_v1 {"time_micros": 1732367215452344, "cf_name": "default", "job": 35792, "event": "table_file_creation", "file_number": 280672, "file_size": 42215601, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4261173481, "table_properties": {"data_size": 40356784, "index_size": 224384, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588540, "raw_average_key_size": 20, "raw_value_size": 131629974, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129427, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367213, "oldest_key_time": 0, "file_creation_time": 1732367213, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 280672, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:06:55.489212 139957433374272 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280673.sst) /dev/shm/ToplingTemp/Topling-188820-Btyl0R 2024/11/23-21:06:56.216372 139957433374272 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280673.sst): first pass time = 0.73's, 184.586'MB/sec 2024/11/23-21:06:57.027635 139957433374272 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280673.sst): old prealloc_size = 147639500, real_size = 40907360 2024/11/23-21:06:57.027758 139957433374272 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280673.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129426 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.71 raw-val = 0.1316 GB zip-val = 0.0407 GB avg-val =1017.03 avg-zval = 314.10 2024/11/23-21:06:57.027894 139957433374272 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280673.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-21:06:57.189061 139957433374272 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280673.sst): second pass time = 0.81's, 162.567'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 264.156'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2227.009'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.273'MB/sec write SST data time = 0.04's, 999.619'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 47032.248'MB/sec zip my value time = 0.81's, unzip length = 0.132'GB zip my value throughput = 162.567'MB/sec zip pipeline throughput = 162.567'MB/sec entries = 129426 avg-key = 20.00 avg-zkey = 1.71 avg-val = 1017.03 avg-zval = 314.10 usrkeys = 129426 avg-key = 12.00 avg-zkey = 1.71 avg-val = 1022.24 avg-zval = 314.10 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 96355 bytes = 361344 } seq expand size = 674485 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0407 GB dict = 1.38 MB all = 0.0426 GB } UnZip/Zip{ index = 6.9995 value = 3.2379 dict = 1.00 all = 3.1480 } Zip/UnZip{ index = 0.1429 value = 0.3088 dict = 1.00 all = 0.3177 } ---------------------------- total value len = 11.100850 GB avg = 0.203 KB (by entry num) total key len = 1.484827 GB avg = 0.027 KB total ukey len = 1.024282 GB avg = 0.015 KB total ukey num = 0.067750743 Billion total entry num = 0.054558472 Billion write speed all = 0.286657198 MB/sec (with seq num) write speed all = 0.276716006 MB/sec (without seq num) 2024/11/23-21:06:57.240086 139957433374272 [compaction_job.cc:1948] [default] [JOB 35792] Generated table #280673: 129426 keys, 42636600 bytes, temperature: kWarm 2024/11/23-21:06:57.240161 139957433374272 EVENT_LOG_v1 {"time_micros": 1732367217240120, "cf_name": "default", "job": 35792, "event": "table_file_creation", "file_number": 280673, "file_size": 42636600, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4261169189, "table_properties": {"data_size": 40652944, "index_size": 221888, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588520, "raw_average_key_size": 20, "raw_value_size": 131629499, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129426, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367215, "oldest_key_time": 0, "file_creation_time": 1732367215, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 280673, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:06:57.285728 139957433374272 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280674.sst) /dev/shm/ToplingTemp/Topling-188820-5B0apT 2024/11/23-21:06:57.860457 139957433374272 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280674.sst): first pass time = 0.57's, 233.550'MB/sec 2024/11/23-21:06:58.893687 139957433374272 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280674.sst): old prealloc_size = 147639500, real_size = 40770256 2024/11/23-21:06:58.893812 139957433374272 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280674.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129429 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.76 raw-val = 0.1316 GB zip-val = 0.0405 GB avg-val =1017.01 avg-zval = 312.99 2024/11/23-21:06:58.893960 139957433374272 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280674.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-21:06:59.054345 139957433374272 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280674.sst): second pass time = 1.03's, 127.489'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 265.034'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2205.317'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.274'MB/sec write SST data time = 0.04's, 1002.766'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 45415.895'MB/sec zip my value time = 1.03's, unzip length = 0.132'GB zip my value throughput = 127.489'MB/sec zip pipeline throughput = 165.664'MB/sec entries = 129429 avg-key = 20.00 avg-zkey = 1.76 avg-val = 1017.01 avg-zval = 312.99 usrkeys = 129429 avg-key = 12.00 avg-zkey = 1.76 avg-val = 1023.29 avg-zval = 312.99 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 116194 bytes = 435744 } seq expand size = 813358 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0405 GB dict = 1.38 MB all = 0.0426 GB } UnZip/Zip{ index = 6.8111 value = 3.2493 dict = 1.00 all = 3.1526 } Zip/UnZip{ index = 0.1468 value = 0.3078 dict = 1.00 all = 0.3172 } ---------------------------- total value len = 11.233293 GB avg = 0.205 KB (by entry num) total key len = 1.487416 GB avg = 0.027 KB total ukey len = 1.025835 GB avg = 0.015 KB total ukey num = 0.067880172 Billion total entry num = 0.054687901 Billion write speed all = 0.289720443 MB/sec (with seq num) write speed all = 0.279756091 MB/sec (without seq num) 2024/11/23-21:06:59.110759 139957433374272 [compaction_job.cc:1948] [default] [JOB 35792] Generated table #280674: 129429 keys, 42573621 bytes, temperature: kWarm 2024/11/23-21:06:59.110818 139957433374272 EVENT_LOG_v1 {"time_micros": 1732367219110785, "cf_name": "default", "job": 35792, "event": "table_file_creation", "file_number": 280674, "file_size": 42573621, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4261175865, "table_properties": {"data_size": 40509696, "index_size": 228032, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588580, "raw_average_key_size": 20, "raw_value_size": 131630151, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129429, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367217, "oldest_key_time": 0, "file_creation_time": 1732367217, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 280674, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:06:59.148088 139957433374272 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280675.sst) /dev/shm/ToplingTemp/Topling-188820-tSEwBS 2024/11/23-21:06:59.644324 139957433374272 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280675.sst): first pass time = 0.50's, 270.491'MB/sec 2024/11/23-21:07:00.431302 139957433374272 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280675.sst): old prealloc_size = 147639500, real_size = 40489360 2024/11/23-21:07:00.431422 139957433374272 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280675.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129430 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.72 raw-val = 0.1316 GB zip-val = 0.0402 GB avg-val =1016.99 avg-zval = 310.85 2024/11/23-21:07:00.431516 139957433374272 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280675.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-21:07:00.592106 139957433374272 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280675.sst): second pass time = 0.79's, 167.582'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 261.329'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2378.844'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.277'MB/sec write SST data time = 0.04's, 958.329'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 42068.631'MB/sec zip my value time = 0.79's, unzip length = 0.132'GB zip my value throughput = 167.582'MB/sec zip pipeline throughput = 167.582'MB/sec entries = 129430 avg-key = 20.00 avg-zkey = 1.72 avg-val = 1016.99 avg-zval = 310.85 usrkeys = 129430 avg-key = 12.00 avg-zkey = 1.72 avg-val = 1019.29 avg-zval = 310.85 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 42447 bytes = 159184 } seq expand size = 297129 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0402 GB dict = 1.38 MB all = 0.0420 GB } UnZip/Zip{ index = 6.9676 value = 3.2716 dict = 1.00 all = 3.1944 } Zip/UnZip{ index = 0.1435 value = 0.3057 dict = 1.00 all = 0.3130 } ---------------------------- total value len = 11.365220 GB avg = 0.207 KB (by entry num) total key len = 1.490004 GB avg = 0.027 KB total ukey len = 1.027388 GB avg = 0.015 KB total ukey num = 0.068009602 Billion total entry num = 0.054817331 Billion write speed all = 0.292773843 MB/sec (with seq num) write speed all = 0.282786258 MB/sec (without seq num) 2024/11/23-21:07:00.649553 139957433374272 [compaction_job.cc:1948] [default] [JOB 35792] Generated table #280675: 129430 keys, 42016165 bytes, temperature: kWarm 2024/11/23-21:07:00.649625 139957433374272 EVENT_LOG_v1 {"time_micros": 1732367220649590, "cf_name": "default", "job": 35792, "event": "table_file_creation", "file_number": 280675, "file_size": 42016165, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4261158607, "table_properties": {"data_size": 40233920, "index_size": 222912, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588600, "raw_average_key_size": 20, "raw_value_size": 131629647, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129430, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367219, "oldest_key_time": 0, "file_creation_time": 1732367219, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 280675, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:07:00.686293 139957433374272 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280676.sst) /dev/shm/ToplingTemp/Topling-188820-zcJ9bT 2024/11/23-21:07:01.347690 139957433374272 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280676.sst): first pass time = 0.66's, 202.944'MB/sec 2024/11/23-21:07:02.158357 139957433374272 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280676.sst): old prealloc_size = 147639500, real_size = 40611632 2024/11/23-21:07:02.158504 139957433374272 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280676.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129425 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.72 raw-val = 0.1316 GB zip-val = 0.0404 GB avg-val =1017.04 avg-zval = 311.82 2024/11/23-21:07:02.158616 139957433374272 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280676.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-21:07:02.424210 139957433374272 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280676.sst): second pass time = 0.81's, 162.552'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.27's, 158.406'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1787.594'MB/sec (index lex order gen) rebuild zvType time = 0.20's, 0.159'MB/sec write SST data time = 0.06's, 677.007'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 41780.853'MB/sec zip my value time = 0.81's, unzip length = 0.132'GB zip my value throughput = 162.552'MB/sec zip pipeline throughput = 168.297'MB/sec entries = 129425 avg-key = 20.00 avg-zkey = 1.72 avg-val = 1017.04 avg-zval = 311.82 usrkeys = 129425 avg-key = 12.00 avg-zkey = 1.72 avg-val = 1018.92 avg-zval = 311.82 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 34796 bytes = 130496 } seq expand size = 243572 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0404 GB dict = 1.38 MB all = 0.0421 GB } UnZip/Zip{ index = 6.9934 value = 3.2616 dict = 1.00 all = 3.1873 } Zip/UnZip{ index = 0.1430 value = 0.3066 dict = 1.00 all = 0.3137 } ---------------------------- total value len = 11.497094 GB avg = 0.209 KB (by entry num) total key len = 1.492593 GB avg = 0.027 KB total ukey len = 1.028941 GB avg = 0.015 KB total ukey num = 0.068139027 Billion total entry num = 0.054946756 Billion write speed all = 0.295823836 MB/sec (with seq num) write speed all = 0.285813088 MB/sec (without seq num) 2024/11/23-21:07:02.478831 139957433374272 [compaction_job.cc:1948] [default] [JOB 35792] Generated table #280676: 129425 keys, 42110064 bytes, temperature: kWarm 2024/11/23-21:07:02.478898 139957433374272 EVENT_LOG_v1 {"time_micros": 1732367222478862, "cf_name": "default", "job": 35792, "event": "table_file_creation", "file_number": 280676, "file_size": 42110064, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4261174613, "table_properties": {"data_size": 40357024, "index_size": 222080, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588500, "raw_average_key_size": 20, "raw_value_size": 131630138, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129425, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367220, "oldest_key_time": 0, "file_creation_time": 1732367220, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 280676, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:07:02.515540 139957433374272 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280677.sst) /dev/shm/ToplingTemp/Topling-188820-MZagcU 2024/11/23-21:07:03.197269 139957433374272 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280677.sst): first pass time = 0.68's, 196.889'MB/sec 2024/11/23-21:07:03.970489 139957433374272 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280677.sst): old prealloc_size = 147639500, real_size = 40471040 2024/11/23-21:07:03.970615 139957433374272 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280677.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129431 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.72 raw-val = 0.1316 GB zip-val = 0.0402 GB avg-val =1016.99 avg-zval = 310.72 2024/11/23-21:07:03.970717 139957433374272 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280677.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-21:07:04.149082 139957433374272 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280677.sst): second pass time = 0.77's, 170.411'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.18's, 235.018'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2137.419'MB/sec (index lex order gen) rebuild zvType time = 0.13's, 0.245'MB/sec write SST data time = 0.05's, 900.677'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 34312.425'MB/sec zip my value time = 0.77's, unzip length = 0.132'GB zip my value throughput = 170.411'MB/sec zip pipeline throughput = 170.411'MB/sec entries = 129431 avg-key = 20.00 avg-zkey = 1.72 avg-val = 1016.99 avg-zval = 310.72 usrkeys = 129431 avg-key = 12.00 avg-zkey = 1.72 avg-val = 1018.84 avg-zval = 310.72 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 34343 bytes = 128800 } seq expand size = 240401 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0402 GB dict = 1.38 MB all = 0.0420 GB } UnZip/Zip{ index = 6.9938 value = 3.2730 dict = 1.00 all = 3.1981 } Zip/UnZip{ index = 0.1430 value = 0.3055 dict = 1.00 all = 0.3127 } ---------------------------- total value len = 11.628964 GB avg = 0.211 KB (by entry num) total key len = 1.495182 GB avg = 0.027 KB total ukey len = 1.030494 GB avg = 0.015 KB total ukey num = 0.068268458 Billion total entry num = 0.055076187 Billion write speed all = 0.298874222 MB/sec (with seq num) write speed all = 0.288840287 MB/sec (without seq num) 2024/11/23-21:07:04.204007 139957433374272 [compaction_job.cc:1948] [default] [JOB 35792] Generated table #280677: 129431 keys, 41967554 bytes, temperature: kWarm 2024/11/23-21:07:04.204076 139957433374272 EVENT_LOG_v1 {"time_micros": 1732367224204041, "cf_name": "default", "job": 35792, "event": "table_file_creation", "file_number": 280677, "file_size": 41967554, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4261129131, "table_properties": {"data_size": 40216432, "index_size": 222080, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588620, "raw_average_key_size": 20, "raw_value_size": 131629611, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129431, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732367222, "oldest_key_time": 0, "file_creation_time": 1732367222, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 280677, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:07:04.240734 139957433374272 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280678.sst) /dev/shm/ToplingTemp/Topling-188820-RyHZlU 2024/11/23-21:07:04.249884 139957433374272 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280678.sst): first pass time = 0.01's, 294.098'MB/sec 2024/11/23-21:07:04.280593 139957433374272 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280678.sst): old prealloc_size = 147639500, real_size = 833080 2024/11/23-21:07:04.280633 139957433374272 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280678.sst): index type = UintIndex_AllOne , store type = DictZipBlobStore usrkeys = 2585 prefix = 4 raw-key = 0.0000 GB zip-key = 0.0000 GB avg-key = 8.00 avg-zkey = 0.06 raw-val = 0.0026 GB zip-val = 0.0008 GB avg-val =1017.03 avg-zval = 321.88 2024/11/23-21:07:04.283621 139957433374272 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00/280678.sst): second pass time = 0.03's, 87.057'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.00's, 288.129'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 7.933'MB/sec (index lex order gen) rebuild zvType time = 0.00's, 0.307'MB/sec write SST data time = 0.00's, 980.951'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.033'MB, throughput = 1391.954'MB/sec zip my value time = 0.03's, unzip length = 0.003'GB zip my value throughput = 87.057'MB/sec zip pipeline throughput = 87.057'MB/sec entries = 2585 avg-key = 20.00 avg-zkey = 0.07 avg-val = 1017.03 avg-zval = 321.88 usrkeys = 2585 avg-key = 12.00 avg-zkey = 0.07 avg-val = 1017.48 avg-zval = 321.88 TagRS{ kinds = RS_Key0_TagN bytes = 520 } TagArray{ size = 167 bytes = 640 } seq expand size = 1169 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0000 GB value = 0.0026 GB dict = 0.03 MB all = 0.0027 GB } __ZipSize{ index = 0.0000 GB value = 0.0008 GB dict = 0.03 MB all = 0.0009 GB } UnZip/Zip{ index = 161.5625 value = 3.1596 dict = 1.00 all = 3.0912 } Zip/UnZip{ index = 0.0062 value = 0.3165 dict = 1.00 all = 0.3235 } ---------------------------- total value len = 11.631594 GB avg = 0.211 KB (by entry num) total key len = 1.495233 GB avg = 0.027 KB total ukey len = 1.030525 GB avg = 0.015 KB total ukey num = 0.068271043 Billion total entry num = 0.055078772 Billion write speed all = 0.298934381 MB/sec (with seq num) write speed all = 0.288900005 MB/sec (without seq num) 2024/11/23-21:07:04.292996 139957433374272 [compaction_job.cc:1948] [default] [JOB 35792] Generated table #280678: 2585 keys, 867216 bytes, temperature: kWarm 2024/11/23-21:07:04.293043 139957433374272 EVENT_LOG_v1 {"time_micros": 1732367224293017, "cf_name": "default", "job": 35792, "event": "table_file_creation", "file_number": 280678, "file_size": 867216, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4258832117, "table_properties": {"data_size": 832064, "index_size": 192, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 51700, "raw_average_key_size": 20, "raw_value_size": 2629027, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 2585, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-UintIndex_AllOne-DictZipBlobStore", "creation_time": 1732367224, "oldest_key_time": 0, "file_creation_time": 1732367224, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 280678, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:07:04.304160 139957433374272 [compaction_job.cc:703] job-35792: subcompact[0], size: 0.893031 G, files: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-35792/att-00 [280657,280658,280659,280660,280661,280662,280663,280664,280665,280666,280667,280668,280669,280670,280671,280672,280673,280674,280675,280676,280677,280678] 2024/11/23-21:07:04.446011 139957433374272 (Original Log Time 2024/11/23-21:06:25.275064) EVENT_LOG_v1 {"time_micros": 1732367185275016, "job": 35792, "event": "compaction_started", "compaction_reason": "FilesMarkedForCompaction", "files_L2": [280581], "files_L3": [280510, 280511, 280512, 280513, 280514, 280515, 280516, 280517, 280518, 280519, 280520, 280521, 280522, 280523, 280524, 280525, 280526, 280527, 280528, 280529, 280595], "score": 0.995451, "input_data_size": 924851364, "oldest_snapshot_seqno": 4262394409} 2024/11/23-21:07:04.446015 139957433374272 (Original Log Time 2024/11/23-21:07:04.444022) [compaction_job.cc:2022] [default] [JOB 35792] Compacted 1@2 + 21@3 files to L3 => 893030525 bytes 2024/11/23-21:07:04.446016 139957433374272 (Original Log Time 2024/11/23-21:07:04.445917) [compaction_job.cc:1224] [default] compacted to: files[0 0 0 22 0 0 0] max score 0.03, MB/sec: 23.7 rd, 22.9 wr, level 3, files in(1, 21) out(22 +0 blob) MB in(31.2, 850.8 +0.0 blob) out(851.7 +0.0 blob), read-write-amplify(55.6) write-amplify(27.3) OK, records in: 2749938, records dropped: 29330 output_compression: Snappy 2024/11/23-21:07:04.446020 139957433374272 (Original Log Time 2024/11/23-21:07:04.445964) EVENT_LOG_v1 {"time_micros": 1732367224445943, "cf": "default", "job": 35792, "event": "compaction_finished", "compaction_time_micros": 39029101, "compaction_time_cpu_micros": 8048716, "output_level": 3, "num_output_files": 22, "total_output_size": 893030525, "num_input_records": 2749938, "num_output_records": 2720608, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "file_write_nanos": 658015114, "file_range_sync_nanos": 0, "file_fsync_nanos": 15674, "file_prepare_write_nanos": 52012, "lsm_state": [0, 0, 0, 22, 0, 0, 0]} 2024/11/23-21:07:04.591741 139957433374272 DEBG dcompact_worker.cpp:240: HttpPost: 200 OK: url = http://nlb-7zny4kaa1poal01o64.cn-shenzhen.nlb.aliyuncs.com:8443, body = {"instanceId":"nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137","labourId":"","dbId":"d89b4006-2803-486e-b7a2-759bcf348921","dbStarts":1732256054,"starts":1732367185,"executesMs":39304,"compactionJobId":35792,"attempt":0,"compactionInputRawBytes":2851678501,"compactionInputZipBytes":924851364,"compactionOutputRawBytes":0,"compactionOutputZipBytes":893030525,"headers":{"Accept":"*/*","Connection":"close","Host":"aliyun-topling-saas.topling.cn:18443","RemoteIp":"120.24.192.169","X-Forwarded-For":"120.24.192.169","region":"cn-shenzhen","token":"e6474c481bd4415abc537135cc03626b","instance-token":"e6474c481bd4415abc537135cc03626b","provider":"aliyun","CloudMarketInstanceId":"si-59c0ae5c955845588903","MeteringAssit":"","Transfer-Encoding":"chunked","traceparent":"00-a13c81124e233907d1bf3c016e154548-9a89880cdbed380a-00"}}, response = 2024/11/23-21:07:04.591827 139957433374272 INFO dcompact_worker.cpp:1459: finish /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-35792/att-00: olev 3, work 39.305 s, result 9.811 ms, install 2.014 ms, input{raw 2.656 GiB zip 882.007 MiB}