2024/11/23-16:07:26.561576 139957651584576 DEBG dcompact_worker.cpp:2214: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00: fork to child time = 0.007558 sec 2024/11/23-16:07:26.562374 139957651584576 DEBG dcompact_worker.cpp:1013: Beg SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00 2024/11/23-16:07:26.569680 139957651584576 DEBG dcompact_worker.cpp:1033: End SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00 2024/11/23-16:07:26.570573 139957651584576 TRAC dcompact_worker.cpp:1083: INFO_LOG_LEVEL: rpc = INFO_LEVEL, env_var = undefined 2024/11/23-16:07:26.570816 139957651584576 [WARN] [column_family.cc:386] multiple cf_paths/db_paths and level_compaction_dynamic_level_bytes can't be used together 2024/11/23-16:07:26.627074 139957651584576 [version_set.cc:6208] Recovering from manifest file: /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-30212/att-00/MANIFEST-206347 2024/11/23-16:07:26.660287 139957651584576 [version_set.cc:6251] Recovered from manifest file:/worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-30212/att-00/MANIFEST-206347 succeeded,manifest_file_number is 206347, next_file_number is 268507, last_sequence is 4095673235, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 268352 2024/11/23-16:07:26.660300 139957651584576 [version_set.cc:6266] Column family [default] (ID 0), log number is 0 2024/11/23-16:07:26.660450 139957651584576 [version_set.cc:5721] Creating manifest 268507 2024/11/23-16:07:26.696843 139957651584576 DEBG dcompact_worker.cpp:1218: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00: bottommost_level: fake = 1, rpc = 0 2024/11/23-16:07:26.720583 139957651584576 [compaction_job.cc:2437] [default] [JOB 30212] Compacting 1@2 + 21@3 files to L3, score 0.99, subcompactions 1 : 1 2024/11/23-16:07:26.720600 139957651584576 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 22585 Base level 2, inputs: [268484(31MB)], [268401(40MB) 268402(40MB) 268403(40MB) 268404(40MB) 268405(40MB) 268406(40MB) 268407(40MB) 268408(40MB) 268409(40MB) 268410(40MB) 268411(40MB) 268412(40MB) 268413(40MB) 268414(40MB) 268415(40MB) 268416(40MB) 268417(40MB) 268418(39MB) 268419(40MB) 268420(39MB) 268495(40MB)] 2024/11/23-16:07:26.727606 139957651584576 [top_zip_table.cc:59] core git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-16:07:26.727642 139957651584576 [top_zip_table.cc:60] fsa git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-16:07:26.727661 139957651584576 [top_zip_table.cc:61] zbs git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-16:07:26.727667 139957651584576 [top_zip_table.cc:62] topling-zip_table_reader: git_version_hash_info_is: commit a4a382006cb82713acf5b3425835f22711877681 Author: leipeng Date: 2024-04-11 19:44:14 +0800 fixed_len_hole_index.cc: Add env bool FixedLenHoleIndexUseAVX512 for ut & debug 1. FixedLenHoleIndexUseAVX512 is only in unit tests or debug 2. In release mode, use avx512 by compile options(-march=) g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/23-16:07:26.727676 139957651584576 [top_zip_table.cc:64] topling-rocks git_version_hash_info_is: commit feab587e468621ba0204d47b4ffacc52e7c4290d Author: leipeng Date: 2024-03-22 13:35:06 +0800 ToplingZipTableBuilder::Add: immediately return after error This function returns void, and caller does not check builder->status() after calling this function and graceful abandon. So immediately return after error, and return error status in Finish(). g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/23-16:07:27.697876 139957651584576 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268508.sst) /dev/shm/ToplingTemp/Topling-107622-mhLqZ5 2024/11/23-16:07:27.866652 139957651584576 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268508.sst): first pass time = 0.17's, 795.444'MB/sec 2024/11/23-16:07:28.658634 139957651584576 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268508.sst): old prealloc_size = 147639500, real_size = 40639936 2024/11/23-16:07:28.658768 139957651584576 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268508.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129431 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.81 raw-val = 0.1316 GB zip-val = 0.0404 GB avg-val =1016.99 avg-zval = 311.93 2024/11/23-16:07:28.658942 139957651584576 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268508.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:07:28.819723 139957651584576 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268508.sst): second pass time = 0.79's, 166.542'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 263.677'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2113.325'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.274'MB/sec write SST data time = 0.04's, 986.294'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 48567.158'MB/sec zip my value time = 0.79's, unzip length = 0.132'GB zip my value throughput = 166.542'MB/sec zip pipeline throughput = 166.542'MB/sec entries = 129431 avg-key = 20.00 avg-zkey = 1.81 avg-val = 1016.99 avg-zval = 311.93 usrkeys = 129431 avg-key = 12.00 avg-zkey = 1.81 avg-val = 1023.99 avg-zval = 311.93 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129431 bytes = 485376 } seq expand size = 906017 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0404 GB dict = 1.38 MB all = 0.0425 GB } UnZip/Zip{ index = 6.6470 value = 3.2603 dict = 1.00 all = 3.1601 } Zip/UnZip{ index = 0.1504 value = 0.3067 dict = 1.00 all = 0.3164 } ---------------------------- total value len = 8.981156 GB avg = 0.171 KB (by entry num) total key len = 1.443410 GB avg = 0.028 KB total ukey len = 0.999431 GB avg = 0.015 KB total ukey num = 0.065679866 Billion total entry num = 0.052487595 Billion write speed all = 0.401924830 MB/sec (with seq num) write speed all = 0.385735326 MB/sec (without seq num) 2024/11/23-16:07:28.872251 139957651584576 [compaction_job.cc:1948] [default] [JOB 30212] Generated table #268508: 129431 keys, 42472375 bytes, temperature: kWarm 2024/11/23-16:07:28.872345 139957651584576 EVENT_LOG_v1 {"time_micros": 1732349248872280, "cf_name": "default", "job": 30212, "event": "table_file_creation", "file_number": 268508, "file_size": 42472375, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237877277, "largest_seqno": 4095530253, "table_properties": {"data_size": 40373744, "index_size": 233664, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588620, "raw_average_key_size": 20, "raw_value_size": 131630073, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129431, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732349247, "oldest_key_time": 0, "file_creation_time": 1732349247, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 268508, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:07:28.913551 139957651584576 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268509.sst) /dev/shm/ToplingTemp/Topling-107622-kpLJG4 2024/11/23-16:07:29.499973 139957651584576 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268509.sst): first pass time = 0.59's, 228.899'MB/sec 2024/11/23-16:07:30.318603 139957651584576 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268509.sst): old prealloc_size = 147639500, real_size = 40849552 2024/11/23-16:07:30.318722 139957651584576 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268509.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129432 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.75 raw-val = 0.1316 GB zip-val = 0.0406 GB avg-val =1016.98 avg-zval = 313.61 2024/11/23-16:07:30.318876 139957651584576 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268509.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:07:30.479669 139957651584576 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268509.sst): second pass time = 0.82's, 160.934'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 265.032'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2336.977'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.274'MB/sec write SST data time = 0.04's, 993.150'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 45679.781'MB/sec zip my value time = 0.82's, unzip length = 0.132'GB zip my value throughput = 160.934'MB/sec zip pipeline throughput = 160.934'MB/sec entries = 129432 avg-key = 20.00 avg-zkey = 1.75 avg-val = 1016.98 avg-zval = 313.61 usrkeys = 129432 avg-key = 12.00 avg-zkey = 1.75 avg-val = 1023.98 avg-zval = 313.61 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129432 bytes = 485392 } seq expand size = 906024 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0406 GB dict = 1.38 MB all = 0.0427 GB } UnZip/Zip{ index = 6.8594 value = 3.2429 dict = 1.00 all = 3.1446 } Zip/UnZip{ index = 0.1458 value = 0.3084 dict = 1.00 all = 0.3180 } ---------------------------- total value len = 9.113692 GB avg = 0.173 KB (by entry num) total key len = 1.445998 GB avg = 0.027 KB total ukey len = 1.000984 GB avg = 0.015 KB total ukey num = 0.065809298 Billion total entry num = 0.052617027 Billion write speed all = 0.407108585 MB/sec (with seq num) write speed all = 0.390880197 MB/sec (without seq num) 2024/11/23-16:07:30.532222 139957651584576 [compaction_job.cc:1948] [default] [JOB 30212] Generated table #268509: 129432 keys, 42682478 bytes, temperature: kWarm 2024/11/23-16:07:30.532297 139957651584576 EVENT_LOG_v1 {"time_micros": 1732349250532258, "cf_name": "default", "job": 30212, "event": "table_file_creation", "file_number": 268509, "file_size": 42682478, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237868195, "largest_seqno": 4095533446, "table_properties": {"data_size": 40590592, "index_size": 226432, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588640, "raw_average_key_size": 20, "raw_value_size": 131630123, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129432, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732349248, "oldest_key_time": 0, "file_creation_time": 1732349248, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 268509, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:07:30.569522 139957651584576 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268510.sst) /dev/shm/ToplingTemp/Topling-107622-FVNm45 2024/11/23-16:07:31.294734 139957651584576 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268510.sst): first pass time = 0.73's, 185.084'MB/sec 2024/11/23-16:07:32.099412 139957651584576 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268510.sst): old prealloc_size = 147639500, real_size = 40585488 2024/11/23-16:07:32.099543 139957651584576 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268510.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129432 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.81 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1016.98 avg-zval = 311.50 2024/11/23-16:07:32.099709 139957651584576 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268510.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:07:32.259699 139957651584576 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268510.sst): second pass time = 0.80's, 163.962'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 264.661'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2207.727'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.277'MB/sec write SST data time = 0.04's, 980.885'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 37167.723'MB/sec zip my value time = 0.80's, unzip length = 0.132'GB zip my value throughput = 163.962'MB/sec zip pipeline throughput = 163.962'MB/sec entries = 129432 avg-key = 20.00 avg-zkey = 1.81 avg-val = 1016.98 avg-zval = 311.50 usrkeys = 129432 avg-key = 12.00 avg-zkey = 1.81 avg-val = 1023.98 avg-zval = 311.50 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129432 bytes = 485392 } seq expand size = 906024 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0424 GB } UnZip/Zip{ index = 6.6163 value = 3.2648 dict = 1.00 all = 3.1642 } Zip/UnZip{ index = 0.1511 value = 0.3063 dict = 1.00 all = 0.3160 } ---------------------------- total value len = 9.246228 GB avg = 0.175 KB (by entry num) total key len = 1.448587 GB avg = 0.027 KB total ukey len = 1.002538 GB avg = 0.015 KB total ukey num = 0.065938730 Billion total entry num = 0.052746459 Billion write speed all = 0.412289753 MB/sec (with seq num) write speed all = 0.396022562 MB/sec (without seq num) 2024/11/23-16:07:32.310565 139957651584576 [compaction_job.cc:1948] [default] [JOB 30212] Generated table #268510: 129432 keys, 42418174 bytes, temperature: kWarm 2024/11/23-16:07:32.310634 139957651584576 EVENT_LOG_v1 {"time_micros": 1732349252310599, "cf_name": "default", "job": 30212, "event": "table_file_creation", "file_number": 268510, "file_size": 42418174, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237873554, "largest_seqno": 4095536091, "table_properties": {"data_size": 40318208, "index_size": 234752, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588640, "raw_average_key_size": 20, "raw_value_size": 131629734, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129432, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732349250, "oldest_key_time": 0, "file_creation_time": 1732349250, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 268510, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:07:32.347944 139957651584576 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268511.sst) /dev/shm/ToplingTemp/Topling-107622-bYnt43 2024/11/23-16:07:32.906825 139957651584576 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268511.sst): first pass time = 0.56's, 240.175'MB/sec 2024/11/23-16:07:33.751543 139957651584576 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268511.sst): old prealloc_size = 147639500, real_size = 40868992 2024/11/23-16:07:33.751677 139957651584576 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268511.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129435 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.74 raw-val = 0.1316 GB zip-val = 0.0406 GB avg-val =1016.95 avg-zval = 313.76 2024/11/23-16:07:33.751851 139957651584576 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268511.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:07:33.927737 139957651584576 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268511.sst): second pass time = 0.84's, 156.157'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.18's, 242.376'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2114.249'MB/sec (index lex order gen) rebuild zvType time = 0.13's, 0.247'MB/sec write SST data time = 0.04's, 949.022'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 43518.143'MB/sec zip my value time = 0.84's, unzip length = 0.132'GB zip my value throughput = 156.157'MB/sec zip pipeline throughput = 156.157'MB/sec entries = 129435 avg-key = 20.00 avg-zkey = 1.74 avg-val = 1016.95 avg-zval = 313.76 usrkeys = 129435 avg-key = 12.00 avg-zkey = 1.74 avg-val = 1023.95 avg-zval = 313.76 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129435 bytes = 485392 } seq expand size = 906045 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0406 GB dict = 1.38 MB all = 0.0427 GB } UnZip/Zip{ index = 6.8887 value = 3.2412 dict = 1.00 all = 3.1431 } Zip/UnZip{ index = 0.1452 value = 0.3085 dict = 1.00 all = 0.3182 } ---------------------------- total value len = 9.378763 GB avg = 0.177 KB (by entry num) total key len = 1.451176 GB avg = 0.027 KB total ukey len = 1.004091 GB avg = 0.015 KB total ukey num = 0.066068165 Billion total entry num = 0.052875894 Billion write speed all = 0.417471991 MB/sec (with seq num) write speed all = 0.401165930 MB/sec (without seq num) 2024/11/23-16:07:33.979726 139957651584576 [compaction_job.cc:1948] [default] [JOB 30212] Generated table #268511: 129435 keys, 42701777 bytes, temperature: kWarm 2024/11/23-16:07:33.979797 139957651584576 EVENT_LOG_v1 {"time_micros": 1732349253979761, "cf_name": "default", "job": 30212, "event": "table_file_creation", "file_number": 268511, "file_size": 42701777, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237868596, "largest_seqno": 4095515535, "table_properties": {"data_size": 40610992, "index_size": 225472, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588700, "raw_average_key_size": 20, "raw_value_size": 131629105, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129435, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732349252, "oldest_key_time": 0, "file_creation_time": 1732349252, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 268511, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:07:34.019000 139957651584576 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268512.sst) /dev/shm/ToplingTemp/Topling-107622-dmSP03 2024/11/23-16:07:34.630307 139957651584576 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268512.sst): first pass time = 0.61's, 219.576'MB/sec 2024/11/23-16:07:35.427155 139957651584576 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268512.sst): old prealloc_size = 147639500, real_size = 40585616 2024/11/23-16:07:35.427279 139957651584576 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268512.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129429 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.81 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1017.00 avg-zval = 311.51 2024/11/23-16:07:35.427459 139957651584576 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268512.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:07:35.587067 139957651584576 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268512.sst): second pass time = 0.80's, 165.316'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 265.296'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2315.131'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.276'MB/sec write SST data time = 0.04's, 1001.028'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 47709.226'MB/sec zip my value time = 0.80's, unzip length = 0.132'GB zip my value throughput = 165.316'MB/sec zip pipeline throughput = 165.316'MB/sec entries = 129429 avg-key = 20.00 avg-zkey = 1.81 avg-val = 1017.00 avg-zval = 311.51 usrkeys = 129429 avg-key = 12.00 avg-zkey = 1.81 avg-val = 1024.00 avg-zval = 311.51 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129429 bytes = 485376 } seq expand size = 906003 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0424 GB } UnZip/Zip{ index = 6.6161 value = 3.2648 dict = 1.00 all = 3.1641 } Zip/UnZip{ index = 0.1511 value = 0.3063 dict = 1.00 all = 0.3160 } ---------------------------- total value len = 9.511299 GB avg = 0.179 KB (by entry num) total key len = 1.453764 GB avg = 0.027 KB total ukey len = 1.005644 GB avg = 0.015 KB total ukey num = 0.066197594 Billion total entry num = 0.053005323 Billion write speed all = 0.422653723 MB/sec (with seq num) write speed all = 0.406308794 MB/sec (without seq num) 2024/11/23-16:07:35.637825 139957651584576 [compaction_job.cc:1948] [default] [JOB 30212] Generated table #268512: 129429 keys, 42418464 bytes, temperature: kWarm 2024/11/23-16:07:35.637896 139957651584576 EVENT_LOG_v1 {"time_micros": 1732349255637860, "cf_name": "default", "job": 30212, "event": "table_file_creation", "file_number": 268512, "file_size": 42418464, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237869923, "largest_seqno": 4095537543, "table_properties": {"data_size": 40318336, "index_size": 234752, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588580, "raw_average_key_size": 20, "raw_value_size": 131629752, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129429, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732349254, "oldest_key_time": 0, "file_creation_time": 1732349254, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 268512, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:07:35.677595 139957651584576 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268513.sst) /dev/shm/ToplingTemp/Topling-107622-s40fp6 2024/11/23-16:07:36.348903 139957651584576 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268513.sst): first pass time = 0.67's, 199.947'MB/sec 2024/11/23-16:07:37.139843 139957651584576 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268513.sst): old prealloc_size = 147639500, real_size = 40690960 2024/11/23-16:07:37.139971 139957651584576 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268513.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129430 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.80 raw-val = 0.1316 GB zip-val = 0.0404 GB avg-val =1017.00 avg-zval = 312.33 2024/11/23-16:07:37.140142 139957651584576 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268513.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:07:37.301581 139957651584576 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268513.sst): second pass time = 0.79's, 166.719'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 262.954'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1957.045'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.275'MB/sec write SST data time = 0.04's, 970.995'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 29784.727'MB/sec zip my value time = 0.79's, unzip length = 0.132'GB zip my value throughput = 166.719'MB/sec zip pipeline throughput = 166.719'MB/sec entries = 129430 avg-key = 20.00 avg-zkey = 1.80 avg-val = 1017.00 avg-zval = 312.33 usrkeys = 129430 avg-key = 12.00 avg-zkey = 1.80 avg-val = 1024.00 avg-zval = 312.33 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129430 bytes = 485376 } seq expand size = 906010 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0404 GB dict = 1.38 MB all = 0.0425 GB } UnZip/Zip{ index = 6.6634 value = 3.2561 dict = 1.00 all = 3.1563 } Zip/UnZip{ index = 0.1501 value = 0.3071 dict = 1.00 all = 0.3168 } ---------------------------- total value len = 9.643835 GB avg = 0.181 KB (by entry num) total key len = 1.456353 GB avg = 0.027 KB total ukey len = 1.007197 GB avg = 0.015 KB total ukey num = 0.066327024 Billion total entry num = 0.053134753 Billion write speed all = 0.427833887 MB/sec (with seq num) write speed all = 0.411450129 MB/sec (without seq num) 2024/11/23-16:07:37.352963 139957651584576 [compaction_job.cc:1948] [default] [JOB 30212] Generated table #268513: 129430 keys, 42523360 bytes, temperature: kWarm 2024/11/23-16:07:37.353050 139957651584576 EVENT_LOG_v1 {"time_micros": 1732349257353014, "cf_name": "default", "job": 30212, "event": "table_file_creation", "file_number": 268513, "file_size": 42523360, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237881756, "largest_seqno": 4095534582, "table_properties": {"data_size": 40425344, "index_size": 233088, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588600, "raw_average_key_size": 20, "raw_value_size": 131629821, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129430, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732349255, "oldest_key_time": 0, "file_creation_time": 1732349255, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 268513, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:07:37.394279 139957651584576 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268514.sst) /dev/shm/ToplingTemp/Topling-107622-xeL3J4 2024/11/23-16:07:38.273516 139957651584576 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268514.sst): first pass time = 0.88's, 152.662'MB/sec 2024/11/23-16:07:39.139167 139957651584576 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268514.sst): old prealloc_size = 147639500, real_size = 41040288 2024/11/23-16:07:39.139289 139957651584576 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268514.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129429 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.73 raw-val = 0.1316 GB zip-val = 0.0408 GB avg-val =1017.00 avg-zval = 315.11 2024/11/23-16:07:39.139454 139957651584576 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268514.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:07:39.300923 139957651584576 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268514.sst): second pass time = 0.87's, 152.171'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 265.082'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2299.783'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.273'MB/sec write SST data time = 0.04's, 999.151'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 45800.492'MB/sec zip my value time = 0.87's, unzip length = 0.132'GB zip my value throughput = 152.171'MB/sec zip pipeline throughput = 152.171'MB/sec entries = 129429 avg-key = 20.00 avg-zkey = 1.73 avg-val = 1017.00 avg-zval = 315.11 usrkeys = 129429 avg-key = 12.00 avg-zkey = 1.73 avg-val = 1024.00 avg-zval = 315.11 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129429 bytes = 485376 } seq expand size = 906003 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0408 GB dict = 1.38 MB all = 0.0429 GB } UnZip/Zip{ index = 6.9396 value = 3.2275 dict = 1.00 all = 3.1306 } Zip/UnZip{ index = 0.1441 value = 0.3098 dict = 1.00 all = 0.3194 } ---------------------------- total value len = 9.776370 GB avg = 0.184 KB (by entry num) total key len = 1.458941 GB avg = 0.027 KB total ukey len = 1.008750 GB avg = 0.015 KB total ukey num = 0.066456453 Billion total entry num = 0.053264182 Billion write speed all = 0.433008603 MB/sec (with seq num) write speed all = 0.416586202 MB/sec (without seq num) 2024/11/23-16:07:39.352870 139957651584576 [compaction_job.cc:1948] [default] [JOB 30212] Generated table #268514: 129429 keys, 42872901 bytes, temperature: kWarm 2024/11/23-16:07:39.352941 139957651584576 EVENT_LOG_v1 {"time_micros": 1732349259352905, "cf_name": "default", "job": 30212, "event": "table_file_creation", "file_number": 268514, "file_size": 42872901, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237880987, "largest_seqno": 4095522400, "table_properties": {"data_size": 40783952, "index_size": 223808, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588580, "raw_average_key_size": 20, "raw_value_size": 131629602, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129429, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732349257, "oldest_key_time": 0, "file_creation_time": 1732349257, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 268514, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:07:39.392695 139957651584576 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268515.sst) /dev/shm/ToplingTemp/Topling-107622-7wols5 2024/11/23-16:07:40.098250 139957651584576 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268515.sst): first pass time = 0.71's, 190.241'MB/sec 2024/11/23-16:07:40.938216 139957651584576 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268515.sst): old prealloc_size = 147639500, real_size = 40979568 2024/11/23-16:07:40.938352 139957651584576 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268515.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129431 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.71 raw-val = 0.1316 GB zip-val = 0.0407 GB avg-val =1016.99 avg-zval = 314.66 2024/11/23-16:07:40.938511 139957651584576 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268515.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:07:41.099741 139957651584576 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268515.sst): second pass time = 0.84's, 157.018'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 265.086'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1890.376'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.273'MB/sec write SST data time = 0.04's, 995.732'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 45951.687'MB/sec zip my value time = 0.84's, unzip length = 0.132'GB zip my value throughput = 157.018'MB/sec zip pipeline throughput = 157.018'MB/sec entries = 129431 avg-key = 20.00 avg-zkey = 1.71 avg-val = 1016.99 avg-zval = 314.66 usrkeys = 129431 avg-key = 12.00 avg-zkey = 1.71 avg-val = 1023.99 avg-zval = 314.66 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129431 bytes = 485376 } seq expand size = 906017 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0407 GB dict = 1.38 MB all = 0.0428 GB } UnZip/Zip{ index = 7.0323 value = 3.2321 dict = 1.00 all = 3.1350 } Zip/UnZip{ index = 0.1422 value = 0.3094 dict = 1.00 all = 0.3190 } ---------------------------- total value len = 9.908906 GB avg = 0.186 KB (by entry num) total key len = 1.461530 GB avg = 0.027 KB total ukey len = 1.010303 GB avg = 0.015 KB total ukey num = 0.066585884 Billion total entry num = 0.053393613 Billion write speed all = 0.438185925 MB/sec (with seq num) write speed all = 0.421724759 MB/sec (without seq num) 2024/11/23-16:07:41.151413 139957651584576 [compaction_job.cc:1948] [default] [JOB 30212] Generated table #268515: 129431 keys, 42812550 bytes, temperature: kWarm 2024/11/23-16:07:41.151485 139957651584576 EVENT_LOG_v1 {"time_micros": 1732349261151449, "cf_name": "default", "job": 30212, "event": "table_file_creation", "file_number": 268515, "file_size": 42812550, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237868290, "largest_seqno": 4095539378, "table_properties": {"data_size": 40726176, "index_size": 220864, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588620, "raw_average_key_size": 20, "raw_value_size": 131630012, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129431, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732349259, "oldest_key_time": 0, "file_creation_time": 1732349259, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 268515, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:07:41.190595 139957651584576 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268516.sst) /dev/shm/ToplingTemp/Topling-107622-upJnr3 2024/11/23-16:07:41.940887 139957651584576 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268516.sst): first pass time = 0.75's, 178.897'MB/sec 2024/11/23-16:07:42.752191 139957651584576 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268516.sst): old prealloc_size = 147639500, real_size = 40811520 2024/11/23-16:07:42.752335 139957651584576 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268516.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129431 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.77 raw-val = 0.1316 GB zip-val = 0.0406 GB avg-val =1016.98 avg-zval = 313.29 2024/11/23-16:07:42.752501 139957651584576 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268516.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:07:42.915239 139957651584576 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268516.sst): second pass time = 0.81's, 162.407'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 261.563'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1907.281'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.270'MB/sec write SST data time = 0.04's, 992.707'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 46812.530'MB/sec zip my value time = 0.81's, unzip length = 0.132'GB zip my value throughput = 162.407'MB/sec zip pipeline throughput = 162.407'MB/sec entries = 129431 avg-key = 20.00 avg-zkey = 1.77 avg-val = 1016.98 avg-zval = 313.29 usrkeys = 129431 avg-key = 12.00 avg-zkey = 1.77 avg-val = 1023.98 avg-zval = 313.29 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129431 bytes = 485376 } seq expand size = 906017 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0406 GB dict = 1.38 MB all = 0.0426 GB } UnZip/Zip{ index = 6.7826 value = 3.2461 dict = 1.00 all = 3.1474 } Zip/UnZip{ index = 0.1474 value = 0.3081 dict = 1.00 all = 0.3177 } ---------------------------- total value len = 10.041441 GB avg = 0.188 KB (by entry num) total key len = 1.464119 GB avg = 0.027 KB total ukey len = 1.011857 GB avg = 0.015 KB total ukey num = 0.066715315 Billion total entry num = 0.053523044 Billion write speed all = 0.443362214 MB/sec (with seq num) write speed all = 0.426862299 MB/sec (without seq num) 2024/11/23-16:07:42.967068 139957651584576 [compaction_job.cc:1948] [default] [JOB 30212] Generated table #268516: 129431 keys, 42644183 bytes, temperature: kWarm 2024/11/23-16:07:42.967139 139957651584576 EVENT_LOG_v1 {"time_micros": 1732349262967102, "cf_name": "default", "job": 30212, "event": "table_file_creation", "file_number": 268516, "file_size": 42644183, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237874127, "largest_seqno": 4095539467, "table_properties": {"data_size": 40550000, "index_size": 228992, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588620, "raw_average_key_size": 20, "raw_value_size": 131629224, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129431, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732349261, "oldest_key_time": 0, "file_creation_time": 1732349261, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 268516, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:07:43.003749 139957651584576 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268517.sst) /dev/shm/ToplingTemp/Topling-107622-bMZNt2 2024/11/23-16:07:43.704796 139957651584576 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268517.sst): first pass time = 0.70's, 191.464'MB/sec 2024/11/23-16:07:44.505059 139957651584576 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268517.sst): old prealloc_size = 147639500, real_size = 40587088 2024/11/23-16:07:44.505189 139957651584576 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268517.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129432 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.81 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1016.98 avg-zval = 311.51 2024/11/23-16:07:44.505372 139957651584576 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268517.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:07:44.665852 139957651584576 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268517.sst): second pass time = 0.80's, 164.638'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 263.843'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2192.399'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.280'MB/sec write SST data time = 0.05's, 940.744'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.377'MB, throughput = 46455.263'MB/sec zip my value time = 0.80's, unzip length = 0.132'GB zip my value throughput = 164.638'MB/sec zip pipeline throughput = 164.638'MB/sec entries = 129432 avg-key = 20.00 avg-zkey = 1.81 avg-val = 1016.98 avg-zval = 311.51 usrkeys = 129432 avg-key = 12.00 avg-zkey = 1.81 avg-val = 1023.98 avg-zval = 311.51 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129432 bytes = 485392 } seq expand size = 906024 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0424 GB } UnZip/Zip{ index = 6.6199 value = 3.2646 dict = 1.00 all = 3.1641 } Zip/UnZip{ index = 0.1511 value = 0.3063 dict = 1.00 all = 0.3160 } ---------------------------- total value len = 10.173977 GB avg = 0.190 KB (by entry num) total key len = 1.466707 GB avg = 0.027 KB total ukey len = 1.013410 GB avg = 0.015 KB total ukey num = 0.066844747 Billion total entry num = 0.053652476 Billion write speed all = 0.448538927 MB/sec (with seq num) write speed all = 0.432000227 MB/sec (without seq num) 2024/11/23-16:07:44.717189 139957651584576 [compaction_job.cc:1948] [default] [JOB 30212] Generated table #268517: 129432 keys, 42419300 bytes, temperature: kWarm 2024/11/23-16:07:44.717257 139957651584576 EVENT_LOG_v1 {"time_micros": 1732349264717223, "cf_name": "default", "job": 30212, "event": "table_file_creation", "file_number": 268517, "file_size": 42419300, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237873605, "largest_seqno": 4095532768, "table_properties": {"data_size": 40319936, "index_size": 234624, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588640, "raw_average_key_size": 20, "raw_value_size": 131629864, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129432, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732349262, "oldest_key_time": 0, "file_creation_time": 1732349262, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 268517, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:07:44.757107 139957651584576 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268518.sst) /dev/shm/ToplingTemp/Topling-107622-o0KNv3 2024/11/23-16:07:45.544409 139957651584576 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268518.sst): first pass time = 0.79's, 170.488'MB/sec 2024/11/23-16:07:46.313716 139957651584576 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268518.sst): old prealloc_size = 147639500, real_size = 40626688 2024/11/23-16:07:46.313850 139957651584576 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268518.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129430 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.81 raw-val = 0.1316 GB zip-val = 0.0404 GB avg-val =1017.00 avg-zval = 311.83 2024/11/23-16:07:46.314028 139957651584576 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268518.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:07:46.476555 139957651584576 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268518.sst): second pass time = 0.77's, 171.451'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 260.780'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2276.675'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.272'MB/sec write SST data time = 0.04's, 967.380'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 44123.271'MB/sec zip my value time = 0.77's, unzip length = 0.132'GB zip my value throughput = 171.451'MB/sec zip pipeline throughput = 171.451'MB/sec entries = 129430 avg-key = 20.00 avg-zkey = 1.81 avg-val = 1017.00 avg-zval = 311.83 usrkeys = 129430 avg-key = 12.00 avg-zkey = 1.81 avg-val = 1024.00 avg-zval = 311.83 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129430 bytes = 485376 } seq expand size = 906010 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0404 GB dict = 1.38 MB all = 0.0425 GB } UnZip/Zip{ index = 6.6288 value = 3.2614 dict = 1.00 all = 3.1611 } Zip/UnZip{ index = 0.1509 value = 0.3066 dict = 1.00 all = 0.3163 } ---------------------------- total value len = 10.306513 GB avg = 0.192 KB (by entry num) total key len = 1.469296 GB avg = 0.027 KB total ukey len = 1.014963 GB avg = 0.015 KB total ukey num = 0.066974177 Billion total entry num = 0.053781906 Billion write speed all = 0.453713892 MB/sec (with seq num) write speed all = 0.437136451 MB/sec (without seq num) 2024/11/23-16:07:46.527878 139957651584576 [compaction_job.cc:1948] [default] [JOB 30212] Generated table #268518: 129430 keys, 42459529 bytes, temperature: kWarm 2024/11/23-16:07:46.527950 139957651584576 EVENT_LOG_v1 {"time_micros": 1732349266527912, "cf_name": "default", "job": 30212, "event": "table_file_creation", "file_number": 268518, "file_size": 42459529, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237872082, "largest_seqno": 4095537934, "table_properties": {"data_size": 40359856, "index_size": 234304, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588600, "raw_average_key_size": 20, "raw_value_size": 131629977, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129430, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732349264, "oldest_key_time": 0, "file_creation_time": 1732349264, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 268518, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:07:46.582536 139957651584576 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268519.sst) /dev/shm/ToplingTemp/Topling-107622-FHUL72 2024/11/23-16:07:47.108814 139957651584576 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268519.sst): first pass time = 0.53's, 255.053'MB/sec 2024/11/23-16:07:48.005041 139957651584576 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268519.sst): old prealloc_size = 147639500, real_size = 41068480 2024/11/23-16:07:48.005169 139957651584576 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268519.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129430 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.72 raw-val = 0.1316 GB zip-val = 0.0408 GB avg-val =1016.99 avg-zval = 315.33 2024/11/23-16:07:48.005342 139957651584576 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268519.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:07:48.164786 139957651584576 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268519.sst): second pass time = 0.89's, 148.061'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 268.599'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2129.383'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.275'MB/sec write SST data time = 0.04's, 1019.542'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 41855.303'MB/sec zip my value time = 0.89's, unzip length = 0.132'GB zip my value throughput = 148.061'MB/sec zip pipeline throughput = 148.061'MB/sec entries = 129430 avg-key = 20.00 avg-zkey = 1.72 avg-val = 1016.99 avg-zval = 315.33 usrkeys = 129430 avg-key = 12.00 avg-zkey = 1.72 avg-val = 1023.99 avg-zval = 315.33 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129430 bytes = 485376 } seq expand size = 906010 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0408 GB dict = 1.38 MB all = 0.0429 GB } UnZip/Zip{ index = 6.9616 value = 3.2252 dict = 1.00 all = 3.1285 } Zip/UnZip{ index = 0.1436 value = 0.3101 dict = 1.00 all = 0.3196 } ---------------------------- total value len = 10.439049 GB avg = 0.194 KB (by entry num) total key len = 1.471885 GB avg = 0.027 KB total ukey len = 1.016516 GB avg = 0.015 KB total ukey num = 0.067103607 Billion total entry num = 0.053911336 Billion write speed all = 0.458890273 MB/sec (with seq num) write speed all = 0.442274018 MB/sec (without seq num) 2024/11/23-16:07:48.217914 139957651584576 [compaction_job.cc:1948] [default] [JOB 30212] Generated table #268519: 129430 keys, 42901307 bytes, temperature: kWarm 2024/11/23-16:07:48.217990 139957651584576 EVENT_LOG_v1 {"time_micros": 1732349268217946, "cf_name": "default", "job": 30212, "event": "table_file_creation", "file_number": 268519, "file_size": 42901307, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237949482, "largest_seqno": 4095522673, "table_properties": {"data_size": 40812848, "index_size": 223104, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588600, "raw_average_key_size": 20, "raw_value_size": 131629231, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129430, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732349266, "oldest_key_time": 0, "file_creation_time": 1732349266, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 268519, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:07:48.257118 139957651584576 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268520.sst) /dev/shm/ToplingTemp/Topling-107622-xYUeF6 2024/11/23-16:07:49.095350 139957651584576 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268520.sst): first pass time = 0.84's, 160.130'MB/sec 2024/11/23-16:07:49.870150 139957651584576 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268520.sst): old prealloc_size = 147639500, real_size = 40591088 2024/11/23-16:07:49.870295 139957651584576 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268520.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129427 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.80 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1017.02 avg-zval = 311.57 2024/11/23-16:07:49.870515 139957651584576 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268520.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:07:50.053362 139957651584576 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268520.sst): second pass time = 0.77's, 170.025'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.18's, 231.446'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1789.334'MB/sec (index lex order gen) rebuild zvType time = 0.13's, 0.242'MB/sec write SST data time = 0.05's, 862.848'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 43368.568'MB/sec zip my value time = 0.77's, unzip length = 0.132'GB zip my value throughput = 170.025'MB/sec zip pipeline throughput = 170.025'MB/sec entries = 129427 avg-key = 20.00 avg-zkey = 1.80 avg-val = 1017.02 avg-zval = 311.57 usrkeys = 129427 avg-key = 12.00 avg-zkey = 1.80 avg-val = 1023.38 avg-zval = 311.57 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 117629 bytes = 441120 } seq expand size = 823403 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0424 GB } UnZip/Zip{ index = 6.6614 value = 3.2642 dict = 1.00 all = 3.1655 } Zip/UnZip{ index = 0.1501 value = 0.3064 dict = 1.00 all = 0.3159 } ---------------------------- total value len = 10.571502 GB avg = 0.196 KB (by entry num) total key len = 1.474473 GB avg = 0.027 KB total ukey len = 1.018069 GB avg = 0.015 KB total ukey num = 0.067233034 Billion total entry num = 0.054040763 Billion write speed all = 0.464059246 MB/sec (with seq num) write speed all = 0.447404311 MB/sec (without seq num) 2024/11/23-16:07:50.105313 139957651584576 [compaction_job.cc:1948] [default] [JOB 30212] Generated table #268520: 129427 keys, 42400074 bytes, temperature: kWarm 2024/11/23-16:07:50.105379 139957651584576 EVENT_LOG_v1 {"time_micros": 1732349270105344, "cf_name": "default", "job": 30212, "event": "table_file_creation", "file_number": 268520, "file_size": 42400074, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4095536940, "table_properties": {"data_size": 40325408, "index_size": 233152, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588540, "raw_average_key_size": 20, "raw_value_size": 131630079, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129427, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732349268, "oldest_key_time": 0, "file_creation_time": 1732349268, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 268520, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:07:50.146516 139957651584576 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268521.sst) /dev/shm/ToplingTemp/Topling-107622-MeMam6 2024/11/23-16:07:50.861482 139957651584576 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268521.sst): first pass time = 0.71's, 187.736'MB/sec 2024/11/23-16:07:51.688051 139957651584576 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268521.sst): old prealloc_size = 147639500, real_size = 40582128 2024/11/23-16:07:51.688162 139957651584576 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268521.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129431 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.70 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1016.98 avg-zval = 311.59 2024/11/23-16:07:51.688253 139957651584576 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268521.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:07:51.846677 139957651584576 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268521.sst): second pass time = 0.83's, 159.371'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 265.410'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2353.574'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.278'MB/sec write SST data time = 0.04's, 1001.578'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 46306.457'MB/sec zip my value time = 0.83's, unzip length = 0.132'GB zip my value throughput = 159.371'MB/sec zip pipeline throughput = 159.371'MB/sec entries = 129431 avg-key = 20.00 avg-zkey = 1.70 avg-val = 1016.98 avg-zval = 311.59 usrkeys = 129431 avg-key = 12.00 avg-zkey = 1.70 avg-val = 1019.06 avg-zval = 311.59 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 38459 bytes = 144240 } seq expand size = 269213 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0421 GB } UnZip/Zip{ index = 7.0425 value = 3.2639 dict = 1.00 all = 3.1885 } Zip/UnZip{ index = 0.1420 value = 0.3064 dict = 1.00 all = 0.3136 } ---------------------------- total value len = 10.703400 GB avg = 0.198 KB (by entry num) total key len = 1.477062 GB avg = 0.027 KB total ukey len = 1.019622 GB avg = 0.015 KB total ukey num = 0.067362465 Billion total entry num = 0.054170194 Billion write speed all = 0.469207810 MB/sec (with seq num) write speed all = 0.452514139 MB/sec (without seq num) 2024/11/23-16:07:51.897197 139957651584576 [compaction_job.cc:1948] [default] [JOB 30212] Generated table #268521: 129431 keys, 42094453 bytes, temperature: kWarm 2024/11/23-16:07:51.897261 139957651584576 EVENT_LOG_v1 {"time_micros": 1732349271897230, "cf_name": "default", "job": 30212, "event": "table_file_creation", "file_number": 268521, "file_size": 42094453, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4095531225, "table_properties": {"data_size": 40329056, "index_size": 220544, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588620, "raw_average_key_size": 20, "raw_value_size": 131629192, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129431, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732349270, "oldest_key_time": 0, "file_creation_time": 1732349270, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 268521, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:07:51.936073 139957651584576 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268522.sst) /dev/shm/ToplingTemp/Topling-107622-HFw234 2024/11/23-16:07:52.776171 139957651584576 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268522.sst): first pass time = 0.84's, 159.773'MB/sec 2024/11/23-16:07:53.619531 139957651584576 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268522.sst): old prealloc_size = 147639500, real_size = 40984848 2024/11/23-16:07:53.619653 139957651584576 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268522.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129428 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.73 raw-val = 0.1316 GB zip-val = 0.0407 GB avg-val =1017.01 avg-zval = 314.68 2024/11/23-16:07:53.619802 139957651584576 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268522.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:07:53.782360 139957651584576 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268522.sst): second pass time = 0.84's, 156.227'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 262.759'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2322.095'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.273'MB/sec write SST data time = 0.04's, 965.393'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 29029.262'MB/sec zip my value time = 0.84's, unzip length = 0.132'GB zip my value throughput = 156.227'MB/sec zip pipeline throughput = 156.227'MB/sec entries = 129428 avg-key = 20.00 avg-zkey = 1.73 avg-val = 1017.01 avg-zval = 314.68 usrkeys = 129428 avg-key = 12.00 avg-zkey = 1.73 avg-val = 1023.17 avg-zval = 314.68 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 113963 bytes = 427376 } seq expand size = 797741 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0407 GB dict = 1.38 MB all = 0.0428 GB } UnZip/Zip{ index = 6.9535 value = 3.2318 dict = 1.00 all = 3.1374 } Zip/UnZip{ index = 0.1438 value = 0.3094 dict = 1.00 all = 0.3187 } ---------------------------- total value len = 10.835828 GB avg = 0.200 KB (by entry num) total key len = 1.479650 GB avg = 0.027 KB total ukey len = 1.021176 GB avg = 0.015 KB total ukey num = 0.067491893 Billion total entry num = 0.054299622 Billion write speed all = 0.474373434 MB/sec (with seq num) write speed all = 0.457641125 MB/sec (without seq num) 2024/11/23-16:07:53.834051 139957651584576 [compaction_job.cc:1948] [default] [JOB 30212] Generated table #268522: 129428 keys, 42779851 bytes, temperature: kWarm 2024/11/23-16:07:53.834118 139957651584576 EVENT_LOG_v1 {"time_micros": 1732349273834084, "cf_name": "default", "job": 30212, "event": "table_file_creation", "file_number": 268522, "file_size": 42779851, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4095526054, "table_properties": {"data_size": 40728960, "index_size": 223360, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588560, "raw_average_key_size": 20, "raw_value_size": 131629646, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129428, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732349271, "oldest_key_time": 0, "file_creation_time": 1732349271, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 268522, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:07:53.873942 139957651584576 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268523.sst) /dev/shm/ToplingTemp/Topling-107622-mLW4h3 2024/11/23-16:07:54.486971 139957651584576 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268523.sst): first pass time = 0.61's, 218.963'MB/sec 2024/11/23-16:07:55.319244 139957651584576 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268523.sst): old prealloc_size = 147639500, real_size = 40906624 2024/11/23-16:07:55.319381 139957651584576 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268523.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129427 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.72 raw-val = 0.1316 GB zip-val = 0.0407 GB avg-val =1017.02 avg-zval = 314.09 2024/11/23-16:07:55.319512 139957651584576 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268523.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:07:55.480106 139957651584576 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268523.sst): second pass time = 0.83's, 158.402'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 265.001'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1943.314'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.275'MB/sec write SST data time = 0.04's, 985.539'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 42380.071'MB/sec zip my value time = 0.83's, unzip length = 0.132'GB zip my value throughput = 158.402'MB/sec zip pipeline throughput = 158.402'MB/sec entries = 129427 avg-key = 20.00 avg-zkey = 1.72 avg-val = 1017.02 avg-zval = 314.09 usrkeys = 129427 avg-key = 12.00 avg-zkey = 1.72 avg-val = 1022.05 avg-zval = 314.09 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 93007 bytes = 348784 } seq expand size = 651049 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0407 GB dict = 1.38 MB all = 0.0426 GB } UnZip/Zip{ index = 6.9935 value = 3.2380 dict = 1.00 all = 3.1490 } Zip/UnZip{ index = 0.1430 value = 0.3088 dict = 1.00 all = 0.3176 } ---------------------------- total value len = 10.968108 GB avg = 0.202 KB (by entry num) total key len = 1.482239 GB avg = 0.027 KB total ukey len = 1.022729 GB avg = 0.015 KB total ukey num = 0.067621320 Billion total entry num = 0.054429049 Billion write speed all = 0.479537032 MB/sec (with seq num) write speed all = 0.462765937 MB/sec (without seq num) 2024/11/23-16:07:55.534516 139957651584576 [compaction_job.cc:1948] [default] [JOB 30212] Generated table #268523: 129427 keys, 42623107 bytes, temperature: kWarm 2024/11/23-16:07:55.534583 139957651584576 EVENT_LOG_v1 {"time_micros": 1732349275534549, "cf_name": "default", "job": 30212, "event": "table_file_creation", "file_number": 268523, "file_size": 42623107, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4095536415, "table_properties": {"data_size": 40652016, "index_size": 222080, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588540, "raw_average_key_size": 20, "raw_value_size": 131629629, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129427, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732349273, "oldest_key_time": 0, "file_creation_time": 1732349273, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 268523, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:07:55.579996 139957651584576 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268524.sst) /dev/shm/ToplingTemp/Topling-107622-ueMx45 2024/11/23-16:07:56.338638 139957651584576 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268524.sst): first pass time = 0.76's, 176.928'MB/sec 2024/11/23-16:07:57.243821 139957651584576 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268524.sst): old prealloc_size = 147639500, real_size = 40751360 2024/11/23-16:07:57.243963 139957651584576 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268524.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129429 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.77 raw-val = 0.1316 GB zip-val = 0.0405 GB avg-val =1017.00 avg-zval = 312.83 2024/11/23-16:07:57.244120 139957651584576 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268524.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:07:57.405838 139957651584576 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268524.sst): second pass time = 0.90's, 145.690'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 262.460'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1957.347'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.271'MB/sec write SST data time = 0.04's, 999.624'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 49016.079'MB/sec zip my value time = 0.90's, unzip length = 0.132'GB zip my value throughput = 145.690'MB/sec zip pipeline throughput = 145.690'MB/sec entries = 129429 avg-key = 20.00 avg-zkey = 1.77 avg-val = 1017.00 avg-zval = 312.83 usrkeys = 129429 avg-key = 12.00 avg-zkey = 1.77 avg-val = 1022.74 avg-zval = 312.83 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 106152 bytes = 398080 } seq expand size = 743064 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0405 GB dict = 1.38 MB all = 0.0425 GB } UnZip/Zip{ index = 6.7825 value = 3.2509 dict = 1.00 all = 3.1568 } Zip/UnZip{ index = 0.1474 value = 0.3076 dict = 1.00 all = 0.3168 } ---------------------------- total value len = 11.100481 GB avg = 0.203 KB (by entry num) total key len = 1.484827 GB avg = 0.027 KB total ukey len = 1.024282 GB avg = 0.015 KB total ukey num = 0.067750749 Billion total entry num = 0.054558478 Billion write speed all = 0.484699247 MB/sec (with seq num) write speed all = 0.467889518 MB/sec (without seq num) 2024/11/23-16:07:57.457333 139957651584576 [compaction_job.cc:1948] [default] [JOB 30212] Generated table #268524: 129429 keys, 42517154 bytes, temperature: kWarm 2024/11/23-16:07:57.457403 139957651584576 EVENT_LOG_v1 {"time_micros": 1732349277457367, "cf_name": "default", "job": 30212, "event": "table_file_creation", "file_number": 268524, "file_size": 42517154, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4095530182, "table_properties": {"data_size": 40489840, "index_size": 228992, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588580, "raw_average_key_size": 20, "raw_value_size": 131629729, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129429, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732349275, "oldest_key_time": 0, "file_creation_time": 1732349275, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 268524, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:07:57.497828 139957651584576 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268525.sst) /dev/shm/ToplingTemp/Topling-107622-usrJ15 2024/11/23-16:07:58.211488 139957651584576 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268525.sst): first pass time = 0.71's, 188.079'MB/sec 2024/11/23-16:07:59.005463 139957651584576 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268525.sst): old prealloc_size = 147639500, real_size = 40460912 2024/11/23-16:07:59.005586 139957651584576 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268525.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129430 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.72 raw-val = 0.1316 GB zip-val = 0.0402 GB avg-val =1016.99 avg-zval = 310.64 2024/11/23-16:07:59.005667 139957651584576 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268525.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:07:59.166069 139957651584576 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268525.sst): second pass time = 0.79's, 165.910'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 261.158'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2122.669'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.275'MB/sec write SST data time = 0.04's, 979.994'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 49454.914'MB/sec zip my value time = 0.79's, unzip length = 0.132'GB zip my value throughput = 165.910'MB/sec zip pipeline throughput = 165.910'MB/sec entries = 129430 avg-key = 20.00 avg-zkey = 1.72 avg-val = 1016.99 avg-zval = 310.64 usrkeys = 129430 avg-key = 12.00 avg-zkey = 1.72 avg-val = 1018.56 avg-zval = 310.64 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 29062 bytes = 108992 } seq expand size = 203434 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0402 GB dict = 1.38 MB all = 0.0419 GB } UnZip/Zip{ index = 6.9937 value = 3.2738 dict = 1.00 all = 3.2004 } Zip/UnZip{ index = 0.1430 value = 0.3055 dict = 1.00 all = 0.3125 } ---------------------------- total value len = 11.232314 GB avg = 0.205 KB (by entry num) total key len = 1.487416 GB avg = 0.027 KB total ukey len = 1.025835 GB avg = 0.015 KB total ukey num = 0.067880179 Billion total entry num = 0.054687908 Billion write speed all = 0.489843026 MB/sec (with seq num) write speed all = 0.472994561 MB/sec (without seq num) 2024/11/23-16:07:59.217218 139957651584576 [compaction_job.cc:1948] [default] [JOB 30212] Generated table #268525: 129430 keys, 41937330 bytes, temperature: kWarm 2024/11/23-16:07:59.217286 139957651584576 EVENT_LOG_v1 {"time_micros": 1732349279217253, "cf_name": "default", "job": 30212, "event": "table_file_creation", "file_number": 268525, "file_size": 41937330, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4095538280, "table_properties": {"data_size": 40206304, "index_size": 222080, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588600, "raw_average_key_size": 20, "raw_value_size": 131629401, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129430, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732349277, "oldest_key_time": 0, "file_creation_time": 1732349277, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 268525, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:07:59.257884 139957651584576 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268526.sst) /dev/shm/ToplingTemp/Topling-107622-H01Rq2 2024/11/23-16:07:59.763822 139957651584576 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268526.sst): first pass time = 0.51's, 265.307'MB/sec 2024/11/23-16:08:00.796289 139957651584576 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268526.sst): old prealloc_size = 147639500, real_size = 40592480 2024/11/23-16:08:00.796411 139957651584576 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268526.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129426 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.72 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1017.03 avg-zval = 311.67 2024/11/23-16:08:00.796493 139957651584576 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268526.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:08:00.956043 139957651584576 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268526.sst): second pass time = 1.03's, 127.581'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 263.395'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2403.333'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.275'MB/sec write SST data time = 0.04's, 1002.325'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 35761.224'MB/sec zip my value time = 1.03's, unzip length = 0.132'GB zip my value throughput = 127.581'MB/sec zip pipeline throughput = 203.715'MB/sec entries = 129426 avg-key = 20.00 avg-zkey = 1.72 avg-val = 1017.03 avg-zval = 311.67 usrkeys = 129426 avg-key = 12.00 avg-zkey = 1.72 avg-val = 1018.58 avg-zval = 311.67 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 28720 bytes = 107712 } seq expand size = 201040 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0421 GB } UnZip/Zip{ index = 6.9935 value = 3.2632 dict = 1.00 all = 3.1905 } Zip/UnZip{ index = 0.1430 value = 0.3064 dict = 1.00 all = 0.3134 } ---------------------------- total value len = 11.364145 GB avg = 0.207 KB (by entry num) total key len = 1.490004 GB avg = 0.027 KB total ukey len = 1.027388 GB avg = 0.015 KB total ukey num = 0.068009605 Billion total entry num = 0.054817334 Billion write speed all = 0.494985462 MB/sec (with seq num) write speed all = 0.478098287 MB/sec (without seq num) 2024/11/23-16:08:01.011610 139957651584576 [compaction_job.cc:1948] [default] [JOB 30212] Generated table #268526: 129426 keys, 42067878 bytes, temperature: kWarm 2024/11/23-16:08:01.011672 139957651584576 EVENT_LOG_v1 {"time_micros": 1732349281011638, "cf_name": "default", "job": 30212, "event": "table_file_creation", "file_number": 268526, "file_size": 42067878, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4095532026, "table_properties": {"data_size": 40337872, "index_size": 222080, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588520, "raw_average_key_size": 20, "raw_value_size": 131629835, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129426, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732349279, "oldest_key_time": 0, "file_creation_time": 1732349279, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 268526, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:08:01.049281 139957651584576 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268527.sst) /dev/shm/ToplingTemp/Topling-107622-DdqgW5 2024/11/23-16:08:01.541372 139957651584576 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268527.sst): first pass time = 0.49's, 272.774'MB/sec 2024/11/23-16:08:02.350940 139957651584576 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268527.sst): old prealloc_size = 147639500, real_size = 40456576 2024/11/23-16:08:02.351070 139957651584576 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268527.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129430 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.72 raw-val = 0.1316 GB zip-val = 0.0402 GB avg-val =1016.99 avg-zval = 310.61 2024/11/23-16:08:02.351163 139957651584576 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268527.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:08:02.513153 139957651584576 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268527.sst): second pass time = 0.81's, 162.858'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 258.522'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2023.821'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.274'MB/sec write SST data time = 0.04's, 954.292'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 45914.092'MB/sec zip my value time = 0.81's, unzip length = 0.132'GB zip my value throughput = 162.858'MB/sec zip pipeline throughput = 162.858'MB/sec entries = 129430 avg-key = 20.00 avg-zkey = 1.72 avg-val = 1016.99 avg-zval = 310.61 usrkeys = 129430 avg-key = 12.00 avg-zkey = 1.72 avg-val = 1018.51 avg-zval = 310.61 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 28021 bytes = 105088 } seq expand size = 196147 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0402 GB dict = 1.38 MB all = 0.0419 GB } UnZip/Zip{ index = 6.9937 value = 3.2742 dict = 1.00 all = 3.2011 } Zip/UnZip{ index = 0.1430 value = 0.3054 dict = 1.00 all = 0.3124 } ---------------------------- total value len = 11.495971 GB avg = 0.209 KB (by entry num) total key len = 1.492593 GB avg = 0.027 KB total ukey len = 1.028941 GB avg = 0.015 KB total ukey num = 0.068139035 Billion total entry num = 0.054946764 Billion write speed all = 0.500131471 MB/sec (with seq num) write speed all = 0.483205438 MB/sec (without seq num) 2024/11/23-16:08:02.574208 139957651584576 [compaction_job.cc:1948] [default] [JOB 30212] Generated table #268527: 129430 keys, 41929195 bytes, temperature: kWarm 2024/11/23-16:08:02.574278 139957651584576 EVENT_LOG_v1 {"time_micros": 1732349282574242, "cf_name": "default", "job": 30212, "event": "table_file_creation", "file_number": 268527, "file_size": 41929195, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4095526858, "table_properties": {"data_size": 40201968, "index_size": 222080, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588600, "raw_average_key_size": 20, "raw_value_size": 131629388, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129430, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732349281, "oldest_key_time": 0, "file_creation_time": 1732349281, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 268527, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:08:02.616058 139957651584576 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268528.sst) /dev/shm/ToplingTemp/Topling-107622-nmH7z4 2024/11/23-16:08:03.296614 139957651584576 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268528.sst): first pass time = 0.68's, 197.232'MB/sec 2024/11/23-16:08:04.098234 139957651584576 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268528.sst): old prealloc_size = 147639500, real_size = 40790672 2024/11/23-16:08:04.098374 139957651584576 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268528.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129428 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.72 raw-val = 0.1316 GB zip-val = 0.0405 GB avg-val =1017.01 avg-zval = 313.19 2024/11/23-16:08:04.098502 139957651584576 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268528.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:08:04.344155 139957651584576 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268528.sst): second pass time = 0.80's, 164.328'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.25's, 172.763'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1910.366'MB/sec (index lex order gen) rebuild zvType time = 0.18's, 0.178'MB/sec write SST data time = 0.06's, 666.790'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 46059.195'MB/sec zip my value time = 0.80's, unzip length = 0.132'GB zip my value throughput = 164.328'MB/sec zip pipeline throughput = 164.328'MB/sec entries = 129428 avg-key = 20.00 avg-zkey = 1.72 avg-val = 1017.01 avg-zval = 313.19 usrkeys = 129428 avg-key = 12.00 avg-zkey = 1.72 avg-val = 1021.63 avg-zval = 313.19 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 85333 bytes = 320016 } seq expand size = 597331 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0405 GB dict = 1.38 MB all = 0.0425 GB } UnZip/Zip{ index = 6.9936 value = 3.2472 dict = 1.00 all = 3.1597 } Zip/UnZip{ index = 0.1430 value = 0.3080 dict = 1.00 all = 0.3165 } ---------------------------- total value len = 11.628198 GB avg = 0.211 KB (by entry num) total key len = 1.495182 GB avg = 0.027 KB total ukey len = 1.030494 GB avg = 0.015 KB total ukey num = 0.068268463 Billion total entry num = 0.055076192 Billion write speed all = 0.505286994 MB/sec (with seq num) write speed all = 0.488322288 MB/sec (without seq num) 2024/11/23-16:08:04.406044 139957651584576 [compaction_job.cc:1948] [default] [JOB 30212] Generated table #268528: 129428 keys, 42478350 bytes, temperature: kWarm 2024/11/23-16:08:04.406132 139957651584576 EVENT_LOG_v1 {"time_micros": 1732349284406084, "cf_name": "default", "job": 30212, "event": "table_file_creation", "file_number": 268528, "file_size": 42478350, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4095539889, "table_properties": {"data_size": 40536064, "index_size": 222080, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588560, "raw_average_key_size": 20, "raw_value_size": 131629766, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129428, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732349282, "oldest_key_time": 0, "file_creation_time": 1732349282, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 268528, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:08:04.460334 139957651584576 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268529.sst) /dev/shm/ToplingTemp/Topling-107622-z2chN4 2024/11/23-16:08:04.472143 139957651584576 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268529.sst): first pass time = 0.01's, 261.818'MB/sec 2024/11/23-16:08:04.503775 139957651584576 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268529.sst): old prealloc_size = 147639500, real_size = 975096 2024/11/23-16:08:04.503832 139957651584576 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268529.sst): index type = UintIndex_AllOne , store type = DictZipBlobStore usrkeys = 2969 prefix = 4 raw-key = 0.0000 GB zip-key = 0.0000 GB avg-key = 8.00 avg-zkey = 0.06 raw-val = 0.0030 GB zip-val = 0.0010 GB avg-val =1016.93 avg-zval = 328.06 2024/11/23-16:08:04.509272 139957651584576 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00/268529.sst): second pass time = 0.03's, 97.293'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.01's, 186.311'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 5.462'MB/sec (index lex order gen) rebuild zvType time = 0.00's, 0.206'MB/sec write SST data time = 0.00's, 559.408'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.033'MB, throughput = 1245.681'MB/sec zip my value time = 0.03's, unzip length = 0.003'GB zip my value throughput = 97.293'MB/sec zip pipeline throughput = 97.293'MB/sec entries = 2969 avg-key = 20.00 avg-zkey = 0.06 avg-val = 1016.93 avg-zval = 328.06 usrkeys = 2969 avg-key = 12.00 avg-zkey = 0.06 avg-val = 1023.14 avg-zval = 328.06 TagRS{ kinds = RS_Key0_TagN bytes = 560 } TagArray{ size = 2632 bytes = 9888 } seq expand size = 18424 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0000 GB value = 0.0030 GB dict = 0.03 MB all = 0.0031 GB } __ZipSize{ index = 0.0000 GB value = 0.0010 GB dict = 0.03 MB all = 0.0010 GB } UnZip/Zip{ index = 185.5625 value = 3.0998 dict = 1.00 all = 3.0231 } Zip/UnZip{ index = 0.0054 value = 0.3226 dict = 1.00 all = 0.3308 } ---------------------------- total value len = 11.631235 GB avg = 0.211 KB (by entry num) total key len = 1.495241 GB avg = 0.027 KB total ukey len = 1.030530 GB avg = 0.015 KB total ukey num = 0.068271432 Billion total entry num = 0.055079161 Billion write speed all = 0.505403027 MB/sec (with seq num) write speed all = 0.488437515 MB/sec (without seq num) 2024/11/23-16:08:04.518152 139957651584576 [compaction_job.cc:1948] [default] [JOB 30212] Generated table #268529: 2969 keys, 1018370 bytes, temperature: kWarm 2024/11/23-16:08:04.518225 139957651584576 EVENT_LOG_v1 {"time_micros": 1732349284518179, "cf_name": "default", "job": 30212, "event": "table_file_creation", "file_number": 268529, "file_size": 1018370, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4095539891, "table_properties": {"data_size": 974016, "index_size": 192, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 59380, "raw_average_key_size": 20, "raw_value_size": 3019274, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 2969, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-UintIndex_AllOne-DictZipBlobStore", "creation_time": 1732349284, "oldest_key_time": 0, "file_creation_time": 1732349284, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 268529, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:08:04.529193 139957651584576 [compaction_job.cc:703] job-30212: subcompact[0], size: 0.893172 G, files: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30212/att-00 [268508,268509,268510,268511,268512,268513,268514,268515,268516,268517,268518,268519,268520,268521,268522,268523,268524,268525,268526,268527,268528,268529] 2024/11/23-16:08:04.673873 139957651584576 (Original Log Time 2024/11/23-16:07:26.720659) EVENT_LOG_v1 {"time_micros": 1732349246720617, "job": 30212, "event": "compaction_started", "compaction_reason": "FilesMarkedForCompaction", "files_L2": [268484], "files_L3": [268401, 268402, 268403, 268404, 268405, 268406, 268407, 268408, 268409, 268410, 268411, 268412, 268413, 268414, 268415, 268416, 268417, 268418, 268419, 268420, 268495], "score": 0.994461, "input_data_size": 924873752, "oldest_snapshot_seqno": 4095673230} 2024/11/23-16:08:04.673877 139957651584576 (Original Log Time 2024/11/23-16:08:04.671957) [compaction_job.cc:2022] [default] [JOB 30212] Compacted 1@2 + 21@3 files to L3 => 893172160 bytes 2024/11/23-16:08:04.673879 139957651584576 (Original Log Time 2024/11/23-16:08:04.673799) [compaction_job.cc:1224] [default] compacted to: files[0 0 0 22 0 0 0] max score 0.03, MB/sec: 24.5 rd, 23.6 wr, level 3, files in(1, 21) out(22 +0 blob) MB in(31.2, 850.8 +0.0 blob) out(851.8 +0.0 blob), read-write-amplify(55.6) write-amplify(27.3) OK, records in: 2749937, records dropped: 28940 output_compression: Snappy 2024/11/23-16:08:04.673883 139957651584576 (Original Log Time 2024/11/23-16:08:04.673847) EVENT_LOG_v1 {"time_micros": 1732349284673823, "cf": "default", "job": 30212, "event": "compaction_finished", "compaction_time_micros": 37808541, "compaction_time_cpu_micros": 8019800, "output_level": 3, "num_output_files": 22, "total_output_size": 893172160, "num_input_records": 2749937, "num_output_records": 2720997, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "file_write_nanos": 621521144, "file_range_sync_nanos": 0, "file_fsync_nanos": 15704, "file_prepare_write_nanos": 44635, "lsm_state": [0, 0, 0, 22, 0, 0, 0]} 2024/11/23-16:08:04.820120 139957651584576 DEBG dcompact_worker.cpp:240: HttpPost: 200 OK: url = http://nlb-7zny4kaa1poal01o64.cn-shenzhen.nlb.aliyuncs.com:8443, body = {"instanceId":"nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137","labourId":"","dbId":"d89b4006-2803-486e-b7a2-759bcf348921","dbStarts":1732256054,"starts":1732349246,"executesMs":38102,"compactionJobId":30212,"attempt":0,"compactionInputRawBytes":2851672407,"compactionInputZipBytes":924873752,"compactionOutputRawBytes":0,"compactionOutputZipBytes":893172160,"headers":{"Accept":"*/*","Connection":"close","Host":"aliyun-topling-saas.topling.cn:18443","RemoteIp":"120.24.192.169","X-Forwarded-For":"120.24.192.169","region":"cn-shenzhen","token":"e6474c481bd4415abc537135cc03626b","instance-token":"e6474c481bd4415abc537135cc03626b","provider":"aliyun","CloudMarketInstanceId":"si-59c0ae5c955845588903","MeteringAssit":"","Transfer-Encoding":"chunked","traceparent":"00-3b4a1b058e671fb100df7187368de1ae-8b7214c1b3a91f60-00"}}, response = 2024/11/23-16:08:04.820210 139957651584576 INFO dcompact_worker.cpp:1459: finish /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-30212/att-00: olev 3, work 38.102 s, result 7.901 ms, install 1.943 ms, input{raw 2.656 GiB zip 882.028 MiB}