2024/11/23-16:34:46.442877 139957223556672 DEBG dcompact_worker.cpp:2214: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00: fork to child time = 0.027975 sec 2024/11/23-16:34:46.443838 139957223556672 DEBG dcompact_worker.cpp:1013: Beg SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00 2024/11/23-16:34:46.452230 139957223556672 DEBG dcompact_worker.cpp:1033: End SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00 2024/11/23-16:34:46.453463 139957223556672 TRAC dcompact_worker.cpp:1083: INFO_LOG_LEVEL: rpc = INFO_LEVEL, env_var = undefined 2024/11/23-16:34:46.453822 139957223556672 [WARN] [column_family.cc:386] multiple cf_paths/db_paths and level_compaction_dynamic_level_bytes can't be used together 2024/11/23-16:34:46.512445 139957223556672 [version_set.cc:6208] Recovering from manifest file: /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-30816/att-00/MANIFEST-206347 2024/11/23-16:34:46.545926 139957223556672 [version_set.cc:6251] Recovered from manifest file:/worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-30816/att-00/MANIFEST-206347 succeeded,manifest_file_number is 206347, next_file_number is 269829, last_sequence is 4113842015, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 269669 2024/11/23-16:34:46.545944 139957223556672 [version_set.cc:6266] Column family [default] (ID 0), log number is 0 2024/11/23-16:34:46.546168 139957223556672 [version_set.cc:5721] Creating manifest 269829 2024/11/23-16:34:46.582720 139957223556672 DEBG dcompact_worker.cpp:1218: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00: bottommost_level: fake = 1, rpc = 0 2024/11/23-16:34:46.611706 139957223556672 [compaction_job.cc:2437] [default] [JOB 30816] Compacting 1@2 + 22@3 files to L3, score 1.00, subcompactions 1 : 1 2024/11/23-16:34:46.611741 139957223556672 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 23038 Base level 2, inputs: [269806(27MB)], [269826(39MB) 269827(4653KB) 269756(36MB) 269757(35MB) 269758(33MB) 269759(32MB) 269760(33MB) 269761(34MB) 269762(38MB) 269763(35MB) 269764(34MB) 269765(33MB) 269766(35MB) 269767(35MB) 269768(36MB) 269769(34MB) 269770(35MB) 269771(36MB) 269772(37MB) 269773(38MB) 269774(37MB) 269776(36MB)] 2024/11/23-16:34:46.620549 139957223556672 [top_zip_table.cc:59] core git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-16:34:46.620590 139957223556672 [top_zip_table.cc:60] fsa git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-16:34:46.620618 139957223556672 [top_zip_table.cc:61] zbs git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-16:34:46.620627 139957223556672 [top_zip_table.cc:62] topling-zip_table_reader: git_version_hash_info_is: commit a4a382006cb82713acf5b3425835f22711877681 Author: leipeng Date: 2024-04-11 19:44:14 +0800 fixed_len_hole_index.cc: Add env bool FixedLenHoleIndexUseAVX512 for ut & debug 1. FixedLenHoleIndexUseAVX512 is only in unit tests or debug 2. In release mode, use avx512 by compile options(-march=) g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/23-16:34:46.620644 139957223556672 [top_zip_table.cc:64] topling-rocks git_version_hash_info_is: commit feab587e468621ba0204d47b4ffacc52e7c4290d Author: leipeng Date: 2024-03-22 13:35:06 +0800 ToplingZipTableBuilder::Add: immediately return after error This function returns void, and caller does not check builder->status() after calling this function and graceful abandon. So immediately return after error, and return error status in Finish(). g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/23-16:34:47.377159 139957223556672 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269830.sst) /dev/shm/ToplingTemp/Topling-116304-acaA9x 2024/11/23-16:34:47.952608 139957223556672 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269830.sst): first pass time = 0.58's, 233.257'MB/sec 2024/11/23-16:34:49.662474 139957223556672 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269830.sst): old prealloc_size = 147639500, real_size = 37078576 2024/11/23-16:34:49.663011 139957223556672 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269830.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 930604 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0351 GB avg-val = 116.23 avg-zval = 37.69 2024/11/23-16:34:49.663811 139957223556672 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269830.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:34:50.673823 139957223556672 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269830.sst): second pass time = 1.71's, 63.288'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.01's, 40.844'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3414.744'MB/sec (index lex order gen) rebuild zvType time = 0.88's, 0.265'MB/sec write SST data time = 0.13's, 309.168'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 36830.270'MB/sec zip my value time = 1.71's, unzip length = 0.108'GB zip my value throughput = 63.288'MB/sec zip pipeline throughput = 63.288'MB/sec entries = 930604 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.23 avg-zval = 37.69 usrkeys = 930604 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.23 avg-zval = 37.69 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 930604 bytes = 3373456 } seq expand size = 6514228 multi value expand size = 0 cnt WriteAppend = 15 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0351 GB dict = 1.08 MB all = 0.0413 GB } UnZip/Zip{ index = 10.5143 value = 3.0837 dict = 1.00 all = 3.2493 } Zip/UnZip{ index = 0.0951 value = 0.3243 dict = 1.00 all = 0.3078 } ---------------------------- total value len = 8.963295 GB avg = 0.168 KB (by entry num) total key len = 1.466878 GB avg = 0.028 KB total ukey len = 1.016490 GB avg = 0.015 KB total ukey num = 0.066481039 Billion total entry num = 0.053288768 Billion write speed all = 0.378199987 MB/sec (with seq num) write speed all = 0.362741903 MB/sec (without seq num) 2024/11/23-16:34:50.735085 139957223556672 [compaction_job.cc:1948] [default] [JOB 30816] Generated table #269830: 930604 keys, 41307094 bytes, temperature: kWarm 2024/11/23-16:34:50.735182 139957223556672 EVENT_LOG_v1 {"time_micros": 1732350890735115, "cf_name": "default", "job": 30816, "event": "table_file_creation", "file_number": 269830, "file_size": 41307094, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3583362754, "largest_seqno": 4113714925, "table_properties": {"data_size": 35075552, "index_size": 1770176, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26056912, "raw_average_key_size": 28, "raw_value_size": 108160888, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 930604, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732350887, "oldest_key_time": 0, "file_creation_time": 1732350887, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 269830, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:34:50.779811 139957223556672 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269831.sst) /dev/shm/ToplingTemp/Topling-116304-6LLtKA 2024/11/23-16:34:51.789472 139957223556672 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269831.sst): first pass time = 1.01's, 132.938'MB/sec 2024/11/23-16:34:53.409082 139957223556672 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269831.sst): old prealloc_size = 147639500, real_size = 36508208 2024/11/23-16:34:53.409759 139957223556672 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269831.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 931965 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1081 GB zip-val = 0.0345 GB avg-val = 116.02 avg-zval = 37.02 2024/11/23-16:34:53.410404 139957223556672 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269831.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:34:54.309403 139957223556672 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269831.sst): second pass time = 1.62's, 66.792'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.90's, 43.954'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2708.350'MB/sec (index lex order gen) rebuild zvType time = 0.74's, 0.313'MB/sec write SST data time = 0.16's, 254.309'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 32282.299'MB/sec zip my value time = 1.62's, unzip length = 0.108'GB zip my value throughput = 66.792'MB/sec zip pipeline throughput = 66.792'MB/sec entries = 931965 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.02 avg-zval = 37.02 usrkeys = 931965 avg-key = 20.00 avg-zkey = 1.90 avg-val = 120.29 avg-zval = 37.02 TagRS{ kinds = RS_Key0_TagN bytes = 145720 } TagArray{ size = 569319 bytes = 2063792 } seq expand size = 3985233 multi value expand size = 0 cnt WriteAppend = 15 UnZipSize{ index = 0.0186 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0345 GB dict = 1.08 MB all = 0.0396 GB } UnZip/Zip{ index = 10.5148 value = 3.1338 dict = 1.00 all = 3.3917 } Zip/UnZip{ index = 0.0951 value = 0.3191 dict = 1.00 all = 0.2948 } ---------------------------- total value len = 9.075403 GB avg = 0.167 KB (by entry num) total key len = 1.492973 GB avg = 0.028 KB total ukey len = 1.035129 GB avg = 0.015 KB total ukey num = 0.067413004 Billion total entry num = 0.054220733 Billion write speed all = 0.383160742 MB/sec (with seq num) write speed all = 0.367434385 MB/sec (without seq num) 2024/11/23-16:34:54.358319 139957223556672 [compaction_job.cc:1948] [default] [JOB 30816] Generated table #269831: 931965 keys, 39571840 bytes, temperature: kWarm 2024/11/23-16:34:54.358388 139957223556672 EVENT_LOG_v1 {"time_micros": 1732350894358353, "cf_name": "default", "job": 30816, "event": "table_file_creation", "file_number": 269831, "file_size": 39571840, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4012776165, "table_properties": {"data_size": 34502368, "index_size": 1772672, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26095020, "raw_average_key_size": 28, "raw_value_size": 108122726, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 931965, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732350890, "oldest_key_time": 0, "file_creation_time": 1732350890, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 269831, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:34:54.395170 139957223556672 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269832.sst) /dev/shm/ToplingTemp/Topling-116304-8zGPJA 2024/11/23-16:34:55.518550 139957223556672 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269832.sst): first pass time = 1.12's, 119.481'MB/sec 2024/11/23-16:34:57.092842 139957223556672 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269832.sst): old prealloc_size = 147639500, real_size = 35358672 2024/11/23-16:34:57.093652 139957223556672 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269832.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 1081160 prefix = 4 raw-key = 0.0173 GB zip-key = 0.0021 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1039 GB zip-val = 0.0330 GB avg-val = 96.14 avg-zval = 30.54 2024/11/23-16:34:57.093874 139957223556672 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269832.sst: sumWaitingMem = 0.003 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0028 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:34:57.861096 139957223556672 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269832.sst): second pass time = 1.57's, 66.067'MB/sec, value only(77.4% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.77's, 47.470'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2632.851'MB/sec (index lex order gen) rebuild zvType time = 0.60's, 0.453'MB/sec write SST data time = 0.17's, 213.980'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.034'MB, throughput = 35869.938'MB/sec zip my value time = 1.57's, unzip length = 0.104'GB zip my value throughput = 66.067'MB/sec zip pipeline throughput = 66.067'MB/sec entries = 1081160 avg-key = 28.00 avg-zkey = 1.91 avg-val = 96.14 avg-zval = 30.54 usrkeys = 1081160 avg-key = 20.00 avg-zkey = 1.91 avg-val = 96.50 avg-zval = 30.54 TagRS{ kinds = RS_Key0_TagN bytes = 169040 } TagArray{ size = 55403 bytes = 166224 } seq expand size = 387821 multi value expand size = 0 cnt WriteAppend = 16 UnZipSize{ index = 0.0216 GB value = 0.1039 GB dict = 1.03 MB all = 0.1342 GB } __ZipSize{ index = 0.0021 GB value = 0.0330 GB dict = 1.03 MB all = 0.0365 GB } UnZip/Zip{ index = 10.4469 value = 3.1481 dict = 1.00 all = 3.6804 } Zip/UnZip{ index = 0.0957 value = 0.3177 dict = 1.00 all = 0.2717 } ---------------------------- total value len = 9.179736 GB avg = 0.166 KB (by entry num) total key len = 1.523245 GB avg = 0.028 KB total ukey len = 1.056753 GB avg = 0.015 KB total ukey num = 0.068494164 Billion total entry num = 0.055301893 Billion write speed all = 0.387990961 MB/sec (with seq num) write speed all = 0.371953086 MB/sec (without seq num) 2024/11/23-16:34:57.908336 139957223556672 [compaction_job.cc:1948] [default] [JOB 30816] Generated table #269832: 1081160 keys, 36468239 bytes, temperature: kWarm 2024/11/23-16:34:57.908410 139957223556672 EVENT_LOG_v1 {"time_micros": 1732350897908373, "cf_name": "default", "job": 30816, "event": "table_file_creation", "file_number": 269832, "file_size": 36468239, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3284168344, "table_properties": {"data_size": 33018368, "index_size": 2069824, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 30272480, "raw_average_key_size": 28, "raw_value_size": 103945297, "raw_average_value_size": 96, "num_data_blocks": 1, "num_entries": 1081160, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732350894, "oldest_key_time": 0, "file_creation_time": 1732350894, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 269832, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:34:57.944164 139957223556672 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269833.sst) /dev/shm/ToplingTemp/Topling-116304-nL4GPy 2024/11/23-16:34:59.103843 139957223556672 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269833.sst): first pass time = 1.16's, 115.741'MB/sec 2024/11/23-16:35:00.501624 139957223556672 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269833.sst): old prealloc_size = 147639500, real_size = 30485264 2024/11/23-16:35:00.502326 139957223556672 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269833.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 928485 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1082 GB zip-val = 0.0285 GB avg-val = 116.56 avg-zval = 30.67 2024/11/23-16:35:00.503262 139957223556672 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269833.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:35:01.447577 139957223556672 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269833.sst): second pass time = 1.40's, 77.511'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.95's, 36.809'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2609.197'MB/sec (index lex order gen) rebuild zvType time = 0.79's, 0.294'MB/sec write SST data time = 0.16's, 223.910'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 34831.887'MB/sec zip my value time = 1.40's, unzip length = 0.108'GB zip my value throughput = 77.511'MB/sec zip pipeline throughput = 77.511'MB/sec entries = 928485 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.56 avg-zval = 30.67 usrkeys = 928485 avg-key = 20.00 avg-zkey = 1.91 avg-val = 123.56 avg-zval = 30.67 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 928485 bytes = 3481840 } seq expand size = 6499395 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0285 GB dict = 1.08 MB all = 0.0348 GB } UnZip/Zip{ index = 10.4461 value = 3.8005 dict = 1.00 all = 3.8548 } Zip/UnZip{ index = 0.0957 value = 0.2631 dict = 1.00 all = 0.2594 } ---------------------------- total value len = 9.294456 GB avg = 0.165 KB (by entry num) total key len = 1.549243 GB avg = 0.028 KB total ukey len = 1.075322 GB avg = 0.015 KB total ukey num = 0.069422649 Billion total entry num = 0.056230378 Billion write speed all = 0.393040965 MB/sec (with seq num) write speed all = 0.376735944 MB/sec (without seq num) 2024/11/23-16:35:01.491355 139957223556672 [compaction_job.cc:1948] [default] [JOB 30816] Generated table #269833: 928485 keys, 34818580 bytes, temperature: kWarm 2024/11/23-16:35:01.491427 139957223556672 EVENT_LOG_v1 {"time_micros": 1732350901491391, "cf_name": "default", "job": 30816, "event": "table_file_creation", "file_number": 269833, "file_size": 34818580, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3284168345, "largest_seqno": 4012775885, "table_properties": {"data_size": 28475264, "index_size": 1777664, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25997580, "raw_average_key_size": 28, "raw_value_size": 108220286, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 928485, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732350897, "oldest_key_time": 0, "file_creation_time": 1732350897, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 269833, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:35:01.534394 139957223556672 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269834.sst) /dev/shm/ToplingTemp/Topling-116304-PjTFTw 2024/11/23-16:35:02.827853 139957223556672 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269834.sst): first pass time = 1.29's, 103.770'MB/sec 2024/11/23-16:35:04.261534 139957223556672 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269834.sst): old prealloc_size = 147639500, real_size = 31545360 2024/11/23-16:35:04.262272 139957223556672 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269834.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 930646 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1082 GB zip-val = 0.0295 GB avg-val = 116.22 avg-zval = 31.73 2024/11/23-16:35:04.263133 139957223556672 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269834.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:35:05.257739 139957223556672 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269834.sst): second pass time = 1.43's, 75.486'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.00's, 35.907'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2484.380'MB/sec (index lex order gen) rebuild zvType time = 0.83's, 0.279'MB/sec write SST data time = 0.16's, 221.996'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 37356.549'MB/sec zip my value time = 1.43's, unzip length = 0.108'GB zip my value throughput = 75.486'MB/sec zip pipeline throughput = 75.486'MB/sec entries = 930646 avg-key = 28.00 avg-zkey = 1.92 avg-val = 116.22 avg-zval = 31.73 usrkeys = 930646 avg-key = 20.00 avg-zkey = 1.92 avg-val = 123.22 avg-zval = 31.73 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 930646 bytes = 3373600 } seq expand size = 6514522 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0295 GB dict = 1.08 MB all = 0.0358 GB } UnZip/Zip{ index = 10.4434 value = 3.6627 dict = 1.00 all = 3.7522 } Zip/UnZip{ index = 0.0958 value = 0.2730 dict = 1.00 all = 0.2665 } ---------------------------- total value len = 9.409130 GB avg = 0.165 KB (by entry num) total key len = 1.575301 GB avg = 0.028 KB total ukey len = 1.093935 GB avg = 0.016 KB total ukey num = 0.070353295 Billion total entry num = 0.057161024 Billion write speed all = 0.398086973 MB/sec (with seq num) write speed all = 0.381514383 MB/sec (without seq num) 2024/11/23-16:35:05.302828 139957223556672 [compaction_job.cc:1948] [default] [JOB 30816] Generated table #269834: 930646 keys, 35770222 bytes, temperature: kWarm 2024/11/23-16:35:05.302899 139957223556672 EVENT_LOG_v1 {"time_micros": 1732350905302862, "cf_name": "default", "job": 30816, "event": "table_file_creation", "file_number": 269834, "file_size": 35770222, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3487497056, "largest_seqno": 4012775902, "table_properties": {"data_size": 29530240, "index_size": 1782272, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26058088, "raw_average_key_size": 28, "raw_value_size": 108159664, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 930646, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732350901, "oldest_key_time": 0, "file_creation_time": 1732350901, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 269834, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:35:05.370611 139957223556672 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269835.sst) /dev/shm/ToplingTemp/Topling-116304-Vu8xBx 2024/11/23-16:35:06.583311 139957223556672 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269835.sst): first pass time = 1.21's, 110.681'MB/sec 2024/11/23-16:35:08.076808 139957223556672 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269835.sst): old prealloc_size = 147639500, real_size = 31563120 2024/11/23-16:35:08.077548 139957223556672 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269835.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 932240 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1081 GB zip-val = 0.0295 GB avg-val = 115.97 avg-zval = 31.69 2024/11/23-16:35:08.078397 139957223556672 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269835.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:35:09.000510 139957223556672 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269835.sst): second pass time = 1.49's, 72.428'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.92's, 38.625'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2486.509'MB/sec (index lex order gen) rebuild zvType time = 0.77's, 0.303'MB/sec write SST data time = 0.15's, 231.875'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 37036.388'MB/sec zip my value time = 1.49's, unzip length = 0.108'GB zip my value throughput = 72.428'MB/sec zip pipeline throughput = 72.428'MB/sec entries = 932240 avg-key = 28.00 avg-zkey = 1.91 avg-val = 115.97 avg-zval = 31.69 usrkeys = 932240 avg-key = 20.00 avg-zkey = 1.91 avg-val = 122.97 avg-zval = 31.69 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 932240 bytes = 3262848 } seq expand size = 6525680 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0186 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0295 GB dict = 1.08 MB all = 0.0357 GB } UnZip/Zip{ index = 10.4444 value = 3.6594 dict = 1.00 all = 3.7620 } Zip/UnZip{ index = 0.0957 value = 0.2733 dict = 1.00 all = 0.2658 } ---------------------------- total value len = 9.523771 GB avg = 0.164 KB (by entry num) total key len = 1.601404 GB avg = 0.028 KB total ukey len = 1.112580 GB avg = 0.016 KB total ukey num = 0.071285535 Billion total entry num = 0.058093264 Billion write speed all = 0.403132978 MB/sec (with seq num) write speed all = 0.386292390 MB/sec (without seq num) 2024/11/23-16:35:09.045644 139957223556672 [compaction_job.cc:1948] [default] [JOB 30816] Generated table #269835: 932240 keys, 35676798 bytes, temperature: kWarm 2024/11/23-16:35:09.045713 139957223556672 EVENT_LOG_v1 {"time_micros": 1732350909045678, "cf_name": "default", "job": 30816, "event": "table_file_creation", "file_number": 269835, "file_size": 35676798, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3807172320, "largest_seqno": 4012775918, "table_properties": {"data_size": 29544736, "index_size": 1785152, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26102720, "raw_average_key_size": 28, "raw_value_size": 108115060, "raw_average_value_size": 115, "num_data_blocks": 1, "num_entries": 932240, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732350905, "oldest_key_time": 0, "file_creation_time": 1732350905, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 269835, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:35:09.082256 139957223556672 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269836.sst) /dev/shm/ToplingTemp/Topling-116304-woDLOy 2024/11/23-16:35:10.133967 139957223556672 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269836.sst): first pass time = 1.05's, 127.623'MB/sec 2024/11/23-16:35:11.657971 139957223556672 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269836.sst): old prealloc_size = 147639500, real_size = 32391552 2024/11/23-16:35:11.658549 139957223556672 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269836.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 925338 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1083 GB zip-val = 0.0304 GB avg-val = 117.05 avg-zval = 32.84 2024/11/23-16:35:11.659356 139957223556672 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269836.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:35:12.493212 139957223556672 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269836.sst): second pass time = 1.51's, 71.555'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.84's, 43.961'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3251.299'MB/sec (index lex order gen) rebuild zvType time = 0.71's, 0.328'MB/sec write SST data time = 0.13's, 284.198'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 33346.295'MB/sec zip my value time = 1.51's, unzip length = 0.108'GB zip my value throughput = 71.555'MB/sec zip pipeline throughput = 71.555'MB/sec entries = 925338 avg-key = 28.00 avg-zkey = 1.91 avg-val = 117.05 avg-zval = 32.84 usrkeys = 925338 avg-key = 20.00 avg-zkey = 1.91 avg-val = 124.05 avg-zval = 32.84 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 925338 bytes = 3470032 } seq expand size = 6477366 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0304 GB dict = 1.08 MB all = 0.0367 GB } UnZip/Zip{ index = 10.4453 value = 3.5641 dict = 1.00 all = 3.6555 } Zip/UnZip{ index = 0.0957 value = 0.2806 dict = 1.00 all = 0.2736 } ---------------------------- total value len = 9.638556 GB avg = 0.163 KB (by entry num) total key len = 1.627313 GB avg = 0.028 KB total ukey len = 1.131087 GB avg = 0.016 KB total ukey num = 0.072210873 Billion total entry num = 0.059018602 Billion write speed all = 0.408179563 MB/sec (with seq num) write speed all = 0.391072894 MB/sec (without seq num) 2024/11/23-16:35:12.540289 139957223556672 [compaction_job.cc:1948] [default] [JOB 30816] Generated table #269836: 925338 keys, 36716376 bytes, temperature: kWarm 2024/11/23-16:35:12.540356 139957223556672 EVENT_LOG_v1 {"time_micros": 1732350912540322, "cf_name": "default", "job": 30816, "event": "table_file_creation", "file_number": 269836, "file_size": 36716376, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3273701103, "largest_seqno": 4012775935, "table_properties": {"data_size": 30388272, "index_size": 1771776, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25909464, "raw_average_key_size": 28, "raw_value_size": 108308324, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 925338, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732350909, "oldest_key_time": 0, "file_creation_time": 1732350909, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 269836, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:35:12.578031 139957223556672 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269837.sst) /dev/shm/ToplingTemp/Topling-116304-UbPc8z 2024/11/23-16:35:13.738085 139957223556672 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269837.sst): first pass time = 1.16's, 115.704'MB/sec 2024/11/23-16:35:15.271217 139957223556672 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269837.sst): old prealloc_size = 147639500, real_size = 35846896 2024/11/23-16:35:15.271922 139957223556672 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269837.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927048 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1083 GB zip-val = 0.0338 GB avg-val = 116.78 avg-zval = 36.50 2024/11/23-16:35:15.274431 139957223556672 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269837.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:35:16.114201 139957223556672 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269837.sst): second pass time = 1.53's, 70.655'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.84's, 47.525'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2603.736'MB/sec (index lex order gen) rebuild zvType time = 0.71's, 0.327'MB/sec write SST data time = 0.13's, 301.350'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 34989.020'MB/sec zip my value time = 1.53's, unzip length = 0.108'GB zip my value throughput = 70.655'MB/sec zip pipeline throughput = 70.655'MB/sec entries = 927048 avg-key = 28.00 avg-zkey = 1.92 avg-val = 116.78 avg-zval = 36.50 usrkeys = 927048 avg-key = 20.00 avg-zkey = 1.92 avg-val = 123.78 avg-zval = 36.50 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 927048 bytes = 3360560 } seq expand size = 6489336 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0338 GB dict = 1.08 MB all = 0.0401 GB } UnZip/Zip{ index = 10.4435 value = 3.1992 dict = 1.00 all = 3.3503 } Zip/UnZip{ index = 0.0958 value = 0.3126 dict = 1.00 all = 0.2985 } ---------------------------- total value len = 9.753306 GB avg = 0.163 KB (by entry num) total key len = 1.653271 GB avg = 0.028 KB total ukey len = 1.149628 GB avg = 0.016 KB total ukey num = 0.073137921 Billion total entry num = 0.059945650 Billion write speed all = 0.413223386 MB/sec (with seq num) write speed all = 0.395850289 MB/sec (without seq num) 2024/11/23-16:35:16.164182 139957223556672 [compaction_job.cc:1948] [default] [JOB 30816] Generated table #269837: 927048 keys, 40061806 bytes, temperature: kWarm 2024/11/23-16:35:16.164245 139957223556672 EVENT_LOG_v1 {"time_micros": 1732350916164211, "cf_name": "default", "job": 30816, "event": "table_file_creation", "file_number": 269837, "file_size": 40061806, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3514720078, "largest_seqno": 4012775967, "table_properties": {"data_size": 33839584, "index_size": 1775360, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25957344, "raw_average_key_size": 28, "raw_value_size": 108260520, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927048, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732350912, "oldest_key_time": 0, "file_creation_time": 1732350912, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 269837, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:35:16.203574 139957223556672 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269838.sst) /dev/shm/ToplingTemp/Topling-116304-xqx2Yx 2024/11/23-16:35:17.129308 139957223556672 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269838.sst): first pass time = 0.93's, 144.991'MB/sec 2024/11/23-16:35:18.477619 139957223556672 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269838.sst): old prealloc_size = 147639500, real_size = 32545920 2024/11/23-16:35:18.478225 139957223556672 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269838.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927695 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1082 GB zip-val = 0.0305 GB avg-val = 116.68 avg-zval = 32.92 2024/11/23-16:35:18.480339 139957223556672 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269838.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:35:19.615921 139957223556672 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269838.sst): second pass time = 1.35's, 80.319'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.14's, 32.400'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3030.367'MB/sec (index lex order gen) rebuild zvType time = 0.90's, 0.257'MB/sec write SST data time = 0.24's, 155.708'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 26002.792'MB/sec zip my value time = 1.35's, unzip length = 0.108'GB zip my value throughput = 80.319'MB/sec zip pipeline throughput = 80.319'MB/sec entries = 927695 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.68 avg-zval = 32.92 usrkeys = 927695 avg-key = 20.00 avg-zkey = 1.91 avg-val = 123.68 avg-zval = 32.92 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 927695 bytes = 3478864 } seq expand size = 6493865 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0305 GB dict = 1.08 MB all = 0.0369 GB } UnZip/Zip{ index = 10.4459 value = 3.5446 dict = 1.00 all = 3.6394 } Zip/UnZip{ index = 0.0957 value = 0.2821 dict = 1.00 all = 0.2748 } ---------------------------- total value len = 9.868042 GB avg = 0.162 KB (by entry num) total key len = 1.679246 GB avg = 0.028 KB total ukey len = 1.168182 GB avg = 0.016 KB total ukey num = 0.074065616 Billion total entry num = 0.060873345 Billion write speed all = 0.418267855 MB/sec (with seq num) write speed all = 0.400628137 MB/sec (without seq num) 2024/11/23-16:35:19.664580 139957223556672 [compaction_job.cc:1948] [default] [JOB 30816] Generated table #269838: 927695 keys, 36879100 bytes, temperature: kWarm 2024/11/23-16:35:19.664673 139957223556672 EVENT_LOG_v1 {"time_micros": 1732350919664625, "cf_name": "default", "job": 30816, "event": "table_file_creation", "file_number": 269838, "file_size": 36879100, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3369353416, "largest_seqno": 4012776021, "table_properties": {"data_size": 30537648, "index_size": 1776192, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25975460, "raw_average_key_size": 28, "raw_value_size": 108242342, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927695, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732350916, "oldest_key_time": 0, "file_creation_time": 1732350916, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 269838, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:35:19.755574 139957223556672 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269839.sst) /dev/shm/ToplingTemp/Topling-116304-K7Pway 2024/11/23-16:35:20.877187 139957223556672 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269839.sst): first pass time = 1.12's, 119.671'MB/sec 2024/11/23-16:35:22.270632 139957223556672 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269839.sst): old prealloc_size = 147639500, real_size = 33871968 2024/11/23-16:35:22.271211 139957223556672 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269839.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 929074 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1082 GB zip-val = 0.0319 GB avg-val = 116.46 avg-zval = 34.29 2024/11/23-16:35:22.272858 139957223556672 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269839.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:35:23.095777 139957223556672 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269839.sst): second pass time = 1.39's, 77.695'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.83's, 45.656'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3176.238'MB/sec (index lex order gen) rebuild zvType time = 0.69's, 0.336'MB/sec write SST data time = 0.13's, 282.268'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 34211.854'MB/sec zip my value time = 1.39's, unzip length = 0.108'GB zip my value throughput = 77.695'MB/sec zip pipeline throughput = 77.695'MB/sec entries = 929074 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.46 avg-zval = 34.29 usrkeys = 929074 avg-key = 20.00 avg-zkey = 1.91 avg-val = 122.09 avg-zval = 34.29 TagRS{ kinds = RS_Key0_TagN bytes = 145280 } TagArray{ size = 746077 bytes = 2797808 } seq expand size = 5222539 multi value expand size = 0 cnt WriteAppend = 16 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0319 GB dict = 1.08 MB all = 0.0377 GB } UnZip/Zip{ index = 10.4452 value = 3.3962 dict = 1.00 all = 3.5628 } Zip/UnZip{ index = 0.0957 value = 0.2944 dict = 1.00 all = 0.2807 } ---------------------------- total value len = 9.981469 GB avg = 0.162 KB (by entry num) total key len = 1.705260 GB avg = 0.028 KB total ukey len = 1.186763 GB avg = 0.016 KB total ukey num = 0.074994690 Billion total entry num = 0.061802419 Billion write speed all = 0.423265333 MB/sec (with seq num) write speed all = 0.405358648 MB/sec (without seq num) 2024/11/23-16:35:23.143950 139957223556672 [compaction_job.cc:1948] [default] [JOB 30816] Generated table #269839: 929074 keys, 37671592 bytes, temperature: kWarm 2024/11/23-16:35:23.144031 139957223556672 EVENT_LOG_v1 {"time_micros": 1732350923143996, "cf_name": "default", "job": 30816, "event": "table_file_creation", "file_number": 269839, "file_size": 37671592, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4012776210, "table_properties": {"data_size": 31860560, "index_size": 1778944, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26014072, "raw_average_key_size": 28, "raw_value_size": 108203692, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 929074, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732350919, "oldest_key_time": 0, "file_creation_time": 1732350919, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 269839, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:35:23.184894 139957223556672 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269840.sst) /dev/shm/ToplingTemp/Topling-116304-QPP1Cz 2024/11/23-16:35:24.777377 139957223556672 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269840.sst): first pass time = 1.59's, 84.284'MB/sec 2024/11/23-16:35:26.100203 139957223556672 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269840.sst): old prealloc_size = 147639500, real_size = 31066496 2024/11/23-16:35:26.100732 139957223556672 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269840.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 933457 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1081 GB zip-val = 0.0291 GB avg-val = 115.79 avg-zval = 31.13 2024/11/23-16:35:26.101557 139957223556672 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269840.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:35:26.936717 139957223556672 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269840.sst): second pass time = 1.32's, 81.753'MB/sec, value only(80.5% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.84's, 42.200'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3498.808'MB/sec (index lex order gen) rebuild zvType time = 0.71's, 0.330'MB/sec write SST data time = 0.13's, 274.228'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 32171.845'MB/sec zip my value time = 1.32's, unzip length = 0.108'GB zip my value throughput = 81.753'MB/sec zip pipeline throughput = 81.753'MB/sec entries = 933457 avg-key = 28.00 avg-zkey = 1.90 avg-val = 115.79 avg-zval = 31.13 usrkeys = 933457 avg-key = 20.00 avg-zkey = 1.90 avg-val = 122.79 avg-zval = 31.13 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 933457 bytes = 3383792 } seq expand size = 6534199 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0187 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0291 GB dict = 1.08 MB all = 0.0353 GB } UnZip/Zip{ index = 10.5138 value = 3.7196 dict = 1.00 all = 3.8021 } Zip/UnZip{ index = 0.0951 value = 0.2688 dict = 1.00 all = 0.2630 } ---------------------------- total value len = 10.096084 GB avg = 0.161 KB (by entry num) total key len = 1.731397 GB avg = 0.028 KB total ukey len = 1.205432 GB avg = 0.016 KB total ukey num = 0.075928147 Billion total entry num = 0.062735876 Billion write speed all = 0.428303454 MB/sec (with seq num) write speed all = 0.410128836 MB/sec (without seq num) 2024/11/23-16:35:26.981616 139957223556672 [compaction_job.cc:1948] [default] [JOB 30816] Generated table #269840: 933457 keys, 35300782 bytes, temperature: kWarm 2024/11/23-16:35:26.981690 139957223556672 EVENT_LOG_v1 {"time_micros": 1732350926981649, "cf_name": "default", "job": 30816, "event": "table_file_creation", "file_number": 269840, "file_size": 35300782, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3480997236, "largest_seqno": 4012776228, "table_properties": {"data_size": 29057264, "index_size": 1775680, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26136796, "raw_average_key_size": 28, "raw_value_size": 108081050, "raw_average_value_size": 115, "num_data_blocks": 1, "num_entries": 933457, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732350923, "oldest_key_time": 0, "file_creation_time": 1732350923, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 269840, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:35:27.018057 139957223556672 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269841.sst) /dev/shm/ToplingTemp/Topling-116304-DAseay 2024/11/23-16:35:28.667969 139957223556672 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269841.sst): first pass time = 1.65's, 81.350'MB/sec 2024/11/23-16:35:30.041617 139957223556672 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269841.sst): old prealloc_size = 147639500, real_size = 33028480 2024/11/23-16:35:30.042174 139957223556672 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269841.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 931033 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1081 GB zip-val = 0.0310 GB avg-val = 116.16 avg-zval = 33.31 2024/11/23-16:35:30.042996 139957223556672 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269841.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:35:31.023051 139957223556672 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269841.sst): second pass time = 1.37's, 78.775'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.98's, 37.961'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3241.949'MB/sec (index lex order gen) rebuild zvType time = 0.85's, 0.273'MB/sec write SST data time = 0.13's, 290.469'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 32531.411'MB/sec zip my value time = 1.37's, unzip length = 0.108'GB zip my value throughput = 78.775'MB/sec zip pipeline throughput = 78.775'MB/sec entries = 931033 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.16 avg-zval = 33.31 usrkeys = 931033 avg-key = 20.00 avg-zkey = 1.91 avg-val = 123.16 avg-zval = 33.31 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 931033 bytes = 3375008 } seq expand size = 6517231 multi value expand size = 0 cnt WriteAppend = 15 UnZipSize{ index = 0.0186 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0310 GB dict = 1.08 MB all = 0.0373 GB } UnZip/Zip{ index = 10.4458 value = 3.4872 dict = 1.00 all = 3.6027 } Zip/UnZip{ index = 0.0957 value = 0.2868 dict = 1.00 all = 0.2776 } ---------------------------- total value len = 10.210750 GB avg = 0.160 KB (by entry num) total key len = 1.757466 GB avg = 0.028 KB total ukey len = 1.224053 GB avg = 0.016 KB total ukey num = 0.076859180 Billion total entry num = 0.063666909 Billion write speed all = 0.433335709 MB/sec (with seq num) write speed all = 0.414894100 MB/sec (without seq num) 2024/11/23-16:35:31.071156 139957223556672 [compaction_job.cc:1948] [default] [JOB 30816] Generated table #269841: 931033 keys, 37255172 bytes, temperature: kWarm 2024/11/23-16:35:31.071232 139957223556672 EVENT_LOG_v1 {"time_micros": 1732350931071196, "cf_name": "default", "job": 30816, "event": "table_file_creation", "file_number": 269841, "file_size": 37255172, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3512539342, "largest_seqno": 4012776268, "table_properties": {"data_size": 31012976, "index_size": 1782592, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26068924, "raw_average_key_size": 28, "raw_value_size": 108148938, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 931033, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732350927, "oldest_key_time": 0, "file_creation_time": 1732350927, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 269841, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:35:31.110699 139957223556672 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269842.sst) /dev/shm/ToplingTemp/Topling-116304-3dpEaA 2024/11/23-16:35:31.949745 139957223556672 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269842.sst): first pass time = 0.84's, 159.971'MB/sec 2024/11/23-16:35:33.307320 139957223556672 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269842.sst): old prealloc_size = 147639500, real_size = 34421840 2024/11/23-16:35:33.307881 139957223556672 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269842.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 923523 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1084 GB zip-val = 0.0324 GB avg-val = 117.33 avg-zval = 35.11 2024/11/23-16:35:33.308758 139957223556672 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269842.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:35:34.145620 139957223556672 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269842.sst): second pass time = 1.36's, 79.862'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.84's, 46.217'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3292.666'MB/sec (index lex order gen) rebuild zvType time = 0.71's, 0.325'MB/sec write SST data time = 0.13's, 306.163'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.083'MB, throughput = 27482.647'MB/sec zip my value time = 1.36's, unzip length = 0.108'GB zip my value throughput = 79.862'MB/sec zip pipeline throughput = 79.862'MB/sec entries = 923523 avg-key = 28.00 avg-zkey = 1.92 avg-val = 117.33 avg-zval = 35.11 usrkeys = 923523 avg-key = 20.00 avg-zkey = 1.92 avg-val = 124.33 avg-zval = 35.11 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 923523 bytes = 3463232 } seq expand size = 6464661 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0185 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0324 GB dict = 1.08 MB all = 0.0387 GB } UnZip/Zip{ index = 10.4418 value = 3.3422 dict = 1.00 all = 3.4643 } Zip/UnZip{ index = 0.0958 value = 0.2992 dict = 1.00 all = 0.2887 } ---------------------------- total value len = 10.325574 GB avg = 0.160 KB (by entry num) total key len = 1.783325 GB avg = 0.028 KB total ukey len = 1.242523 GB avg = 0.016 KB total ukey num = 0.077782703 Billion total entry num = 0.064590432 Billion write speed all = 0.438379866 MB/sec (with seq num) write speed all = 0.419672866 MB/sec (without seq num) 2024/11/23-16:35:34.194447 139957223556672 [compaction_job.cc:1948] [default] [JOB 30816] Generated table #269842: 923523 keys, 38742562 bytes, temperature: kWarm 2024/11/23-16:35:34.194516 139957223556672 EVENT_LOG_v1 {"time_micros": 1732350934194480, "cf_name": "default", "job": 30816, "event": "table_file_creation", "file_number": 269842, "file_size": 38742562, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3411274482, "largest_seqno": 4012774796, "table_properties": {"data_size": 32421888, "index_size": 1768896, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25858644, "raw_average_key_size": 28, "raw_value_size": 108359150, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 923523, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732350931, "oldest_key_time": 0, "file_creation_time": 1732350931, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 269842, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:35:34.231245 139957223556672 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269843.sst) /dev/shm/ToplingTemp/Topling-116304-yfItXx 2024/11/23-16:35:35.278952 139957223556672 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269843.sst): first pass time = 1.05's, 128.111'MB/sec 2024/11/23-16:35:36.603784 139957223556672 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269843.sst): old prealloc_size = 147639500, real_size = 32946400 2024/11/23-16:35:36.604350 139957223556672 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269843.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 933794 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1081 GB zip-val = 0.0309 GB avg-val = 115.73 avg-zval = 33.13 2024/11/23-16:35:36.605130 139957223556672 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269843.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:35:37.459053 139957223556672 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269843.sst): second pass time = 1.32's, 81.625'MB/sec, value only(80.5% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.86's, 43.475'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3253.731'MB/sec (index lex order gen) rebuild zvType time = 0.73's, 0.320'MB/sec write SST data time = 0.13's, 295.396'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 33455.364'MB/sec zip my value time = 1.32's, unzip length = 0.108'GB zip my value throughput = 81.625'MB/sec zip pipeline throughput = 81.625'MB/sec entries = 933794 avg-key = 28.00 avg-zkey = 1.90 avg-val = 115.73 avg-zval = 33.13 usrkeys = 933794 avg-key = 20.00 avg-zkey = 1.90 avg-val = 122.73 avg-zval = 33.13 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 933794 bytes = 3385024 } seq expand size = 6536558 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0187 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0309 GB dict = 1.08 MB all = 0.0372 GB } UnZip/Zip{ index = 10.5146 value = 3.4933 dict = 1.00 all = 3.6097 } Zip/UnZip{ index = 0.0951 value = 0.2863 dict = 1.00 all = 0.2770 } ---------------------------- total value len = 10.440182 GB avg = 0.159 KB (by entry num) total key len = 1.809471 GB avg = 0.028 KB total ukey len = 1.261199 GB avg = 0.016 KB total ukey num = 0.078716497 Billion total entry num = 0.065524226 Billion write speed all = 0.443422423 MB/sec (with seq num) write speed all = 0.424447249 MB/sec (without seq num) 2024/11/23-16:35:37.505820 139957223556672 [compaction_job.cc:1948] [default] [JOB 30816] Generated table #269843: 933794 keys, 37182054 bytes, temperature: kWarm 2024/11/23-16:35:37.505891 139957223556672 EVENT_LOG_v1 {"time_micros": 1732350937505854, "cf_name": "default", "job": 30816, "event": "table_file_creation", "file_number": 269843, "file_size": 37182054, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3525889795, "largest_seqno": 4012776316, "table_properties": {"data_size": 30936592, "index_size": 1776192, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26146232, "raw_average_key_size": 28, "raw_value_size": 108071628, "raw_average_value_size": 115, "num_data_blocks": 1, "num_entries": 933794, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732350934, "oldest_key_time": 0, "file_creation_time": 1732350934, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 269843, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:35:37.554468 139957223556672 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269844.sst) /dev/shm/ToplingTemp/Topling-116304-g7uKay 2024/11/23-16:35:38.517798 139957223556672 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269844.sst): first pass time = 0.96's, 139.332'MB/sec 2024/11/23-16:35:39.847164 139957223556672 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269844.sst): old prealloc_size = 147639500, real_size = 33346464 2024/11/23-16:35:39.847690 139957223556672 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269844.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 924262 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0314 GB avg-val = 117.22 avg-zval = 33.93 2024/11/23-16:35:39.849772 139957223556672 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269844.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:35:40.693707 139957223556672 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269844.sst): second pass time = 1.33's, 81.542'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.85's, 44.499'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3477.015'MB/sec (index lex order gen) rebuild zvType time = 0.72's, 0.322'MB/sec write SST data time = 0.13's, 294.646'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.082'MB, throughput = 36537.007'MB/sec zip my value time = 1.33's, unzip length = 0.108'GB zip my value throughput = 81.542'MB/sec zip pipeline throughput = 81.542'MB/sec entries = 924262 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.22 avg-zval = 33.93 usrkeys = 924262 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.22 avg-zval = 33.93 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 924262 bytes = 3466000 } seq expand size = 6469834 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0314 GB dict = 1.08 MB all = 0.0377 GB } UnZip/Zip{ index = 10.5118 value = 3.4550 dict = 1.00 all = 3.5631 } Zip/UnZip{ index = 0.0951 value = 0.2894 dict = 1.00 all = 0.2807 } ---------------------------- total value len = 10.554990 GB avg = 0.159 KB (by entry num) total key len = 1.835350 GB avg = 0.028 KB total ukey len = 1.279684 GB avg = 0.016 KB total ukey num = 0.079640759 Billion total entry num = 0.066448488 Billion write speed all = 0.448462632 MB/sec (with seq num) write speed all = 0.429222054 MB/sec (without seq num) 2024/11/23-16:35:40.740666 139957223556672 [compaction_job.cc:1948] [default] [JOB 30816] Generated table #269844: 924262 keys, 37669296 bytes, temperature: kWarm 2024/11/23-16:35:40.740736 139957223556672 EVENT_LOG_v1 {"time_micros": 1732350940740700, "cf_name": "default", "job": 30816, "event": "table_file_creation", "file_number": 269844, "file_size": 37669296, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3405268578, "largest_seqno": 4012776344, "table_properties": {"data_size": 31356688, "index_size": 1758528, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25879336, "raw_average_key_size": 28, "raw_value_size": 108338448, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 924262, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732350937, "oldest_key_time": 0, "file_creation_time": 1732350937, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 269844, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:35:40.799824 139957223556672 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269845.sst) /dev/shm/ToplingTemp/Topling-116304-wvZNMx 2024/11/23-16:35:41.666831 139957223556672 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269845.sst): first pass time = 0.87's, 154.813'MB/sec 2024/11/23-16:35:43.004293 139957223556672 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269845.sst): old prealloc_size = 147639500, real_size = 33059792 2024/11/23-16:35:43.004804 139957223556672 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269845.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 926966 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.93 raw-val = 0.1083 GB zip-val = 0.0310 GB avg-val = 116.79 avg-zval = 33.49 2024/11/23-16:35:43.005683 139957223556672 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269845.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:35:43.855425 139957223556672 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269845.sst): second pass time = 1.34's, 81.024'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.85's, 43.931'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3649.963'MB/sec (index lex order gen) rebuild zvType time = 0.72's, 0.320'MB/sec write SST data time = 0.13's, 293.836'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 33479.261'MB/sec zip my value time = 1.34's, unzip length = 0.108'GB zip my value throughput = 81.024'MB/sec zip pipeline throughput = 81.024'MB/sec entries = 926966 avg-key = 28.00 avg-zkey = 1.93 avg-val = 116.79 avg-zval = 33.49 usrkeys = 926966 avg-key = 20.00 avg-zkey = 1.93 avg-val = 123.79 avg-zval = 33.49 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 926966 bytes = 3476144 } seq expand size = 6488762 multi value expand size = 0 cnt WriteAppend = 16 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0310 GB dict = 1.08 MB all = 0.0374 GB } UnZip/Zip{ index = 10.3760 value = 3.4877 dict = 1.00 all = 3.5897 } Zip/UnZip{ index = 0.0964 value = 0.2867 dict = 1.00 all = 0.2786 } ---------------------------- total value len = 10.669742 GB avg = 0.158 KB (by entry num) total key len = 1.861305 GB avg = 0.028 KB total ukey len = 1.298224 GB avg = 0.016 KB total ukey num = 0.080567725 Billion total entry num = 0.067375454 Billion write speed all = 0.453503541 MB/sec (with seq num) write speed all = 0.433996787 MB/sec (without seq num) 2024/11/23-16:35:43.901485 139957223556672 [compaction_job.cc:1948] [default] [JOB 30816] Generated table #269845: 926966 keys, 37389942 bytes, temperature: kWarm 2024/11/23-16:35:43.901556 139957223556672 EVENT_LOG_v1 {"time_micros": 1732350943901520, "cf_name": "default", "job": 30816, "event": "table_file_creation", "file_number": 269845, "file_size": 37389942, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3471845708, "largest_seqno": 4012771944, "table_properties": {"data_size": 31041088, "index_size": 1786752, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25955048, "raw_average_key_size": 28, "raw_value_size": 108262700, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 926966, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732350940, "oldest_key_time": 0, "file_creation_time": 1732350940, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 269845, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:35:43.938708 139957223556672 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269846.sst) /dev/shm/ToplingTemp/Topling-116304-cIM24A 2024/11/23-16:35:44.958764 139957223556672 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269846.sst): first pass time = 1.02's, 131.583'MB/sec 2024/11/23-16:35:46.392097 139957223556672 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269846.sst): old prealloc_size = 147639500, real_size = 35642080 2024/11/23-16:35:46.392686 139957223556672 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269846.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 929908 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0336 GB avg-val = 116.33 avg-zval = 36.18 2024/11/23-16:35:46.393075 139957223556672 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269846.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:35:47.142262 139957223556672 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269846.sst): second pass time = 1.43's, 75.518'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.75's, 50.343'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3131.292'MB/sec (index lex order gen) rebuild zvType time = 0.62's, 0.372'MB/sec write SST data time = 0.12's, 302.608'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 30126.110'MB/sec zip my value time = 1.43's, unzip length = 0.108'GB zip my value throughput = 75.518'MB/sec zip pipeline throughput = 75.518'MB/sec entries = 929908 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.33 avg-zval = 36.18 usrkeys = 929908 avg-key = 20.00 avg-zkey = 1.90 avg-val = 118.93 avg-zval = 36.18 TagRS{ kinds = RS_Key0_TagN bytes = 145400 } TagArray{ size = 344322 bytes = 1119056 } seq expand size = 2410254 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0336 GB dict = 1.08 MB all = 0.0378 GB } UnZip/Zip{ index = 10.5117 value = 3.2158 dict = 1.00 all = 3.5541 } Zip/UnZip{ index = 0.0951 value = 0.3110 dict = 1.00 all = 0.2814 } ---------------------------- total value len = 10.780332 GB avg = 0.158 KB (by entry num) total key len = 1.887343 GB avg = 0.028 KB total ukey len = 1.316822 GB avg = 0.016 KB total ukey num = 0.081497633 Billion total entry num = 0.068305362 Billion write speed all = 0.458393638 MB/sec (with seq num) write speed all = 0.438620006 MB/sec (without seq num) 2024/11/23-16:35:47.189302 139957223556672 [compaction_job.cc:1948] [default] [JOB 30816] Generated table #269846: 929908 keys, 37763857 bytes, temperature: kWarm 2024/11/23-16:35:47.189371 139957223556672 EVENT_LOG_v1 {"time_micros": 1732350947189336, "cf_name": "default", "job": 30816, "event": "table_file_creation", "file_number": 269846, "file_size": 37763857, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4012776360, "table_properties": {"data_size": 33640144, "index_size": 1769280, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26037424, "raw_average_key_size": 28, "raw_value_size": 108180384, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 929908, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732350943, "oldest_key_time": 0, "file_creation_time": 1732350943, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 269846, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:35:47.227964 139957223556672 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269847.sst) /dev/shm/ToplingTemp/Topling-116304-XkNu6x 2024/11/23-16:35:48.214913 139957223556672 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269847.sst): first pass time = 0.99's, 136.002'MB/sec 2024/11/23-16:35:49.707372 139957223556672 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269847.sst): old prealloc_size = 147639500, real_size = 37215184 2024/11/23-16:35:49.707897 139957223556672 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269847.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 926204 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1083 GB zip-val = 0.0352 GB avg-val = 116.91 avg-zval = 38.02 2024/11/23-16:35:49.708199 139957223556672 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269847.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:35:50.423973 139957223556672 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269847.sst): second pass time = 1.49's, 72.621'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.72's, 54.435'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3523.108'MB/sec (index lex order gen) rebuild zvType time = 0.59's, 0.391'MB/sec write SST data time = 0.12's, 315.673'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 29280.340'MB/sec zip my value time = 1.49's, unzip length = 0.108'GB zip my value throughput = 72.621'MB/sec zip pipeline throughput = 72.621'MB/sec entries = 926204 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.91 avg-zval = 38.02 usrkeys = 926204 avg-key = 20.00 avg-zkey = 1.91 avg-val = 118.50 avg-zval = 38.02 TagRS{ kinds = RS_Key0_TagN bytes = 144800 } TagArray{ size = 210197 bytes = 788256 } seq expand size = 1471379 multi value expand size = 0 cnt WriteAppend = 15 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0352 GB dict = 1.08 MB all = 0.0390 GB } UnZip/Zip{ index = 10.4468 value = 3.0754 dict = 1.00 all = 3.4409 } Zip/UnZip{ index = 0.0957 value = 0.3252 dict = 1.00 all = 0.2906 } ---------------------------- total value len = 10.890088 GB avg = 0.157 KB (by entry num) total key len = 1.913276 GB avg = 0.028 KB total ukey len = 1.335346 GB avg = 0.016 KB total ukey num = 0.082423837 Billion total entry num = 0.069231566 Billion write speed all = 0.463248687 MB/sec (with seq num) write speed all = 0.443209308 MB/sec (without seq num) 2024/11/23-16:35:50.472379 139957223556672 [compaction_job.cc:1948] [default] [JOB 30816] Generated table #269847: 926204 keys, 39006609 bytes, temperature: kWarm 2024/11/23-16:35:50.472447 139957223556672 EVENT_LOG_v1 {"time_micros": 1732350950472412, "cf_name": "default", "job": 30816, "event": "table_file_creation", "file_number": 269847, "file_size": 39006609, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4023634337, "table_properties": {"data_size": 35210240, "index_size": 1773184, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25933712, "raw_average_key_size": 28, "raw_value_size": 108284080, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 926204, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732350947, "oldest_key_time": 0, "file_creation_time": 1732350947, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 269847, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:35:50.514383 139957223556672 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269848.sst) /dev/shm/ToplingTemp/Topling-116304-9R3meB 2024/11/23-16:35:51.476072 139957223556672 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269848.sst): first pass time = 0.96's, 139.569'MB/sec 2024/11/23-16:35:52.813615 139957223556672 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269848.sst): old prealloc_size = 147639500, real_size = 35990560 2024/11/23-16:35:52.814200 139957223556672 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269848.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 928557 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1082 GB zip-val = 0.0340 GB avg-val = 116.54 avg-zval = 36.59 2024/11/23-16:35:52.816148 139957223556672 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269848.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:35:53.637138 139957223556672 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269848.sst): second pass time = 1.34's, 80.978'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.82's, 48.546'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3163.242'MB/sec (index lex order gen) rebuild zvType time = 0.69's, 0.335'MB/sec write SST data time = 0.13's, 309.486'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 34752.188'MB/sec zip my value time = 1.34's, unzip length = 0.108'GB zip my value throughput = 80.978'MB/sec zip pipeline throughput = 80.978'MB/sec entries = 928557 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.54 avg-zval = 36.59 usrkeys = 928557 avg-key = 20.00 avg-zkey = 1.91 avg-val = 123.54 avg-zval = 36.59 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 928557 bytes = 3133888 } seq expand size = 6499899 multi value expand size = 0 cnt WriteAppend = 15 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0340 GB dict = 1.08 MB all = 0.0400 GB } UnZip/Zip{ index = 10.4443 value = 3.1848 dict = 1.00 all = 3.3573 } Zip/UnZip{ index = 0.0957 value = 0.3140 dict = 1.00 all = 0.2979 } ---------------------------- total value len = 11.004806 GB avg = 0.157 KB (by entry num) total key len = 1.939276 GB avg = 0.028 KB total ukey len = 1.353917 GB avg = 0.016 KB total ukey num = 0.083352394 Billion total entry num = 0.070160123 Billion write speed all = 0.468285662 MB/sec (with seq num) write speed all = 0.447979870 MB/sec (without seq num) 2024/11/23-16:35:53.685489 139957223556672 [compaction_job.cc:1948] [default] [JOB 30816] Generated table #269848: 928557 keys, 39977948 bytes, temperature: kWarm 2024/11/23-16:35:53.685559 139957223556672 EVENT_LOG_v1 {"time_micros": 1732350953685523, "cf_name": "default", "job": 30816, "event": "table_file_creation", "file_number": 269848, "file_size": 39977948, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4023634338, "largest_seqno": 4113714538, "table_properties": {"data_size": 33980112, "index_size": 1778112, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25999596, "raw_average_key_size": 28, "raw_value_size": 108218170, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 928557, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732350950, "oldest_key_time": 0, "file_creation_time": 1732350950, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 269848, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:35:53.727705 139957223556672 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269849.sst) /dev/shm/ToplingTemp/Topling-116304-ToHOwx 2024/11/23-16:35:54.793828 139957223556672 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269849.sst): first pass time = 1.07's, 125.897'MB/sec 2024/11/23-16:35:56.124395 139957223556672 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269849.sst): old prealloc_size = 147639500, real_size = 36149792 2024/11/23-16:35:56.124908 139957223556672 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269849.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 928260 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0342 GB avg-val = 116.59 avg-zval = 36.79 2024/11/23-16:35:56.125650 139957223556672 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269849.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:35:56.942873 139957223556672 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269849.sst): second pass time = 1.33's, 81.415'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.82's, 48.897'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3628.487'MB/sec (index lex order gen) rebuild zvType time = 0.69's, 0.336'MB/sec write SST data time = 0.13's, 316.293'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 32118.046'MB/sec zip my value time = 1.33's, unzip length = 0.108'GB zip my value throughput = 81.415'MB/sec zip pipeline throughput = 81.415'MB/sec entries = 928260 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.59 avg-zval = 36.79 usrkeys = 928260 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.59 avg-zval = 36.79 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 928260 bytes = 3016864 } seq expand size = 6497820 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0342 GB dict = 1.08 MB all = 0.0400 GB } UnZip/Zip{ index = 10.5129 value = 3.1690 dict = 1.00 all = 3.3538 } Zip/UnZip{ index = 0.0951 value = 0.3156 dict = 1.00 all = 0.2982 } ---------------------------- total value len = 11.119530 GB avg = 0.156 KB (by entry num) total key len = 1.965267 GB avg = 0.028 KB total ukey len = 1.372482 GB avg = 0.016 KB total ukey num = 0.084280654 Billion total entry num = 0.071088383 Billion write speed all = 0.473319806 MB/sec (with seq num) write speed all = 0.452747816 MB/sec (without seq num) 2024/11/23-16:35:56.992938 139957223556672 [compaction_job.cc:1948] [default] [JOB 30816] Generated table #269849: 928260 keys, 40019984 bytes, temperature: kWarm 2024/11/23-16:35:56.993017 139957223556672 EVENT_LOG_v1 {"time_micros": 1732350956992972, "cf_name": "default", "job": 30816, "event": "table_file_creation", "file_number": 269849, "file_size": 40019984, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4050411210, "largest_seqno": 4113714699, "table_properties": {"data_size": 34151568, "index_size": 1765952, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25991280, "raw_average_key_size": 28, "raw_value_size": 108226468, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 928260, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732350953, "oldest_key_time": 0, "file_creation_time": 1732350953, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 269849, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:35:57.032445 139957223556672 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269850.sst) /dev/shm/ToplingTemp/Topling-116304-HnZ5fz 2024/11/23-16:35:58.038902 139957223556672 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269850.sst): first pass time = 1.01's, 133.362'MB/sec 2024/11/23-16:35:59.366591 139957223556672 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269850.sst): old prealloc_size = 147639500, real_size = 34684800 2024/11/23-16:35:59.367151 139957223556672 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269850.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 925144 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0327 GB avg-val = 117.08 avg-zval = 35.34 2024/11/23-16:35:59.369046 139957223556672 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269850.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:36:00.215557 139957223556672 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269850.sst): second pass time = 1.33's, 81.628'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.85's, 45.410'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3299.063'MB/sec (index lex order gen) rebuild zvType time = 0.72's, 0.321'MB/sec write SST data time = 0.13's, 299.548'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 30483.785'MB/sec zip my value time = 1.33's, unzip length = 0.108'GB zip my value throughput = 81.628'MB/sec zip pipeline throughput = 81.628'MB/sec entries = 925144 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.08 avg-zval = 35.34 usrkeys = 925144 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.08 avg-zval = 35.34 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 925144 bytes = 3006736 } seq expand size = 6476008 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0327 GB dict = 1.08 MB all = 0.0386 GB } UnZip/Zip{ index = 10.5138 value = 3.3130 dict = 1.00 all = 3.4816 } Zip/UnZip{ index = 0.0951 value = 0.3018 dict = 1.00 all = 0.2872 } ---------------------------- total value len = 11.234320 GB avg = 0.156 KB (by entry num) total key len = 1.991171 GB avg = 0.028 KB total ukey len = 1.390985 GB avg = 0.016 KB total ukey num = 0.085205798 Billion total entry num = 0.072013527 Billion write speed all = 0.478352533 MB/sec (with seq num) write speed all = 0.457515286 MB/sec (without seq num) 2024/11/23-16:36:00.262965 139957223556672 [compaction_job.cc:1948] [default] [JOB 30816] Generated table #269850: 925144 keys, 38550856 bytes, temperature: kWarm 2024/11/23-16:36:00.263045 139957223556672 EVENT_LOG_v1 {"time_micros": 1732350960263009, "cf_name": "default", "job": 30816, "event": "table_file_creation", "file_number": 269850, "file_size": 38550856, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4060761866, "largest_seqno": 4113714871, "table_properties": {"data_size": 32693488, "index_size": 1759872, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25904032, "raw_average_key_size": 28, "raw_value_size": 108313828, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 925144, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732350957, "oldest_key_time": 0, "file_creation_time": 1732350957, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 269850, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:36:00.299934 139957223556672 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269851.sst) /dev/shm/ToplingTemp/Topling-116304-kxkCgx 2024/11/23-16:36:00.440176 139957223556672 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269851.sst): first pass time = 0.14's, 243.148'MB/sec 2024/11/23-16:36:00.760144 139957223556672 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269851.sst): old prealloc_size = 147639500, real_size = 9515648 2024/11/23-16:36:00.760344 139957223556672 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269851.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 237626 prefix = 4 raw-key = 0.0038 GB zip-key = 0.0005 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.0274 GB zip-val = 0.0090 GB avg-val = 115.46 avg-zval = 37.89 2024/11/23-16:36:00.760554 139957223556672 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269851.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0005 GB, waited 0.000 sec, Key+Value = 0.034 GB 2024/11/23-16:36:00.969237 139957223556672 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00/269851.sst): second pass time = 0.32's, 85.932'MB/sec, value only(80.5% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.21's, 50.002'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2570.202'MB/sec (index lex order gen) rebuild zvType time = 0.18's, 0.338'MB/sec write SST data time = 0.03's, 314.276'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.282'MB, throughput = 9714.571'MB/sec zip my value time = 0.32's, unzip length = 0.027'GB zip my value throughput = 85.932'MB/sec zip pipeline throughput = 85.932'MB/sec entries = 237626 avg-key = 28.00 avg-zkey = 1.91 avg-val = 115.46 avg-zval = 37.89 usrkeys = 237626 avg-key = 20.00 avg-zkey = 1.91 avg-val = 122.46 avg-zval = 37.89 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 237626 bytes = 712896 } seq expand size = 1663382 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0048 GB value = 0.0274 GB dict = 0.28 MB all = 0.0341 GB } __ZipSize{ index = 0.0005 GB value = 0.0090 GB dict = 0.28 MB all = 0.0105 GB } UnZip/Zip{ index = 10.4825 value = 3.0477 dict = 1.00 all = 3.2611 } Zip/UnZip{ index = 0.0954 value = 0.3281 dict = 1.00 all = 0.3066 } ---------------------------- total value len = 11.263421 GB avg = 0.156 KB (by entry num) total key len = 1.997825 GB avg = 0.028 KB total ukey len = 1.395738 GB avg = 0.016 KB total ukey num = 0.085443424 Billion total entry num = 0.072251153 Billion write speed all = 0.479632655 MB/sec (with seq num) write speed all = 0.458727221 MB/sec (without seq num) 2024/11/23-16:36:00.987050 139957223556672 [compaction_job.cc:1948] [default] [JOB 30816] Generated table #269851: 237626 keys, 10453753 bytes, temperature: kWarm 2024/11/23-16:36:00.987109 139957223556672 EVENT_LOG_v1 {"time_micros": 1732350960987078, "cf_name": "default", "job": 30816, "event": "table_file_creation", "file_number": 269851, "file_size": 10453753, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4103119889, "largest_seqno": 4112206940, "table_properties": {"data_size": 9002672, "index_size": 453376, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 6653528, "raw_average_key_size": 28, "raw_value_size": 27437396, "raw_average_value_size": 115, "num_data_blocks": 1, "num_entries": 237626, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732350960, "oldest_key_time": 0, "file_creation_time": 1732350960, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 269851, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:36:01.001259 139957223556672 [compaction_job.cc:703] job-30816: subcompact[0], size: 0.804254 G, files: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30816/att-00 [269830,269831,269832,269833,269834,269835,269836,269837,269838,269839,269840,269841,269842,269843,269844,269845,269846,269847,269848,269849,269850,269851] 2024/11/23-16:36:01.130409 139957223556672 (Original Log Time 2024/11/23-16:34:46.611830) EVENT_LOG_v1 {"time_micros": 1732350886611764, "job": 30816, "event": "compaction_started", "compaction_reason": "FilesMarkedForCompaction", "files_L2": [269806], "files_L3": [269826, 269827, 269756, 269757, 269758, 269759, 269760, 269761, 269762, 269763, 269764, 269765, 269766, 269767, 269768, 269769, 269770, 269771, 269772, 269773, 269774, 269776], "score": 0.998312, "input_data_size": 821302538, "oldest_snapshot_seqno": 4113842015} 2024/11/23-16:36:01.130413 139957223556672 (Original Log Time 2024/11/23-16:36:01.128831) [compaction_job.cc:2022] [default] [JOB 30816] Compacted 1@2 + 22@3 files to L3 => 804254462 bytes 2024/11/23-16:36:01.130414 139957223556672 (Original Log Time 2024/11/23-16:36:01.130330) [compaction_job.cc:1224] [default] compacted to: files[0 0 0 22 0 0 0] max score 0.03, MB/sec: 11.0 rd, 10.8 wr, level 3, files in(1, 22) out(22 +0 blob) MB in(27.1, 756.2 +0.0 blob) out(767.0 +0.0 blob), read-write-amplify(57.2) write-amplify(28.3) OK, records in: 19987878, records dropped: 94889 output_compression: Snappy 2024/11/23-16:36:01.130418 139957223556672 (Original Log Time 2024/11/23-16:36:01.130380) EVENT_LOG_v1 {"time_micros": 1732350961130353, "cf": "default", "job": 30816, "event": "compaction_finished", "compaction_time_micros": 74389434, "compaction_time_cpu_micros": 31893857, "output_level": 3, "num_output_files": 22, "total_output_size": 804254462, "num_input_records": 19987878, "num_output_records": 19892989, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "file_write_nanos": 561255601, "file_range_sync_nanos": 0, "file_fsync_nanos": 16630, "file_prepare_write_nanos": 62576, "lsm_state": [0, 0, 0, 22, 0, 0, 0]} 2024/11/23-16:36:01.257066 139957223556672 DEBG dcompact_worker.cpp:240: HttpPost: 200 OK: url = http://nlb-7zny4kaa1poal01o64.cn-shenzhen.nlb.aliyuncs.com:8443, body = {"instanceId":"nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137","labourId":"","dbId":"d89b4006-2803-486e-b7a2-759bcf348921","dbStarts":1732256054,"starts":1732350886,"executesMs":74677,"compactionJobId":30816,"attempt":0,"compactionInputRawBytes":2866138969,"compactionInputZipBytes":821302538,"compactionOutputRawBytes":0,"compactionOutputZipBytes":804254462,"headers":{"Accept":"*/*","Connection":"close","Host":"aliyun-topling-saas.topling.cn:18443","RemoteIp":"120.24.192.169","X-Forwarded-For":"120.24.192.169","region":"cn-shenzhen","token":"e6474c481bd4415abc537135cc03626b","instance-token":"e6474c481bd4415abc537135cc03626b","provider":"aliyun","CloudMarketInstanceId":"si-59c0ae5c955845588903","MeteringAssit":"","Transfer-Encoding":"chunked","traceparent":"00-7ef8d9d23f1594f86aa7ee2c8b5d1b09-df6cf55ebddeb84d-00"}}, response = 2024/11/23-16:36:01.257149 139957223556672 INFO dcompact_worker.cpp:1459: finish /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-30816/att-00: olev 3, work 74.678 s, result 7.755 ms, install 1.602 ms, input{raw 2.669 GiB zip 783.255 MiB}