2024/11/23-14:53:06.031256 139957584442944 DEBG dcompact_worker.cpp:2214: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00: fork to child time = 0.008267 sec 2024/11/23-14:53:06.032030 139957584442944 DEBG dcompact_worker.cpp:1013: Beg SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00 2024/11/23-14:53:06.039375 139957584442944 DEBG dcompact_worker.cpp:1033: End SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00 2024/11/23-14:53:06.041069 139957584442944 TRAC dcompact_worker.cpp:1083: INFO_LOG_LEVEL: rpc = INFO_LEVEL, env_var = undefined 2024/11/23-14:53:06.041344 139957584442944 [WARN] [column_family.cc:386] multiple cf_paths/db_paths and level_compaction_dynamic_level_bytes can't be used together 2024/11/23-14:53:06.095522 139957584442944 [version_set.cc:6208] Recovering from manifest file: /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-28466/att-00/MANIFEST-206347 2024/11/23-14:53:06.111661 139957584442944 [version_set.cc:6251] Recovered from manifest file:/worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-28466/att-00/MANIFEST-206347 succeeded,manifest_file_number is 206347, next_file_number is 264691, last_sequence is 4042626878, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 264556 2024/11/23-14:53:06.111669 139957584442944 [version_set.cc:6266] Column family [default] (ID 0), log number is 0 2024/11/23-14:53:06.111808 139957584442944 [version_set.cc:5721] Creating manifest 264691 2024/11/23-14:53:06.144868 139957584442944 DEBG dcompact_worker.cpp:1218: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00: bottommost_level: fake = 1, rpc = 0 2024/11/23-14:53:06.166420 139957584442944 [compaction_job.cc:2437] [default] [JOB 28466] Compacting 1@2 + 25@3 files to L3, score 0.99, subcompactions 1 : 1 2024/11/23-14:53:06.166439 139957584442944 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 21262 Base level 2, inputs: [264687(27MB)], [264606(37MB) 264607(39MB) 264636(39MB) 264637(37MB) 264638(34MB) 264639(33MB) 264640(34MB) 264641(33MB) 264642(34MB) 264643(35MB) 264644(35MB) 264645(35MB) 264646(35MB) 264647(37MB) 264648(35MB) 264649(37MB) 264650(35MB) 264651(34MB) 264652(37MB) 264653(34MB) 264654(37MB) 264655(35MB) 264656(35MB) 264657(36MB) 264658(39MB)] 2024/11/23-14:53:06.175076 139957584442944 [top_zip_table.cc:59] core git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-14:53:06.175115 139957584442944 [top_zip_table.cc:60] fsa git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-14:53:06.175142 139957584442944 [top_zip_table.cc:61] zbs git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-14:53:06.175151 139957584442944 [top_zip_table.cc:62] topling-zip_table_reader: git_version_hash_info_is: commit a4a382006cb82713acf5b3425835f22711877681 Author: leipeng Date: 2024-04-11 19:44:14 +0800 fixed_len_hole_index.cc: Add env bool FixedLenHoleIndexUseAVX512 for ut & debug 1. FixedLenHoleIndexUseAVX512 is only in unit tests or debug 2. In release mode, use avx512 by compile options(-march=) g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/23-14:53:06.175166 139957584442944 [top_zip_table.cc:64] topling-rocks git_version_hash_info_is: commit feab587e468621ba0204d47b4ffacc52e7c4290d Author: leipeng Date: 2024-03-22 13:35:06 +0800 ToplingZipTableBuilder::Add: immediately return after error This function returns void, and caller does not check builder->status() after calling this function and graceful abandon. So immediately return after error, and return error status in Finish(). g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/23-14:53:06.778371 139957584442944 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264692.sst) /dev/shm/ToplingTemp/Topling-82429-NrDSE3 2024/11/23-14:53:07.441217 139957584442944 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264692.sst): first pass time = 0.66's, 202.501'MB/sec 2024/11/23-14:53:08.958310 139957584442944 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264692.sst): old prealloc_size = 147639500, real_size = 34990880 2024/11/23-14:53:08.958871 139957584442944 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264692.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 929137 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0330 GB avg-val = 116.45 avg-zval = 35.51 2024/11/23-14:53:08.959659 139957584442944 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264692.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-14:53:10.115971 139957584442944 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264692.sst): second pass time = 1.52's, 71.401'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.16's, 33.675'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3224.077'MB/sec (index lex order gen) rebuild zvType time = 1.02's, 0.227'MB/sec write SST data time = 0.13's, 289.774'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 41828.213'MB/sec zip my value time = 1.52's, unzip length = 0.108'GB zip my value throughput = 71.401'MB/sec zip pipeline throughput = 71.401'MB/sec entries = 929137 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.45 avg-zval = 35.51 usrkeys = 929137 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.45 avg-zval = 35.51 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 929137 bytes = 3135856 } seq expand size = 6503959 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0330 GB dict = 1.08 MB all = 0.0390 GB } UnZip/Zip{ index = 10.5133 value = 3.2798 dict = 1.00 all = 3.4429 } Zip/UnZip{ index = 0.0951 value = 0.3049 dict = 1.00 all = 0.2905 } ---------------------------- total value len = 8.963326 GB avg = 0.168 KB (by entry num) total key len = 1.466837 GB avg = 0.028 KB total ukey len = 1.016461 GB avg = 0.015 KB total ukey num = 0.066479572 Billion total entry num = 0.053287301 Billion write speed all = 0.485622991 MB/sec (with seq num) write speed all = 0.465774757 MB/sec (without seq num) 2024/11/23-14:53:10.201086 139957584442944 [compaction_job.cc:1948] [default] [JOB 28466] Generated table #264692: 929137 keys, 38983644 bytes, temperature: kWarm 2024/11/23-14:53:10.201153 139957584442944 EVENT_LOG_v1 {"time_micros": 1732344790201110, "cf_name": "default", "job": 28466, "event": "table_file_creation", "file_number": 264692, "file_size": 38983644, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3934836997, "largest_seqno": 4042593318, "table_properties": {"data_size": 32990864, "index_size": 1767552, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26015836, "raw_average_key_size": 28, "raw_value_size": 108202018, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 929137, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732344786, "oldest_key_time": 0, "file_creation_time": 1732344786, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 264692, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-14:53:10.243055 139957584442944 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264693.sst) /dev/shm/ToplingTemp/Topling-82429-O8RI67 2024/11/23-14:53:11.186981 139957584442944 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264693.sst): first pass time = 0.94's, 142.197'MB/sec 2024/11/23-14:53:13.875194 139957584442944 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264693.sst): old prealloc_size = 147639500, real_size = 37025888 2024/11/23-14:53:13.875877 139957584442944 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264693.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 923571 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1084 GB zip-val = 0.0350 GB avg-val = 117.32 avg-zval = 37.92 2024/11/23-14:53:13.876659 139957584442944 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264693.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-14:53:14.945722 139957584442944 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264693.sst): second pass time = 2.69's, 40.323'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.07's, 38.084'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2678.018'MB/sec (index lex order gen) rebuild zvType time = 0.88's, 0.262'MB/sec write SST data time = 0.19's, 217.840'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.083'MB, throughput = 34863.067'MB/sec zip my value time = 2.69's, unzip length = 0.108'GB zip my value throughput = 40.323'MB/sec zip pipeline throughput = 69.693'MB/sec entries = 923571 avg-key = 28.00 avg-zkey = 1.91 avg-val = 117.32 avg-zval = 37.92 usrkeys = 923571 avg-key = 20.00 avg-zkey = 1.91 avg-val = 124.32 avg-zval = 37.92 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 923571 bytes = 2886176 } seq expand size = 6464997 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0185 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0350 GB dict = 1.08 MB all = 0.0408 GB } UnZip/Zip{ index = 10.4450 value = 3.0936 dict = 1.00 all = 3.2921 } Zip/UnZip{ index = 0.0957 value = 0.3232 dict = 1.00 all = 0.3038 } ---------------------------- total value len = 9.078149 GB avg = 0.167 KB (by entry num) total key len = 1.492697 GB avg = 0.028 KB total ukey len = 1.034932 GB avg = 0.015 KB total ukey num = 0.067403143 Billion total entry num = 0.054210872 Billion write speed all = 0.492062458 MB/sec (with seq num) write speed all = 0.471874756 MB/sec (without seq num) 2024/11/23-14:53:14.998269 139957584442944 [compaction_job.cc:1948] [default] [JOB 28466] Generated table #264693: 923571 keys, 40769804 bytes, temperature: kWarm 2024/11/23-14:53:14.998341 139957584442944 EVENT_LOG_v1 {"time_micros": 1732344794998306, "cf_name": "default", "job": 28466, "event": "table_file_creation", "file_number": 264693, "file_size": 40769804, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4012777810, "largest_seqno": 4042598224, "table_properties": {"data_size": 35026384, "index_size": 1768448, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25859988, "raw_average_key_size": 28, "raw_value_size": 108357790, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 923571, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732344790, "oldest_key_time": 0, "file_creation_time": 1732344790, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 264693, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-14:53:15.041677 139957584442944 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264694.sst) /dev/shm/ToplingTemp/Topling-82429-PtLES4 2024/11/23-14:53:16.317146 139957584442944 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264694.sst): first pass time = 1.28's, 105.234'MB/sec 2024/11/23-14:53:19.218426 139957584442944 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264694.sst): old prealloc_size = 147639500, real_size = 37564864 2024/11/23-14:53:19.219010 139957584442944 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264694.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 924232 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0017 GB avg-key = 16.00 avg-zkey = 1.89 raw-val = 0.1083 GB zip-val = 0.0356 GB avg-val = 117.22 avg-zval = 38.50 2024/11/23-14:53:19.219870 139957584442944 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264694.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-14:53:20.265908 139957584442944 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264694.sst): second pass time = 2.90's, 37.353'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.05's, 39.884'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3088.306'MB/sec (index lex order gen) rebuild zvType time = 0.81's, 0.285'MB/sec write SST data time = 0.24's, 177.714'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.082'MB, throughput = 36394.335'MB/sec zip my value time = 2.90's, unzip length = 0.108'GB zip my value throughput = 37.353'MB/sec zip pipeline throughput = 104.174'MB/sec entries = 924232 avg-key = 28.00 avg-zkey = 1.89 avg-val = 117.22 avg-zval = 38.50 usrkeys = 924232 avg-key = 20.00 avg-zkey = 1.89 avg-val = 124.22 avg-zval = 38.50 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 924232 bytes = 3350352 } seq expand size = 6469624 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0017 GB value = 0.0356 GB dict = 1.08 MB all = 0.0418 GB } UnZip/Zip{ index = 10.5838 value = 3.0443 dict = 1.00 all = 3.2128 } Zip/UnZip{ index = 0.0945 value = 0.3285 dict = 1.00 all = 0.3113 } ---------------------------- total value len = 9.192957 GB avg = 0.167 KB (by entry num) total key len = 1.518575 GB avg = 0.028 KB total ukey len = 1.053417 GB avg = 0.015 KB total ukey num = 0.068327375 Billion total entry num = 0.055135104 Billion write speed all = 0.498487868 MB/sec (with seq num) write speed all = 0.477961072 MB/sec (without seq num) 2024/11/23-14:53:20.320663 139957584442944 [compaction_job.cc:1948] [default] [JOB 28466] Generated table #264694: 924232 keys, 41775570 bytes, temperature: kWarm 2024/11/23-14:53:20.320752 139957584442944 EVENT_LOG_v1 {"time_micros": 1732344800320706, "cf_name": "default", "job": 28466, "event": "table_file_creation", "file_number": 264694, "file_size": 41775570, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3736072251, "largest_seqno": 4042597884, "table_properties": {"data_size": 35587120, "index_size": 1746496, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25878496, "raw_average_key_size": 28, "raw_value_size": 108339264, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 924232, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732344795, "oldest_key_time": 0, "file_creation_time": 1732344795, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 264694, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-14:53:20.383760 139957584442944 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264695.sst) /dev/shm/ToplingTemp/Topling-82429-3SRc67 2024/11/23-14:53:21.834146 139957584442944 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264695.sst): first pass time = 1.45's, 92.542'MB/sec 2024/11/23-14:53:23.899567 139957584442944 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264695.sst): old prealloc_size = 147639500, real_size = 35045456 2024/11/23-14:53:23.900273 139957584442944 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264695.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 925203 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.93 raw-val = 0.1083 GB zip-val = 0.0330 GB avg-val = 117.07 avg-zval = 35.70 2024/11/23-14:53:23.901197 139957584442944 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264695.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-14:53:25.151609 139957584442944 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264695.sst): second pass time = 2.06's, 52.480'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.25's, 31.353'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2593.088'MB/sec (index lex order gen) rebuild zvType time = 1.07's, 0.217'MB/sec write SST data time = 0.18's, 212.276'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 36054.433'MB/sec zip my value time = 2.06's, unzip length = 0.108'GB zip my value throughput = 52.480'MB/sec zip pipeline throughput = 52.480'MB/sec entries = 925203 avg-key = 28.00 avg-zkey = 1.93 avg-val = 117.07 avg-zval = 35.70 usrkeys = 925203 avg-key = 20.00 avg-zkey = 1.93 avg-val = 124.07 avg-zval = 35.70 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 925203 bytes = 3353872 } seq expand size = 6476421 multi value expand size = 0 cnt WriteAppend = 16 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0330 GB dict = 1.08 MB all = 0.0393 GB } UnZip/Zip{ index = 10.3771 value = 3.2791 dict = 1.00 all = 3.4191 } Zip/UnZip{ index = 0.0964 value = 0.3050 dict = 1.00 all = 0.2925 } ---------------------------- total value len = 9.307746 GB avg = 0.166 KB (by entry num) total key len = 1.544481 GB avg = 0.028 KB total ukey len = 1.071921 GB avg = 0.015 KB total ukey num = 0.069252578 Billion total entry num = 0.056060307 Billion write speed all = 0.504920622 MB/sec (with seq num) write speed all = 0.484054118 MB/sec (without seq num) 2024/11/23-14:53:25.201328 139957584442944 [compaction_job.cc:1948] [default] [JOB 28466] Generated table #264695: 925203 keys, 39254760 bytes, temperature: kWarm 2024/11/23-14:53:25.201398 139957584442944 EVENT_LOG_v1 {"time_micros": 1732344805201362, "cf_name": "default", "job": 28466, "event": "table_file_creation", "file_number": 264695, "file_size": 39254760, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3583362754, "largest_seqno": 4012776108, "table_properties": {"data_size": 33030784, "index_size": 1783168, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25905684, "raw_average_key_size": 28, "raw_value_size": 108312158, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 925203, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732344800, "oldest_key_time": 0, "file_creation_time": 1732344800, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 264695, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-14:53:25.241424 139957584442944 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264696.sst) /dev/shm/ToplingTemp/Topling-82429-nvhlO7 2024/11/23-14:53:26.167769 139957584442944 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264696.sst): first pass time = 0.93's, 144.897'MB/sec 2024/11/23-14:53:27.855462 139957584442944 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264696.sst): old prealloc_size = 147639500, real_size = 32531248 2024/11/23-14:53:27.856043 139957584442944 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264696.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 933961 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.93 raw-val = 0.1081 GB zip-val = 0.0305 GB avg-val = 115.71 avg-zval = 32.65 2024/11/23-14:53:27.856880 139957584442944 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264696.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-14:53:28.943085 139957584442944 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264696.sst): second pass time = 1.69's, 64.083'MB/sec, value only(80.5% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.09's, 33.914'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3251.257'MB/sec (index lex order gen) rebuild zvType time = 0.93's, 0.252'MB/sec write SST data time = 0.16's, 229.632'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 37071.190'MB/sec zip my value time = 1.69's, unzip length = 0.108'GB zip my value throughput = 64.083'MB/sec zip pipeline throughput = 72.073'MB/sec entries = 933961 avg-key = 28.00 avg-zkey = 1.93 avg-val = 115.71 avg-zval = 32.65 usrkeys = 933961 avg-key = 20.00 avg-zkey = 1.93 avg-val = 122.71 avg-zval = 32.65 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 933961 bytes = 3502368 } seq expand size = 6537727 multi value expand size = 0 cnt WriteAppend = 15 UnZipSize{ index = 0.0187 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0305 GB dict = 1.08 MB all = 0.0369 GB } UnZip/Zip{ index = 10.3796 value = 3.5434 dict = 1.00 all = 3.6389 } Zip/UnZip{ index = 0.0963 value = 0.2822 dict = 1.00 all = 0.2748 } ---------------------------- total value len = 9.422351 GB avg = 0.165 KB (by entry num) total key len = 1.570632 GB avg = 0.028 KB total ukey len = 1.090600 GB avg = 0.016 KB total ukey num = 0.070186539 Billion total entry num = 0.056994268 Billion write speed all = 0.511379329 MB/sec (with seq num) write speed all = 0.490168932 MB/sec (without seq num) 2024/11/23-14:53:28.989521 139957584442944 [compaction_job.cc:1948] [default] [JOB 28466] Generated table #264696: 933961 keys, 36884470 bytes, temperature: kWarm 2024/11/23-14:53:28.989587 139957584442944 EVENT_LOG_v1 {"time_micros": 1732344808989553, "cf_name": "default", "job": 28466, "event": "table_file_creation", "file_number": 264696, "file_size": 36884470, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3376774746, "largest_seqno": 4012776149, "table_properties": {"data_size": 30497952, "index_size": 1799616, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26150908, "raw_average_key_size": 28, "raw_value_size": 108066830, "raw_average_value_size": 115, "num_data_blocks": 1, "num_entries": 933961, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732344805, "oldest_key_time": 0, "file_creation_time": 1732344805, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 264696, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-14:53:29.028896 139957584442944 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264697.sst) /dev/shm/ToplingTemp/Topling-82429-4ZScy6 2024/11/23-14:53:29.898383 139957584442944 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264697.sst): first pass time = 0.87's, 154.373'MB/sec 2024/11/23-14:53:31.586458 139957584442944 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264697.sst): old prealloc_size = 147639500, real_size = 31950752 2024/11/23-14:53:31.587230 139957584442944 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264697.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 933773 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1081 GB zip-val = 0.0299 GB avg-val = 115.74 avg-zval = 32.06 2024/11/23-14:53:31.588120 139957584442944 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264697.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-14:53:32.671153 139957584442944 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264697.sst): second pass time = 1.68's, 64.156'MB/sec, value only(80.5% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.08's, 33.361'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2359.106'MB/sec (index lex order gen) rebuild zvType time = 0.92's, 0.253'MB/sec write SST data time = 0.16's, 226.278'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 27096.004'MB/sec zip my value time = 1.68's, unzip length = 0.108'GB zip my value throughput = 64.156'MB/sec zip pipeline throughput = 64.156'MB/sec entries = 933773 avg-key = 28.00 avg-zkey = 1.90 avg-val = 115.74 avg-zval = 32.06 usrkeys = 933773 avg-key = 20.00 avg-zkey = 1.90 avg-val = 122.74 avg-zval = 32.06 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 933773 bytes = 3384944 } seq expand size = 6536411 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0187 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0299 GB dict = 1.08 MB all = 0.0362 GB } UnZip/Zip{ index = 10.5139 value = 3.6095 dict = 1.00 all = 3.7091 } Zip/UnZip{ index = 0.0951 value = 0.2770 dict = 1.00 all = 0.2696 } ---------------------------- total value len = 9.536959 GB avg = 0.165 KB (by entry num) total key len = 1.596778 GB avg = 0.028 KB total ukey len = 1.109276 GB avg = 0.016 KB total ukey num = 0.071120312 Billion total entry num = 0.057928041 Billion write speed all = 0.517837226 MB/sec (with seq num) write speed all = 0.496283064 MB/sec (without seq num) 2024/11/23-14:53:32.717554 139957584442944 [compaction_job.cc:1948] [default] [JOB 28466] Generated table #264697: 933773 keys, 36186262 bytes, temperature: kWarm 2024/11/23-14:53:32.717632 139957584442944 EVENT_LOG_v1 {"time_micros": 1732344812717588, "cf_name": "default", "job": 28466, "event": "table_file_creation", "file_number": 264697, "file_size": 36186262, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3563652023, "largest_seqno": 4012776165, "table_properties": {"data_size": 29940880, "index_size": 1776256, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26145644, "raw_average_key_size": 28, "raw_value_size": 108072122, "raw_average_value_size": 115, "num_data_blocks": 1, "num_entries": 933773, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732344809, "oldest_key_time": 0, "file_creation_time": 1732344809, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 264697, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-14:53:32.756360 139957584442944 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264698.sst) /dev/shm/ToplingTemp/Topling-82429-aRCdy4 2024/11/23-14:53:33.830058 139957584442944 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264698.sst): first pass time = 1.07's, 125.010'MB/sec 2024/11/23-14:53:35.334970 139957584442944 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264698.sst): old prealloc_size = 147639500, real_size = 31396928 2024/11/23-14:53:35.335741 139957584442944 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264698.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 934645 prefix = 4 raw-key = 0.0150 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1080 GB zip-val = 0.0294 GB avg-val = 115.60 avg-zval = 31.44 2024/11/23-14:53:35.336639 139957584442944 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264698.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-14:53:36.340936 139957584442944 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264698.sst): second pass time = 1.50's, 71.859'MB/sec, value only(80.5% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.01's, 35.308'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2426.662'MB/sec (index lex order gen) rebuild zvType time = 0.80's, 0.293'MB/sec write SST data time = 0.21's, 170.131'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 36303.122'MB/sec zip my value time = 1.50's, unzip length = 0.108'GB zip my value throughput = 71.859'MB/sec zip pipeline throughput = 71.859'MB/sec entries = 934645 avg-key = 28.00 avg-zkey = 1.90 avg-val = 115.60 avg-zval = 31.44 usrkeys = 934645 avg-key = 20.00 avg-zkey = 1.90 avg-val = 122.60 avg-zval = 31.44 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 934645 bytes = 3271280 } seq expand size = 6542515 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0187 GB value = 0.1080 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0294 GB dict = 1.08 MB all = 0.0355 GB } UnZip/Zip{ index = 10.5135 value = 3.6770 dict = 1.00 all = 3.7788 } Zip/UnZip{ index = 0.0951 value = 0.2720 dict = 1.00 all = 0.2646 } ---------------------------- total value len = 9.651549 GB avg = 0.164 KB (by entry num) total key len = 1.622948 GB avg = 0.028 KB total ukey len = 1.127968 GB avg = 0.016 KB total ukey num = 0.072054957 Billion total entry num = 0.058862686 Billion write speed all = 0.524294589 MB/sec (with seq num) write speed all = 0.502396397 MB/sec (without seq num) 2024/11/23-14:53:36.387006 139957584442944 [compaction_job.cc:1948] [default] [JOB 28466] Generated table #264698: 934645 keys, 35518276 bytes, temperature: kWarm 2024/11/23-14:53:36.387076 139957584442944 EVENT_LOG_v1 {"time_micros": 1732344816387041, "cf_name": "default", "job": 28466, "event": "table_file_creation", "file_number": 264698, "file_size": 35518276, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3759280178, "largest_seqno": 4012776176, "table_properties": {"data_size": 29385072, "index_size": 1777984, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26170060, "raw_average_key_size": 28, "raw_value_size": 108047734, "raw_average_value_size": 115, "num_data_blocks": 1, "num_entries": 934645, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732344812, "oldest_key_time": 0, "file_creation_time": 1732344812, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 264698, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-14:53:36.426082 139957584442944 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264699.sst) /dev/shm/ToplingTemp/Topling-82429-bY8rR6 2024/11/23-14:53:37.608226 139957584442944 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264699.sst): first pass time = 1.18's, 113.542'MB/sec 2024/11/23-14:53:39.032446 139957584442944 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264699.sst): old prealloc_size = 147639500, real_size = 30396720 2024/11/23-14:53:39.033181 139957584442944 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264699.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 931746 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.93 raw-val = 0.1081 GB zip-val = 0.0284 GB avg-val = 116.05 avg-zval = 30.45 2024/11/23-14:53:39.035260 139957584442944 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264699.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-14:53:39.959158 139957584442944 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264699.sst): second pass time = 1.42's, 76.008'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.93's, 37.332'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2513.373'MB/sec (index lex order gen) rebuild zvType time = 0.76's, 0.306'MB/sec write SST data time = 0.16's, 209.821'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 24085.748'MB/sec zip my value time = 1.42's, unzip length = 0.108'GB zip my value throughput = 76.008'MB/sec zip pipeline throughput = 76.008'MB/sec entries = 931746 avg-key = 28.00 avg-zkey = 1.93 avg-val = 116.05 avg-zval = 30.45 usrkeys = 931746 avg-key = 20.00 avg-zkey = 1.93 avg-val = 122.92 avg-zval = 30.45 TagRS{ kinds = RS_Key0_TagN bytes = 145680 } TagArray{ size = 913805 bytes = 3198336 } seq expand size = 6396635 multi value expand size = 0 cnt WriteAppend = 15 UnZipSize{ index = 0.0186 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0284 GB dict = 1.08 MB all = 0.0346 GB } UnZip/Zip{ index = 10.3775 value = 3.8117 dict = 1.00 all = 3.8797 } Zip/UnZip{ index = 0.0964 value = 0.2624 dict = 1.00 all = 0.2578 } ---------------------------- total value len = 9.766075 GB avg = 0.163 KB (by entry num) total key len = 1.649037 GB avg = 0.028 KB total ukey len = 1.146603 GB avg = 0.016 KB total ukey num = 0.072986703 Billion total entry num = 0.059794432 Billion write speed all = 0.530744242 MB/sec (with seq num) write speed all = 0.508503162 MB/sec (without seq num) 2024/11/23-14:53:40.004025 139957584442944 [compaction_job.cc:1948] [default] [JOB 28466] Generated table #264699: 931746 keys, 34595190 bytes, temperature: kWarm 2024/11/23-14:53:40.004088 139957584442944 EVENT_LOG_v1 {"time_micros": 1732344820004055, "cf_name": "default", "job": 28466, "event": "table_file_creation", "file_number": 264699, "file_size": 34595190, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4012776192, "table_properties": {"data_size": 28367904, "index_size": 1795712, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26088888, "raw_average_key_size": 28, "raw_value_size": 108128964, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 931746, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732344816, "oldest_key_time": 0, "file_creation_time": 1732344816, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 264699, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-14:53:40.043783 139957584442944 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264700.sst) /dev/shm/ToplingTemp/Topling-82429-0VRq23 2024/11/23-14:53:41.303355 139957584442944 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264700.sst): first pass time = 1.26's, 106.562'MB/sec 2024/11/23-14:53:42.909862 139957584442944 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264700.sst): old prealloc_size = 147639500, real_size = 34944800 2024/11/23-14:53:42.910520 139957584442944 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264700.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 1081477 prefix = 4 raw-key = 0.0173 GB zip-key = 0.0021 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1039 GB zip-val = 0.0326 GB avg-val = 96.11 avg-zval = 30.16 2024/11/23-14:53:42.910554 139957584442944 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264700.sst: sumWaitingMem = 0.003 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0028 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-14:53:43.594852 139957584442944 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264700.sst): second pass time = 1.61's, 64.723'MB/sec, value only(77.4% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.68's, 52.140'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3213.795'MB/sec (index lex order gen) rebuild zvType time = 0.55's, 0.496'MB/sec write SST data time = 0.14's, 257.520'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.029'MB, throughput = 34609.029'MB/sec zip my value time = 1.61's, unzip length = 0.104'GB zip my value throughput = 64.723'MB/sec zip pipeline throughput = 64.723'MB/sec entries = 1081477 avg-key = 28.00 avg-zkey = 1.90 avg-val = 96.11 avg-zval = 30.16 usrkeys = 1081477 avg-key = 20.00 avg-zkey = 1.90 avg-val = 96.11 avg-zval = 30.16 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 11 UnZipSize{ index = 0.0216 GB value = 0.1039 GB dict = 1.03 MB all = 0.1342 GB } __ZipSize{ index = 0.0021 GB value = 0.0326 GB dict = 1.03 MB all = 0.0357 GB } UnZip/Zip{ index = 10.5163 value = 3.1865 dict = 1.00 all = 3.7581 } Zip/UnZip{ index = 0.0951 value = 0.3138 dict = 1.00 all = 0.2661 } ---------------------------- total value len = 9.870011 GB avg = 0.162 KB (by entry num) total key len = 1.679318 GB avg = 0.028 KB total ukey len = 1.168233 GB avg = 0.016 KB total ukey num = 0.074068180 Billion total entry num = 0.060875909 Billion write speed all = 0.536893928 MB/sec (with seq num) write speed all = 0.514254410 MB/sec (without seq num) 2024/11/23-14:53:43.642784 139957584442944 [compaction_job.cc:1948] [default] [JOB 28466] Generated table #264700: 1081477 keys, 35714166 bytes, temperature: kWarm 2024/11/23-14:53:43.642850 139957584442944 EVENT_LOG_v1 {"time_micros": 1732344823642817, "cf_name": "default", "job": 28466, "event": "table_file_creation", "file_number": 264700, "file_size": 35714166, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 32617488, "index_size": 2056768, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 30281356, "raw_average_key_size": 28, "raw_value_size": 103936503, "raw_average_value_size": 96, "num_data_blocks": 1, "num_entries": 1081477, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732344820, "oldest_key_time": 0, "file_creation_time": 1732344820, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 264700, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-14:53:43.682160 139957584442944 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264701.sst) /dev/shm/ToplingTemp/Topling-82429-gIMbR5 2024/11/23-14:53:44.832783 139957584442944 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264701.sst): first pass time = 1.15's, 116.651'MB/sec 2024/11/23-14:53:46.369386 139957584442944 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264701.sst): old prealloc_size = 147639500, real_size = 34505968 2024/11/23-14:53:46.369933 139957584442944 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264701.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 921703 prefix = 4 raw-key = 0.0147 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1084 GB zip-val = 0.0325 GB avg-val = 117.62 avg-zval = 35.28 2024/11/23-14:53:46.370548 139957584442944 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264701.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-14:53:47.175481 139957584442944 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264701.sst): second pass time = 1.54's, 70.600'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.81's, 47.000'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3340.699'MB/sec (index lex order gen) rebuild zvType time = 0.68's, 0.340'MB/sec write SST data time = 0.13's, 297.056'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.084'MB, throughput = 27115.932'MB/sec zip my value time = 1.54's, unzip length = 0.108'GB zip my value throughput = 70.600'MB/sec zip pipeline throughput = 70.600'MB/sec entries = 921703 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.62 avg-zval = 35.28 usrkeys = 921703 avg-key = 20.00 avg-zkey = 1.90 avg-val = 122.42 avg-zval = 35.28 TagRS{ kinds = RS_Key0_TagN bytes = 144120 } TagArray{ size = 632718 bytes = 2372704 } seq expand size = 4429026 multi value expand size = 0 cnt WriteAppend = 15 UnZipSize{ index = 0.0184 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0325 GB dict = 1.08 MB all = 0.0379 GB } UnZip/Zip{ index = 10.5125 value = 3.3335 dict = 1.00 all = 3.5427 } Zip/UnZip{ index = 0.0951 value = 0.3000 dict = 1.00 all = 0.2823 } ---------------------------- total value len = 9.982851 GB avg = 0.162 KB (by entry num) total key len = 1.705126 GB avg = 0.028 KB total ukey len = 1.186667 GB avg = 0.016 KB total ukey num = 0.074989883 Billion total entry num = 0.061797612 Billion write speed all = 0.543248781 MB/sec (with seq num) write speed all = 0.520270310 MB/sec (without seq num) 2024/11/23-14:53:47.222496 139957584442944 [compaction_job.cc:1948] [default] [JOB 28466] Generated table #264701: 921703 keys, 37885378 bytes, temperature: kWarm 2024/11/23-14:53:47.222559 139957584442944 EVENT_LOG_v1 {"time_micros": 1732344827222525, "cf_name": "default", "job": 28466, "event": "table_file_creation", "file_number": 264701, "file_size": 37885378, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4009662773, "table_properties": {"data_size": 32521824, "index_size": 1753536, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25807684, "raw_average_key_size": 28, "raw_value_size": 108410122, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 921703, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732344823, "oldest_key_time": 0, "file_creation_time": 1732344823, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 264701, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-14:53:47.261523 139957584442944 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264702.sst) /dev/shm/ToplingTemp/Topling-82429-RkPUT6 2024/11/23-14:53:48.430460 139957584442944 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264702.sst): first pass time = 1.17's, 114.824'MB/sec 2024/11/23-14:53:49.916932 139957584442944 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264702.sst): old prealloc_size = 147639500, real_size = 32961184 2024/11/23-14:53:49.917679 139957584442944 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264702.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 931429 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1081 GB zip-val = 0.0310 GB avg-val = 116.10 avg-zval = 33.24 2024/11/23-14:53:49.918564 139957584442944 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264702.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-14:53:50.800506 139957584442944 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264702.sst): second pass time = 1.49's, 72.790'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.88's, 42.090'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2489.747'MB/sec (index lex order gen) rebuild zvType time = 0.75's, 0.312'MB/sec write SST data time = 0.14's, 271.627'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 36742.433'MB/sec zip my value time = 1.49's, unzip length = 0.108'GB zip my value throughput = 72.790'MB/sec zip pipeline throughput = 72.790'MB/sec entries = 931429 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.10 avg-zval = 33.24 usrkeys = 931429 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.10 avg-zval = 33.24 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 931429 bytes = 3376448 } seq expand size = 6520003 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0186 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0310 GB dict = 1.08 MB all = 0.0372 GB } UnZip/Zip{ index = 10.5141 value = 3.4932 dict = 1.00 all = 3.6091 } Zip/UnZip{ index = 0.0951 value = 0.2863 dict = 1.00 all = 0.2771 } ---------------------------- total value len = 10.097508 GB avg = 0.161 KB (by entry num) total key len = 1.731206 GB avg = 0.028 KB total ukey len = 1.205296 GB avg = 0.016 KB total ukey num = 0.075921312 Billion total entry num = 0.062729041 Billion write speed all = 0.549697554 MB/sec (with seq num) write speed all = 0.526376676 MB/sec (without seq num) 2024/11/23-14:53:50.845943 139957584442944 [compaction_job.cc:1948] [default] [JOB 28466] Generated table #264702: 931429 keys, 37188484 bytes, temperature: kWarm 2024/11/23-14:53:50.846032 139957584442944 EVENT_LOG_v1 {"time_micros": 1732344830845997, "cf_name": "default", "job": 28466, "event": "table_file_creation", "file_number": 264702, "file_size": 37188484, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3487497056, "largest_seqno": 4012775885, "table_properties": {"data_size": 30956368, "index_size": 1771776, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26080012, "raw_average_key_size": 28, "raw_value_size": 108137762, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 931429, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732344827, "oldest_key_time": 0, "file_creation_time": 1732344827, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 264702, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-14:53:50.882200 139957584442944 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264703.sst) /dev/shm/ToplingTemp/Topling-82429-4pQlP6 2024/11/23-14:53:51.848748 139957584442944 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264703.sst): first pass time = 0.97's, 138.868'MB/sec 2024/11/23-14:53:53.192646 139957584442944 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264703.sst): old prealloc_size = 147639500, real_size = 32849504 2024/11/23-14:53:53.193221 139957584442944 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264703.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 931309 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1081 GB zip-val = 0.0308 GB avg-val = 116.12 avg-zval = 33.12 2024/11/23-14:53:53.194026 139957584442944 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264703.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-14:53:54.054898 139957584442944 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264703.sst): second pass time = 1.34's, 80.512'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.86's, 42.865'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3205.940'MB/sec (index lex order gen) rebuild zvType time = 0.74's, 0.317'MB/sec write SST data time = 0.13's, 291.961'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 35844.543'MB/sec zip my value time = 1.34's, unzip length = 0.108'GB zip my value throughput = 80.512'MB/sec zip pipeline throughput = 80.512'MB/sec entries = 931309 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.12 avg-zval = 33.12 usrkeys = 931309 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.12 avg-zval = 33.12 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 931309 bytes = 3259600 } seq expand size = 6519163 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0186 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0308 GB dict = 1.08 MB all = 0.0370 GB } UnZip/Zip{ index = 10.5116 value = 3.5060 dict = 1.00 all = 3.6314 } Zip/UnZip{ index = 0.0951 value = 0.2852 dict = 1.00 all = 0.2754 } ---------------------------- total value len = 10.212169 GB avg = 0.160 KB (by entry num) total key len = 1.757282 GB avg = 0.028 KB total ukey len = 1.223922 GB avg = 0.016 KB total ukey num = 0.076852621 Billion total entry num = 0.063660350 Billion write speed all = 0.556153695 MB/sec (with seq num) write speed all = 0.532490161 MB/sec (without seq num) 2024/11/23-14:53:54.101281 139957584442944 [compaction_job.cc:1948] [default] [JOB 28466] Generated table #264703: 931309 keys, 36960232 bytes, temperature: kWarm 2024/11/23-14:53:54.101350 139957584442944 EVENT_LOG_v1 {"time_micros": 1732344834101315, "cf_name": "default", "job": 28466, "event": "table_file_creation", "file_number": 264703, "file_size": 36960232, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3807172320, "largest_seqno": 4012775902, "table_properties": {"data_size": 30844496, "index_size": 1771968, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26076652, "raw_average_key_size": 28, "raw_value_size": 108141150, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 931309, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732344830, "oldest_key_time": 0, "file_creation_time": 1732344830, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 264703, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-14:53:54.139539 139957584442944 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264704.sst) /dev/shm/ToplingTemp/Topling-82429-A4YiO7 2024/11/23-14:53:55.040972 139957584442944 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264704.sst): first pass time = 0.90's, 148.900'MB/sec 2024/11/23-14:53:56.389566 139957584442944 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264704.sst): old prealloc_size = 147639500, real_size = 33014736 2024/11/23-14:53:56.390205 139957584442944 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264704.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 931462 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1081 GB zip-val = 0.0310 GB avg-val = 116.09 avg-zval = 33.28 2024/11/23-14:53:56.391046 139957584442944 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264704.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-14:53:57.248881 139957584442944 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264704.sst): second pass time = 1.35's, 80.256'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.86's, 43.476'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2860.472'MB/sec (index lex order gen) rebuild zvType time = 0.73's, 0.318'MB/sec write SST data time = 0.13's, 293.902'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 30933.479'MB/sec zip my value time = 1.35's, unzip length = 0.108'GB zip my value throughput = 80.256'MB/sec zip pipeline throughput = 80.256'MB/sec entries = 931462 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.09 avg-zval = 33.28 usrkeys = 931462 avg-key = 20.00 avg-zkey = 1.91 avg-val = 123.09 avg-zval = 33.28 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 931462 bytes = 3492992 } seq expand size = 6520234 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0186 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0310 GB dict = 1.08 MB all = 0.0374 GB } UnZip/Zip{ index = 10.4446 value = 3.4885 dict = 1.00 all = 3.5927 } Zip/UnZip{ index = 0.0957 value = 0.2867 dict = 1.00 all = 0.2783 } ---------------------------- total value len = 10.326826 GB avg = 0.160 KB (by entry num) total key len = 1.783363 GB avg = 0.028 KB total ukey len = 1.242551 GB avg = 0.016 KB total ukey num = 0.077784083 Billion total entry num = 0.064591812 Billion write speed all = 0.562609512 MB/sec (with seq num) write speed all = 0.538603302 MB/sec (without seq num) 2024/11/23-14:53:57.294747 139957584442944 [compaction_job.cc:1948] [default] [JOB 28466] Generated table #264704: 931462 keys, 37358692 bytes, temperature: kWarm 2024/11/23-14:53:57.294816 139957584442944 EVENT_LOG_v1 {"time_micros": 1732344837294782, "cf_name": "default", "job": 28466, "event": "table_file_creation", "file_number": 264704, "file_size": 37358692, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3273701103, "largest_seqno": 4012775918, "table_properties": {"data_size": 30998080, "index_size": 1783616, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26080936, "raw_average_key_size": 28, "raw_value_size": 108136860, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 931462, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732344834, "oldest_key_time": 0, "file_creation_time": 1732344834, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 264704, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-14:53:57.333665 139957584442944 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264705.sst) /dev/shm/ToplingTemp/Topling-82429-87Knz5 2024/11/23-14:53:58.373323 139957584442944 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264705.sst): first pass time = 1.04's, 129.103'MB/sec 2024/11/23-14:53:59.684950 139957584442944 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264705.sst): old prealloc_size = 147639500, real_size = 34406576 2024/11/23-14:53:59.685516 139957584442944 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264705.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 928172 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1082 GB zip-val = 0.0324 GB avg-val = 116.60 avg-zval = 34.90 2024/11/23-14:53:59.686348 139957584442944 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264705.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-14:54:00.533635 139957584442944 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264705.sst): second pass time = 1.31's, 82.584'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.85's, 45.513'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3378.949'MB/sec (index lex order gen) rebuild zvType time = 0.72's, 0.322'MB/sec write SST data time = 0.13's, 302.509'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 34904.523'MB/sec zip my value time = 1.31's, unzip length = 0.108'GB zip my value throughput = 82.584'MB/sec zip pipeline throughput = 82.584'MB/sec entries = 928172 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.60 avg-zval = 34.90 usrkeys = 928172 avg-key = 20.00 avg-zkey = 1.91 avg-val = 123.60 avg-zval = 34.90 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 928172 bytes = 3364640 } seq expand size = 6497204 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0324 GB dict = 1.08 MB all = 0.0386 GB } UnZip/Zip{ index = 10.4445 value = 3.3407 dict = 1.00 all = 3.4749 } Zip/UnZip{ index = 0.0957 value = 0.2993 dict = 1.00 all = 0.2878 } ---------------------------- total value len = 10.441552 GB avg = 0.159 KB (by entry num) total key len = 1.809352 GB avg = 0.028 KB total ukey len = 1.261114 GB avg = 0.016 KB total ukey num = 0.078712255 Billion total entry num = 0.065519984 Billion write speed all = 0.569059947 MB/sec (with seq num) write speed all = 0.544712488 MB/sec (without seq num) 2024/11/23-14:54:00.579826 139957584442944 [compaction_job.cc:1948] [default] [JOB 28466] Generated table #264705: 928172 keys, 38624538 bytes, temperature: kWarm 2024/11/23-14:54:00.579894 139957584442944 EVENT_LOG_v1 {"time_micros": 1732344840579858, "cf_name": "default", "job": 28466, "event": "table_file_creation", "file_number": 264705, "file_size": 38624538, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3623676327, "largest_seqno": 4012775967, "table_properties": {"data_size": 32397024, "index_size": 1777344, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25988816, "raw_average_key_size": 28, "raw_value_size": 108229032, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 928172, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732344837, "oldest_key_time": 0, "file_creation_time": 1732344837, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 264705, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-14:54:00.617228 139957584442944 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264706.sst) /dev/shm/ToplingTemp/Topling-82429-OjH3N5 2024/11/23-14:54:01.648739 139957584442944 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264706.sst): first pass time = 1.03's, 130.122'MB/sec 2024/11/23-14:54:02.985938 139957584442944 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264706.sst): old prealloc_size = 147639500, real_size = 34364224 2024/11/23-14:54:02.986519 139957584442944 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264706.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 925453 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1083 GB zip-val = 0.0324 GB avg-val = 117.03 avg-zval = 34.97 2024/11/23-14:54:02.988640 139957584442944 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264706.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-14:54:03.833242 139957584442944 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264706.sst): second pass time = 1.34's, 81.068'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.85's, 45.527'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3305.454'MB/sec (index lex order gen) rebuild zvType time = 0.72's, 0.322'MB/sec write SST data time = 0.13's, 301.958'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 33124.625'MB/sec zip my value time = 1.34's, unzip length = 0.108'GB zip my value throughput = 81.068'MB/sec zip pipeline throughput = 81.068'MB/sec entries = 925453 avg-key = 28.00 avg-zkey = 1.91 avg-val = 117.03 avg-zval = 34.97 usrkeys = 925453 avg-key = 20.00 avg-zkey = 1.91 avg-val = 124.03 avg-zval = 34.97 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 925453 bytes = 3354784 } seq expand size = 6478171 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0324 GB dict = 1.08 MB all = 0.0386 GB } UnZip/Zip{ index = 10.4466 value = 3.3468 dict = 1.00 all = 3.4795 } Zip/UnZip{ index = 0.0957 value = 0.2988 dict = 1.00 all = 0.2874 } ---------------------------- total value len = 10.556335 GB avg = 0.159 KB (by entry num) total key len = 1.835265 GB avg = 0.028 KB total ukey len = 1.279623 GB avg = 0.016 KB total ukey num = 0.079637708 Billion total entry num = 0.066445437 Billion write speed all = 0.575507133 MB/sec (with seq num) write speed all = 0.550819556 MB/sec (without seq num) 2024/11/23-14:54:03.883555 139957584442944 [compaction_job.cc:1948] [default] [JOB 28466] Generated table #264706: 925453 keys, 38574116 bytes, temperature: kWarm 2024/11/23-14:54:03.883630 139957584442944 EVENT_LOG_v1 {"time_micros": 1732344843883590, "cf_name": "default", "job": 28466, "event": "table_file_creation", "file_number": 264706, "file_size": 38574116, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3514720078, "largest_seqno": 4012776021, "table_properties": {"data_size": 32360880, "index_size": 1771776, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25912684, "raw_average_key_size": 28, "raw_value_size": 108305174, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 925453, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732344840, "oldest_key_time": 0, "file_creation_time": 1732344840, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 264706, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-14:54:03.919530 139957584442944 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264707.sst) /dev/shm/ToplingTemp/Topling-82429-0Ca4H4 2024/11/23-14:54:04.986477 139957584442944 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264707.sst): first pass time = 1.07's, 125.801'MB/sec 2024/11/23-14:54:06.335894 139957584442944 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264707.sst): old prealloc_size = 147639500, real_size = 36153712 2024/11/23-14:54:06.336448 139957584442944 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264707.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 926677 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1083 GB zip-val = 0.0341 GB avg-val = 116.84 avg-zval = 36.85 2024/11/23-14:54:06.337179 139957584442944 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264707.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-14:54:07.144174 139957584442944 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264707.sst): second pass time = 1.35's, 80.280'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.81's, 49.422'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3349.751'MB/sec (index lex order gen) rebuild zvType time = 0.68's, 0.341'MB/sec write SST data time = 0.13's, 310.166'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 35059.751'MB/sec zip my value time = 1.35's, unzip length = 0.108'GB zip my value throughput = 80.280'MB/sec zip pipeline throughput = 80.280'MB/sec entries = 926677 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.84 avg-zval = 36.85 usrkeys = 926677 avg-key = 20.00 avg-zkey = 1.91 avg-val = 122.46 avg-zval = 36.85 TagRS{ kinds = RS_Key0_TagN bytes = 144880 } TagArray{ size = 743680 bytes = 2788816 } seq expand size = 5205760 multi value expand size = 0 cnt WriteAppend = 15 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0341 GB dict = 1.08 MB all = 0.0399 GB } UnZip/Zip{ index = 10.4450 value = 3.1707 dict = 1.00 all = 3.3600 } Zip/UnZip{ index = 0.0957 value = 0.3154 dict = 1.00 all = 0.2976 } ---------------------------- total value len = 10.669812 GB avg = 0.158 KB (by entry num) total key len = 1.861212 GB avg = 0.028 KB total ukey len = 1.298157 GB avg = 0.016 KB total ukey num = 0.080564385 Billion total entry num = 0.067372114 Billion write speed all = 0.581892950 MB/sec (with seq num) write speed all = 0.556864918 MB/sec (without seq num) 2024/11/23-14:54:07.198162 139957584442944 [compaction_job.cc:1948] [default] [JOB 28466] Generated table #264707: 926677 keys, 39945522 bytes, temperature: kWarm 2024/11/23-14:54:07.198232 139957584442944 EVENT_LOG_v1 {"time_micros": 1732344847198197, "cf_name": "default", "job": 28466, "event": "table_file_creation", "file_number": 264707, "file_size": 39945522, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4012774830, "table_properties": {"data_size": 34147488, "index_size": 1774400, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25946956, "raw_average_key_size": 28, "raw_value_size": 108270870, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 926677, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732344843, "oldest_key_time": 0, "file_creation_time": 1732344843, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 264707, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-14:54:07.240770 139957584442944 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264708.sst) /dev/shm/ToplingTemp/Topling-82429-x8kDK7 2024/11/23-14:54:08.249797 139957584442944 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264708.sst): first pass time = 1.01's, 133.023'MB/sec 2024/11/23-14:54:09.560970 139957584442944 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264708.sst): old prealloc_size = 147639500, real_size = 32969696 2024/11/23-14:54:09.561563 139957584442944 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264708.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 930548 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0310 GB avg-val = 116.24 avg-zval = 33.28 2024/11/23-14:54:09.562407 139957584442944 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264708.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-14:54:10.422743 139957584442944 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264708.sst): second pass time = 1.31's, 82.546'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.86's, 43.162'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3205.703'MB/sec (index lex order gen) rebuild zvType time = 0.73's, 0.317'MB/sec write SST data time = 0.13's, 294.037'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 34601.194'MB/sec zip my value time = 1.31's, unzip length = 0.108'GB zip my value throughput = 82.546'MB/sec zip pipeline throughput = 82.546'MB/sec entries = 930548 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.24 avg-zval = 33.28 usrkeys = 930548 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.24 avg-zval = 33.28 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 930548 bytes = 3373248 } seq expand size = 6513836 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0310 GB dict = 1.08 MB all = 0.0372 GB } UnZip/Zip{ index = 10.5140 value = 3.4929 dict = 1.00 all = 3.6085 } Zip/UnZip{ index = 0.0951 value = 0.2863 dict = 1.00 all = 0.2771 } ---------------------------- total value len = 10.784488 GB avg = 0.158 KB (by entry num) total key len = 1.887267 GB avg = 0.028 KB total ukey len = 1.316768 GB avg = 0.016 KB total ukey num = 0.081494933 Billion total entry num = 0.068302662 Billion write speed all = 0.588338421 MB/sec (with seq num) write speed all = 0.562968562 MB/sec (without seq num) 2024/11/23-14:54:10.471623 139957584442944 [compaction_job.cc:1948] [default] [JOB 28466] Generated table #264708: 930548 keys, 37194562 bytes, temperature: kWarm 2024/11/23-14:54:10.471696 139957584442944 EVENT_LOG_v1 {"time_micros": 1732344850471659, "cf_name": "default", "job": 28466, "event": "table_file_creation", "file_number": 264708, "file_size": 37194562, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3480997236, "largest_seqno": 4012776228, "table_properties": {"data_size": 30966736, "index_size": 1770112, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26055344, "raw_average_key_size": 28, "raw_value_size": 108162468, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 930548, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732344847, "oldest_key_time": 0, "file_creation_time": 1732344847, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 264708, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-14:54:10.507985 139957584442944 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264709.sst) /dev/shm/ToplingTemp/Topling-82429-XkYYA5 2024/11/23-14:54:11.523325 139957584442944 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264709.sst): first pass time = 1.02's, 132.194'MB/sec 2024/11/23-14:54:12.851800 139957584442944 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264709.sst): old prealloc_size = 147639500, real_size = 32106416 2024/11/23-14:54:12.852333 139957584442944 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264709.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 936596 prefix = 4 raw-key = 0.0150 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1080 GB zip-val = 0.0301 GB avg-val = 115.30 avg-zval = 32.13 2024/11/23-14:54:12.853163 139957584442944 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264709.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-14:54:13.717885 139957584442944 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264709.sst): second pass time = 1.33's, 81.365'MB/sec, value only(80.5% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.87's, 41.972'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3457.305'MB/sec (index lex order gen) rebuild zvType time = 0.74's, 0.318'MB/sec write SST data time = 0.13's, 282.473'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.077'MB, throughput = 30010.482'MB/sec zip my value time = 1.33's, unzip length = 0.108'GB zip my value throughput = 81.365'MB/sec zip pipeline throughput = 81.365'MB/sec entries = 936596 avg-key = 28.00 avg-zkey = 1.90 avg-val = 115.30 avg-zval = 32.13 usrkeys = 936596 avg-key = 20.00 avg-zkey = 1.90 avg-val = 122.30 avg-zval = 32.13 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 936596 bytes = 3395168 } seq expand size = 6556172 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0187 GB value = 0.1080 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0301 GB dict = 1.08 MB all = 0.0363 GB } UnZip/Zip{ index = 10.5124 value = 3.5890 dict = 1.00 all = 3.6924 } Zip/UnZip{ index = 0.0951 value = 0.2786 dict = 1.00 all = 0.2708 } ---------------------------- total value len = 10.899038 GB avg = 0.157 KB (by entry num) total key len = 1.913492 GB avg = 0.028 KB total ukey len = 1.335500 GB avg = 0.016 KB total ukey num = 0.082431529 Billion total entry num = 0.069239258 Billion write speed all = 0.594783436 MB/sec (with seq num) write speed all = 0.569069629 MB/sec (without seq num) 2024/11/23-14:54:13.764019 139957584442944 [compaction_job.cc:1948] [default] [JOB 28466] Generated table #264709: 936596 keys, 36349896 bytes, temperature: kWarm 2024/11/23-14:54:13.764090 139957584442944 EVENT_LOG_v1 {"time_micros": 1732344853764056, "cf_name": "default", "job": 28466, "event": "table_file_creation", "file_number": 264709, "file_size": 36349896, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3512539342, "largest_seqno": 4012776248, "table_properties": {"data_size": 30090208, "index_size": 1781888, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26224688, "raw_average_key_size": 28, "raw_value_size": 107993132, "raw_average_value_size": 115, "num_data_blocks": 1, "num_entries": 936596, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732344850, "oldest_key_time": 0, "file_creation_time": 1732344850, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 264709, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-14:54:13.824469 139957584442944 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264710.sst) /dev/shm/ToplingTemp/Topling-82429-hr45e5 2024/11/23-14:54:14.850872 139957584442944 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264710.sst): first pass time = 1.03's, 130.771'MB/sec 2024/11/23-14:54:16.209023 139957584442944 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264710.sst): old prealloc_size = 147639500, real_size = 35266064 2024/11/23-14:54:16.209589 139957584442944 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264710.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927593 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.93 raw-val = 0.1082 GB zip-val = 0.0332 GB avg-val = 116.69 avg-zval = 35.84 2024/11/23-14:54:16.210490 139957584442944 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264710.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-14:54:17.052005 139957584442944 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264710.sst): second pass time = 1.36's, 79.747'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.84's, 46.976'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3301.660'MB/sec (index lex order gen) rebuild zvType time = 0.71's, 0.325'MB/sec write SST data time = 0.13's, 308.008'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 38098.385'MB/sec zip my value time = 1.36's, unzip length = 0.108'GB zip my value throughput = 79.747'MB/sec zip pipeline throughput = 79.747'MB/sec entries = 927593 avg-key = 28.00 avg-zkey = 1.93 avg-val = 116.69 avg-zval = 35.84 usrkeys = 927593 avg-key = 20.00 avg-zkey = 1.93 avg-val = 123.69 avg-zval = 35.84 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 927593 bytes = 3478496 } seq expand size = 6493151 multi value expand size = 0 cnt WriteAppend = 17 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0332 GB dict = 1.08 MB all = 0.0396 GB } UnZip/Zip{ index = 10.3759 value = 3.2559 dict = 1.00 all = 3.3894 } Zip/UnZip{ index = 0.0964 value = 0.3071 dict = 1.00 all = 0.2950 } ---------------------------- total value len = 11.013776 GB avg = 0.157 KB (by entry num) total key len = 1.939464 GB avg = 0.028 KB total ukey len = 1.354052 GB avg = 0.016 KB total ukey num = 0.083359122 Billion total entry num = 0.070166851 Billion write speed all = 0.601222467 MB/sec (with seq num) write speed all = 0.575168206 MB/sec (without seq num) 2024/11/23-14:54:17.099774 139957584442944 [compaction_job.cc:1948] [default] [JOB 28466] Generated table #264710: 927593 keys, 39598810 bytes, temperature: kWarm 2024/11/23-14:54:17.099847 139957584442944 EVENT_LOG_v1 {"time_micros": 1732344857099811, "cf_name": "default", "job": 28466, "event": "table_file_creation", "file_number": 264710, "file_size": 39598810, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3411274482, "largest_seqno": 4012776268, "table_properties": {"data_size": 33246016, "index_size": 1787968, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25972604, "raw_average_key_size": 28, "raw_value_size": 108245178, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927593, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732344853, "oldest_key_time": 0, "file_creation_time": 1732344853, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 264710, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-14:54:17.137881 139957584442944 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264711.sst) /dev/shm/ToplingTemp/Topling-82429-CP0p06 2024/11/23-14:54:18.153140 139957584442944 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264711.sst): first pass time = 1.02's, 132.206'MB/sec 2024/11/23-14:54:19.456101 139957584442944 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264711.sst): old prealloc_size = 147639500, real_size = 31549072 2024/11/23-14:54:19.456615 139957584442944 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264711.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 931242 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1081 GB zip-val = 0.0295 GB avg-val = 116.13 avg-zval = 31.71 2024/11/23-14:54:19.457444 139957584442944 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264711.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-14:54:20.290900 139957584442944 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264711.sst): second pass time = 1.30's, 83.050'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.83's, 42.857'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3533.734'MB/sec (index lex order gen) rebuild zvType time = 0.71's, 0.329'MB/sec write SST data time = 0.13's, 281.171'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 33515.351'MB/sec zip my value time = 1.30's, unzip length = 0.108'GB zip my value throughput = 83.050'MB/sec zip pipeline throughput = 83.050'MB/sec entries = 931242 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.13 avg-zval = 31.71 usrkeys = 931242 avg-key = 20.00 avg-zkey = 1.91 avg-val = 123.13 avg-zval = 31.71 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 931242 bytes = 3375760 } seq expand size = 6518694 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0186 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0295 GB dict = 1.08 MB all = 0.0358 GB } UnZip/Zip{ index = 10.4448 value = 3.6618 dict = 1.00 all = 3.7516 } Zip/UnZip{ index = 0.0957 value = 0.2731 dict = 1.00 all = 0.2666 } ---------------------------- total value len = 11.128438 GB avg = 0.157 KB (by entry num) total key len = 1.965539 GB avg = 0.028 KB total ukey len = 1.372677 GB avg = 0.016 KB total ukey num = 0.084290364 Billion total entry num = 0.071098093 Billion write speed all = 0.607663373 MB/sec (with seq num) write speed all = 0.581267293 MB/sec (without seq num) 2024/11/23-14:54:20.336058 139957584442944 [compaction_job.cc:1948] [default] [JOB 28466] Generated table #264711: 931242 keys, 35776396 bytes, temperature: kWarm 2024/11/23-14:54:20.336128 139957584442944 EVENT_LOG_v1 {"time_micros": 1732344860336092, "cf_name": "default", "job": 28466, "event": "table_file_creation", "file_number": 264711, "file_size": 35776396, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3525889795, "largest_seqno": 4012776300, "table_properties": {"data_size": 29532928, "index_size": 1783168, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26074776, "raw_average_key_size": 28, "raw_value_size": 108142972, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 931242, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732344857, "oldest_key_time": 0, "file_creation_time": 1732344857, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 264711, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-14:54:20.373943 139957584442944 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264712.sst) /dev/shm/ToplingTemp/Topling-82429-qKyeY6 2024/11/23-14:54:21.312492 139957584442944 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264712.sst): first pass time = 0.94's, 143.010'MB/sec 2024/11/23-14:54:22.635727 139957584442944 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264712.sst): old prealloc_size = 147639500, real_size = 35281392 2024/11/23-14:54:22.636298 139957584442944 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264712.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 922697 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1084 GB zip-val = 0.0333 GB avg-val = 117.46 avg-zval = 36.08 2024/11/23-14:54:22.637169 139957584442944 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264712.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-14:54:23.485093 139957584442944 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264712.sst): second pass time = 1.32's, 81.958'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.85's, 46.624'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3197.063'MB/sec (index lex order gen) rebuild zvType time = 0.72's, 0.319'MB/sec write SST data time = 0.13's, 313.796'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.083'MB, throughput = 33690.748'MB/sec zip my value time = 1.32's, unzip length = 0.108'GB zip my value throughput = 81.958'MB/sec zip pipeline throughput = 81.958'MB/sec entries = 922697 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.46 avg-zval = 36.08 usrkeys = 922697 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.46 avg-zval = 36.08 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 922697 bytes = 3460128 } seq expand size = 6458879 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0333 GB dict = 1.08 MB all = 0.0396 GB } UnZip/Zip{ index = 10.5127 value = 3.2552 dict = 1.00 all = 3.3893 } Zip/UnZip{ index = 0.0951 value = 0.3072 dict = 1.00 all = 0.2950 } ---------------------------- total value len = 11.243279 GB avg = 0.156 KB (by entry num) total key len = 1.991375 GB avg = 0.028 KB total ukey len = 1.391131 GB avg = 0.016 KB total ukey num = 0.085213061 Billion total entry num = 0.072020790 Billion write speed all = 0.614100844 MB/sec (with seq num) write speed all = 0.587366164 MB/sec (without seq num) 2024/11/23-14:54:23.533397 139957584442944 [compaction_job.cc:1948] [default] [JOB 28466] Generated table #264712: 922697 keys, 39600014 bytes, temperature: kWarm 2024/11/23-14:54:23.533470 139957584442944 EVENT_LOG_v1 {"time_micros": 1732344863533433, "cf_name": "default", "job": 28466, "event": "table_file_creation", "file_number": 264712, "file_size": 39600014, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3405268578, "largest_seqno": 4012776316, "table_properties": {"data_size": 33295136, "index_size": 1755392, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25835516, "raw_average_key_size": 28, "raw_value_size": 108382282, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 922697, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732344860, "oldest_key_time": 0, "file_creation_time": 1732344860, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 264712, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-14:54:23.569748 139957584442944 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264713.sst) /dev/shm/ToplingTemp/Topling-82429-v7d1v7 2024/11/23-14:54:24.582170 139957584442944 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264713.sst): first pass time = 1.01's, 132.576'MB/sec 2024/11/23-14:54:25.872478 139957584442944 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264713.sst): old prealloc_size = 147639500, real_size = 32738800 2024/11/23-14:54:25.873040 139957584442944 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264713.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 931083 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1081 GB zip-val = 0.0307 GB avg-val = 116.15 avg-zval = 33.00 2024/11/23-14:54:25.874150 139957584442944 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264713.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-14:54:26.725133 139957584442944 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264713.sst): second pass time = 1.29's, 83.867'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.85's, 43.491'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3307.369'MB/sec (index lex order gen) rebuild zvType time = 0.73's, 0.320'MB/sec write SST data time = 0.12's, 297.072'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 28541.307'MB/sec zip my value time = 1.29's, unzip length = 0.108'GB zip my value throughput = 83.867'MB/sec zip pipeline throughput = 83.867'MB/sec entries = 931083 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.15 avg-zval = 33.00 usrkeys = 931083 avg-key = 20.00 avg-zkey = 1.91 avg-val = 123.15 avg-zval = 33.00 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 931083 bytes = 3491584 } seq expand size = 6517581 multi value expand size = 0 cnt WriteAppend = 15 UnZipSize{ index = 0.0186 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0307 GB dict = 1.08 MB all = 0.0371 GB } UnZip/Zip{ index = 10.4441 value = 3.5201 dict = 1.00 all = 3.6195 } Zip/UnZip{ index = 0.0957 value = 0.2841 dict = 1.00 all = 0.2763 } ---------------------------- total value len = 11.357944 GB avg = 0.156 KB (by entry num) total key len = 2.017445 GB avg = 0.028 KB total ukey len = 1.409752 GB avg = 0.016 KB total ukey num = 0.086144144 Billion total entry num = 0.072951873 Billion write speed all = 0.620537813 MB/sec (with seq num) write speed all = 0.593461578 MB/sec (without seq num) 2024/11/23-14:54:26.769584 139957584442944 [compaction_job.cc:1948] [default] [JOB 28466] Generated table #264713: 931083 keys, 37081984 bytes, temperature: kWarm 2024/11/23-14:54:26.769661 139957584442944 EVENT_LOG_v1 {"time_micros": 1732344866769624, "cf_name": "default", "job": 28466, "event": "table_file_creation", "file_number": 264713, "file_size": 37081984, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3471845708, "largest_seqno": 4012776344, "table_properties": {"data_size": 30722848, "index_size": 1782976, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26070324, "raw_average_key_size": 28, "raw_value_size": 108147522, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 931083, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732344863, "oldest_key_time": 0, "file_creation_time": 1732344863, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 264713, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-14:54:26.810253 139957584442944 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264714.sst) /dev/shm/ToplingTemp/Topling-82429-oBKgU3 2024/11/23-14:54:27.811444 139957584442944 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264714.sst): first pass time = 1.00's, 134.063'MB/sec 2024/11/23-14:54:29.148040 139957584442944 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264714.sst): old prealloc_size = 147639500, real_size = 33242656 2024/11/23-14:54:29.148555 139957584442944 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264714.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 926971 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1083 GB zip-val = 0.0312 GB avg-val = 116.79 avg-zval = 33.70 2024/11/23-14:54:29.149224 139957584442944 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264714.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-14:54:29.957376 139957584442944 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264714.sst): second pass time = 1.34's, 81.047'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.81's, 45.389'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3596.754'MB/sec (index lex order gen) rebuild zvType time = 0.68's, 0.340'MB/sec write SST data time = 0.13's, 287.920'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 28617.720'MB/sec zip my value time = 1.34's, unzip length = 0.108'GB zip my value throughput = 81.047'MB/sec zip pipeline throughput = 81.047'MB/sec entries = 926971 avg-key = 28.00 avg-zkey = 1.92 avg-val = 116.79 avg-zval = 33.70 usrkeys = 926971 avg-key = 20.00 avg-zkey = 1.92 avg-val = 121.97 avg-zval = 33.70 TagRS{ kinds = RS_Key0_TagN bytes = 144920 } TagArray{ size = 686307 bytes = 2487872 } seq expand size = 4804149 multi value expand size = 0 cnt WriteAppend = 17 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0312 GB dict = 1.08 MB all = 0.0367 GB } UnZip/Zip{ index = 10.4434 value = 3.4660 dict = 1.00 all = 3.6537 } Zip/UnZip{ index = 0.0958 value = 0.2885 dict = 1.00 all = 0.2737 } ---------------------------- total value len = 11.471011 GB avg = 0.155 KB (by entry num) total key len = 2.043400 GB avg = 0.028 KB total ukey len = 1.428292 GB avg = 0.016 KB total ukey num = 0.087071115 Billion total entry num = 0.073878844 Billion write speed all = 0.626893589 MB/sec (with seq num) write speed all = 0.599477418 MB/sec (without seq num) 2024/11/23-14:54:30.004817 139957584442944 [compaction_job.cc:1948] [default] [JOB 28466] Generated table #264714: 926971 keys, 36734250 bytes, temperature: kWarm 2024/11/23-14:54:30.004886 139957584442944 EVENT_LOG_v1 {"time_micros": 1732344870004851, "cf_name": "default", "job": 28466, "event": "table_file_creation", "file_number": 264714, "file_size": 36734250, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4012776360, "table_properties": {"data_size": 31235472, "index_size": 1775232, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25955188, "raw_average_key_size": 28, "raw_value_size": 108262574, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 926971, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732344866, "oldest_key_time": 0, "file_creation_time": 1732344866, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 264714, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-14:54:30.040697 139957584442944 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264715.sst) /dev/shm/ToplingTemp/Topling-82429-yutjQ4 2024/11/23-14:54:31.046669 139957584442944 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264715.sst): first pass time = 1.01's, 133.426'MB/sec 2024/11/23-14:54:32.532872 139957584442944 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264715.sst): old prealloc_size = 147639500, real_size = 36783840 2024/11/23-14:54:32.533436 139957584442944 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264715.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 926667 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0348 GB avg-val = 116.84 avg-zval = 37.54 2024/11/23-14:54:32.533707 139957584442944 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264715.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-14:54:33.246194 139957584442944 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264715.sst): second pass time = 1.48's, 72.915'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.71's, 53.651'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3252.332'MB/sec (index lex order gen) rebuild zvType time = 0.59's, 0.393'MB/sec write SST data time = 0.12's, 309.008'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 33672.318'MB/sec zip my value time = 1.48's, unzip length = 0.108'GB zip my value throughput = 72.915'MB/sec zip pipeline throughput = 72.915'MB/sec entries = 926667 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.84 avg-zval = 37.54 usrkeys = 926667 avg-key = 20.00 avg-zkey = 1.90 avg-val = 118.01 avg-zval = 37.54 TagRS{ kinds = RS_Key0_TagN bytes = 144880 } TagArray{ size = 154398 bytes = 482512 } seq expand size = 1080786 multi value expand size = 0 cnt WriteAppend = 15 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0348 GB dict = 1.08 MB all = 0.0383 GB } UnZip/Zip{ index = 10.5135 value = 3.1122 dict = 1.00 all = 3.5072 } Zip/UnZip{ index = 0.0951 value = 0.3213 dict = 1.00 all = 0.2851 } ---------------------------- total value len = 11.580363 GB avg = 0.155 KB (by entry num) total key len = 2.069347 GB avg = 0.028 KB total ukey len = 1.446825 GB avg = 0.016 KB total ukey num = 0.087997782 Billion total entry num = 0.074805511 Billion write speed all = 0.633073110 MB/sec (with seq num) write speed all = 0.605317291 MB/sec (without seq num) 2024/11/23-14:54:33.294483 139957584442944 [compaction_job.cc:1948] [default] [JOB 28466] Generated table #264715: 926667 keys, 38269545 bytes, temperature: kWarm 2024/11/23-14:54:33.294556 139957584442944 EVENT_LOG_v1 {"time_micros": 1732344873294518, "cf_name": "default", "job": 28466, "event": "table_file_creation", "file_number": 264715, "file_size": 38269545, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3273700812, "table_properties": {"data_size": 34789200, "index_size": 1762816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25946676, "raw_average_key_size": 28, "raw_value_size": 108271134, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 926667, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732344870, "oldest_key_time": 0, "file_creation_time": 1732344870, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 264715, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-14:54:33.332381 139957584442944 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264716.sst) /dev/shm/ToplingTemp/Topling-82429-pvsIl5 2024/11/23-14:54:34.189589 139957584442944 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264716.sst): first pass time = 0.86's, 156.583'MB/sec 2024/11/23-14:54:35.568383 139957584442944 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264716.sst): old prealloc_size = 147639500, real_size = 37583392 2024/11/23-14:54:35.568937 139957584442944 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264716.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 925380 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0356 GB avg-val = 117.04 avg-zval = 38.46 2024/11/23-14:54:35.569506 139957584442944 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264716.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-14:54:36.333365 139957584442944 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264716.sst): second pass time = 1.38's, 78.599'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.76's, 53.045'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3325.622'MB/sec (index lex order gen) rebuild zvType time = 0.64's, 0.363'MB/sec write SST data time = 0.13's, 318.589'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 27842.908'MB/sec zip my value time = 1.38's, unzip length = 0.108'GB zip my value throughput = 78.599'MB/sec zip pipeline throughput = 78.599'MB/sec entries = 925380 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.04 avg-zval = 38.46 usrkeys = 925380 avg-key = 20.00 avg-zkey = 1.90 avg-val = 121.86 avg-zval = 38.46 TagRS{ kinds = RS_Key0_TagN bytes = 144680 } TagArray{ size = 636720 bytes = 1989760 } seq expand size = 4457040 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0356 GB dict = 1.08 MB all = 0.0406 GB } UnZip/Zip{ index = 10.5145 value = 3.0430 dict = 1.00 all = 3.3077 } Zip/UnZip{ index = 0.0951 value = 0.3286 dict = 1.00 all = 0.3023 } ---------------------------- total value len = 11.693127 GB avg = 0.154 KB (by entry num) total key len = 2.095257 GB avg = 0.028 KB total ukey len = 1.465333 GB avg = 0.016 KB total ukey num = 0.088923162 Billion total entry num = 0.075730891 Billion write speed all = 0.639413294 MB/sec (with seq num) write speed all = 0.611318145 MB/sec (without seq num) 2024/11/23-14:54:36.382763 139957584442944 [compaction_job.cc:1948] [default] [JOB 28466] Generated table #264716: 925380 keys, 40576822 bytes, temperature: kWarm 2024/11/23-14:54:36.382835 139957584442944 EVENT_LOG_v1 {"time_micros": 1732344876382797, "cf_name": "default", "job": 28466, "event": "table_file_creation", "file_number": 264716, "file_size": 40576822, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4042598287, "table_properties": {"data_size": 35591696, "index_size": 1760192, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25910640, "raw_average_key_size": 28, "raw_value_size": 108307192, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 925380, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732344873, "oldest_key_time": 0, "file_creation_time": 1732344873, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 264716, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-14:54:36.423408 139957584442944 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264717.sst) /dev/shm/ToplingTemp/Topling-82429-kVCyO5 2024/11/23-14:54:36.498203 139957584442944 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264717.sst): first pass time = 0.07's, 233.414'MB/sec 2024/11/23-14:54:36.655811 139957584442944 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264717.sst): old prealloc_size = 147639500, real_size = 5273536 2024/11/23-14:54:36.655932 139957584442944 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264717.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 120815 prefix = 4 raw-key = 0.0019 GB zip-key = 0.0002 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.0141 GB zip-val = 0.0050 GB avg-val = 116.44 avg-zval = 41.48 2024/11/23-14:54:36.656091 139957584442944 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264717.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.017 GB 2024/11/23-14:54:36.759497 139957584442944 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00/264717.sst): second pass time = 0.16's, 89.641'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.10's, 55.511'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2303.291'MB/sec (index lex order gen) rebuild zvType time = 0.09's, 0.350'MB/sec write SST data time = 0.02's, 333.681'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.147'MB, throughput = 4331.499'MB/sec zip my value time = 0.16's, unzip length = 0.014'GB zip my value throughput = 89.641'MB/sec zip pipeline throughput = 89.641'MB/sec entries = 120815 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.44 avg-zval = 41.48 usrkeys = 120815 avg-key = 20.00 avg-zkey = 1.91 avg-val = 123.44 avg-zval = 41.48 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 120815 bytes = 362464 } seq expand size = 845705 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0024 GB value = 0.0141 GB dict = 0.15 MB all = 0.0175 GB } __ZipSize{ index = 0.0002 GB value = 0.0050 GB dict = 0.15 MB all = 0.0058 GB } UnZip/Zip{ index = 10.4497 value = 2.8068 dict = 1.00 all = 3.0323 } Zip/UnZip{ index = 0.0957 value = 0.3563 dict = 1.00 all = 0.3298 } ---------------------------- total value len = 11.708040 GB avg = 0.154 KB (by entry num) total key len = 2.098640 GB avg = 0.028 KB total ukey len = 1.467749 GB avg = 0.016 KB total ukey num = 0.089043977 Billion total entry num = 0.075851706 Billion write speed all = 0.640249079 MB/sec (with seq num) write speed all = 0.612109665 MB/sec (without seq num) 2024/11/23-14:54:36.772550 139957584442944 [compaction_job.cc:1948] [default] [JOB 28466] Generated table #264717: 120815 keys, 5754747 bytes, temperature: kWarm 2024/11/23-14:54:36.772603 139957584442944 EVENT_LOG_v1 {"time_micros": 1732344876772576, "cf_name": "default", "job": 28466, "event": "table_file_creation", "file_number": 264717, "file_size": 5754747, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4031991581, "largest_seqno": 4041081111, "table_properties": {"data_size": 5011888, "index_size": 231232, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 3382820, "raw_average_key_size": 28, "raw_value_size": 14067274, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 120815, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732344876, "oldest_key_time": 0, "file_creation_time": 1732344876, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 264717, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-14:54:36.782395 139957584442944 [compaction_job.cc:703] job-28466: subcompact[0], size: 0.953156 G, files: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28466/att-00 [264692,264693,264694,264695,264696,264697,264698,264699,264700,264701,264702,264703,264704,264705,264706,264707,264708,264709,264710,264711,264712,264713,264714,264715,264716,264717] 2024/11/23-14:54:36.953546 139957584442944 (Original Log Time 2024/11/23-14:53:06.166499) EVENT_LOG_v1 {"time_micros": 1732344786166455, "job": 28466, "event": "compaction_started", "compaction_reason": "FilesMarkedForCompaction", "files_L2": [264687], "files_L3": [264606, 264607, 264636, 264637, 264638, 264639, 264640, 264641, 264642, 264643, 264644, 264645, 264646, 264647, 264648, 264649, 264650, 264651, 264652, 264653, 264654, 264655, 264656, 264657, 264658], "score": 0.9902, "input_data_size": 975754012, "oldest_snapshot_seqno": 4042626878} 2024/11/23-14:54:36.953549 139957584442944 (Original Log Time 2024/11/23-14:54:36.952000) [compaction_job.cc:2022] [default] [JOB 28466] Compacted 1@2 + 25@3 files to L3 => 953156130 bytes 2024/11/23-14:54:36.953551 139957584442944 (Original Log Time 2024/11/23-14:54:36.953475) [compaction_job.cc:1224] [default] compacted to: files[0 0 0 26 0 0 0] max score 0.04, MB/sec: 10.8 rd, 10.5 wr, level 3, files in(1, 25) out(26 +0 blob) MB in(27.1, 903.4 +0.0 blob) out(909.0 +0.0 blob), read-write-amplify(67.8) write-amplify(33.5) OK, records in: 23606814, records dropped: 113272 output_compression: Snappy 2024/11/23-14:54:36.953554 139957584442944 (Original Log Time 2024/11/23-14:54:36.953520) EVENT_LOG_v1 {"time_micros": 1732344876953498, "cf": "default", "job": 28466, "event": "compaction_finished", "compaction_time_micros": 90615901, "compaction_time_cpu_micros": 37600978, "output_level": 3, "num_output_files": 26, "total_output_size": 953156130, "num_input_records": 23606814, "num_output_records": 23493542, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "file_write_nanos": 711368363, "file_range_sync_nanos": 0, "file_fsync_nanos": 18737, "file_prepare_write_nanos": 71409, "lsm_state": [0, 0, 0, 26, 0, 0, 0]} 2024/11/23-14:54:37.086764 139957584442944 DEBG dcompact_worker.cpp:240: HttpPost: 200 OK: url = http://nlb-7zny4kaa1poal01o64.cn-shenzhen.nlb.aliyuncs.com:8443, body = {"instanceId":"nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137","labourId":"","dbId":"d89b4006-2803-486e-b7a2-759bcf348921","dbStarts":1732256054,"starts":1732344786,"executesMs":90914,"compactionJobId":28466,"attempt":0,"compactionInputRawBytes":3388979881,"compactionInputZipBytes":975754012,"compactionOutputRawBytes":0,"compactionOutputZipBytes":953156130,"headers":{"Accept":"*/*","Connection":"close","Host":"aliyun-topling-saas.topling.cn:18443","RemoteIp":"120.24.192.169","X-Forwarded-For":"120.24.192.169","region":"cn-shenzhen","token":"e6474c481bd4415abc537135cc03626b","instance-token":"e6474c481bd4415abc537135cc03626b","provider":"aliyun","CloudMarketInstanceId":"si-59c0ae5c955845588903","MeteringAssit":"","Transfer-Encoding":"chunked","traceparent":"00-d925586b945f5e5a0df9cb867b05ee29-25e5df929d2d6d30-00"}}, response = 2024/11/23-14:54:37.086837 139957584442944 INFO dcompact_worker.cpp:1459: finish /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-28466/att-00: olev 3, work 90.915 s, result 6.001 ms, install 1.569 ms, input{raw 3.156 GiB zip 930.552 MiB}