2024/11/23-17:17:11.494560 139957584442944 DEBG dcompact_worker.cpp:2214: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00: fork to child time = 0.007196 sec 2024/11/23-17:17:11.495214 139957584442944 DEBG dcompact_worker.cpp:1013: Beg SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00 2024/11/23-17:17:11.502235 139957584442944 DEBG dcompact_worker.cpp:1033: End SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00 2024/11/23-17:17:11.503125 139957584442944 TRAC dcompact_worker.cpp:1083: INFO_LOG_LEVEL: rpc = INFO_LEVEL, env_var = undefined 2024/11/23-17:17:11.503333 139957584442944 [WARN] [column_family.cc:386] multiple cf_paths/db_paths and level_compaction_dynamic_level_bytes can't be used together 2024/11/23-17:17:11.554008 139957584442944 [version_set.cc:6208] Recovering from manifest file: /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-31712/att-00/MANIFEST-206347 2024/11/23-17:17:11.575575 139957584442944 [version_set.cc:6251] Recovered from manifest file:/worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-31712/att-00/MANIFEST-206347 succeeded,manifest_file_number is 206347, next_file_number is 271808, last_sequence is 4140889703, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 271654 2024/11/23-17:17:11.575581 139957584442944 [version_set.cc:6266] Column family [default] (ID 0), log number is 0 2024/11/23-17:17:11.575681 139957584442944 [version_set.cc:5721] Creating manifest 271808 2024/11/23-17:17:11.611057 139957584442944 DEBG dcompact_worker.cpp:1218: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00: bottommost_level: fake = 1, rpc = 0 2024/11/23-17:17:11.636649 139957584442944 [compaction_job.cc:2437] [default] [JOB 31712] Compacting 1@2 + 22@3 files to L3, score 1.00, subcompactions 1 : 1 2024/11/23-17:17:11.636662 139957584442944 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 23735 Base level 2, inputs: [271790(31MB)], [271713(40MB) 271714(40MB) 271715(40MB) 271716(40MB) 271717(40MB) 271718(40MB) 271719(40MB) 271720(40MB) 271721(40MB) 271722(40MB) 271723(40MB) 271724(40MB) 271725(40MB) 271726(40MB) 271727(40MB) 271728(40MB) 271729(40MB) 271730(40MB) 271731(40MB) 271732(40MB) 271733(40MB) 271800(15MB)] 2024/11/23-17:17:11.643678 139957584442944 [top_zip_table.cc:59] core git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-17:17:11.643700 139957584442944 [top_zip_table.cc:60] fsa git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-17:17:11.643715 139957584442944 [top_zip_table.cc:61] zbs git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-17:17:11.643720 139957584442944 [top_zip_table.cc:62] topling-zip_table_reader: git_version_hash_info_is: commit a4a382006cb82713acf5b3425835f22711877681 Author: leipeng Date: 2024-04-11 19:44:14 +0800 fixed_len_hole_index.cc: Add env bool FixedLenHoleIndexUseAVX512 for ut & debug 1. FixedLenHoleIndexUseAVX512 is only in unit tests or debug 2. In release mode, use avx512 by compile options(-march=) g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/23-17:17:11.643730 139957584442944 [top_zip_table.cc:64] topling-rocks git_version_hash_info_is: commit feab587e468621ba0204d47b4ffacc52e7c4290d Author: leipeng Date: 2024-03-22 13:35:06 +0800 ToplingZipTableBuilder::Add: immediately return after error This function returns void, and caller does not check builder->status() after calling this function and graceful abandon. So immediately return after error, and return error status in Finish(). g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/23-17:17:12.308693 139957584442944 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271809.sst) /dev/shm/ToplingTemp/Topling-129809-hKCm9I 2024/11/23-17:17:12.491236 139957584442944 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271809.sst): first pass time = 0.18's, 735.431'MB/sec 2024/11/23-17:17:13.341870 139957584442944 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271809.sst): old prealloc_size = 147639500, real_size = 40594640 2024/11/23-17:17:13.342009 139957584442944 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271809.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129431 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.81 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1016.98 avg-zval = 311.58 2024/11/23-17:17:13.342184 139957584442944 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271809.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-17:17:13.504872 139957584442944 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271809.sst): second pass time = 0.85's, 155.055'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 260.300'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1919.953'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.277'MB/sec write SST data time = 0.05's, 924.587'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 46746.845'MB/sec zip my value time = 0.85's, unzip length = 0.132'GB zip my value throughput = 155.055'MB/sec zip pipeline throughput = 155.055'MB/sec entries = 129431 avg-key = 20.00 avg-zkey = 1.81 avg-val = 1016.98 avg-zval = 311.58 usrkeys = 129431 avg-key = 12.00 avg-zkey = 1.81 avg-val = 1023.98 avg-zval = 311.58 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129431 bytes = 485376 } seq expand size = 906017 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0424 GB } UnZip/Zip{ index = 6.6470 value = 3.2639 dict = 1.00 all = 3.1635 } Zip/UnZip{ index = 0.1504 value = 0.3064 dict = 1.00 all = 0.3161 } ---------------------------- total value len = 8.981155 GB avg = 0.171 KB (by entry num) total key len = 1.443410 GB avg = 0.028 KB total ukey len = 0.999431 GB avg = 0.015 KB total ukey num = 0.065679866 Billion total entry num = 0.052487595 Billion write speed all = 0.346086263 MB/sec (with seq num) write speed all = 0.332145932 MB/sec (without seq num) 2024/11/23-17:17:13.557313 139957584442944 [compaction_job.cc:1948] [default] [JOB 31712] Generated table #271809: 129431 keys, 42427504 bytes, temperature: kWarm 2024/11/23-17:17:13.557409 139957584442944 EVENT_LOG_v1 {"time_micros": 1732353433557350, "cf_name": "default", "job": 31712, "event": "table_file_creation", "file_number": 271809, "file_size": 42427504, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237877277, "largest_seqno": 4140724617, "table_properties": {"data_size": 40328448, "index_size": 233664, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588620, "raw_average_key_size": 20, "raw_value_size": 131629266, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129431, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732353432, "oldest_key_time": 0, "file_creation_time": 1732353432, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 271809, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-17:17:13.598603 139957584442944 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271810.sst) /dev/shm/ToplingTemp/Topling-129809-X8Rj8K 2024/11/23-17:17:14.324515 139957584442944 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271810.sst): first pass time = 0.73's, 184.906'MB/sec 2024/11/23-17:17:15.213847 139957584442944 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271810.sst): old prealloc_size = 147639500, real_size = 40863568 2024/11/23-17:17:15.213993 139957584442944 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271810.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129432 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.74 raw-val = 0.1316 GB zip-val = 0.0406 GB avg-val =1016.98 avg-zval = 313.72 2024/11/23-17:17:15.214154 139957584442944 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271810.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-17:17:15.380901 139957584442944 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271810.sst): second pass time = 0.89's, 148.251'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.17's, 255.600'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1849.535'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.271'MB/sec write SST data time = 0.05's, 899.861'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 48853.076'MB/sec zip my value time = 0.89's, unzip length = 0.132'GB zip my value throughput = 148.251'MB/sec zip pipeline throughput = 148.251'MB/sec entries = 129432 avg-key = 20.00 avg-zkey = 1.74 avg-val = 1016.98 avg-zval = 313.72 usrkeys = 129432 avg-key = 12.00 avg-zkey = 1.74 avg-val = 1023.98 avg-zval = 313.72 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129432 bytes = 485392 } seq expand size = 906024 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0406 GB dict = 1.38 MB all = 0.0427 GB } UnZip/Zip{ index = 6.8964 value = 3.2416 dict = 1.00 all = 3.1436 } Zip/UnZip{ index = 0.1450 value = 0.3085 dict = 1.00 all = 0.3181 } ---------------------------- total value len = 9.113690 GB avg = 0.173 KB (by entry num) total key len = 1.445998 GB avg = 0.027 KB total ukey len = 1.000984 GB avg = 0.015 KB total ukey num = 0.065809298 Billion total entry num = 0.052617027 Billion write speed all = 0.350550421 MB/sec (with seq num) write speed all = 0.336576584 MB/sec (without seq num) 2024/11/23-17:17:15.436156 139957584442944 [compaction_job.cc:1948] [default] [JOB 31712] Generated table #271810: 129432 keys, 42696236 bytes, temperature: kWarm 2024/11/23-17:17:15.436221 139957584442944 EVENT_LOG_v1 {"time_micros": 1732353435436188, "cf_name": "default", "job": 31712, "event": "table_file_creation", "file_number": 271810, "file_size": 42696236, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237868195, "largest_seqno": 4140724638, "table_properties": {"data_size": 40605824, "index_size": 225216, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588640, "raw_average_key_size": 20, "raw_value_size": 131629188, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129432, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732353433, "oldest_key_time": 0, "file_creation_time": 1732353433, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 271810, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-17:17:15.474313 139957584442944 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271811.sst) /dev/shm/ToplingTemp/Topling-129809-c64pmI 2024/11/23-17:17:16.158311 139957584442944 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271811.sst): first pass time = 0.68's, 196.237'MB/sec 2024/11/23-17:17:16.940086 139957584442944 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271811.sst): old prealloc_size = 147639500, real_size = 40585312 2024/11/23-17:17:16.940213 139957584442944 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271811.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129433 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.81 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1016.97 avg-zval = 311.51 2024/11/23-17:17:16.940375 139957584442944 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271811.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-17:17:17.102793 139957584442944 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271811.sst): second pass time = 0.78's, 168.776'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 260.739'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2187.154'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.277'MB/sec write SST data time = 0.05's, 929.296'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 36835.369'MB/sec zip my value time = 0.78's, unzip length = 0.132'GB zip my value throughput = 168.776'MB/sec zip pipeline throughput = 168.776'MB/sec entries = 129433 avg-key = 20.00 avg-zkey = 1.81 avg-val = 1016.97 avg-zval = 311.51 usrkeys = 129433 avg-key = 12.00 avg-zkey = 1.81 avg-val = 1023.97 avg-zval = 311.51 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129433 bytes = 485392 } seq expand size = 906031 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0424 GB } UnZip/Zip{ index = 6.6453 value = 3.2647 dict = 1.00 all = 3.1642 } Zip/UnZip{ index = 0.1505 value = 0.3063 dict = 1.00 all = 0.3160 } ---------------------------- total value len = 9.246226 GB avg = 0.175 KB (by entry num) total key len = 1.448587 GB avg = 0.027 KB total ukey len = 1.002538 GB avg = 0.015 KB total ukey num = 0.065938731 Billion total entry num = 0.052746460 Billion write speed all = 0.355015865 MB/sec (with seq num) write speed all = 0.341008454 MB/sec (without seq num) 2024/11/23-17:17:17.157814 139957584442944 [compaction_job.cc:1948] [default] [JOB 31712] Generated table #271811: 129433 keys, 42418332 bytes, temperature: kWarm 2024/11/23-17:17:17.157884 139957584442944 EVENT_LOG_v1 {"time_micros": 1732353437157848, "cf_name": "default", "job": 31712, "event": "table_file_creation", "file_number": 271811, "file_size": 42418332, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237873554, "largest_seqno": 4140724773, "table_properties": {"data_size": 40319056, "index_size": 233728, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588660, "raw_average_key_size": 20, "raw_value_size": 131629900, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129433, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732353435, "oldest_key_time": 0, "file_creation_time": 1732353435, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 271811, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-17:17:17.202165 139957584442944 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271812.sst) /dev/shm/ToplingTemp/Topling-129809-SePXEI 2024/11/23-17:17:17.817882 139957584442944 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271812.sst): first pass time = 0.62's, 217.999'MB/sec 2024/11/23-17:17:18.636926 139957584442944 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271812.sst): old prealloc_size = 147639500, real_size = 40874576 2024/11/23-17:17:18.637081 139957584442944 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271812.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129433 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.74 raw-val = 0.1316 GB zip-val = 0.0406 GB avg-val =1016.97 avg-zval = 313.81 2024/11/23-17:17:18.637251 139957584442944 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271812.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-17:17:18.800545 139957584442944 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271812.sst): second pass time = 0.82's, 161.065'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 261.051'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1713.763'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.274'MB/sec write SST data time = 0.05's, 939.379'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 44890.333'MB/sec zip my value time = 0.82's, unzip length = 0.132'GB zip my value throughput = 161.065'MB/sec zip pipeline throughput = 161.065'MB/sec entries = 129433 avg-key = 20.00 avg-zkey = 1.74 avg-val = 1016.97 avg-zval = 313.81 usrkeys = 129433 avg-key = 12.00 avg-zkey = 1.74 avg-val = 1023.97 avg-zval = 313.81 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129433 bytes = 485392 } seq expand size = 906031 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0406 GB dict = 1.38 MB all = 0.0427 GB } UnZip/Zip{ index = 6.9024 value = 3.2407 dict = 1.00 all = 3.1427 } Zip/UnZip{ index = 0.1449 value = 0.3086 dict = 1.00 all = 0.3182 } ---------------------------- total value len = 9.378761 GB avg = 0.177 KB (by entry num) total key len = 1.451176 GB avg = 0.027 KB total ukey len = 1.004091 GB avg = 0.015 KB total ukey num = 0.066068164 Billion total entry num = 0.052875893 Billion write speed all = 0.359481059 MB/sec (with seq num) write speed all = 0.345440067 MB/sec (without seq num) 2024/11/23-17:17:18.853833 139957584442944 [compaction_job.cc:1948] [default] [JOB 31712] Generated table #271812: 129433 keys, 42707162 bytes, temperature: kWarm 2024/11/23-17:17:18.853905 139957584442944 EVENT_LOG_v1 {"time_micros": 1732353438853868, "cf_name": "default", "job": 31712, "event": "table_file_creation", "file_number": 271812, "file_size": 42707162, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237868596, "largest_seqno": 4140720657, "table_properties": {"data_size": 40617024, "index_size": 225024, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588660, "raw_average_key_size": 20, "raw_value_size": 131629095, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129433, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732353437, "oldest_key_time": 0, "file_creation_time": 1732353437, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 271812, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-17:17:18.895041 139957584442944 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271813.sst) /dev/shm/ToplingTemp/Topling-129809-TzjL2L 2024/11/23-17:17:19.475796 139957584442944 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271813.sst): first pass time = 0.58's, 231.127'MB/sec 2024/11/23-17:17:20.251954 139957584442944 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271813.sst): old prealloc_size = 147639500, real_size = 40582720 2024/11/23-17:17:20.252100 139957584442944 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271813.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129431 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.81 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1016.99 avg-zval = 311.49 2024/11/23-17:17:20.252267 139957584442944 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271813.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-17:17:20.413407 139957584442944 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271813.sst): second pass time = 0.77's, 169.978'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 262.746'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2222.658'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.277'MB/sec write SST data time = 0.04's, 955.893'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 42825.200'MB/sec zip my value time = 0.77's, unzip length = 0.132'GB zip my value throughput = 169.978'MB/sec zip pipeline throughput = 169.978'MB/sec entries = 129431 avg-key = 20.00 avg-zkey = 1.81 avg-val = 1016.99 avg-zval = 311.49 usrkeys = 129431 avg-key = 12.00 avg-zkey = 1.81 avg-val = 1023.99 avg-zval = 311.49 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129431 bytes = 485376 } seq expand size = 906017 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0424 GB } UnZip/Zip{ index = 6.6452 value = 3.2649 dict = 1.00 all = 3.1644 } Zip/UnZip{ index = 0.1505 value = 0.3063 dict = 1.00 all = 0.3160 } ---------------------------- total value len = 9.511297 GB avg = 0.179 KB (by entry num) total key len = 1.453764 GB avg = 0.027 KB total ukey len = 1.005644 GB avg = 0.015 KB total ukey num = 0.066197595 Billion total entry num = 0.053005324 Billion write speed all = 0.363946790 MB/sec (with seq num) write speed all = 0.349872182 MB/sec (without seq num) 2024/11/23-17:17:20.467305 139957584442944 [compaction_job.cc:1948] [default] [JOB 31712] Generated table #271813: 129431 keys, 42415361 bytes, temperature: kWarm 2024/11/23-17:17:20.467376 139957584442944 EVENT_LOG_v1 {"time_micros": 1732353440467338, "cf_name": "default", "job": 31712, "event": "table_file_creation", "file_number": 271813, "file_size": 42415361, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237869923, "largest_seqno": 4140724044, "table_properties": {"data_size": 40316464, "index_size": 233728, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588620, "raw_average_key_size": 20, "raw_value_size": 131629584, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129431, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732353438, "oldest_key_time": 0, "file_creation_time": 1732353438, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 271813, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-17:17:20.504052 139957584442944 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271814.sst) /dev/shm/ToplingTemp/Topling-129809-hVburK 2024/11/23-17:17:21.197283 139957584442944 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271814.sst): first pass time = 0.69's, 193.622'MB/sec 2024/11/23-17:17:21.971920 139957584442944 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271814.sst): old prealloc_size = 147639500, real_size = 40592224 2024/11/23-17:17:21.972071 139957584442944 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271814.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129431 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.81 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1016.99 avg-zval = 311.56 2024/11/23-17:17:21.972239 139957584442944 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271814.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-17:17:22.132598 139957584442944 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271814.sst): second pass time = 0.77's, 170.083'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 264.058'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1826.157'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.278'MB/sec write SST data time = 0.04's, 963.196'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 46042.602'MB/sec zip my value time = 0.77's, unzip length = 0.132'GB zip my value throughput = 170.083'MB/sec zip pipeline throughput = 170.083'MB/sec entries = 129431 avg-key = 20.00 avg-zkey = 1.81 avg-val = 1016.99 avg-zval = 311.56 usrkeys = 129431 avg-key = 12.00 avg-zkey = 1.81 avg-val = 1023.99 avg-zval = 311.56 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129431 bytes = 485376 } seq expand size = 906017 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0424 GB } UnZip/Zip{ index = 6.6452 value = 3.2641 dict = 1.00 all = 3.1637 } Zip/UnZip{ index = 0.1505 value = 0.3064 dict = 1.00 all = 0.3161 } ---------------------------- total value len = 9.643832 GB avg = 0.181 KB (by entry num) total key len = 1.456353 GB avg = 0.027 KB total ukey len = 1.007197 GB avg = 0.015 KB total ukey num = 0.066327026 Billion total entry num = 0.053134755 Billion write speed all = 0.368410739 MB/sec (with seq num) write speed all = 0.354302568 MB/sec (without seq num) 2024/11/23-17:17:22.185383 139957584442944 [compaction_job.cc:1948] [default] [JOB 31712] Generated table #271814: 129431 keys, 42424938 bytes, temperature: kWarm 2024/11/23-17:17:22.185461 139957584442944 EVENT_LOG_v1 {"time_micros": 1732353442185417, "cf_name": "default", "job": 31712, "event": "table_file_creation", "file_number": 271814, "file_size": 42424938, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237881756, "largest_seqno": 4140723461, "table_properties": {"data_size": 40325968, "index_size": 233728, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588620, "raw_average_key_size": 20, "raw_value_size": 131629471, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129431, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732353440, "oldest_key_time": 0, "file_creation_time": 1732353440, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 271814, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-17:17:22.223169 139957584442944 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271815.sst) /dev/shm/ToplingTemp/Topling-129809-OebVFL 2024/11/23-17:17:22.955389 139957584442944 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271815.sst): first pass time = 0.73's, 183.311'MB/sec 2024/11/23-17:17:23.762065 139957584442944 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271815.sst): old prealloc_size = 147639500, real_size = 41081280 2024/11/23-17:17:23.762186 139957584442944 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271815.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129427 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.72 raw-val = 0.1316 GB zip-val = 0.0408 GB avg-val =1017.02 avg-zval = 315.44 2024/11/23-17:17:23.762362 139957584442944 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271815.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-17:17:23.923012 139957584442944 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271815.sst): second pass time = 0.81's, 163.322'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 266.712'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2276.848'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.275'MB/sec write SST data time = 0.04's, 992.115'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 46490.775'MB/sec zip my value time = 0.81's, unzip length = 0.132'GB zip my value throughput = 163.322'MB/sec zip pipeline throughput = 163.322'MB/sec entries = 129427 avg-key = 20.00 avg-zkey = 1.72 avg-val = 1017.02 avg-zval = 315.44 usrkeys = 129427 avg-key = 12.00 avg-zkey = 1.72 avg-val = 1024.02 avg-zval = 315.44 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129427 bytes = 485360 } seq expand size = 905989 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0408 GB dict = 1.38 MB all = 0.0429 GB } UnZip/Zip{ index = 6.9815 value = 3.2241 dict = 1.00 all = 3.1276 } Zip/UnZip{ index = 0.1432 value = 0.3102 dict = 1.00 all = 0.3197 } ---------------------------- total value len = 9.776368 GB avg = 0.184 KB (by entry num) total key len = 1.458941 GB avg = 0.027 KB total ukey len = 1.008750 GB avg = 0.015 KB total ukey num = 0.066456453 Billion total entry num = 0.053264182 Billion write speed all = 0.372873291 MB/sec (with seq num) write speed all = 0.358731595 MB/sec (without seq num) 2024/11/23-17:17:23.974712 139957584442944 [compaction_job.cc:1948] [default] [JOB 31712] Generated table #271815: 129427 keys, 42914311 bytes, temperature: kWarm 2024/11/23-17:17:23.974798 139957584442944 EVENT_LOG_v1 {"time_micros": 1732353443974750, "cf_name": "default", "job": 31712, "event": "table_file_creation", "file_number": 271815, "file_size": 42914311, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237882779, "largest_seqno": 4140720573, "table_properties": {"data_size": 40826288, "index_size": 222464, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588540, "raw_average_key_size": 20, "raw_value_size": 131629391, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129427, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732353442, "oldest_key_time": 0, "file_creation_time": 1732353442, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 271815, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-17:17:24.014912 139957584442944 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271816.sst) /dev/shm/ToplingTemp/Topling-129809-4f0SbK 2024/11/23-17:17:24.539261 139957584442944 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271816.sst): first pass time = 0.52's, 255.991'MB/sec 2024/11/23-17:17:25.322378 139957584442944 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271816.sst): old prealloc_size = 147639500, real_size = 40888080 2024/11/23-17:17:25.322509 139957584442944 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271816.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129431 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.74 raw-val = 0.1316 GB zip-val = 0.0406 GB avg-val =1016.99 avg-zval = 313.92 2024/11/23-17:17:25.322670 139957584442944 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271816.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-17:17:25.481207 139957584442944 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271816.sst): second pass time = 0.78's, 168.235'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 269.007'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2047.963'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.276'MB/sec write SST data time = 0.04's, 1027.500'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 43864.712'MB/sec zip my value time = 0.78's, unzip length = 0.132'GB zip my value throughput = 168.235'MB/sec zip pipeline throughput = 168.235'MB/sec entries = 129431 avg-key = 20.00 avg-zkey = 1.74 avg-val = 1016.99 avg-zval = 313.92 usrkeys = 129431 avg-key = 12.00 avg-zkey = 1.74 avg-val = 1023.99 avg-zval = 313.92 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129431 bytes = 485376 } seq expand size = 906017 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0406 GB dict = 1.38 MB all = 0.0427 GB } UnZip/Zip{ index = 6.9101 value = 3.2397 dict = 1.00 all = 3.1418 } Zip/UnZip{ index = 0.1447 value = 0.3087 dict = 1.00 all = 0.3183 } ---------------------------- total value len = 9.908904 GB avg = 0.186 KB (by entry num) total key len = 1.461530 GB avg = 0.027 KB total ukey len = 1.010303 GB avg = 0.015 KB total ukey num = 0.066585884 Billion total entry num = 0.053393613 Billion write speed all = 0.377338238 MB/sec (with seq num) write speed all = 0.363162911 MB/sec (without seq num) 2024/11/23-17:17:25.532663 139957584442944 [compaction_job.cc:1948] [default] [JOB 31712] Generated table #271816: 129431 keys, 42720506 bytes, temperature: kWarm 2024/11/23-17:17:25.532732 139957584442944 EVENT_LOG_v1 {"time_micros": 1732353445532696, "cf_name": "default", "job": 31712, "event": "table_file_creation", "file_number": 271816, "file_size": 42720506, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237868290, "largest_seqno": 4140724684, "table_properties": {"data_size": 40630784, "index_size": 224768, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588620, "raw_average_key_size": 20, "raw_value_size": 131629808, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129431, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732353444, "oldest_key_time": 0, "file_creation_time": 1732353444, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 271816, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-17:17:25.571103 139957584442944 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271817.sst) /dev/shm/ToplingTemp/Topling-129809-ZE2mcJ 2024/11/23-17:17:26.225554 139957584442944 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271817.sst): first pass time = 0.65's, 205.098'MB/sec 2024/11/23-17:17:27.034262 139957584442944 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271817.sst): old prealloc_size = 147639500, real_size = 40971792 2024/11/23-17:17:27.034377 139957584442944 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271817.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129431 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.73 raw-val = 0.1316 GB zip-val = 0.0407 GB avg-val =1016.99 avg-zval = 314.58 2024/11/23-17:17:27.034548 139957584442944 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271817.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-17:17:27.193432 139957584442944 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271817.sst): second pass time = 0.81's, 162.907'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 268.961'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2425.605'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.276'MB/sec write SST data time = 0.04's, 1027.550'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.379'MB, throughput = 36181.749'MB/sec zip my value time = 0.81's, unzip length = 0.132'GB zip my value throughput = 162.907'MB/sec zip pipeline throughput = 162.907'MB/sec entries = 129431 avg-key = 20.00 avg-zkey = 1.73 avg-val = 1016.99 avg-zval = 314.58 usrkeys = 129431 avg-key = 12.00 avg-zkey = 1.73 avg-val = 1023.99 avg-zval = 314.58 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129431 bytes = 485376 } seq expand size = 906017 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0407 GB dict = 1.38 MB all = 0.0428 GB } UnZip/Zip{ index = 6.9497 value = 3.2329 dict = 1.00 all = 3.1356 } Zip/UnZip{ index = 0.1439 value = 0.3093 dict = 1.00 all = 0.3189 } ---------------------------- total value len = 10.041439 GB avg = 0.188 KB (by entry num) total key len = 1.464119 GB avg = 0.027 KB total ukey len = 1.011857 GB avg = 0.015 KB total ukey num = 0.066715315 Billion total entry num = 0.053523044 Billion write speed all = 0.381800769 MB/sec (with seq num) write speed all = 0.367591887 MB/sec (without seq num) 2024/11/23-17:17:27.244740 139957584442944 [compaction_job.cc:1948] [default] [JOB 31712] Generated table #271817: 129431 keys, 42805156 bytes, temperature: kWarm 2024/11/23-17:17:27.244810 139957584442944 EVENT_LOG_v1 {"time_micros": 1732353447244774, "cf_name": "default", "job": 31712, "event": "table_file_creation", "file_number": 271817, "file_size": 42805156, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237912377, "largest_seqno": 4140725428, "table_properties": {"data_size": 40715776, "index_size": 223488, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588620, "raw_average_key_size": 20, "raw_value_size": 131629742, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129431, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732353445, "oldest_key_time": 0, "file_creation_time": 1732353445, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 271817, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-17:17:27.303574 139957584442944 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271818.sst) /dev/shm/ToplingTemp/Topling-129809-LK88kL 2024/11/23-17:17:27.930297 139957584442944 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271818.sst): first pass time = 0.63's, 214.174'MB/sec 2024/11/23-17:17:28.683105 139957584442944 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271818.sst): old prealloc_size = 147639500, real_size = 40586672 2024/11/23-17:17:28.683244 139957584442944 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271818.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129432 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.81 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1016.98 avg-zval = 311.52 2024/11/23-17:17:28.683407 139957584442944 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271818.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-17:17:28.841940 139957584442944 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271818.sst): second pass time = 0.75's, 175.023'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 267.103'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1969.878'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.279'MB/sec write SST data time = 0.04's, 988.438'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 43876.385'MB/sec zip my value time = 0.75's, unzip length = 0.132'GB zip my value throughput = 175.023'MB/sec zip pipeline throughput = 175.023'MB/sec entries = 129432 avg-key = 20.00 avg-zkey = 1.81 avg-val = 1016.98 avg-zval = 311.52 usrkeys = 129432 avg-key = 12.00 avg-zkey = 1.81 avg-val = 1023.98 avg-zval = 311.52 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129432 bytes = 485392 } seq expand size = 906024 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0424 GB } UnZip/Zip{ index = 6.6453 value = 3.2646 dict = 1.00 all = 3.1641 } Zip/UnZip{ index = 0.1505 value = 0.3063 dict = 1.00 all = 0.3160 } ---------------------------- total value len = 10.173975 GB avg = 0.190 KB (by entry num) total key len = 1.466707 GB avg = 0.027 KB total ukey len = 1.013410 GB avg = 0.015 KB total ukey num = 0.066844747 Billion total entry num = 0.053652476 Billion write speed all = 0.386263619 MB/sec (with seq num) write speed all = 0.372021156 MB/sec (without seq num) 2024/11/23-17:17:28.893457 139957584442944 [compaction_job.cc:1948] [default] [JOB 31712] Generated table #271818: 129432 keys, 42419716 bytes, temperature: kWarm 2024/11/23-17:17:28.893525 139957584442944 EVENT_LOG_v1 {"time_micros": 1732353448893489, "cf_name": "default", "job": 31712, "event": "table_file_creation", "file_number": 271818, "file_size": 42419716, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237873877, "largest_seqno": 4140719321, "table_properties": {"data_size": 40320416, "index_size": 233728, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588640, "raw_average_key_size": 20, "raw_value_size": 131629975, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129432, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732353447, "oldest_key_time": 0, "file_creation_time": 1732353447, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 271818, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-17:17:28.929034 139957584442944 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271819.sst) /dev/shm/ToplingTemp/Topling-129809-TChDvL 2024/11/23-17:17:29.649151 139957584442944 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271819.sst): first pass time = 0.72's, 186.393'MB/sec 2024/11/23-17:17:30.415522 139957584442944 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271819.sst): old prealloc_size = 147639500, real_size = 40581792 2024/11/23-17:17:30.415641 139957584442944 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271819.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129429 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.81 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1017.00 avg-zval = 311.49 2024/11/23-17:17:30.415801 139957584442944 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271819.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-17:17:30.573395 139957584442944 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271819.sst): second pass time = 0.77's, 171.929'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 268.689'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2388.035'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.280'MB/sec write SST data time = 0.04's, 1004.848'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 42306.526'MB/sec zip my value time = 0.77's, unzip length = 0.132'GB zip my value throughput = 171.929'MB/sec zip pipeline throughput = 171.929'MB/sec entries = 129429 avg-key = 20.00 avg-zkey = 1.81 avg-val = 1017.00 avg-zval = 311.49 usrkeys = 129429 avg-key = 12.00 avg-zkey = 1.81 avg-val = 1024.00 avg-zval = 311.49 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129429 bytes = 485376 } seq expand size = 906003 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0424 GB } UnZip/Zip{ index = 6.6397 value = 3.2650 dict = 1.00 all = 3.1644 } Zip/UnZip{ index = 0.1506 value = 0.3063 dict = 1.00 all = 0.3160 } ---------------------------- total value len = 10.306511 GB avg = 0.192 KB (by entry num) total key len = 1.469296 GB avg = 0.027 KB total ukey len = 1.014963 GB avg = 0.015 KB total ukey num = 0.066974176 Billion total entry num = 0.053781905 Billion write speed all = 0.390724878 MB/sec (with seq num) write speed all = 0.376448877 MB/sec (without seq num) 2024/11/23-17:17:30.624232 139957584442944 [compaction_job.cc:1948] [default] [JOB 31712] Generated table #271819: 129429 keys, 42414805 bytes, temperature: kWarm 2024/11/23-17:17:30.624303 139957584442944 EVENT_LOG_v1 {"time_micros": 1732353450624268, "cf_name": "default", "job": 31712, "event": "table_file_creation", "file_number": 271819, "file_size": 42414805, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237872082, "largest_seqno": 4140713220, "table_properties": {"data_size": 40315344, "index_size": 233920, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588580, "raw_average_key_size": 20, "raw_value_size": 131629243, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129429, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732353448, "oldest_key_time": 0, "file_creation_time": 1732353448, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 271819, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-17:17:30.662029 139957584442944 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271820.sst) /dev/shm/ToplingTemp/Topling-129809-DGEQ1L 2024/11/23-17:17:31.184724 139957584442944 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271820.sst): first pass time = 0.52's, 256.796'MB/sec 2024/11/23-17:17:31.998154 139957584442944 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271820.sst): old prealloc_size = 147639500, real_size = 40976656 2024/11/23-17:17:31.998271 139957584442944 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271820.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129431 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.74 raw-val = 0.1316 GB zip-val = 0.0407 GB avg-val =1016.98 avg-zval = 314.60 2024/11/23-17:17:31.998428 139957584442944 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271820.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-17:17:32.156033 139957584442944 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271820.sst): second pass time = 0.81's, 162.095'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 271.212'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2395.210'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.278'MB/sec write SST data time = 0.04's, 1032.739'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 37715.889'MB/sec zip my value time = 0.81's, unzip length = 0.132'GB zip my value throughput = 162.095'MB/sec zip pipeline throughput = 162.095'MB/sec entries = 129431 avg-key = 20.00 avg-zkey = 1.74 avg-val = 1016.98 avg-zval = 314.60 usrkeys = 129431 avg-key = 12.00 avg-zkey = 1.74 avg-val = 1023.98 avg-zval = 314.60 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129431 bytes = 485376 } seq expand size = 906017 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0407 GB dict = 1.38 MB all = 0.0428 GB } UnZip/Zip{ index = 6.8846 value = 3.2327 dict = 1.00 all = 3.1352 } Zip/UnZip{ index = 0.1453 value = 0.3093 dict = 1.00 all = 0.3190 } ---------------------------- total value len = 10.439046 GB avg = 0.194 KB (by entry num) total key len = 1.471885 GB avg = 0.027 KB total ukey len = 1.016516 GB avg = 0.015 KB total ukey num = 0.067103607 Billion total entry num = 0.053911336 Billion write speed all = 0.395187576 MB/sec (with seq num) write speed all = 0.380877970 MB/sec (without seq num) 2024/11/23-17:17:32.207032 139957584442944 [compaction_job.cc:1948] [default] [JOB 31712] Generated table #271820: 129431 keys, 42809373 bytes, temperature: kWarm 2024/11/23-17:17:32.207102 139957584442944 EVENT_LOG_v1 {"time_micros": 1732353452207066, "cf_name": "default", "job": 31712, "event": "table_file_creation", "file_number": 271820, "file_size": 42809373, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237888398, "largest_seqno": 4140722579, "table_properties": {"data_size": 40718528, "index_size": 225600, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588620, "raw_average_key_size": 20, "raw_value_size": 131629201, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129431, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732353450, "oldest_key_time": 0, "file_creation_time": 1732353450, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 271820, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-17:17:32.245019 139957584442944 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271821.sst) /dev/shm/ToplingTemp/Topling-129809-nihvyJ 2024/11/23-17:17:32.871154 139957584442944 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271821.sst): first pass time = 0.63's, 214.372'MB/sec 2024/11/23-17:17:33.633039 139957584442944 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271821.sst): old prealloc_size = 147639500, real_size = 40756688 2024/11/23-17:17:33.633159 139957584442944 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271821.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129423 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.78 raw-val = 0.1316 GB zip-val = 0.0405 GB avg-val =1017.05 avg-zval = 312.88 2024/11/23-17:17:33.633333 139957584442944 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271821.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-17:17:33.792422 139957584442944 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271821.sst): second pass time = 0.76's, 173.132'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 267.255'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2308.031'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.277'MB/sec write SST data time = 0.04's, 1005.661'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 44901.557'MB/sec zip my value time = 0.76's, unzip length = 0.132'GB zip my value throughput = 173.132'MB/sec zip pipeline throughput = 173.132'MB/sec entries = 129423 avg-key = 20.00 avg-zkey = 1.78 avg-val = 1017.05 avg-zval = 312.88 usrkeys = 129423 avg-key = 12.00 avg-zkey = 1.78 avg-val = 1024.05 avg-zval = 312.88 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129423 bytes = 485344 } seq expand size = 905961 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0405 GB dict = 1.38 MB all = 0.0426 GB } UnZip/Zip{ index = 6.7314 value = 3.2506 dict = 1.00 all = 3.1514 } Zip/UnZip{ index = 0.1486 value = 0.3076 dict = 1.00 all = 0.3173 } ---------------------------- total value len = 10.571581 GB avg = 0.196 KB (by entry num) total key len = 1.474473 GB avg = 0.027 KB total ukey len = 1.018069 GB avg = 0.015 KB total ukey num = 0.067233030 Billion total entry num = 0.054040759 Billion write speed all = 0.399649091 MB/sec (with seq num) write speed all = 0.385305911 MB/sec (without seq num) 2024/11/23-17:17:33.843279 139957584442944 [compaction_job.cc:1948] [default] [JOB 31712] Generated table #271821: 129423 keys, 42589779 bytes, temperature: kWarm 2024/11/23-17:17:33.843350 139957584442944 EVENT_LOG_v1 {"time_micros": 1732353453843313, "cf_name": "default", "job": 31712, "event": "table_file_creation", "file_number": 271821, "file_size": 42589779, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237871365, "largest_seqno": 4140711954, "table_properties": {"data_size": 40493440, "index_size": 230720, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588460, "raw_average_key_size": 20, "raw_value_size": 131629342, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129423, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732353452, "oldest_key_time": 0, "file_creation_time": 1732353452, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 271821, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-17:17:33.881152 139957584442944 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271822.sst) /dev/shm/ToplingTemp/Topling-129809-Vpv3PK 2024/11/23-17:17:34.458165 139957584442944 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271822.sst): first pass time = 0.58's, 232.624'MB/sec 2024/11/23-17:17:35.226394 139957584442944 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271822.sst): old prealloc_size = 147639500, real_size = 40529664 2024/11/23-17:17:35.226525 139957584442944 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271822.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129430 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.74 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1017.00 avg-zval = 311.14 2024/11/23-17:17:35.226642 139957584442944 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271822.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-17:17:35.385264 139957584442944 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271822.sst): second pass time = 0.77's, 171.675'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 265.253'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2004.762'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.279'MB/sec write SST data time = 0.04's, 987.756'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 46485.511'MB/sec zip my value time = 0.77's, unzip length = 0.132'GB zip my value throughput = 171.675'MB/sec zip pipeline throughput = 171.675'MB/sec entries = 129430 avg-key = 20.00 avg-zkey = 1.74 avg-val = 1017.00 avg-zval = 311.14 usrkeys = 129430 avg-key = 12.00 avg-zkey = 1.74 avg-val = 1020.42 avg-zval = 311.14 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 63363 bytes = 237632 } seq expand size = 443541 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0421 GB } UnZip/Zip{ index = 6.8826 value = 3.2686 dict = 1.00 all = 3.1854 } Zip/UnZip{ index = 0.1453 value = 0.3059 dict = 1.00 all = 0.3139 } ---------------------------- total value len = 10.703655 GB avg = 0.198 KB (by entry num) total key len = 1.477062 GB avg = 0.027 KB total ukey len = 1.019622 GB avg = 0.015 KB total ukey num = 0.067362460 Billion total entry num = 0.054170189 Billion write speed all = 0.404095390 MB/sec (with seq num) write speed all = 0.389718617 MB/sec (without seq num) 2024/11/23-17:17:35.436083 139957584442944 [compaction_job.cc:1948] [default] [JOB 31712] Generated table #271822: 129430 keys, 42134961 bytes, temperature: kWarm 2024/11/23-17:17:35.436151 139957584442944 EVENT_LOG_v1 {"time_micros": 1732353455436115, "cf_name": "default", "job": 31712, "event": "table_file_creation", "file_number": 271822, "file_size": 42134961, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4140699821, "table_properties": {"data_size": 40271472, "index_size": 225664, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588600, "raw_average_key_size": 20, "raw_value_size": 131629994, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129430, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732353453, "oldest_key_time": 0, "file_creation_time": 1732353453, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 271822, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-17:17:35.478203 139957584442944 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271823.sst) /dev/shm/ToplingTemp/Topling-129809-uH8V1J 2024/11/23-17:17:36.200472 139957584442944 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271823.sst): first pass time = 0.72's, 185.837'MB/sec 2024/11/23-17:17:37.005694 139957584442944 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271823.sst): old prealloc_size = 147639500, real_size = 40931808 2024/11/23-17:17:37.005813 139957584442944 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271823.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129433 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.70 raw-val = 0.1316 GB zip-val = 0.0407 GB avg-val =1016.97 avg-zval = 314.29 2024/11/23-17:17:37.005947 139957584442944 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271823.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-17:17:37.164702 139957584442944 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271823.sst): second pass time = 0.80's, 163.787'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 268.253'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2302.043'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.276'MB/sec write SST data time = 0.04's, 1024.691'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 47775.181'MB/sec zip my value time = 0.80's, unzip length = 0.132'GB zip my value throughput = 163.787'MB/sec zip pipeline throughput = 163.787'MB/sec entries = 129433 avg-key = 20.00 avg-zkey = 1.70 avg-val = 1016.97 avg-zval = 314.29 usrkeys = 129433 avg-key = 12.00 avg-zkey = 1.70 avg-val = 1022.00 avg-zval = 314.29 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 93043 bytes = 348928 } seq expand size = 651301 multi value expand size = 0 cnt WriteAppend = 11 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0407 GB dict = 1.38 MB all = 0.0426 GB } UnZip/Zip{ index = 7.0467 value = 3.2358 dict = 1.00 all = 3.1471 } Zip/UnZip{ index = 0.1419 value = 0.3090 dict = 1.00 all = 0.3178 } ---------------------------- total value len = 10.835936 GB avg = 0.200 KB (by entry num) total key len = 1.479650 GB avg = 0.027 KB total ukey len = 1.021176 GB avg = 0.015 KB total ukey num = 0.067491893 Billion total entry num = 0.054299622 Billion write speed all = 0.408545571 MB/sec (with seq num) write speed all = 0.394135297 MB/sec (without seq num) 2024/11/23-17:17:37.216291 139957584442944 [compaction_job.cc:1948] [default] [JOB 31712] Generated table #271823: 129433 keys, 42648283 bytes, temperature: kWarm 2024/11/23-17:17:37.216361 139957584442944 EVENT_LOG_v1 {"time_micros": 1732353457216325, "cf_name": "default", "job": 31712, "event": "table_file_creation", "file_number": 271823, "file_size": 42648283, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4140701887, "table_properties": {"data_size": 40678864, "index_size": 220416, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588660, "raw_average_key_size": 20, "raw_value_size": 131629579, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129433, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732353455, "oldest_key_time": 0, "file_creation_time": 1732353455, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 271823, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-17:17:37.255805 139957584442944 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271824.sst) /dev/shm/ToplingTemp/Topling-129809-V7O1AI 2024/11/23-17:17:37.956040 139957584442944 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271824.sst): first pass time = 0.70's, 191.687'MB/sec 2024/11/23-17:17:38.739836 139957584442944 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271824.sst): old prealloc_size = 147639500, real_size = 40679408 2024/11/23-17:17:38.739971 139957584442944 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271824.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129427 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.74 raw-val = 0.1316 GB zip-val = 0.0404 GB avg-val =1017.02 avg-zval = 312.31 2024/11/23-17:17:38.740109 139957584442944 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271824.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-17:17:38.898277 139957584442944 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271824.sst): second pass time = 0.78's, 168.106'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 267.271'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2002.291'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.279'MB/sec write SST data time = 0.04's, 1001.394'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 45087.467'MB/sec zip my value time = 0.78's, unzip length = 0.132'GB zip my value throughput = 168.106'MB/sec zip pipeline throughput = 168.106'MB/sec entries = 129427 avg-key = 20.00 avg-zkey = 1.74 avg-val = 1017.02 avg-zval = 312.31 usrkeys = 129427 avg-key = 12.00 avg-zkey = 1.74 avg-val = 1021.25 avg-zval = 312.31 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 78303 bytes = 293648 } seq expand size = 548121 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0404 GB dict = 1.38 MB all = 0.0423 GB } UnZip/Zip{ index = 6.8883 value = 3.2564 dict = 1.00 all = 3.1700 } Zip/UnZip{ index = 0.1452 value = 0.3071 dict = 1.00 all = 0.3155 } ---------------------------- total value len = 10.968113 GB avg = 0.202 KB (by entry num) total key len = 1.482239 GB avg = 0.027 KB total ukey len = 1.022729 GB avg = 0.015 KB total ukey num = 0.067621320 Billion total entry num = 0.054429049 Billion write speed all = 0.412992423 MB/sec (with seq num) write speed all = 0.398548633 MB/sec (without seq num) 2024/11/23-17:17:38.949843 139957584442944 [compaction_job.cc:1948] [default] [JOB 31712] Generated table #271824: 129427 keys, 42340624 bytes, temperature: kWarm 2024/11/23-17:17:38.949911 139957584442944 EVENT_LOG_v1 {"time_micros": 1732353458949877, "cf_name": "default", "job": 31712, "event": "table_file_creation", "file_number": 271824, "file_size": 42340624, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4140706921, "table_properties": {"data_size": 40421408, "index_size": 225472, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588540, "raw_average_key_size": 20, "raw_value_size": 131629449, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129427, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732353457, "oldest_key_time": 0, "file_creation_time": 1732353457, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 271824, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-17:17:38.991541 139957584442944 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271825.sst) /dev/shm/ToplingTemp/Topling-129809-k4aCEM 2024/11/23-17:17:39.596143 139957584442944 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271825.sst): first pass time = 0.60's, 222.008'MB/sec 2024/11/23-17:17:40.423460 139957584442944 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271825.sst): old prealloc_size = 147639500, real_size = 41068864 2024/11/23-17:17:40.423587 139957584442944 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271825.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129425 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.72 raw-val = 0.1316 GB zip-val = 0.0408 GB avg-val =1017.04 avg-zval = 315.35 2024/11/23-17:17:40.423745 139957584442944 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271825.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-17:17:40.583652 139957584442944 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271825.sst): second pass time = 0.83's, 159.409'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 267.775'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2255.338'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.276'MB/sec write SST data time = 0.04's, 1001.534'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 45767.116'MB/sec zip my value time = 0.83's, unzip length = 0.132'GB zip my value throughput = 159.409'MB/sec zip pipeline throughput = 159.409'MB/sec entries = 129425 avg-key = 20.00 avg-zkey = 1.72 avg-val = 1017.04 avg-zval = 315.35 usrkeys = 129425 avg-key = 12.00 avg-zkey = 1.72 avg-val = 1023.61 avg-zval = 315.35 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 121523 bytes = 455728 } seq expand size = 850661 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0408 GB dict = 1.38 MB all = 0.0429 GB } UnZip/Zip{ index = 6.9914 value = 3.2251 dict = 1.00 all = 3.1292 } Zip/UnZip{ index = 0.1430 value = 0.3101 dict = 1.00 all = 0.3196 } ---------------------------- total value len = 11.100594 GB avg = 0.203 KB (by entry num) total key len = 1.484827 GB avg = 0.027 KB total ukey len = 1.024282 GB avg = 0.015 KB total ukey num = 0.067750745 Billion total entry num = 0.054558474 Billion write speed all = 0.417449482 MB/sec (with seq num) write speed all = 0.402972155 MB/sec (without seq num) 2024/11/23-17:17:40.635495 139957584442944 [compaction_job.cc:1948] [default] [JOB 31712] Generated table #271825: 129425 keys, 42892845 bytes, temperature: kWarm 2024/11/23-17:17:40.635566 139957584442944 EVENT_LOG_v1 {"time_micros": 1732353460635529, "cf_name": "default", "job": 31712, "event": "table_file_creation", "file_number": 271825, "file_size": 42892845, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4140718442, "table_properties": {"data_size": 40814192, "index_size": 222144, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588500, "raw_average_key_size": 20, "raw_value_size": 131629930, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129425, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732353458, "oldest_key_time": 0, "file_creation_time": 1732353458, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 271825, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-17:17:40.675922 139957584442944 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271826.sst) /dev/shm/ToplingTemp/Topling-129809-c1EqeL 2024/11/23-17:17:41.171809 139957584442944 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271826.sst): first pass time = 0.50's, 270.683'MB/sec 2024/11/23-17:17:41.939264 139957584442944 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271826.sst): old prealloc_size = 147639500, real_size = 40541840 2024/11/23-17:17:41.939384 139957584442944 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271826.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129430 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.75 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1016.99 avg-zval = 311.23 2024/11/23-17:17:41.939510 139957584442944 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271826.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-17:17:42.103329 139957584442944 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271826.sst): second pass time = 0.77's, 171.676'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 257.010'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2290.517'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.265'MB/sec write SST data time = 0.04's, 1009.337'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 46586.237'MB/sec zip my value time = 0.77's, unzip length = 0.132'GB zip my value throughput = 171.676'MB/sec zip pipeline throughput = 171.676'MB/sec entries = 129430 avg-key = 20.00 avg-zkey = 1.75 avg-val = 1016.99 avg-zval = 311.23 usrkeys = 129430 avg-key = 12.00 avg-zkey = 1.75 avg-val = 1020.62 avg-zval = 311.23 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 67053 bytes = 251456 } seq expand size = 469371 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0422 GB } UnZip/Zip{ index = 6.8496 value = 3.2677 dict = 1.00 all = 3.1834 } Zip/UnZip{ index = 0.1460 value = 0.3060 dict = 1.00 all = 0.3141 } ---------------------------- total value len = 11.232693 GB avg = 0.205 KB (by entry num) total key len = 1.487416 GB avg = 0.027 KB total ukey len = 1.025835 GB avg = 0.015 KB total ukey num = 0.067880175 Billion total entry num = 0.054687904 Billion write speed all = 0.421895706 MB/sec (with seq num) write speed all = 0.407384766 MB/sec (without seq num) 2024/11/23-17:17:42.159262 139957584442944 [compaction_job.cc:1948] [default] [JOB 31712] Generated table #271826: 129430 keys, 42161322 bytes, temperature: kWarm 2024/11/23-17:17:42.159332 139957584442944 EVENT_LOG_v1 {"time_micros": 1732353462159296, "cf_name": "default", "job": 31712, "event": "table_file_creation", "file_number": 271826, "file_size": 42161322, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4140691245, "table_properties": {"data_size": 40282560, "index_size": 226752, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588600, "raw_average_key_size": 20, "raw_value_size": 131629571, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129430, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732353460, "oldest_key_time": 0, "file_creation_time": 1732353460, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 271826, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-17:17:42.203971 139957584442944 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271827.sst) /dev/shm/ToplingTemp/Topling-129809-yYzhmJ 2024/11/23-17:17:42.770082 139957584442944 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271827.sst): first pass time = 0.57's, 237.110'MB/sec 2024/11/23-17:17:43.543206 139957584442944 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271827.sst): old prealloc_size = 147639500, real_size = 40621584 2024/11/23-17:17:43.543325 139957584442944 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271827.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129428 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.73 raw-val = 0.1316 GB zip-val = 0.0404 GB avg-val =1017.01 avg-zval = 311.88 2024/11/23-17:17:43.543414 139957584442944 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271827.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-17:17:43.700873 139957584442944 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271827.sst): second pass time = 0.77's, 170.618'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 267.330'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2329.566'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.278'MB/sec write SST data time = 0.04's, 1028.729'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 43267.632'MB/sec zip my value time = 0.77's, unzip length = 0.132'GB zip my value throughput = 170.618'MB/sec zip pipeline throughput = 170.618'MB/sec entries = 129428 avg-key = 20.00 avg-zkey = 1.73 avg-val = 1017.01 avg-zval = 311.88 usrkeys = 129428 avg-key = 12.00 avg-zkey = 1.73 avg-val = 1019.22 avg-zval = 311.88 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 40970 bytes = 153648 } seq expand size = 286790 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0404 GB dict = 1.38 MB all = 0.0421 GB } UnZip/Zip{ index = 6.9515 value = 3.2609 dict = 1.00 all = 3.1848 } Zip/UnZip{ index = 0.1439 value = 0.3067 dict = 1.00 all = 0.3140 } ---------------------------- total value len = 11.364609 GB avg = 0.207 KB (by entry num) total key len = 1.490004 GB avg = 0.027 KB total ukey len = 1.027388 GB avg = 0.015 KB total ukey num = 0.068009603 Billion total entry num = 0.054817332 Billion write speed all = 0.426334312 MB/sec (with seq num) write speed all = 0.411789800 MB/sec (without seq num) 2024/11/23-17:17:43.754231 139957584442944 [compaction_job.cc:1948] [default] [JOB 31712] Generated table #271827: 129428 keys, 42142828 bytes, temperature: kWarm 2024/11/23-17:17:43.754305 139957584442944 EVENT_LOG_v1 {"time_micros": 1732353463754267, "cf_name": "default", "job": 31712, "event": "table_file_creation", "file_number": 271827, "file_size": 42142828, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4140725314, "table_properties": {"data_size": 40365632, "index_size": 223424, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588560, "raw_average_key_size": 20, "raw_value_size": 131629218, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129428, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732353462, "oldest_key_time": 0, "file_creation_time": 1732353462, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 271827, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-17:17:43.794401 139957584442944 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271828.sst) /dev/shm/ToplingTemp/Topling-129809-ZtEbqL 2024/11/23-17:17:44.377875 139957584442944 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271828.sst): first pass time = 0.58's, 230.046'MB/sec 2024/11/23-17:17:45.137577 139957584442944 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271828.sst): old prealloc_size = 147639500, real_size = 40480576 2024/11/23-17:17:45.137694 139957584442944 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271828.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129431 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.72 raw-val = 0.1316 GB zip-val = 0.0402 GB avg-val =1016.99 avg-zval = 310.78 2024/11/23-17:17:45.137781 139957584442944 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271828.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-17:17:45.295401 139957584442944 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271828.sst): second pass time = 0.76's, 173.635'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 266.086'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2299.026'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.278'MB/sec write SST data time = 0.04's, 1020.678'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 42227.596'MB/sec zip my value time = 0.76's, unzip length = 0.132'GB zip my value throughput = 173.635'MB/sec zip pipeline throughput = 173.635'MB/sec entries = 129431 avg-key = 20.00 avg-zkey = 1.72 avg-val = 1016.99 avg-zval = 310.78 usrkeys = 129431 avg-key = 12.00 avg-zkey = 1.72 avg-val = 1019.03 avg-zval = 310.78 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 37689 bytes = 141344 } seq expand size = 263823 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0402 GB dict = 1.38 MB all = 0.0420 GB } UnZip/Zip{ index = 6.9636 value = 3.2723 dict = 1.00 all = 3.1965 } Zip/UnZip{ index = 0.1436 value = 0.3056 dict = 1.00 all = 0.3128 } ---------------------------- total value len = 11.496502 GB avg = 0.209 KB (by entry num) total key len = 1.492593 GB avg = 0.027 KB total ukey len = 1.028941 GB avg = 0.015 KB total ukey num = 0.068139034 Billion total entry num = 0.054946763 Billion write speed all = 0.430771748 MB/sec (with seq num) write speed all = 0.416193666 MB/sec (without seq num) 2024/11/23-17:17:45.348881 139957584442944 [compaction_job.cc:1948] [default] [JOB 31712] Generated table #271828: 129431 keys, 41989449 bytes, temperature: kWarm 2024/11/23-17:17:45.348951 139957584442944 EVENT_LOG_v1 {"time_micros": 1732353465348916, "cf_name": "default", "job": 31712, "event": "table_file_creation", "file_number": 271828, "file_size": 41989449, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4140722335, "table_properties": {"data_size": 40225008, "index_size": 223040, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588620, "raw_average_key_size": 20, "raw_value_size": 131629738, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129431, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732353463, "oldest_key_time": 0, "file_creation_time": 1732353463, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 271828, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-17:17:45.388872 139957584442944 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271829.sst) /dev/shm/ToplingTemp/Topling-129809-btsSEJ 2024/11/23-17:17:45.914264 139957584442944 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271829.sst): first pass time = 0.53's, 255.481'MB/sec 2024/11/23-17:17:46.675529 139957584442944 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271829.sst): old prealloc_size = 147639500, real_size = 40474320 2024/11/23-17:17:46.675647 139957584442944 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271829.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129428 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.72 raw-val = 0.1316 GB zip-val = 0.0402 GB avg-val =1017.01 avg-zval = 310.74 2024/11/23-17:17:46.675734 139957584442944 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271829.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-17:17:46.834418 139957584442944 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271829.sst): second pass time = 0.76's, 173.246'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 264.212'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2299.116'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.277'MB/sec write SST data time = 0.04's, 1002.155'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 35860.596'MB/sec zip my value time = 0.76's, unzip length = 0.132'GB zip my value throughput = 173.246'MB/sec zip pipeline throughput = 173.246'MB/sec entries = 129428 avg-key = 20.00 avg-zkey = 1.72 avg-val = 1017.01 avg-zval = 310.74 usrkeys = 129428 avg-key = 12.00 avg-zkey = 1.72 avg-val = 1018.91 avg-zval = 310.74 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 35191 bytes = 131984 } seq expand size = 246337 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0402 GB dict = 1.38 MB all = 0.0420 GB } UnZip/Zip{ index = 6.9735 value = 3.2728 dict = 1.00 all = 3.1976 } Zip/UnZip{ index = 0.1434 value = 0.3055 dict = 1.00 all = 0.3127 } ---------------------------- total value len = 11.628378 GB avg = 0.211 KB (by entry num) total key len = 1.495182 GB avg = 0.027 KB total ukey len = 1.030494 GB avg = 0.015 KB total ukey num = 0.068268462 Billion total entry num = 0.055076191 Billion write speed all = 0.435208917 MB/sec (with seq num) write speed all = 0.420597242 MB/sec (without seq num) 2024/11/23-17:17:46.886519 139957584442944 [compaction_job.cc:1948] [default] [JOB 31712] Generated table #271829: 129428 keys, 41974269 bytes, temperature: kWarm 2024/11/23-17:17:46.886585 139957584442944 EVENT_LOG_v1 {"time_micros": 1732353466886549, "cf_name": "default", "job": 31712, "event": "table_file_creation", "file_number": 271829, "file_size": 41974269, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4140722896, "table_properties": {"data_size": 40219072, "index_size": 222720, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588560, "raw_average_key_size": 20, "raw_value_size": 131629215, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129428, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732353465, "oldest_key_time": 0, "file_creation_time": 1732353465, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 271829, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-17:17:46.923182 139957584442944 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271830.sst) /dev/shm/ToplingTemp/Topling-129809-iOi2zL 2024/11/23-17:17:47.187382 139957584442944 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271830.sst): first pass time = 0.26's, 200.404'MB/sec 2024/11/23-17:17:47.596015 139957584442944 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271830.sst): old prealloc_size = 147639500, real_size = 16330832 2024/11/23-17:17:47.596095 139957584442944 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271830.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 51054 prefix = 4 raw-key = 0.0004 GB zip-key = 0.0001 GB avg-key = 8.00 avg-zkey = 1.72 raw-val = 0.0519 GB zip-val = 0.0162 GB avg-val =1016.94 avg-zval = 317.90 2024/11/23-17:17:47.596185 139957584442944 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271830.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0001 GB, waited 0.000 sec, Key+Value = 0.053 GB 2024/11/23-17:17:47.660281 139957584442944 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00/271830.sst): second pass time = 0.41's, 127.266'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.06's, 264.928'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1480.922'MB/sec (index lex order gen) rebuild zvType time = 0.05's, 0.270'MB/sec write SST data time = 0.02's, 1002.028'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.526'MB, throughput = 16405.924'MB/sec zip my value time = 0.41's, unzip length = 0.052'GB zip my value throughput = 127.266'MB/sec zip pipeline throughput = 127.266'MB/sec entries = 51054 avg-key = 20.00 avg-zkey = 1.72 avg-val = 1016.94 avg-zval = 317.90 usrkeys = 51054 avg-key = 12.00 avg-zkey = 1.72 avg-val = 1023.28 avg-zval = 317.90 TagRS{ kinds = RS_Key0_TagN bytes = 8080 } TagArray{ size = 46256 bytes = 173472 } seq expand size = 323792 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0006 GB value = 0.0519 GB dict = 0.53 MB all = 0.0529 GB } __ZipSize{ index = 0.0001 GB value = 0.0162 GB dict = 0.53 MB all = 0.0170 GB } UnZip/Zip{ index = 6.9721 value = 3.1989 dict = 1.00 all = 3.1093 } Zip/UnZip{ index = 0.1434 value = 0.3126 dict = 1.00 all = 0.3216 } ---------------------------- total value len = 11.680621 GB avg = 0.212 KB (by entry num) total key len = 1.496203 GB avg = 0.027 KB total ukey len = 1.031107 GB avg = 0.015 KB total ukey num = 0.068319516 Billion total entry num = 0.055127245 Billion write speed all = 0.436963307 MB/sec (with seq num) write speed all = 0.422338488 MB/sec (without seq num) 2024/11/23-17:17:47.685890 139957584442944 [compaction_job.cc:1948] [default] [JOB 31712] Generated table #271830: 51054 keys, 17026603 bytes, temperature: kWarm 2024/11/23-17:17:47.685958 139957584442944 EVENT_LOG_v1 {"time_micros": 1732353467685923, "cf_name": "default", "job": 31712, "event": "table_file_creation", "file_number": 271830, "file_size": 17026603, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4140725385, "table_properties": {"data_size": 16230016, "index_size": 87872, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 1021080, "raw_average_key_size": 20, "raw_value_size": 51918967, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 51054, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732353466, "oldest_key_time": 0, "file_creation_time": 1732353466, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 271830, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-17:17:47.703097 139957584442944 [compaction_job.cc:703] job-31712: subcompact[0], size: 0.909074 G, files: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31712/att-00 [271809,271810,271811,271812,271813,271814,271815,271816,271817,271818,271819,271820,271821,271822,271823,271824,271825,271826,271827,271828,271829,271830] 2024/11/23-17:17:47.838693 139957584442944 (Original Log Time 2024/11/23-17:17:11.636697) EVENT_LOG_v1 {"time_micros": 1732353431636671, "job": 31712, "event": "compaction_started", "compaction_reason": "FilesMarkedForCompaction", "files_L2": [271790], "files_L3": [271713, 271714, 271715, 271716, 271717, 271718, 271719, 271720, 271721, 271722, 271723, 271724, 271725, 271726, 271727, 271728, 271729, 271730, 271731, 271732, 271733, 271800], "score": 0.999479, "input_data_size": 940708035, "oldest_snapshot_seqno": 4140889666} 2024/11/23-17:17:47.838697 139957584442944 (Original Log Time 2024/11/23-17:17:47.837082) [compaction_job.cc:2022] [default] [JOB 31712] Compacted 1@2 + 22@3 files to L3 => 909074363 bytes 2024/11/23-17:17:47.838698 139957584442944 (Original Log Time 2024/11/23-17:17:47.838622) [compaction_job.cc:1224] [default] compacted to: files[0 0 0 22 0 0 0] max score 0.03, MB/sec: 26.1 rd, 25.2 wr, level 3, files in(1, 22) out(22 +0 blob) MB in(31.2, 865.9 +0.0 blob) out(867.0 +0.0 blob), read-write-amplify(56.6) write-amplify(27.8) OK, records in: 2797766, records dropped: 28685 output_compression: Snappy 2024/11/23-17:17:47.838701 139957584442944 (Original Log Time 2024/11/23-17:17:47.838667) EVENT_LOG_v1 {"time_micros": 1732353467838645, "cf": "default", "job": 31712, "event": "compaction_finished", "compaction_time_micros": 36066407, "compaction_time_cpu_micros": 7421739, "output_level": 3, "num_output_files": 22, "total_output_size": 909074363, "num_input_records": 2797766, "num_output_records": 2769081, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "file_write_nanos": 605188802, "file_range_sync_nanos": 0, "file_fsync_nanos": 15586, "file_prepare_write_nanos": 44022, "lsm_state": [0, 0, 0, 22, 0, 0, 0]} 2024/11/23-17:17:47.950818 139957584442944 DEBG dcompact_worker.cpp:240: HttpPost: 200 OK: url = http://nlb-7zny4kaa1poal01o64.cn-shenzhen.nlb.aliyuncs.com:8443, body = {"instanceId":"nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137","labourId":"","dbId":"d89b4006-2803-486e-b7a2-759bcf348921","dbStarts":1732256054,"starts":1732353431,"executesMs":36334,"compactionJobId":31712,"attempt":0,"compactionInputRawBytes":2901266261,"compactionInputZipBytes":940708035,"compactionOutputRawBytes":0,"compactionOutputZipBytes":909074363,"headers":{"Accept":"*/*","Connection":"close","Host":"aliyun-topling-saas.topling.cn:18443","RemoteIp":"120.24.192.169","X-Forwarded-For":"120.24.192.169","region":"cn-shenzhen","token":"e6474c481bd4415abc537135cc03626b","instance-token":"e6474c481bd4415abc537135cc03626b","provider":"aliyun","CloudMarketInstanceId":"si-59c0ae5c955845588903","MeteringAssit":"","Transfer-Encoding":"chunked","traceparent":"00-1fbaec6c7eddae444d87e330b7152bdb-425e0f863cbf6d85-00"}}, response = 2024/11/23-17:17:47.950897 139957584442944 INFO dcompact_worker.cpp:1459: finish /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-31712/att-00: olev 3, work 36.335 s, result 7.773 ms, install 1.635 ms, input{raw 2.702 GiB zip 897.129 MiB}