2024/11/23-09:18:15.333151 139957282305600 DEBG dcompact_worker.cpp:2214: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00: fork to child time = 0.007649 sec 2024/11/23-09:18:15.333620 139957282305600 DEBG dcompact_worker.cpp:1013: Beg SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00 2024/11/23-09:18:15.340121 139957282305600 DEBG dcompact_worker.cpp:1033: End SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00 2024/11/23-09:18:15.341058 139957282305600 TRAC dcompact_worker.cpp:1083: INFO_LOG_LEVEL: rpc = INFO_LEVEL, env_var = undefined 2024/11/23-09:18:15.341280 139957282305600 [WARN] [column_family.cc:386] multiple cf_paths/db_paths and level_compaction_dynamic_level_bytes can't be used together 2024/11/23-09:18:15.385308 139957282305600 [version_set.cc:6208] Recovering from manifest file: /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-23363/att-00/MANIFEST-206347 2024/11/23-09:18:15.403457 139957282305600 [version_set.cc:6251] Recovered from manifest file:/worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-23363/att-00/MANIFEST-206347 succeeded,manifest_file_number is 206347, next_file_number is 253861, last_sequence is 3903099267, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 253716 2024/11/23-09:18:15.403465 139957282305600 [version_set.cc:6266] Column family [default] (ID 0), log number is 0 2024/11/23-09:18:15.403579 139957282305600 [version_set.cc:5721] Creating manifest 253861 2024/11/23-09:18:15.434387 139957282305600 DEBG dcompact_worker.cpp:1218: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00: bottommost_level: fake = 1, rpc = 0 2024/11/23-09:18:15.453780 139957282305600 [compaction_job.cc:2437] [default] [JOB 23363] Compacting 1@2 + 17@3 files to L3, score 1.00, subcompactions 1 : 1 2024/11/23-09:18:15.453798 139957282305600 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 17540 Base level 2, inputs: [253859(27MB)], [253800(33MB) 253801(34MB) 253802(36MB) 253816(35MB) 253817(34MB) 253818(36MB) 253819(35MB) 253820(35MB) 253821(34MB) 253822(36MB) 253823(33MB) 253824(33MB) 253825(34MB) 253826(33MB) 253827(33MB) 253828(33MB) 253829(35MB)] 2024/11/23-09:18:15.459791 139957282305600 [top_zip_table.cc:59] core git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-09:18:15.459818 139957282305600 [top_zip_table.cc:60] fsa git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-09:18:15.459841 139957282305600 [top_zip_table.cc:61] zbs git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-09:18:15.459851 139957282305600 [top_zip_table.cc:62] topling-zip_table_reader: git_version_hash_info_is: commit a4a382006cb82713acf5b3425835f22711877681 Author: leipeng Date: 2024-04-11 19:44:14 +0800 fixed_len_hole_index.cc: Add env bool FixedLenHoleIndexUseAVX512 for ut & debug 1. FixedLenHoleIndexUseAVX512 is only in unit tests or debug 2. In release mode, use avx512 by compile options(-march=) g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/23-09:18:15.459864 139957282305600 [top_zip_table.cc:64] topling-rocks git_version_hash_info_is: commit feab587e468621ba0204d47b4ffacc52e7c4290d Author: leipeng Date: 2024-03-22 13:35:06 +0800 ToplingZipTableBuilder::Add: immediately return after error This function returns void, and caller does not check builder->status() after calling this function and graceful abandon. So immediately return after error, and return error status in Finish(). g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/23-09:18:16.031583 139957282305600 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253862.sst) /dev/shm/ToplingTemp/Topling-10604-h5cBs1 2024/11/23-09:18:16.813561 139957282305600 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253862.sst): first pass time = 0.78's, 171.647'MB/sec 2024/11/23-09:18:18.723707 139957282305600 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253862.sst): old prealloc_size = 147639500, real_size = 30934256 2024/11/23-09:18:18.724397 139957282305600 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253862.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927086 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.94 raw-val = 0.1083 GB zip-val = 0.0289 GB avg-val = 116.77 avg-zval = 31.18 2024/11/23-09:18:18.725375 139957282305600 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253862.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-09:18:19.827020 139957282305600 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253862.sst): second pass time = 1.91's, 56.720'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.10's, 31.752'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2694.832'MB/sec (index lex order gen) rebuild zvType time = 0.88's, 0.263'MB/sec write SST data time = 0.22's, 158.072'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 37612.169'MB/sec zip my value time = 1.91's, unzip length = 0.108'GB zip my value throughput = 56.720'MB/sec zip pipeline throughput = 101.172'MB/sec entries = 927086 avg-key = 28.00 avg-zkey = 1.94 avg-val = 116.77 avg-zval = 31.18 usrkeys = 927086 avg-key = 20.00 avg-zkey = 1.94 avg-val = 123.77 avg-zval = 31.18 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 927086 bytes = 3244816 } seq expand size = 6489602 multi value expand size = 0 cnt WriteAppend = 16 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0289 GB dict = 1.08 MB all = 0.0350 GB } UnZip/Zip{ index = 10.3109 value = 3.7455 dict = 1.00 all = 3.8313 } Zip/UnZip{ index = 0.0970 value = 0.2670 dict = 1.00 all = 0.2610 } ---------------------------- total value len = 8.963369 GB avg = 0.168 KB (by entry num) total key len = 1.466779 GB avg = 0.028 KB total ukey len = 1.016420 GB avg = 0.015 KB total ukey num = 0.066477521 Billion total entry num = 0.053285250 Billion write speed all = 7.516615408 MB/sec (with seq num) write speed all = 7.209410012 MB/sec (without seq num) 2024/11/23-09:18:19.872772 139957282305600 [compaction_job.cc:1948] [default] [JOB 23363] Generated table #253862: 927086 keys, 35031872 bytes, temperature: kWarm 2024/11/23-09:18:19.872860 139957282305600 EVENT_LOG_v1 {"time_micros": 1732324699872806, "cf_name": "default", "job": 23363, "event": "table_file_creation", "file_number": 253862, "file_size": 35031872, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3640687044, "largest_seqno": 3903084193, "table_properties": {"data_size": 28904032, "index_size": 1798272, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25958408, "raw_average_key_size": 28, "raw_value_size": 108259460, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927086, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732324696, "oldest_key_time": 0, "file_creation_time": 1732324696, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 253862, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-09:18:19.905808 139957282305600 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253863.sst) /dev/shm/ToplingTemp/Topling-10604-Qc4zz3 2024/11/23-09:18:21.013866 139957282305600 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253863.sst): first pass time = 1.11's, 121.134'MB/sec 2024/11/23-09:18:22.739449 139957282305600 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253863.sst): old prealloc_size = 147639500, real_size = 31445488 2024/11/23-09:18:22.739989 139957282305600 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253863.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 931983 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1081 GB zip-val = 0.0294 GB avg-val = 116.01 avg-zval = 31.58 2024/11/23-09:18:22.740778 139957282305600 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253863.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-09:18:23.584819 139957282305600 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253863.sst): second pass time = 1.72's, 62.690'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.85's, 42.201'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3421.521'MB/sec (index lex order gen) rebuild zvType time = 0.72's, 0.322'MB/sec write SST data time = 0.12's, 293.376'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 39136.539'MB/sec zip my value time = 1.72's, unzip length = 0.108'GB zip my value throughput = 62.690'MB/sec zip pipeline throughput = 77.144'MB/sec entries = 931983 avg-key = 28.00 avg-zkey = 1.92 avg-val = 116.01 avg-zval = 31.58 usrkeys = 931983 avg-key = 20.00 avg-zkey = 1.92 avg-val = 123.01 avg-zval = 31.58 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 931983 bytes = 3378448 } seq expand size = 6523881 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0186 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0294 GB dict = 1.08 MB all = 0.0357 GB } UnZip/Zip{ index = 10.4437 value = 3.6742 dict = 1.00 all = 3.7623 } Zip/UnZip{ index = 0.0958 value = 0.2722 dict = 1.00 all = 0.2658 } ---------------------------- total value len = 9.078015 GB avg = 0.167 KB (by entry num) total key len = 1.492875 GB avg = 0.028 KB total ukey len = 1.035059 GB avg = 0.015 KB total ukey num = 0.067409504 Billion total entry num = 0.054217233 Billion write speed all = 7.597467767 MB/sec (with seq num) write speed all = 7.285733426 MB/sec (without seq num) 2024/11/23-09:18:23.630022 139957282305600 [compaction_job.cc:1948] [default] [JOB 23363] Generated table #253863: 931983 keys, 35674430 bytes, temperature: kWarm 2024/11/23-09:18:23.630085 139957282305600 EVENT_LOG_v1 {"time_micros": 1732324703630052, "cf_name": "default", "job": 23363, "event": "table_file_creation", "file_number": 253863, "file_size": 35674430, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3631595348, "largest_seqno": 3903084526, "table_properties": {"data_size": 29427552, "index_size": 1784768, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26095524, "raw_average_key_size": 28, "raw_value_size": 108122282, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 931983, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732324699, "oldest_key_time": 0, "file_creation_time": 1732324699, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 253863, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-09:18:23.677869 139957282305600 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253864.sst) /dev/shm/ToplingTemp/Topling-10604-F0MPSZ 2024/11/23-09:18:25.201188 139957282305600 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253864.sst): first pass time = 1.52's, 88.113'MB/sec 2024/11/23-09:18:27.466628 139957282305600 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253864.sst): old prealloc_size = 147639500, real_size = 33738512 2024/11/23-09:18:27.467219 139957282305600 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253864.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 924535 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1083 GB zip-val = 0.0317 GB avg-val = 117.17 avg-zval = 34.33 2024/11/23-09:18:27.468052 139957282305600 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253864.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-09:18:28.512826 139957282305600 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253864.sst): second pass time = 2.26's, 47.845'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.05's, 36.271'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3041.938'MB/sec (index lex order gen) rebuild zvType time = 0.92's, 0.252'MB/sec write SST data time = 0.13's, 296.980'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.082'MB, throughput = 36278.402'MB/sec zip my value time = 2.26's, unzip length = 0.108'GB zip my value throughput = 47.845'MB/sec zip pipeline throughput = 47.845'MB/sec entries = 924535 avg-key = 28.00 avg-zkey = 1.92 avg-val = 117.17 avg-zval = 34.33 usrkeys = 924535 avg-key = 20.00 avg-zkey = 1.92 avg-val = 124.17 avg-zval = 34.33 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 924535 bytes = 3351456 } seq expand size = 6471745 multi value expand size = 0 cnt WriteAppend = 15 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0317 GB dict = 1.08 MB all = 0.0379 GB } UnZip/Zip{ index = 10.4438 value = 3.4134 dict = 1.00 all = 3.5370 } Zip/UnZip{ index = 0.0958 value = 0.2930 dict = 1.00 all = 0.2827 } ---------------------------- total value len = 9.192818 GB avg = 0.167 KB (by entry num) total key len = 1.518762 GB avg = 0.028 KB total ukey len = 1.053550 GB avg = 0.015 KB total ukey num = 0.068334039 Billion total entry num = 0.055141768 Billion write speed all = 7.671412702 MB/sec (with seq num) write speed all = 7.355481512 MB/sec (without seq num) 2024/11/23-09:18:28.597397 139957282305600 [compaction_job.cc:1948] [default] [JOB 23363] Generated table #253864: 924535 keys, 37946288 bytes, temperature: kWarm 2024/11/23-09:18:28.597450 139957282305600 EVENT_LOG_v1 {"time_micros": 1732324708597418, "cf_name": "default", "job": 23363, "event": "table_file_creation", "file_number": 253864, "file_size": 37946288, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3583362754, "largest_seqno": 3903084657, "table_properties": {"data_size": 31736704, "index_size": 1770496, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25886980, "raw_average_key_size": 28, "raw_value_size": 108330798, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 924535, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732324703, "oldest_key_time": 0, "file_creation_time": 1732324703, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 253864, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-09:18:28.637664 139957282305600 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253865.sst) /dev/shm/ToplingTemp/Topling-10604-ObRwGZ 2024/11/23-09:18:29.726813 139957282305600 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253865.sst): first pass time = 1.09's, 123.238'MB/sec 2024/11/23-09:18:32.777241 139957282305600 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253865.sst): old prealloc_size = 147639500, real_size = 32591040 2024/11/23-09:18:32.777900 139957282305600 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253865.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 929793 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0306 GB avg-val = 116.35 avg-zval = 32.90 2024/11/23-09:18:32.778790 139957282305600 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253865.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-09:18:34.046870 139957282305600 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253865.sst): second pass time = 3.05's, 35.474'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.27's, 28.996'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2831.956'MB/sec (index lex order gen) rebuild zvType time = 1.10's, 0.211'MB/sec write SST data time = 0.17's, 220.647'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 27827.226'MB/sec zip my value time = 3.05's, unzip length = 0.108'GB zip my value throughput = 35.474'MB/sec zip pipeline throughput = 105.589'MB/sec entries = 929793 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.35 avg-zval = 32.90 usrkeys = 929793 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.35 avg-zval = 32.90 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 929793 bytes = 3370512 } seq expand size = 6508551 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0306 GB dict = 1.08 MB all = 0.0368 GB } UnZip/Zip{ index = 10.5138 value = 3.5366 dict = 1.00 all = 3.6458 } Zip/UnZip{ index = 0.0951 value = 0.2828 dict = 1.00 all = 0.2743 } ---------------------------- total value len = 9.307510 GB avg = 0.166 KB (by entry num) total key len = 1.544796 GB avg = 0.028 KB total ukey len = 1.072146 GB avg = 0.015 KB total ukey num = 0.069263832 Billion total entry num = 0.056071561 Billion write speed all = 7.741515533 MB/sec (with seq num) write speed all = 7.421525394 MB/sec (without seq num) 2024/11/23-09:18:34.093647 139957282305600 [compaction_job.cc:1948] [default] [JOB 23363] Generated table #253865: 929793 keys, 36814040 bytes, temperature: kWarm 2024/11/23-09:18:34.093716 139957282305600 EVENT_LOG_v1 {"time_micros": 1732324714093676, "cf_name": "default", "job": 23363, "event": "table_file_creation", "file_number": 253865, "file_size": 36814040, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3621075956, "largest_seqno": 3903084240, "table_properties": {"data_size": 30589680, "index_size": 1768704, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26034204, "raw_average_key_size": 28, "raw_value_size": 108183622, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 929793, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732324708, "oldest_key_time": 0, "file_creation_time": 1732324708, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 253865, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-09:18:34.128493 139957282305600 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253866.sst) /dev/shm/ToplingTemp/Topling-10604-CWHm32 2024/11/23-09:18:35.511686 139957282305600 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253866.sst): first pass time = 1.38's, 97.038'MB/sec 2024/11/23-09:18:37.232335 139957282305600 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253866.sst): old prealloc_size = 147639500, real_size = 31647056 2024/11/23-09:18:37.232835 139957282305600 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253866.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 929587 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0296 GB avg-val = 116.38 avg-zval = 31.89 2024/11/23-09:18:37.233632 139957282305600 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253866.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-09:18:38.061213 139957282305600 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253866.sst): second pass time = 1.72's, 62.899'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.83's, 43.277'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3649.294'MB/sec (index lex order gen) rebuild zvType time = 0.71's, 0.329'MB/sec write SST data time = 0.12's, 293.646'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 37660.201'MB/sec zip my value time = 1.72's, unzip length = 0.108'GB zip my value throughput = 62.899'MB/sec zip pipeline throughput = 62.899'MB/sec entries = 929587 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.38 avg-zval = 31.89 usrkeys = 929587 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.38 avg-zval = 31.89 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 929587 bytes = 3369760 } seq expand size = 6507109 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0296 GB dict = 1.08 MB all = 0.0359 GB } UnZip/Zip{ index = 10.5138 value = 3.6494 dict = 1.00 all = 3.7418 } Zip/UnZip{ index = 0.0951 value = 0.2740 dict = 1.00 all = 0.2672 } ---------------------------- total value len = 9.422206 GB avg = 0.165 KB (by entry num) total key len = 1.570825 GB avg = 0.028 KB total ukey len = 1.090738 GB avg = 0.016 KB total ukey num = 0.070193419 Billion total entry num = 0.057001148 Billion write speed all = 7.819509749 MB/sec (with seq num) write speed all = 7.495143495 MB/sec (without seq num) 2024/11/23-09:18:38.105992 139957282305600 [compaction_job.cc:1948] [default] [JOB 23363] Generated table #253866: 929587 keys, 35869716 bytes, temperature: kWarm 2024/11/23-09:18:38.106060 139957282305600 EVENT_LOG_v1 {"time_micros": 1732324718106024, "cf_name": "default", "job": 23363, "event": "table_file_creation", "file_number": 253866, "file_size": 35869716, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3376774746, "largest_seqno": 3903084257, "table_properties": {"data_size": 29646144, "index_size": 1768320, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26028436, "raw_average_key_size": 28, "raw_value_size": 108189418, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 929587, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732324714, "oldest_key_time": 0, "file_creation_time": 1732324714, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 253866, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-09:18:38.140171 139957282305600 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253867.sst) /dev/shm/ToplingTemp/Topling-10604-jO8pa2 2024/11/23-09:18:39.161087 139957282305600 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253867.sst): first pass time = 1.02's, 131.473'MB/sec 2024/11/23-09:18:40.446066 139957282305600 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253867.sst): old prealloc_size = 147639500, real_size = 33481680 2024/11/23-09:18:40.446575 139957282305600 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253867.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 926236 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0315 GB avg-val = 116.91 avg-zval = 34.00 2024/11/23-09:18:40.447343 139957282305600 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253867.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-09:18:41.296836 139957282305600 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253867.sst): second pass time = 1.28's, 84.316'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.85's, 44.307'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3605.009'MB/sec (index lex order gen) rebuild zvType time = 0.73's, 0.318'MB/sec write SST data time = 0.12's, 308.598'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 36603.476'MB/sec zip my value time = 1.28's, unzip length = 0.108'GB zip my value throughput = 84.316'MB/sec zip pipeline throughput = 84.316'MB/sec entries = 926236 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.91 avg-zval = 34.00 usrkeys = 926236 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.91 avg-zval = 34.00 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 926236 bytes = 3357616 } seq expand size = 6483652 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0315 GB dict = 1.08 MB all = 0.0377 GB } UnZip/Zip{ index = 10.5120 value = 3.4389 dict = 1.00 all = 3.5607 } Zip/UnZip{ index = 0.0951 value = 0.2908 dict = 1.00 all = 0.2808 } ---------------------------- total value len = 9.536973 GB avg = 0.165 KB (by entry num) total key len = 1.596759 GB avg = 0.028 KB total ukey len = 1.109262 GB avg = 0.016 KB total ukey num = 0.071119655 Billion total entry num = 0.057927384 Billion write speed all = 7.901407323 MB/sec (with seq num) write speed all = 7.572527236 MB/sec (without seq num) 2024/11/23-09:18:41.343414 139957282305600 [compaction_job.cc:1948] [default] [JOB 23363] Generated table #253867: 926236 keys, 37694018 bytes, temperature: kWarm 2024/11/23-09:18:41.343479 139957282305600 EVENT_LOG_v1 {"time_micros": 1732324721343444, "cf_name": "default", "job": 23363, "event": "table_file_creation", "file_number": 253867, "file_size": 37694018, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3563652023, "largest_seqno": 3903084272, "table_properties": {"data_size": 31487680, "index_size": 1762240, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25934608, "raw_average_key_size": 28, "raw_value_size": 108283152, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 926236, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732324718, "oldest_key_time": 0, "file_creation_time": 1732324718, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 253867, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-09:18:41.378344 139957282305600 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253868.sst) /dev/shm/ToplingTemp/Topling-10604-klvJAZ 2024/11/23-09:18:42.284470 139957282305600 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253868.sst): first pass time = 0.91's, 148.128'MB/sec 2024/11/23-09:18:43.595464 139957282305600 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253868.sst): old prealloc_size = 147639500, real_size = 33115456 2024/11/23-09:18:43.596003 139957282305600 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253868.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 929802 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0311 GB avg-val = 116.35 avg-zval = 33.46 2024/11/23-09:18:43.596772 139957282305600 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253868.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-09:18:44.455760 139957282305600 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253868.sst): second pass time = 1.31's, 82.584'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.86's, 43.268'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3408.828'MB/sec (index lex order gen) rebuild zvType time = 0.74's, 0.315'MB/sec write SST data time = 0.12's, 304.697'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 33676.870'MB/sec zip my value time = 1.31's, unzip length = 0.108'GB zip my value throughput = 82.584'MB/sec zip pipeline throughput = 82.584'MB/sec entries = 929802 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.35 avg-zval = 33.46 usrkeys = 929802 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.35 avg-zval = 33.46 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 929802 bytes = 3254320 } seq expand size = 6508614 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0311 GB dict = 1.08 MB all = 0.0372 GB } UnZip/Zip{ index = 10.5124 value = 3.4770 dict = 1.00 all = 3.6058 } Zip/UnZip{ index = 0.0951 value = 0.2876 dict = 1.00 all = 0.2773 } ---------------------------- total value len = 9.651665 GB avg = 0.164 KB (by entry num) total key len = 1.622794 GB avg = 0.028 KB total ukey len = 1.127858 GB avg = 0.016 KB total ukey num = 0.072049457 Billion total entry num = 0.058857186 Billion write speed all = 7.983380873 MB/sec (with seq num) write speed all = 7.649969329 MB/sec (without seq num) 2024/11/23-09:18:44.492416 139957282305600 [compaction_job.cc:1948] [default] [JOB 23363] Generated table #253868: 929802 keys, 37222430 bytes, temperature: kWarm 2024/11/23-09:18:44.492480 139957282305600 EVENT_LOG_v1 {"time_micros": 1732324724492443, "cf_name": "default", "job": 23363, "event": "table_file_creation", "file_number": 253868, "file_size": 37222430, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3759280178, "largest_seqno": 3903084282, "table_properties": {"data_size": 31113840, "index_size": 1768960, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26034456, "raw_average_key_size": 28, "raw_value_size": 108183284, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 929802, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732324721, "oldest_key_time": 0, "file_creation_time": 1732324721, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 253868, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-09:18:44.526972 139957282305600 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253869.sst) /dev/shm/ToplingTemp/Topling-10604-x2pGF3 2024/11/23-09:18:45.553582 139957282305600 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253869.sst): first pass time = 1.03's, 130.745'MB/sec 2024/11/23-09:18:46.861017 139957282305600 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253869.sst): old prealloc_size = 147639500, real_size = 33073104 2024/11/23-09:18:46.861526 139957282305600 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253869.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 929560 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0311 GB avg-val = 116.39 avg-zval = 33.43 2024/11/23-09:18:46.862274 139957282305600 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253869.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-09:18:47.717060 139957282305600 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253869.sst): second pass time = 1.31's, 82.826'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.86's, 43.296'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3628.510'MB/sec (index lex order gen) rebuild zvType time = 0.73's, 0.316'MB/sec write SST data time = 0.12's, 305.783'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 33149.526'MB/sec zip my value time = 1.31's, unzip length = 0.108'GB zip my value throughput = 82.826'MB/sec zip pipeline throughput = 82.826'MB/sec entries = 929560 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.39 avg-zval = 33.43 usrkeys = 929560 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.39 avg-zval = 33.43 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 929560 bytes = 3137280 } seq expand size = 6506920 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0311 GB dict = 1.08 MB all = 0.0371 GB } UnZip/Zip{ index = 10.5150 value = 3.4819 dict = 1.00 all = 3.6213 } Zip/UnZip{ index = 0.0951 value = 0.2872 dict = 1.00 all = 0.2761 } ---------------------------- total value len = 9.766362 GB avg = 0.163 KB (by entry num) total key len = 1.648821 GB avg = 0.028 KB total ukey len = 1.146450 GB avg = 0.016 KB total ukey num = 0.072979017 Billion total entry num = 0.059786746 Billion write speed all = 8.064404057 MB/sec (with seq num) write speed all = 7.726507092 MB/sec (without seq num) 2024/11/23-09:18:47.762035 139957282305600 [compaction_job.cc:1948] [default] [JOB 23363] Generated table #253869: 929560 keys, 37063272 bytes, temperature: kWarm 2024/11/23-09:18:47.762099 139957282305600 EVENT_LOG_v1 {"time_micros": 1732324727762065, "cf_name": "default", "job": 23363, "event": "table_file_creation", "file_number": 253869, "file_size": 37063272, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3801926538, "largest_seqno": 3903084295, "table_properties": {"data_size": 31072448, "index_size": 1768064, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26027680, "raw_average_key_size": 28, "raw_value_size": 108190104, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 929560, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732324724, "oldest_key_time": 0, "file_creation_time": 1732324724, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 253869, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-09:18:47.796139 139957282305600 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253870.sst) /dev/shm/ToplingTemp/Topling-10604-Zgvf4Z 2024/11/23-09:18:48.776835 139957282305600 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253870.sst): first pass time = 0.98's, 136.865'MB/sec 2024/11/23-09:18:50.122941 139957282305600 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253870.sst): old prealloc_size = 147639500, real_size = 34453504 2024/11/23-09:18:50.123468 139957282305600 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253870.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 943709 prefix = 4 raw-key = 0.0151 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.93 raw-val = 0.1078 GB zip-val = 0.0324 GB avg-val = 114.22 avg-zval = 34.33 2024/11/23-09:18:50.123902 139957282305600 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253870.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0024 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-09:18:50.893550 139957282305600 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253870.sst): second pass time = 1.35's, 80.126'MB/sec, value only(80.3% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.77's, 47.887'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3730.680'MB/sec (index lex order gen) rebuild zvType time = 0.65's, 0.365'MB/sec write SST data time = 0.12's, 296.293'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.075'MB, throughput = 33879.559'MB/sec zip my value time = 1.35's, unzip length = 0.108'GB zip my value throughput = 80.126'MB/sec zip pipeline throughput = 80.126'MB/sec entries = 943709 avg-key = 28.00 avg-zkey = 1.93 avg-val = 114.22 avg-zval = 34.33 usrkeys = 943709 avg-key = 20.00 avg-zkey = 1.93 avg-val = 117.41 avg-zval = 34.33 TagRS{ kinds = RS_Key0_TagN bytes = 147560 } TagArray{ size = 429929 bytes = 1451024 } seq expand size = 3009503 multi value expand size = 0 cnt WriteAppend = 19 UnZipSize{ index = 0.0189 GB value = 0.1078 GB dict = 1.07 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0324 GB dict = 1.07 MB all = 0.0369 GB } UnZip/Zip{ index = 10.3779 value = 3.3271 dict = 1.00 all = 3.6373 } Zip/UnZip{ index = 0.0964 value = 0.3006 dict = 1.00 all = 0.2749 } ---------------------------- total value len = 9.877165 GB avg = 0.163 KB (by entry num) total key len = 1.675245 GB avg = 0.028 KB total ukey len = 1.165324 GB avg = 0.016 KB total ukey num = 0.073922726 Billion total entry num = 0.060730455 Billion write speed all = 8.143076416 MB/sec (with seq num) write speed all = 7.800614395 MB/sec (without seq num) 2024/11/23-09:18:50.938527 139957282305600 [compaction_job.cc:1948] [default] [JOB 23363] Generated table #253870: 943709 keys, 36900700 bytes, temperature: kWarm 2024/11/23-09:18:50.938593 139957282305600 EVENT_LOG_v1 {"time_micros": 1732324730938559, "cf_name": "default", "job": 23363, "event": "table_file_creation", "file_number": 253870, "file_size": 36900700, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3903084314, "table_properties": {"data_size": 32398704, "index_size": 1818688, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26423852, "raw_average_key_size": 28, "raw_value_size": 107793919, "raw_average_value_size": 114, "num_data_blocks": 1, "num_entries": 943709, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732324727, "oldest_key_time": 0, "file_creation_time": 1732324727, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 253870, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-09:18:50.973255 139957282305600 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253871.sst) /dev/shm/ToplingTemp/Topling-10604-xJVrE1 2024/11/23-09:18:52.048663 139957282305600 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253871.sst): first pass time = 1.08's, 124.811'MB/sec 2024/11/23-09:18:53.368956 139957282305600 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253871.sst): old prealloc_size = 147639500, real_size = 35492656 2024/11/23-09:18:53.369578 139957282305600 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253871.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 1070176 prefix = 4 raw-key = 0.0171 GB zip-key = 0.0020 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1043 GB zip-val = 0.0332 GB avg-val = 97.42 avg-zval = 31.01 2024/11/23-09:18:53.369862 139957282305600 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253871.sst: sumWaitingMem = 0.003 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0028 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-09:18:54.071891 139957282305600 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253871.sst): second pass time = 1.32's, 79.011'MB/sec, value only(77.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.70's, 52.802'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3528.637'MB/sec (index lex order gen) rebuild zvType time = 0.57's, 0.471'MB/sec write SST data time = 0.13's, 275.841'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.027'MB, throughput = 26658.994'MB/sec zip my value time = 1.32's, unzip length = 0.104'GB zip my value throughput = 79.011'MB/sec zip pipeline throughput = 79.011'MB/sec entries = 1070176 avg-key = 28.00 avg-zkey = 1.90 avg-val = 97.42 avg-zval = 31.01 usrkeys = 1070176 avg-key = 20.00 avg-zkey = 1.90 avg-val = 98.70 avg-zval = 31.01 TagRS{ kinds = RS_Key0_TagN bytes = 167320 } TagArray{ size = 195553 bytes = 684448 } seq expand size = 1368871 multi value expand size = 0 cnt WriteAppend = 15 UnZipSize{ index = 0.0214 GB value = 0.1043 GB dict = 1.03 MB all = 0.1342 GB } __ZipSize{ index = 0.0020 GB value = 0.0332 GB dict = 1.03 MB all = 0.0371 GB } UnZip/Zip{ index = 10.5157 value = 3.1411 dict = 1.00 all = 3.6163 } Zip/UnZip{ index = 0.0951 value = 0.3184 dict = 1.00 all = 0.2765 } ---------------------------- total value len = 9.982787 GB avg = 0.162 KB (by entry num) total key len = 1.705210 GB avg = 0.028 KB total ukey len = 1.186727 GB avg = 0.016 KB total ukey num = 0.074992902 Billion total entry num = 0.061800631 Billion write speed all = 8.220232704 MB/sec (with seq num) write speed all = 7.872514920 MB/sec (without seq num) 2024/11/23-09:18:54.117666 139957282305600 [compaction_job.cc:1948] [default] [JOB 23363] Generated table #253871: 1070176 keys, 37114962 bytes, temperature: kWarm 2024/11/23-09:18:54.117731 139957282305600 EVENT_LOG_v1 {"time_micros": 1732324734117697, "cf_name": "default", "job": 23363, "event": "table_file_creation", "file_number": 253871, "file_size": 37114962, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3419041277, "table_properties": {"data_size": 33189536, "index_size": 2035392, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 29964928, "raw_average_key_size": 28, "raw_value_size": 104252936, "raw_average_value_size": 97, "num_data_blocks": 1, "num_entries": 1070176, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732324730, "oldest_key_time": 0, "file_creation_time": 1732324730, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 253871, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-09:18:54.152017 139957282305600 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253872.sst) /dev/shm/ToplingTemp/Topling-10604-q4kTw2 2024/11/23-09:18:55.133793 139957282305600 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253872.sst): first pass time = 0.98's, 136.716'MB/sec 2024/11/23-09:18:56.393297 139957282305600 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253872.sst): old prealloc_size = 147639500, real_size = 30742384 2024/11/23-09:18:56.393806 139957282305600 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253872.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 926417 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.93 raw-val = 0.1083 GB zip-val = 0.0287 GB avg-val = 116.88 avg-zval = 31.01 2024/11/23-09:18:56.394607 139957282305600 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253872.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-09:18:57.204044 139957282305600 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253872.sst): second pass time = 1.26's, 86.021'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.81's, 43.114'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3669.031'MB/sec (index lex order gen) rebuild zvType time = 0.69's, 0.336'MB/sec write SST data time = 0.12's, 287.480'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 35698.864'MB/sec zip my value time = 1.26's, unzip length = 0.108'GB zip my value throughput = 86.021'MB/sec zip pipeline throughput = 86.021'MB/sec entries = 926417 avg-key = 28.00 avg-zkey = 1.93 avg-val = 116.88 avg-zval = 31.01 usrkeys = 926417 avg-key = 20.00 avg-zkey = 1.93 avg-val = 123.88 avg-zval = 31.01 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 926417 bytes = 3358272 } seq expand size = 6484919 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0287 GB dict = 1.08 MB all = 0.0350 GB } UnZip/Zip{ index = 10.3765 value = 3.7695 dict = 1.00 all = 3.8399 } Zip/UnZip{ index = 0.0964 value = 0.2653 dict = 1.00 all = 0.2604 } ---------------------------- total value len = 10.097550 GB avg = 0.161 KB (by entry num) total key len = 1.731150 GB avg = 0.028 KB total ukey len = 1.205256 GB avg = 0.016 KB total ukey num = 0.075919319 Billion total entry num = 0.062727048 Billion write speed all = 8.300903960 MB/sec (with seq num) write speed all = 7.948749490 MB/sec (without seq num) 2024/11/23-09:18:57.246691 139957282305600 [compaction_job.cc:1948] [default] [JOB 23363] Generated table #253872: 926417 keys, 34953780 bytes, temperature: kWarm 2024/11/23-09:18:57.246759 139957282305600 EVENT_LOG_v1 {"time_micros": 1732324737246723, "cf_name": "default", "job": 23363, "event": "table_file_creation", "file_number": 253872, "file_size": 34953780, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3419041278, "largest_seqno": 3903084371, "table_properties": {"data_size": 28725024, "index_size": 1785600, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25939676, "raw_average_key_size": 28, "raw_value_size": 108278118, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 926417, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732324734, "oldest_key_time": 0, "file_creation_time": 1732324734, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 253872, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-09:18:57.281421 139957282305600 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253873.sst) /dev/shm/ToplingTemp/Topling-10604-TjK1KZ 2024/11/23-09:18:58.274219 139957282305600 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253873.sst): first pass time = 0.99's, 135.197'MB/sec 2024/11/23-09:18:59.548528 139957282305600 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253873.sst): old prealloc_size = 147639500, real_size = 31822848 2024/11/23-09:18:59.549046 139957282305600 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253873.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 929037 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0298 GB avg-val = 116.47 avg-zval = 32.10 2024/11/23-09:18:59.549830 139957282305600 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253873.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-09:19:00.382841 139957282305600 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253873.sst): second pass time = 1.27's, 84.978'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.83's, 43.202'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3576.455'MB/sec (index lex order gen) rebuild zvType time = 0.71's, 0.327'MB/sec write SST data time = 0.12's, 291.767'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 35865.683'MB/sec zip my value time = 1.27's, unzip length = 0.108'GB zip my value throughput = 84.978'MB/sec zip pipeline throughput = 84.978'MB/sec entries = 929037 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.47 avg-zval = 32.10 usrkeys = 929037 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.47 avg-zval = 32.10 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 929037 bytes = 3367776 } seq expand size = 6503259 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0298 GB dict = 1.08 MB all = 0.0360 GB } UnZip/Zip{ index = 10.5121 value = 3.6283 dict = 1.00 all = 3.7238 } Zip/UnZip{ index = 0.0951 value = 0.2756 dict = 1.00 all = 0.2685 } ---------------------------- total value len = 10.212258 GB avg = 0.160 KB (by entry num) total key len = 1.757163 GB avg = 0.028 KB total ukey len = 1.223836 GB avg = 0.016 KB total ukey num = 0.076848356 Billion total entry num = 0.063656085 Billion write speed all = 8.380960510 MB/sec (with seq num) write speed all = 8.024385784 MB/sec (without seq num) 2024/11/23-09:19:00.426728 139957282305600 [compaction_job.cc:1948] [default] [JOB 23363] Generated table #253873: 929037 keys, 36043482 bytes, temperature: kWarm 2024/11/23-09:19:00.426794 139957282305600 EVENT_LOG_v1 {"time_micros": 1732324740426759, "cf_name": "default", "job": 23363, "event": "table_file_creation", "file_number": 253873, "file_size": 36043482, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3487497056, "largest_seqno": 3903084387, "table_properties": {"data_size": 29822832, "index_size": 1767552, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26013036, "raw_average_key_size": 28, "raw_value_size": 108204798, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 929037, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732324737, "oldest_key_time": 0, "file_creation_time": 1732324737, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 253873, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-09:19:00.462021 139957282305600 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253874.sst) /dev/shm/ToplingTemp/Topling-10604-2pkGx0 2024/11/23-09:19:01.464202 139957282305600 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253874.sst): first pass time = 1.00's, 133.931'MB/sec 2024/11/23-09:19:02.742698 139957282305600 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253874.sst): old prealloc_size = 147639500, real_size = 31528032 2024/11/23-09:19:02.743238 139957282305600 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253874.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 931317 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1081 GB zip-val = 0.0295 GB avg-val = 116.12 avg-zval = 31.70 2024/11/23-09:19:02.744038 139957282305600 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253874.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-09:19:03.577437 139957282305600 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253874.sst): second pass time = 1.28's, 84.639'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.83's, 42.556'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3425.719'MB/sec (index lex order gen) rebuild zvType time = 0.71's, 0.327'MB/sec write SST data time = 0.12's, 288.902'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 36169.893'MB/sec zip my value time = 1.28's, unzip length = 0.108'GB zip my value throughput = 84.639'MB/sec zip pipeline throughput = 84.639'MB/sec entries = 931317 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.12 avg-zval = 31.70 usrkeys = 931317 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.12 avg-zval = 31.70 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 931317 bytes = 3143216 } seq expand size = 6519219 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0186 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0295 GB dict = 1.08 MB all = 0.0355 GB } UnZip/Zip{ index = 10.5113 value = 3.6629 dict = 1.00 all = 3.7784 } Zip/UnZip{ index = 0.0951 value = 0.2730 dict = 1.00 all = 0.2647 } ---------------------------- total value len = 10.326918 GB avg = 0.160 KB (by entry num) total key len = 1.783240 GB avg = 0.028 KB total ukey len = 1.242463 GB avg = 0.016 KB total ukey num = 0.077779673 Billion total entry num = 0.064587402 Billion write speed all = 8.460579224 MB/sec (with seq num) write speed all = 8.099595117 MB/sec (without seq num) 2024/11/23-09:19:03.620240 139957282305600 [compaction_job.cc:1948] [default] [JOB 23363] Generated table #253874: 931317 keys, 35522292 bytes, temperature: kWarm 2024/11/23-09:19:03.620308 139957282305600 EVENT_LOG_v1 {"time_micros": 1732324743620272, "cf_name": "default", "job": 23363, "event": "table_file_creation", "file_number": 253874, "file_size": 35522292, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3807172320, "largest_seqno": 3903084397, "table_properties": {"data_size": 29522960, "index_size": 1772032, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26076876, "raw_average_key_size": 28, "raw_value_size": 108140946, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 931317, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732324740, "oldest_key_time": 0, "file_creation_time": 1732324740, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 253874, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-09:19:03.652678 139957282305600 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253875.sst) /dev/shm/ToplingTemp/Topling-10604-pUjAi1 2024/11/23-09:19:04.513946 139957282305600 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253875.sst): first pass time = 0.86's, 155.845'MB/sec 2024/11/23-09:19:05.788052 139957282305600 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253875.sst): old prealloc_size = 147639500, real_size = 31732512 2024/11/23-09:19:05.788573 139957282305600 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253875.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 926905 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0297 GB avg-val = 116.80 avg-zval = 32.08 2024/11/23-09:19:05.789373 139957282305600 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253875.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-09:19:06.613486 139957282305600 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253875.sst): second pass time = 1.27's, 85.029'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.83's, 43.691'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3523.458'MB/sec (index lex order gen) rebuild zvType time = 0.70's, 0.330'MB/sec write SST data time = 0.12's, 295.610'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 35703.087'MB/sec zip my value time = 1.27's, unzip length = 0.108'GB zip my value throughput = 85.029'MB/sec zip pipeline throughput = 85.029'MB/sec entries = 926905 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.80 avg-zval = 32.08 usrkeys = 926905 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.80 avg-zval = 32.08 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 926905 bytes = 3475904 } seq expand size = 6488335 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0297 GB dict = 1.08 MB all = 0.0361 GB } UnZip/Zip{ index = 10.5128 value = 3.6407 dict = 1.00 all = 3.7218 } Zip/UnZip{ index = 0.0951 value = 0.2747 dict = 1.00 all = 0.2687 } ---------------------------- total value len = 10.441671 GB avg = 0.159 KB (by entry num) total key len = 1.809193 GB avg = 0.028 KB total ukey len = 1.261001 GB avg = 0.016 KB total ukey num = 0.078706578 Billion total entry num = 0.065514307 Billion write speed all = 8.540765690 MB/sec (with seq num) write speed all = 8.175376063 MB/sec (without seq num) 2024/11/23-09:19:06.659671 139957282305600 [compaction_job.cc:1948] [default] [JOB 23363] Generated table #253875: 926905 keys, 36062848 bytes, temperature: kWarm 2024/11/23-09:19:06.659738 139957282305600 EVENT_LOG_v1 {"time_micros": 1732324746659701, "cf_name": "default", "job": 23363, "event": "table_file_creation", "file_number": 253875, "file_size": 36062848, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3273701103, "largest_seqno": 3903084410, "table_properties": {"data_size": 29737232, "index_size": 1763392, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25953340, "raw_average_key_size": 28, "raw_value_size": 108264478, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 926905, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732324743, "oldest_key_time": 0, "file_creation_time": 1732324743, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 253875, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-09:19:06.690758 139957282305600 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253876.sst) /dev/shm/ToplingTemp/Topling-10604-ACCoX2 2024/11/23-09:19:07.654327 139957282305600 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253876.sst): first pass time = 0.96's, 139.297'MB/sec 2024/11/23-09:19:08.943970 139957282305600 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253876.sst): old prealloc_size = 147639500, real_size = 32068368 2024/11/23-09:19:08.944503 139957282305600 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253876.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 930507 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0301 GB avg-val = 116.24 avg-zval = 32.31 2024/11/23-09:19:08.946485 139957282305600 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253876.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-09:19:09.782649 139957282305600 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253876.sst): second pass time = 1.29's, 83.922'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.84's, 43.137'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3606.949'MB/sec (index lex order gen) rebuild zvType time = 0.72's, 0.325'MB/sec write SST data time = 0.12's, 296.717'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 35934.480'MB/sec zip my value time = 1.29's, unzip length = 0.108'GB zip my value throughput = 83.922'MB/sec zip pipeline throughput = 83.922'MB/sec entries = 930507 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.24 avg-zval = 32.31 usrkeys = 930507 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.24 avg-zval = 32.31 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 930507 bytes = 3256784 } seq expand size = 6513549 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0301 GB dict = 1.08 MB all = 0.0362 GB } UnZip/Zip{ index = 10.5128 value = 3.5976 dict = 1.00 all = 3.7101 } Zip/UnZip{ index = 0.0951 value = 0.2780 dict = 1.00 all = 0.2695 } ---------------------------- total value len = 10.556348 GB avg = 0.159 KB (by entry num) total key len = 1.835247 GB avg = 0.028 KB total ukey len = 1.279611 GB avg = 0.016 KB total ukey num = 0.079637085 Billion total entry num = 0.066444814 Billion write speed all = 8.619832753 MB/sec (with seq num) write speed all = 8.250070409 MB/sec (without seq num) 2024/11/23-09:19:09.827820 139957282305600 [compaction_job.cc:1948] [default] [JOB 23363] Generated table #253876: 930507 keys, 36176634 bytes, temperature: kWarm 2024/11/23-09:19:09.827888 139957282305600 EVENT_LOG_v1 {"time_micros": 1732324749827853, "cf_name": "default", "job": 23363, "event": "table_file_creation", "file_number": 253876, "file_size": 36176634, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3680980241, "largest_seqno": 3903084592, "table_properties": {"data_size": 30065344, "index_size": 1770240, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26054196, "raw_average_key_size": 28, "raw_value_size": 108163582, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 930507, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732324746, "oldest_key_time": 0, "file_creation_time": 1732324746, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 253876, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-09:19:09.864341 139957282305600 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253877.sst) /dev/shm/ToplingTemp/Topling-10604-gvqAJZ 2024/11/23-09:19:10.839555 139957282305600 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253877.sst): first pass time = 0.98's, 137.634'MB/sec 2024/11/23-09:19:12.108558 139957282305600 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253877.sst): old prealloc_size = 147639500, real_size = 32549680 2024/11/23-09:19:12.109077 139957282305600 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253877.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 922848 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1084 GB zip-val = 0.0306 GB avg-val = 117.44 avg-zval = 33.12 2024/11/23-09:19:12.109841 139957282305600 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253877.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-09:19:12.937427 139957282305600 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253877.sst): second pass time = 1.27's, 85.482'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.83's, 44.342'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3541.950'MB/sec (index lex order gen) rebuild zvType time = 0.71's, 0.326'MB/sec write SST data time = 0.12's, 304.461'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.083'MB, throughput = 36778.680'MB/sec zip my value time = 1.27's, unzip length = 0.108'GB zip my value throughput = 85.482'MB/sec zip pipeline throughput = 85.482'MB/sec entries = 922848 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.44 avg-zval = 33.12 usrkeys = 922848 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.44 avg-zval = 33.12 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 922848 bytes = 3345344 } seq expand size = 6459936 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0306 GB dict = 1.08 MB all = 0.0368 GB } UnZip/Zip{ index = 10.5110 value = 3.5461 dict = 1.00 all = 3.6519 } Zip/UnZip{ index = 0.0951 value = 0.2820 dict = 1.00 all = 0.2738 } ---------------------------- total value len = 10.671186 GB avg = 0.158 KB (by entry num) total key len = 1.861087 GB avg = 0.028 KB total ukey len = 1.298068 GB avg = 0.016 KB total ukey num = 0.080559933 Billion total entry num = 0.067367662 Billion write speed all = 8.698601621 MB/sec (with seq num) write speed all = 8.324524591 MB/sec (without seq num) 2024/11/23-09:19:12.983779 139957282305600 [compaction_job.cc:1948] [default] [JOB 23363] Generated table #253877: 922848 keys, 36752878 bytes, temperature: kWarm 2024/11/23-09:19:12.983843 139957282305600 EVENT_LOG_v1 {"time_micros": 1732324752983809, "cf_name": "default", "job": 23363, "event": "table_file_creation", "file_number": 253877, "file_size": 36752878, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3369194706, "largest_seqno": 3903082162, "table_properties": {"data_size": 30562848, "index_size": 1755968, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25839744, "raw_average_key_size": 28, "raw_value_size": 108378084, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 922848, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732324749, "oldest_key_time": 0, "file_creation_time": 1732324749, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 253877, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-09:19:13.018882 139957282305600 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253878.sst) /dev/shm/ToplingTemp/Topling-10604-NUQRx3 2024/11/23-09:19:14.049733 139957282305600 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253878.sst): first pass time = 1.03's, 130.206'MB/sec 2024/11/23-09:19:15.315102 139957282305600 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253878.sst): old prealloc_size = 147639500, real_size = 31860352 2024/11/23-09:19:15.315615 139957282305600 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253878.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 938078 prefix = 4 raw-key = 0.0150 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1080 GB zip-val = 0.0298 GB avg-val = 115.08 avg-zval = 31.81 2024/11/23-09:19:15.316561 139957282305600 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253878.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-09:19:16.172727 139957282305600 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253878.sst): second pass time = 1.26's, 85.367'MB/sec, value only(80.4% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.86's, 42.106'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3630.993'MB/sec (index lex order gen) rebuild zvType time = 0.74's, 0.319'MB/sec write SST data time = 0.12's, 297.044'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.077'MB, throughput = 34381.262'MB/sec zip my value time = 1.26's, unzip length = 0.108'GB zip my value throughput = 85.367'MB/sec zip pipeline throughput = 85.367'MB/sec entries = 938078 avg-key = 28.00 avg-zkey = 1.90 avg-val = 115.08 avg-zval = 31.81 usrkeys = 938078 avg-key = 20.00 avg-zkey = 1.90 avg-val = 122.08 avg-zval = 31.81 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 938078 bytes = 3400544 } seq expand size = 6566546 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0188 GB value = 0.1080 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0298 GB dict = 1.08 MB all = 0.0361 GB } UnZip/Zip{ index = 10.5139 value = 3.6175 dict = 1.00 all = 3.7169 } Zip/UnZip{ index = 0.0951 value = 0.2764 dict = 1.00 all = 0.2690 } ---------------------------- total value len = 10.785705 GB avg = 0.158 KB (by entry num) total key len = 1.887353 GB avg = 0.028 KB total ukey len = 1.316830 GB avg = 0.016 KB total ukey num = 0.081498011 Billion total entry num = 0.068305740 Billion write speed all = 8.776610694 MB/sec (with seq num) write speed all = 8.398174554 MB/sec (without seq num) 2024/11/23-09:19:16.216790 139957282305600 [compaction_job.cc:1948] [default] [JOB 23363] Generated table #253878: 938078 keys, 36109712 bytes, temperature: kWarm 2024/11/23-09:19:16.216856 139957282305600 EVENT_LOG_v1 {"time_micros": 1732324756216821, "cf_name": "default", "job": 23363, "event": "table_file_creation", "file_number": 253878, "file_size": 36109712, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3514720078, "largest_seqno": 3903084438, "table_properties": {"data_size": 29841200, "index_size": 1784448, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26266184, "raw_average_key_size": 28, "raw_value_size": 107951684, "raw_average_value_size": 115, "num_data_blocks": 1, "num_entries": 938078, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732324753, "oldest_key_time": 0, "file_creation_time": 1732324753, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 253878, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-09:19:16.287896 139957282305600 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253879.sst) /dev/shm/ToplingTemp/Topling-10604-6BX4B1 2024/11/23-09:19:16.372723 139957282305600 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253879.sst): first pass time = 0.08's, 242.391'MB/sec 2024/11/23-09:19:16.560199 139957282305600 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253879.sst): old prealloc_size = 147639500, real_size = 6079696 2024/11/23-09:19:16.560324 139957282305600 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253879.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 140947 prefix = 4 raw-key = 0.0023 GB zip-key = 0.0003 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.0166 GB zip-val = 0.0058 GB avg-val = 117.81 avg-zval = 40.96 2024/11/23-09:19:16.560482 139957282305600 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253879.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.021 GB 2024/11/23-09:19:16.685143 139957282305600 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00/253879.sst): second pass time = 0.19's, 88.905'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.12's, 53.888'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2651.673'MB/sec (index lex order gen) rebuild zvType time = 0.11's, 0.335'MB/sec write SST data time = 0.02's, 342.445'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.174'MB, throughput = 4737.806'MB/sec zip my value time = 0.19's, unzip length = 0.017'GB zip my value throughput = 88.905'MB/sec zip pipeline throughput = 88.905'MB/sec entries = 140947 avg-key = 28.00 avg-zkey = 1.92 avg-val = 117.81 avg-zval = 40.96 usrkeys = 140947 avg-key = 20.00 avg-zkey = 1.92 avg-val = 124.81 avg-zval = 40.96 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 140947 bytes = 510944 } seq expand size = 986629 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0028 GB value = 0.0166 GB dict = 0.17 MB all = 0.0206 GB } __ZipSize{ index = 0.0003 GB value = 0.0058 GB dict = 0.17 MB all = 0.0067 GB } UnZip/Zip{ index = 10.3955 value = 2.8762 dict = 1.00 all = 3.0529 } Zip/UnZip{ index = 0.0962 value = 0.3477 dict = 1.00 all = 0.3276 } ---------------------------- total value len = 10.803296 GB avg = 0.158 KB (by entry num) total key len = 1.891300 GB avg = 0.028 KB total ukey len = 1.319648 GB avg = 0.016 KB total ukey num = 0.081638958 Billion total entry num = 0.068446687 Billion write speed all = 8.788407858 MB/sec (with seq num) write speed all = 8.409325350 MB/sec (without seq num) 2024/11/23-09:19:16.699668 139957282305600 [compaction_job.cc:1948] [default] [JOB 23363] Generated table #253879: 140947 keys, 6731683 bytes, temperature: kWarm 2024/11/23-09:19:16.699728 139957282305600 EVENT_LOG_v1 {"time_micros": 1732324756699696, "cf_name": "default", "job": 23363, "event": "table_file_creation", "file_number": 253879, "file_size": 6731683, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3610601794, "largest_seqno": 3901574992, "table_properties": {"data_size": 5773120, "index_size": 271168, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 3946516, "raw_average_key_size": 28, "raw_value_size": 16604798, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 140947, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732324756, "oldest_key_time": 0, "file_creation_time": 1732324756, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 253879, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-09:19:16.712062 139957282305600 [compaction_job.cc:703] job-23363: subcompact[0], size: 0.625685 G, files: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23363/att-00 [253862,253863,253864,253865,253866,253867,253868,253869,253870,253871,253872,253873,253874,253875,253876,253877,253878,253879] 2024/11/23-09:19:16.807877 139957282305600 (Original Log Time 2024/11/23-09:18:15.453855) EVENT_LOG_v1 {"time_micros": 1732324695453813, "job": 23363, "event": "compaction_started", "compaction_reason": "FilesMarkedForCompaction", "files_L2": [253859], "files_L3": [253800, 253801, 253802, 253816, 253817, 253818, 253819, 253820, 253821, 253822, 253823, 253824, 253825, 253826, 253827, 253828, 253829], "score": 0.995384, "input_data_size": 644674547, "oldest_snapshot_seqno": 3903099225} 2024/11/23-09:19:16.807881 139957282305600 (Original Log Time 2024/11/23-09:19:16.806423) [compaction_job.cc:2022] [default] [JOB 23363] Compacted 1@2 + 17@3 files to L3 => 625685037 bytes 2024/11/23-09:19:16.807883 139957282305600 (Original Log Time 2024/11/23-09:19:16.807807) [compaction_job.cc:1224] [default] compacted to: files[0 0 0 18 0 0 0] max score 0.02, MB/sec: 10.5 rd, 10.2 wr, level 3, files in(1, 17) out(18 +0 blob) MB in(27.1, 587.7 +0.0 blob) out(596.7 +0.0 blob), read-write-amplify(44.7) write-amplify(22.0) OK, records in: 16179721, records dropped: 91198 output_compression: Snappy 2024/11/23-09:19:16.807889 139957282305600 (Original Log Time 2024/11/23-09:19:16.807856) EVENT_LOG_v1 {"time_micros": 1732324756807833, "cf": "default", "job": 23363, "event": "compaction_finished", "compaction_time_micros": 61258215, "compaction_time_cpu_micros": 25704515, "output_level": 3, "num_output_files": 18, "total_output_size": 625685037, "num_input_records": 16179721, "num_output_records": 16088523, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "file_write_nanos": 447748693, "file_range_sync_nanos": 0, "file_fsync_nanos": 12918, "file_prepare_write_nanos": 46444, "lsm_state": [0, 0, 0, 18, 0, 0, 0]} 2024/11/23-09:19:16.937493 139957282305600 DEBG dcompact_worker.cpp:240: HttpPost: 200 OK: url = http://nlb-7zny4kaa1poal01o64.cn-shenzhen.nlb.aliyuncs.com:8443, body = {"instanceId":"nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137","labourId":"","dbId":"d89b4006-2803-486e-b7a2-759bcf348921","dbStarts":1732256054,"starts":1732324695,"executesMs":61465,"compactionJobId":23363,"attempt":0,"compactionInputRawBytes":2315204223,"compactionInputZipBytes":644674547,"compactionOutputRawBytes":0,"compactionOutputZipBytes":625685037,"headers":{"Accept":"*/*","Connection":"close","Host":"aliyun-topling-saas.topling.cn:18443","RemoteIp":"120.24.192.169","X-Forwarded-For":"120.24.192.169","region":"cn-shenzhen","token":"e6474c481bd4415abc537135cc03626b","instance-token":"e6474c481bd4415abc537135cc03626b","provider":"aliyun","CloudMarketInstanceId":"si-59c0ae5c955845588903","MeteringAssit":"","Transfer-Encoding":"chunked","traceparent":"00-cf8acb2876a6d06d942e640550e2f20a-5b4bdb8e78bc5015-00"}}, response = 2024/11/23-09:19:16.937586 139957282305600 INFO dcompact_worker.cpp:1459: finish /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-23363/att-00: olev 3, work 61.465 s, result 7.772 ms, install 1.484 ms, input{raw 2.156 GiB zip 614.810 MiB}