2024/11/23-09:45:21.810954 139957349447232 DEBG dcompact_worker.cpp:2214: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23773/att-00: fork to child time = 0.025680 sec 2024/11/23-09:45:21.811672 139957349447232 DEBG dcompact_worker.cpp:1013: Beg SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23773/att-00 2024/11/23-09:45:21.819339 139957349447232 DEBG dcompact_worker.cpp:1033: End SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23773/att-00 2024/11/23-09:45:21.820523 139957349447232 TRAC dcompact_worker.cpp:1083: INFO_LOG_LEVEL: rpc = INFO_LEVEL, env_var = undefined 2024/11/23-09:45:21.820815 139957349447232 [WARN] [column_family.cc:386] multiple cf_paths/db_paths and level_compaction_dynamic_level_bytes can't be used together 2024/11/23-09:45:21.877944 139957349447232 [version_set.cc:6208] Recovering from manifest file: /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-23773/att-00/MANIFEST-206347 2024/11/23-09:45:21.909729 139957349447232 [version_set.cc:6251] Recovered from manifest file:/worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-23773/att-00/MANIFEST-206347 succeeded,manifest_file_number is 206347, next_file_number is 254705, last_sequence is 3913620205, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 254541 2024/11/23-09:45:21.909746 139957349447232 [version_set.cc:6266] Column family [default] (ID 0), log number is 0 2024/11/23-09:45:21.909896 139957349447232 [version_set.cc:5721] Creating manifest 254705 2024/11/23-09:45:21.944039 139957349447232 DEBG dcompact_worker.cpp:1218: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23773/att-00: bottommost_level: fake = 1, rpc = 0 2024/11/23-09:45:21.969572 139957349447232 [compaction_job.cc:2437] [default] [JOB 23773] Compacting 1@2 + 14@3 files to L3, score 1.00, subcompactions 1 : 1 2024/11/23-09:45:21.969595 139957349447232 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 17837 Base level 2, inputs: [254699(27MB)], [254636(33MB) 254637(34MB) 254638(34MB) 254639(35MB) 254640(35MB) 254641(35MB) 254642(34MB) 254643(35MB) 254652(36MB) 254653(34MB) 254654(35MB) 254655(34MB) 254656(35MB) 254702(13MB)] 2024/11/23-09:45:21.977813 139957349447232 [top_zip_table.cc:59] core git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-09:45:21.977859 139957349447232 [top_zip_table.cc:60] fsa git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-09:45:21.977888 139957349447232 [top_zip_table.cc:61] zbs git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-09:45:21.977898 139957349447232 [top_zip_table.cc:62] topling-zip_table_reader: git_version_hash_info_is: commit a4a382006cb82713acf5b3425835f22711877681 Author: leipeng Date: 2024-04-11 19:44:14 +0800 fixed_len_hole_index.cc: Add env bool FixedLenHoleIndexUseAVX512 for ut & debug 1. FixedLenHoleIndexUseAVX512 is only in unit tests or debug 2. In release mode, use avx512 by compile options(-march=) g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/23-09:45:21.977919 139957349447232 [top_zip_table.cc:64] topling-rocks git_version_hash_info_is: commit feab587e468621ba0204d47b4ffacc52e7c4290d Author: leipeng Date: 2024-03-22 13:35:06 +0800 ToplingZipTableBuilder::Add: immediately return after error This function returns void, and caller does not check builder->status() after calling this function and graceful abandon. So immediately return after error, and return error status in Finish(). g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/23-09:45:22.767387 139957349447232 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23773/att-00/254706.sst) /dev/shm/ToplingTemp/Topling-16828-daAQlD 2024/11/23-09:45:23.889564 139957349447232 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23773/att-00/254706.sst): first pass time = 1.12's, 119.612'MB/sec 2024/11/23-09:45:25.520775 139957349447232 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23773/att-00/254706.sst): old prealloc_size = 147639500, real_size = 30456432 2024/11/23-09:45:25.521500 139957349447232 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23773/att-00/254706.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 929744 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1082 GB zip-val = 0.0284 GB avg-val = 116.36 avg-zval = 30.59 2024/11/23-09:45:25.522542 139957349447232 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23773/att-00/254706.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-09:45:26.680298 139957349447232 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23773/att-00/254706.sst): second pass time = 1.63's, 66.356'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.16's, 30.009'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2512.334'MB/sec (index lex order gen) rebuild zvType time = 0.90's, 0.259'MB/sec write SST data time = 0.26's, 133.243'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 34774.198'MB/sec zip my value time = 1.63's, unzip length = 0.108'GB zip my value throughput = 66.356'MB/sec zip pipeline throughput = 96.050'MB/sec entries = 929744 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.36 avg-zval = 30.59 usrkeys = 929744 avg-key = 20.00 avg-zkey = 1.91 avg-val = 123.36 avg-zval = 30.59 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 929744 bytes = 3486560 } seq expand size = 6508208 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0284 GB dict = 1.08 MB all = 0.0348 GB } UnZip/Zip{ index = 10.4441 value = 3.8035 dict = 1.00 all = 3.8573 } Zip/UnZip{ index = 0.0957 value = 0.2629 dict = 1.00 all = 0.2592 } ---------------------------- total value len = 8.963313 GB avg = 0.168 KB (by entry num) total key len = 1.466854 GB avg = 0.028 KB total ukey len = 1.016473 GB avg = 0.015 KB total ukey num = 0.066480179 Billion total entry num = 0.053287908 Billion write speed all = 3.460038393 MB/sec (with seq num) write speed all = 3.318619211 MB/sec (without seq num) 2024/11/23-09:45:26.731470 139957349447232 [compaction_job.cc:1948] [default] [JOB 23773] Generated table #254706: 929744 keys, 34795684 bytes, temperature: kWarm 2024/11/23-09:45:26.731591 139957349447232 EVENT_LOG_v1 {"time_micros": 1732326326731517, "cf_name": "default", "job": 23773, "event": "table_file_creation", "file_number": 254706, "file_size": 34795684, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3369194706, "largest_seqno": 3913570109, "table_properties": {"data_size": 28443424, "index_size": 1780416, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26032832, "raw_average_key_size": 28, "raw_value_size": 108184896, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 929744, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732326322, "oldest_key_time": 0, "file_creation_time": 1732326322, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 254706, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-09:45:26.796769 139957349447232 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23773/att-00/254707.sst) /dev/shm/ToplingTemp/Topling-16828-NHoRBC 2024/11/23-09:45:28.299043 139957349447232 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23773/att-00/254707.sst): first pass time = 1.50's, 89.346'MB/sec 2024/11/23-09:45:30.169791 139957349447232 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23773/att-00/254707.sst): old prealloc_size = 147639500, real_size = 31535216 2024/11/23-09:45:30.170480 139957349447232 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23773/att-00/254707.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 919300 prefix = 4 raw-key = 0.0147 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1085 GB zip-val = 0.0295 GB avg-val = 118.00 avg-zval = 32.14 2024/11/23-09:45:30.171346 139957349447232 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23773/att-00/254707.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-09:45:31.512477 139957349447232 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23773/att-00/254707.sst): second pass time = 1.86's, 58.477'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.34's, 26.609'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2627.174'MB/sec (index lex order gen) rebuild zvType time = 1.11's, 0.207'MB/sec write SST data time = 0.23's, 155.437'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.085'MB, throughput = 31416.782'MB/sec zip my value time = 1.86's, unzip length = 0.108'GB zip my value throughput = 58.477'MB/sec zip pipeline throughput = 67.434'MB/sec entries = 919300 avg-key = 28.00 avg-zkey = 1.91 avg-val = 118.00 avg-zval = 32.14 usrkeys = 919300 avg-key = 20.00 avg-zkey = 1.91 avg-val = 125.00 avg-zval = 32.14 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 919300 bytes = 3332480 } seq expand size = 6435100 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0184 GB value = 0.1085 GB dict = 1.09 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0295 GB dict = 1.09 MB all = 0.0357 GB } UnZip/Zip{ index = 10.4439 value = 3.6716 dict = 1.00 all = 3.7568 } Zip/UnZip{ index = 0.0957 value = 0.2724 dict = 1.00 all = 0.2662 } ---------------------------- total value len = 9.078225 GB avg = 0.167 KB (by entry num) total key len = 1.492594 GB avg = 0.028 KB total ukey len = 1.034859 GB avg = 0.015 KB total ukey num = 0.067399479 Billion total entry num = 0.054207208 Billion write speed all = 3.501085481 MB/sec (with seq num) write speed all = 3.357456832 MB/sec (without seq num) 2024/11/23-09:45:31.566230 139957349447232 [compaction_job.cc:1948] [default] [JOB 23773] Generated table #254707: 919300 keys, 35726898 bytes, temperature: kWarm 2024/11/23-09:45:31.566294 139957349447232 EVENT_LOG_v1 {"time_micros": 1732326331566253, "cf_name": "default", "job": 23773, "event": "table_file_creation", "file_number": 254707, "file_size": 35726898, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3370187233, "largest_seqno": 3898540085, "table_properties": {"data_size": 29544736, "index_size": 1760448, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25740400, "raw_average_key_size": 28, "raw_value_size": 108477400, "raw_average_value_size": 118, "num_data_blocks": 1, "num_entries": 919300, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 118, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732326326, "oldest_key_time": 0, "file_creation_time": 1732326326, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 254707, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-09:45:31.626204 139957349447232 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23773/att-00/254708.sst) /dev/shm/ToplingTemp/Topling-16828-vtbtRE 2024/11/23-09:45:33.168103 139957349447232 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23773/att-00/254708.sst): first pass time = 1.54's, 87.050'MB/sec 2024/11/23-09:45:35.853854 139957349447232 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23773/att-00/254708.sst): old prealloc_size = 147639500, real_size = 31761280 2024/11/23-09:45:35.854552 139957349447232 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23773/att-00/254708.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 938543 prefix = 4 raw-key = 0.0150 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1079 GB zip-val = 0.0297 GB avg-val = 115.01 avg-zval = 31.69 2024/11/23-09:45:35.855425 139957349447232 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23773/att-00/254708.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-09:45:37.170897 139957349447232 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23773/att-00/254708.sst): second pass time = 2.68's, 40.202'MB/sec, value only(80.4% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.32's, 27.343'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2636.597'MB/sec (index lex order gen) rebuild zvType time = 1.12's, 0.209'MB/sec write SST data time = 0.19's, 186.285'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.077'MB, throughput = 34582.889'MB/sec zip my value time = 2.68's, unzip length = 0.108'GB zip my value throughput = 40.202'MB/sec zip pipeline throughput = 116.812'MB/sec entries = 938543 avg-key = 28.00 avg-zkey = 1.90 avg-val = 115.01 avg-zval = 31.69 usrkeys = 938543 avg-key = 20.00 avg-zkey = 1.90 avg-val = 122.01 avg-zval = 31.69 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 938543 bytes = 3402240 } seq expand size = 6569801 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0188 GB value = 0.1079 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0297 GB dict = 1.08 MB all = 0.0360 GB } UnZip/Zip{ index = 10.5131 value = 3.6293 dict = 1.00 all = 3.7271 } Zip/UnZip{ index = 0.0951 value = 0.2755 dict = 1.00 all = 0.2683 } ---------------------------- total value len = 9.192734 GB avg = 0.167 KB (by entry num) total key len = 1.518874 GB avg = 0.028 KB total ukey len = 1.053630 GB avg = 0.015 KB total ukey num = 0.068338022 Billion total entry num = 0.055145751 Billion write speed all = 3.541078416 MB/sec (with seq num) write speed all = 3.395236304 MB/sec (without seq num) 2024/11/23-09:45:37.219065 139957349447232 [compaction_job.cc:1948] [default] [JOB 23773] Generated table #254708: 938543 keys, 36011642 bytes, temperature: kWarm 2024/11/23-09:45:37.219132 139957349447232 EVENT_LOG_v1 {"time_micros": 1732326337219097, "cf_name": "default", "job": 23773, "event": "table_file_creation", "file_number": 254708, "file_size": 36011642, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3514720078, "largest_seqno": 3913572143, "table_properties": {"data_size": 29740976, "index_size": 1785472, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26279204, "raw_average_key_size": 28, "raw_value_size": 107938562, "raw_average_value_size": 115, "num_data_blocks": 1, "num_entries": 938543, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732326331, "oldest_key_time": 0, "file_creation_time": 1732326331, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 254708, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-09:45:37.253897 139957349447232 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23773/att-00/254709.sst) /dev/shm/ToplingTemp/Topling-16828-xkz7OC 2024/11/23-09:45:38.446020 139957349447232 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23773/att-00/254709.sst): first pass time = 1.19's, 112.591'MB/sec 2024/11/23-09:45:40.230201 139957349447232 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23773/att-00/254709.sst): old prealloc_size = 147639500, real_size = 32421552 2024/11/23-09:45:40.230853 139957349447232 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23773/att-00/254709.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 931400 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1081 GB zip-val = 0.0304 GB avg-val = 116.10 avg-zval = 32.66 2024/11/23-09:45:40.231722 139957349447232 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23773/att-00/254709.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-09:45:41.280487 139957349447232 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23773/att-00/254709.sst): second pass time = 1.78's, 60.638'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.05's, 34.895'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2824.042'MB/sec (index lex order gen) rebuild zvType time = 0.90's, 0.259'MB/sec write SST data time = 0.15's, 245.090'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 35073.740'MB/sec zip my value time = 1.78's, unzip length = 0.108'GB zip my value throughput = 60.638'MB/sec zip pipeline throughput = 60.638'MB/sec entries = 931400 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.10 avg-zval = 32.66 usrkeys = 931400 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.10 avg-zval = 32.66 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 931400 bytes = 3376336 } seq expand size = 6519800 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0304 GB dict = 1.08 MB all = 0.0366 GB } UnZip/Zip{ index = 10.5126 value = 3.5553 dict = 1.00 all = 3.6622 } Zip/UnZip{ index = 0.0951 value = 0.2813 dict = 1.00 all = 0.2731 } ---------------------------- total value len = 9.307392 GB avg = 0.166 KB (by entry num) total key len = 1.544953 GB avg = 0.028 KB total ukey len = 1.072258 GB avg = 0.015 KB total ukey num = 0.069269422 Billion total entry num = 0.056077151 Billion write speed all = 3.582736524 MB/sec (with seq num) write speed all = 3.434632378 MB/sec (without seq num) 2024/11/23-09:45:41.325418 139957349447232 [compaction_job.cc:1948] [default] [JOB 23773] Generated table #254709: 931400 keys, 36649168 bytes, temperature: kWarm 2024/11/23-09:45:41.325486 139957349447232 EVENT_LOG_v1 {"time_micros": 1732326341325450, "cf_name": "default", "job": 23773, "event": "table_file_creation", "file_number": 254709, "file_size": 36649168, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3516470397, "largest_seqno": 3913572200, "table_properties": {"data_size": 30416544, "index_size": 1771968, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26079200, "raw_average_key_size": 28, "raw_value_size": 108138544, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 931400, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732326337, "oldest_key_time": 0, "file_creation_time": 1732326337, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 254709, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-09:45:41.359965 139957349447232 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23773/att-00/254710.sst) /dev/shm/ToplingTemp/Topling-16828-xq8PAC 2024/11/23-09:45:42.355064 139957349447232 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23773/att-00/254710.sst): first pass time = 1.00's, 134.886'MB/sec 2024/11/23-09:45:43.697145 139957349447232 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23773/att-00/254710.sst): old prealloc_size = 147639500, real_size = 32486496 2024/11/23-09:45:43.697804 139957349447232 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23773/att-00/254710.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 929760 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0305 GB avg-val = 116.36 avg-zval = 32.79 2024/11/23-09:45:43.698707 139957349447232 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23773/att-00/254710.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-09:45:44.640281 139957349447232 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23773/att-00/254710.sst): second pass time = 1.34's, 80.659'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.94's, 39.047'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2777.436'MB/sec (index lex order gen) rebuild zvType time = 0.79's, 0.293'MB/sec write SST data time = 0.15's, 245.703'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 35532.875'MB/sec zip my value time = 1.34's, unzip length = 0.108'GB zip my value throughput = 80.659'MB/sec zip pipeline throughput = 80.659'MB/sec entries = 929760 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.36 avg-zval = 32.79 usrkeys = 929760 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.36 avg-zval = 32.79 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 929760 bytes = 3486608 } seq expand size = 6508320 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0305 GB dict = 1.08 MB all = 0.0368 GB } UnZip/Zip{ index = 10.5123 value = 3.5488 dict = 1.00 all = 3.6447 } Zip/UnZip{ index = 0.0951 value = 0.2818 dict = 1.00 all = 0.2744 } ---------------------------- total value len = 9.422085 GB avg = 0.165 KB (by entry num) total key len = 1.570986 GB avg = 0.028 KB total ukey len = 1.090853 GB avg = 0.016 KB total ukey num = 0.070199182 Billion total entry num = 0.057006911 Billion write speed all = 3.625174106 MB/sec (with seq num) write speed all = 3.474781205 MB/sec (without seq num) 2024/11/23-09:45:44.685522 139957349447232 [compaction_job.cc:1948] [default] [JOB 23773] Generated table #254710: 929760 keys, 36825752 bytes, temperature: kWarm 2024/11/23-09:45:44.685590 139957349447232 EVENT_LOG_v1 {"time_micros": 1732326344685556, "cf_name": "default", "job": 23773, "event": "table_file_creation", "file_number": 254710, "file_size": 36825752, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3369353416, "largest_seqno": 3913570037, "table_properties": {"data_size": 30485008, "index_size": 1768896, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26033280, "raw_average_key_size": 28, "raw_value_size": 108184448, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 929760, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732326341, "oldest_key_time": 0, "file_creation_time": 1732326341, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 254710, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-09:45:44.720952 139957349447232 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23773/att-00/254711.sst) /dev/shm/ToplingTemp/Topling-16828-LnGq2C 2024/11/23-09:45:45.780456 139957349447232 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23773/att-00/254711.sst): first pass time = 1.06's, 126.687'MB/sec 2024/11/23-09:45:47.787146 139957349447232 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23773/att-00/254711.sst): old prealloc_size = 147639500, real_size = 34469472 2024/11/23-09:45:47.787666 139957349447232 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23773/att-00/254711.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 928774 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.93 raw-val = 0.1082 GB zip-val = 0.0324 GB avg-val = 116.51 avg-zval = 34.94 2024/11/23-09:45:47.788423 139957349447232 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23773/att-00/254711.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-09:45:48.843667 139957349447232 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23773/att-00/254711.sst): second pass time = 2.01's, 53.956'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.06's, 36.222'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3570.109'MB/sec (index lex order gen) rebuild zvType time = 0.77's, 0.301'MB/sec write SST data time = 0.28's, 134.706'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 37100.646'MB/sec zip my value time = 2.01's, unzip length = 0.108'GB zip my value throughput = 53.956'MB/sec zip pipeline throughput = 127.127'MB/sec entries = 928774 avg-key = 28.00 avg-zkey = 1.93 avg-val = 116.51 avg-zval = 34.94 usrkeys = 928774 avg-key = 20.00 avg-zkey = 1.93 avg-val = 122.13 avg-zval = 34.94 TagRS{ kinds = RS_Key0_TagN bytes = 145240 } TagArray{ size = 745777 bytes = 2796672 } seq expand size = 5220439 multi value expand size = 0 cnt WriteAppend = 18 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0324 GB dict = 1.08 MB all = 0.0383 GB } UnZip/Zip{ index = 10.3784 value = 3.3350 dict = 1.00 all = 3.5073 } Zip/UnZip{ index = 0.0964 value = 0.2998 dict = 1.00 all = 0.2851 } ---------------------------- total value len = 9.535517 GB avg = 0.165 KB (by entry num) total key len = 1.596992 GB avg = 0.028 KB total ukey len = 1.109428 GB avg = 0.016 KB total ukey num = 0.071127956 Billion total entry num = 0.057935685 Billion write speed all = 3.666074838 MB/sec (with seq num) write speed all = 3.513443258 MB/sec (without seq num) 2024/11/23-09:45:48.893907 139957349447232 [compaction_job.cc:1948] [default] [JOB 23773] Generated table #254711: 928774 keys, 38268084 bytes, temperature: kWarm 2024/11/23-09:45:48.894009 139957349447232 EVENT_LOG_v1 {"time_micros": 1732326348893947, "cf_name": "default", "job": 23773, "event": "table_file_creation", "file_number": 254711, "file_size": 38268084, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3913571635, "table_properties": {"data_size": 32447248, "index_size": 1789824, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26005672, "raw_average_key_size": 28, "raw_value_size": 108212172, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 928774, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732326344, "oldest_key_time": 0, "file_creation_time": 1732326344, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 254711, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-09:45:48.942039 139957349447232 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23773/att-00/254712.sst) /dev/shm/ToplingTemp/Topling-16828-gFVsxG 2024/11/23-09:45:49.822271 139957349447232 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23773/att-00/254712.sst): first pass time = 0.88's, 152.488'MB/sec 2024/11/23-09:45:51.668499 139957349447232 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23773/att-00/254712.sst): old prealloc_size = 147639500, real_size = 32488352 2024/11/23-09:45:51.669036 139957349447232 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23773/att-00/254712.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 930392 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0305 GB avg-val = 116.26 avg-zval = 32.77 2024/11/23-09:45:51.669823 139957349447232 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23773/att-00/254712.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-09:45:52.521594 139957349447232 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23773/att-00/254712.sst): second pass time = 1.84's, 58.635'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.85's, 43.036'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3424.867'MB/sec (index lex order gen) rebuild zvType time = 0.73's, 0.319'MB/sec write SST data time = 0.12's, 298.772'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 38526.116'MB/sec zip my value time = 1.84's, unzip length = 0.108'GB zip my value throughput = 58.635'MB/sec zip pipeline throughput = 120.842'MB/sec entries = 930392 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.26 avg-zval = 32.77 usrkeys = 930392 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.26 avg-zval = 32.77 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 930392 bytes = 3372688 } seq expand size = 6512744 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0305 GB dict = 1.08 MB all = 0.0367 GB } UnZip/Zip{ index = 10.5134 value = 3.5481 dict = 1.00 all = 3.6559 } Zip/UnZip{ index = 0.0951 value = 0.2818 dict = 1.00 all = 0.2735 } ---------------------------- total value len = 9.650197 GB avg = 0.164 KB (by entry num) total key len = 1.623043 GB avg = 0.028 KB total ukey len = 1.128036 GB avg = 0.016 KB total ukey num = 0.072058348 Billion total entry num = 0.058866077 Billion write speed all = 3.707928155 MB/sec (with seq num) write speed all = 3.553033065 MB/sec (without seq num) 2024/11/23-09:45:52.566497 139957349447232 [compaction_job.cc:1948] [default] [JOB 23773] Generated table #254712: 930392 keys, 36712602 bytes, temperature: kWarm 2024/11/23-09:45:52.566562 139957349447232 EVENT_LOG_v1 {"time_micros": 1732326352566528, "cf_name": "default", "job": 23773, "event": "table_file_creation", "file_number": 254712, "file_size": 36712602, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3480997236, "largest_seqno": 3913571475, "table_properties": {"data_size": 30485648, "index_size": 1769920, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26050976, "raw_average_key_size": 28, "raw_value_size": 108166848, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 930392, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732326348, "oldest_key_time": 0, "file_creation_time": 1732326348, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 254712, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-09:45:52.600504 139957349447232 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23773/att-00/254713.sst) /dev/shm/ToplingTemp/Topling-16828-ZOyPUF 2024/11/23-09:45:53.519934 139957349447232 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23773/att-00/254713.sst): first pass time = 0.92's, 145.987'MB/sec 2024/11/23-09:45:55.033003 139957349447232 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23773/att-00/254713.sst): old prealloc_size = 147639500, real_size = 32140160 2024/11/23-09:45:55.033519 139957349447232 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23773/att-00/254713.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 932562 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1081 GB zip-val = 0.0301 GB avg-val = 115.92 avg-zval = 32.30 2024/11/23-09:45:55.035701 139957349447232 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23773/att-00/254713.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-09:45:55.885133 139957349447232 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23773/att-00/254713.sst): second pass time = 1.51's, 71.501'MB/sec, value only(80.5% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.85's, 42.683'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3604.993'MB/sec (index lex order gen) rebuild zvType time = 0.73's, 0.321'MB/sec write SST data time = 0.13's, 289.530'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 32761.051'MB/sec zip my value time = 1.51's, unzip length = 0.108'GB zip my value throughput = 71.501'MB/sec zip pipeline throughput = 108.215'MB/sec entries = 932562 avg-key = 28.00 avg-zkey = 1.91 avg-val = 115.92 avg-zval = 32.30 usrkeys = 932562 avg-key = 20.00 avg-zkey = 1.91 avg-val = 122.92 avg-zval = 32.30 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 932562 bytes = 3380560 } seq expand size = 6527934 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0187 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0301 GB dict = 1.08 MB all = 0.0364 GB } UnZip/Zip{ index = 10.4454 value = 3.5890 dict = 1.00 all = 3.6902 } Zip/UnZip{ index = 0.0957 value = 0.2786 dict = 1.00 all = 0.2710 } ---------------------------- total value len = 9.764831 GB avg = 0.163 KB (by entry num) total key len = 1.649154 GB avg = 0.028 KB total ukey len = 1.146688 GB avg = 0.016 KB total ukey num = 0.072990910 Billion total entry num = 0.059798639 Billion write speed all = 3.750072661 MB/sec (with seq num) write speed all = 3.592897594 MB/sec (without seq num) 2024/11/23-09:45:55.930291 139957349447232 [compaction_job.cc:1948] [default] [JOB 23773] Generated table #254713: 932562 keys, 36371034 bytes, temperature: kWarm 2024/11/23-09:45:55.930357 139957349447232 EVENT_LOG_v1 {"time_micros": 1732326355930322, "cf_name": "default", "job": 23773, "event": "table_file_creation", "file_number": 254713, "file_size": 36371034, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3512539342, "largest_seqno": 3913571340, "table_properties": {"data_size": 30121264, "index_size": 1785600, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26111736, "raw_average_key_size": 28, "raw_value_size": 108106068, "raw_average_value_size": 115, "num_data_blocks": 1, "num_entries": 932562, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732326352, "oldest_key_time": 0, "file_creation_time": 1732326352, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 254713, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-09:45:55.964710 139957349447232 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23773/att-00/254714.sst) /dev/shm/ToplingTemp/Topling-16828-c54uMF 2024/11/23-09:45:56.870382 139957349447232 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23773/att-00/254714.sst): first pass time = 0.91's, 148.205'MB/sec 2024/11/23-09:45:58.407662 139957349447232 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23773/att-00/254714.sst): old prealloc_size = 147639500, real_size = 34017840 2024/11/23-09:45:58.408186 139957349447232 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23773/att-00/254714.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 929634 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1082 GB zip-val = 0.0320 GB avg-val = 116.38 avg-zval = 34.43 2024/11/23-09:45:58.409649 139957349447232 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23773/att-00/254714.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-09:45:59.251238 139957349447232 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23773/att-00/254714.sst): second pass time = 1.54's, 70.412'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.84's, 45.332'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3553.200'MB/sec (index lex order gen) rebuild zvType time = 0.72's, 0.323'MB/sec write SST data time = 0.12's, 312.107'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 33231.442'MB/sec zip my value time = 1.54's, unzip length = 0.108'GB zip my value throughput = 70.412'MB/sec zip pipeline throughput = 100.737'MB/sec entries = 929634 avg-key = 28.00 avg-zkey = 1.92 avg-val = 116.38 avg-zval = 34.43 usrkeys = 929634 avg-key = 20.00 avg-zkey = 1.92 avg-val = 123.38 avg-zval = 34.43 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 929634 bytes = 3369936 } seq expand size = 6507438 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0320 GB dict = 1.08 MB all = 0.0382 GB } UnZip/Zip{ index = 10.4421 value = 3.3804 dict = 1.00 all = 3.5098 } Zip/UnZip{ index = 0.0958 value = 0.2958 dict = 1.00 all = 0.2849 } ---------------------------- total value len = 9.879526 GB avg = 0.163 KB (by entry num) total key len = 1.675184 GB avg = 0.028 KB total ukey len = 1.165280 GB avg = 0.016 KB total ukey num = 0.073920544 Billion total entry num = 0.060728273 Billion write speed all = 3.792114173 MB/sec (with seq num) write speed all = 3.632671984 MB/sec (without seq num) 2024/11/23-09:45:59.297671 139957349447232 [compaction_job.cc:1948] [default] [JOB 23773] Generated table #254714: 929634 keys, 38240492 bytes, temperature: kWarm 2024/11/23-09:45:59.297733 139957349447232 EVENT_LOG_v1 {"time_micros": 1732326359297701, "cf_name": "default", "job": 23773, "event": "table_file_creation", "file_number": 254714, "file_size": 38240492, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3411274482, "largest_seqno": 3913571601, "table_properties": {"data_size": 32004704, "index_size": 1780544, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26029752, "raw_average_key_size": 28, "raw_value_size": 108187984, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 929634, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732326355, "oldest_key_time": 0, "file_creation_time": 1732326355, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 254714, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-09:45:59.330488 139957349447232 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23773/att-00/254715.sst) /dev/shm/ToplingTemp/Topling-16828-OatEFC 2024/11/23-09:46:00.212382 139957349447232 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23773/att-00/254715.sst): first pass time = 0.88's, 152.200'MB/sec 2024/11/23-09:46:01.491382 139957349447232 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23773/att-00/254715.sst): old prealloc_size = 147639500, real_size = 30552752 2024/11/23-09:46:01.491916 139957349447232 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23773/att-00/254715.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 929757 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1082 GB zip-val = 0.0285 GB avg-val = 116.36 avg-zval = 30.70 2024/11/23-09:46:01.493401 139957349447232 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23773/att-00/254715.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-09:46:02.311352 139957349447232 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23773/att-00/254715.sst): second pass time = 1.28's, 84.633'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.82's, 42.412'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3543.519'MB/sec (index lex order gen) rebuild zvType time = 0.69's, 0.335'MB/sec write SST data time = 0.12's, 279.016'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 37649.456'MB/sec zip my value time = 1.28's, unzip length = 0.108'GB zip my value throughput = 84.633'MB/sec zip pipeline throughput = 84.633'MB/sec entries = 929757 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.36 avg-zval = 30.70 usrkeys = 929757 avg-key = 20.00 avg-zkey = 1.91 avg-val = 123.36 avg-zval = 30.70 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 929757 bytes = 3370384 } seq expand size = 6508299 multi value expand size = 0 cnt WriteAppend = 15 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0285 GB dict = 1.08 MB all = 0.0348 GB } UnZip/Zip{ index = 10.4439 value = 3.7907 dict = 1.00 all = 3.8595 } Zip/UnZip{ index = 0.0957 value = 0.2638 dict = 1.00 all = 0.2591 } ---------------------------- total value len = 9.994219 GB avg = 0.162 KB (by entry num) total key len = 1.701217 GB avg = 0.028 KB total ukey len = 1.183875 GB avg = 0.016 KB total ukey num = 0.074850301 Billion total entry num = 0.061658030 Billion write speed all = 3.834447868 MB/sec (with seq num) write speed all = 3.672727015 MB/sec (without seq num) 2024/11/23-09:46:02.354356 139957349447232 [compaction_job.cc:1948] [default] [JOB 23773] Generated table #254715: 929757 keys, 34775776 bytes, temperature: kWarm 2024/11/23-09:46:02.354430 139957349447232 EVENT_LOG_v1 {"time_micros": 1732326362354396, "cf_name": "default", "job": 23773, "event": "table_file_creation", "file_number": 254715, "file_size": 34775776, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3430924201, "largest_seqno": 3913571525, "table_properties": {"data_size": 28539680, "index_size": 1780480, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26033196, "raw_average_key_size": 28, "raw_value_size": 108184662, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 929757, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732326359, "oldest_key_time": 0, "file_creation_time": 1732326359, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 254715, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-09:46:02.390704 139957349447232 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23773/att-00/254716.sst) /dev/shm/ToplingTemp/Topling-16828-vflkkG 2024/11/23-09:46:03.436011 139957349447232 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23773/att-00/254716.sst): first pass time = 1.05's, 128.406'MB/sec 2024/11/23-09:46:04.732184 139957349447232 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23773/att-00/254716.sst): old prealloc_size = 147639500, real_size = 32537600 2024/11/23-09:46:04.732708 139957349447232 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23773/att-00/254716.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 929842 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1082 GB zip-val = 0.0305 GB avg-val = 116.34 avg-zval = 32.83 2024/11/23-09:46:04.734198 139957349447232 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23773/att-00/254716.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-09:46:05.574822 139957349447232 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23773/att-00/254716.sst): second pass time = 1.30's, 83.533'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.84's, 43.627'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3558.340'MB/sec (index lex order gen) rebuild zvType time = 0.72's, 0.323'MB/sec write SST data time = 0.12's, 298.794'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 34378.428'MB/sec zip my value time = 1.30's, unzip length = 0.108'GB zip my value throughput = 83.533'MB/sec zip pipeline throughput = 83.533'MB/sec entries = 929842 avg-key = 28.00 avg-zkey = 1.92 avg-val = 116.34 avg-zval = 32.83 usrkeys = 929842 avg-key = 20.00 avg-zkey = 1.92 avg-val = 123.34 avg-zval = 32.83 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 929842 bytes = 3370688 } seq expand size = 6508894 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0305 GB dict = 1.08 MB all = 0.0368 GB } UnZip/Zip{ index = 10.4426 value = 3.5442 dict = 1.00 all = 3.6511 } Zip/UnZip{ index = 0.0958 value = 0.2822 dict = 1.00 all = 0.2739 } ---------------------------- total value len = 10.108911 GB avg = 0.162 KB (by entry num) total key len = 1.727253 GB avg = 0.028 KB total ukey len = 1.202472 GB avg = 0.016 KB total ukey num = 0.075780143 Billion total entry num = 0.062587872 Billion write speed all = 3.876438691 MB/sec (with seq num) write speed all = 3.712454441 MB/sec (without seq num) 2024/11/23-09:46:05.620494 139957349447232 [compaction_job.cc:1948] [default] [JOB 23773] Generated table #254716: 929842 keys, 36760922 bytes, temperature: kWarm 2024/11/23-09:46:05.620562 139957349447232 EVENT_LOG_v1 {"time_micros": 1732326365620526, "cf_name": "default", "job": 23773, "event": "table_file_creation", "file_number": 254716, "file_size": 36760922, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3527554269, "largest_seqno": 3913571397, "table_properties": {"data_size": 30524080, "index_size": 1780864, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26035576, "raw_average_key_size": 28, "raw_value_size": 108182236, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 929842, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732326362, "oldest_key_time": 0, "file_creation_time": 1732326362, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 254716, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-09:46:05.653562 139957349447232 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23773/att-00/254717.sst) /dev/shm/ToplingTemp/Topling-16828-enEghF 2024/11/23-09:46:06.566852 139957349447232 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23773/att-00/254717.sst): first pass time = 0.91's, 146.967'MB/sec 2024/11/23-09:46:07.873590 139957349447232 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23773/att-00/254717.sst): old prealloc_size = 147639500, real_size = 33131664 2024/11/23-09:46:07.874122 139957349447232 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23773/att-00/254717.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927427 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0311 GB avg-val = 116.72 avg-zval = 33.57 2024/11/23-09:46:07.876685 139957349447232 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23773/att-00/254717.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-09:46:08.728509 139957349447232 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23773/att-00/254717.sst): second pass time = 1.31's, 82.888'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.85's, 43.687'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3453.764'MB/sec (index lex order gen) rebuild zvType time = 0.73's, 0.318'MB/sec write SST data time = 0.13's, 295.972'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 36661.802'MB/sec zip my value time = 1.31's, unzip length = 0.108'GB zip my value throughput = 82.888'MB/sec zip pipeline throughput = 82.888'MB/sec entries = 927427 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.72 avg-zval = 33.57 usrkeys = 927427 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.72 avg-zval = 33.57 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 927427 bytes = 3361936 } seq expand size = 6491989 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0311 GB dict = 1.08 MB all = 0.0373 GB } UnZip/Zip{ index = 10.5129 value = 3.4768 dict = 1.00 all = 3.5937 } Zip/UnZip{ index = 0.0951 value = 0.2876 dict = 1.00 all = 0.2783 } ---------------------------- total value len = 10.223652 GB avg = 0.161 KB (by entry num) total key len = 1.753221 GB avg = 0.028 KB total ukey len = 1.221021 GB avg = 0.016 KB total ukey num = 0.076707570 Billion total entry num = 0.063515299 Billion write speed all = 3.918475059 MB/sec (with seq num) write speed all = 3.752232596 MB/sec (without seq num) 2024/11/23-09:46:08.774858 139957349447232 [compaction_job.cc:1948] [default] [JOB 23773] Generated table #254717: 927427 keys, 37347730 bytes, temperature: kWarm 2024/11/23-09:46:08.774926 139957349447232 EVENT_LOG_v1 {"time_micros": 1732326368774891, "cf_name": "default", "job": 23773, "event": "table_file_creation", "file_number": 254717, "file_size": 37347730, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3405268578, "largest_seqno": 3913571426, "table_properties": {"data_size": 31135296, "index_size": 1764352, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25967956, "raw_average_key_size": 28, "raw_value_size": 108249878, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927427, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732326365, "oldest_key_time": 0, "file_creation_time": 1732326365, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 254717, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-09:46:08.808961 139957349447232 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23773/att-00/254718.sst) /dev/shm/ToplingTemp/Topling-16828-uMYFSE 2024/11/23-09:46:09.827152 139957349447232 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23773/att-00/254718.sst): first pass time = 1.02's, 131.827'MB/sec 2024/11/23-09:46:11.166794 139957349447232 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23773/att-00/254718.sst): old prealloc_size = 147639500, real_size = 33096656 2024/11/23-09:46:11.167422 139957349447232 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23773/att-00/254718.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 928265 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.93 raw-val = 0.1082 GB zip-val = 0.0311 GB avg-val = 116.59 avg-zval = 33.48 2024/11/23-09:46:11.168908 139957349447232 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23773/att-00/254718.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-09:46:12.021208 139957349447232 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23773/att-00/254718.sst): second pass time = 1.34's, 80.830'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.85's, 43.674'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2953.362'MB/sec (index lex order gen) rebuild zvType time = 0.73's, 0.318'MB/sec write SST data time = 0.12's, 300.580'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 31966.117'MB/sec zip my value time = 1.34's, unzip length = 0.108'GB zip my value throughput = 80.830'MB/sec zip pipeline throughput = 80.830'MB/sec entries = 928265 avg-key = 28.00 avg-zkey = 1.93 avg-val = 116.59 avg-zval = 33.48 usrkeys = 928265 avg-key = 20.00 avg-zkey = 1.93 avg-val = 123.59 avg-zval = 33.48 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 928265 bytes = 3364976 } seq expand size = 6497855 multi value expand size = 0 cnt WriteAppend = 16 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0311 GB dict = 1.08 MB all = 0.0373 GB } UnZip/Zip{ index = 10.3746 value = 3.4828 dict = 1.00 all = 3.5969 } Zip/UnZip{ index = 0.0964 value = 0.2871 dict = 1.00 all = 0.2780 } ---------------------------- total value len = 10.338377 GB avg = 0.160 KB (by entry num) total key len = 1.779212 GB avg = 0.028 KB total ukey len = 1.239586 GB avg = 0.016 KB total ukey num = 0.077635835 Billion total entry num = 0.064443564 Billion write speed all = 3.960246740 MB/sec (with seq num) write speed all = 3.791756183 MB/sec (without seq num) 2024/11/23-09:46:12.067300 139957349447232 [compaction_job.cc:1948] [default] [JOB 23773] Generated table #254718: 928265 keys, 37314552 bytes, temperature: kWarm 2024/11/23-09:46:12.067369 139957349447232 EVENT_LOG_v1 {"time_micros": 1732326372067332, "cf_name": "default", "job": 23773, "event": "table_file_creation", "file_number": 254718, "file_size": 37314552, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3471845708, "largest_seqno": 3913569449, "table_properties": {"data_size": 31074880, "index_size": 1789504, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25991420, "raw_average_key_size": 28, "raw_value_size": 108226346, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 928265, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732326368, "oldest_key_time": 0, "file_creation_time": 1732326368, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 254718, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-09:46:12.100784 139957349447232 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23773/att-00/254719.sst) /dev/shm/ToplingTemp/Topling-16828-Gx1GVD 2024/11/23-09:46:12.576753 139957349447232 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23773/att-00/254719.sst): first pass time = 0.48's, 152.715'MB/sec 2024/11/23-09:46:13.291596 139957349447232 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23773/att-00/254719.sst): old prealloc_size = 147639500, real_size = 17927600 2024/11/23-09:46:13.291904 139957349447232 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23773/att-00/254719.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 504817 prefix = 4 raw-key = 0.0081 GB zip-key = 0.0010 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.0585 GB zip-val = 0.0168 GB avg-val = 115.98 avg-zval = 33.35 2024/11/23-09:46:13.292373 139957349447232 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23773/att-00/254719.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0012 GB, waited 0.000 sec, Key+Value = 0.073 GB 2024/11/23-09:46:13.763076 139957349447232 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23773/att-00/254719.sst): second pass time = 0.71's, 81.985'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.47's, 42.623'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3392.547'MB/sec (index lex order gen) rebuild zvType time = 0.40's, 0.313'MB/sec write SST data time = 0.07's, 295.395'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.587'MB, throughput = 20101.630'MB/sec zip my value time = 0.71's, unzip length = 0.059'GB zip my value throughput = 81.985'MB/sec zip pipeline throughput = 81.985'MB/sec entries = 504817 avg-key = 28.00 avg-zkey = 1.92 avg-val = 115.98 avg-zval = 33.35 usrkeys = 504817 avg-key = 20.00 avg-zkey = 1.92 avg-val = 122.98 avg-zval = 33.35 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 504817 bytes = 1703776 } seq expand size = 3533719 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0101 GB value = 0.0585 GB dict = 0.59 MB all = 0.0727 GB } __ZipSize{ index = 0.0010 GB value = 0.0168 GB dict = 0.59 MB all = 0.0201 GB } UnZip/Zip{ index = 10.4384 value = 3.4779 dict = 1.00 all = 3.6169 } Zip/UnZip{ index = 0.0958 value = 0.2875 dict = 1.00 all = 0.2765 } ---------------------------- total value len = 10.400457 GB avg = 0.160 KB (by entry num) total key len = 1.793347 GB avg = 0.028 KB total ukey len = 1.249682 GB avg = 0.016 KB total ukey num = 0.078140652 Billion total entry num = 0.064948381 Billion write speed all = 3.982887956 MB/sec (with seq num) write speed all = 3.813174146 MB/sec (without seq num) 2024/11/23-09:46:13.791423 139957349447232 [compaction_job.cc:1948] [default] [JOB 23773] Generated table #254719: 504817 keys, 20094903 bytes, temperature: kWarm 2024/11/23-09:46:13.791486 139957349447232 EVENT_LOG_v1 {"time_micros": 1732326373791452, "cf_name": "default", "job": 23773, "event": "table_file_creation", "file_number": 254719, "file_size": 20094903, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3828659352, "largest_seqno": 3913571437, "table_properties": {"data_size": 16833952, "index_size": 967232, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 14134876, "raw_average_key_size": 28, "raw_value_size": 58546814, "raw_average_value_size": 115, "num_data_blocks": 1, "num_entries": 504817, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732326372, "oldest_key_time": 0, "file_creation_time": 1732326372, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 254719, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-09:46:13.808746 139957349447232 [compaction_job.cc:703] job-23773: subcompact[0], size: 0.495895 G, files: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23773/att-00 [254706,254707,254708,254709,254710,254711,254712,254713,254714,254715,254716,254717,254718,254719] 2024/11/23-09:46:13.910689 139957349447232 (Original Log Time 2024/11/23-09:45:21.969675) EVENT_LOG_v1 {"time_micros": 1732326321969618, "job": 23773, "event": "compaction_started", "compaction_reason": "FilesMarkedForCompaction", "files_L2": [254699], "files_L3": [254636, 254637, 254638, 254639, 254640, 254641, 254642, 254643, 254652, 254653, 254654, 254655, 254656, 254702], "score": 0.998349, "input_data_size": 518138385, "oldest_snapshot_seqno": 3913620165} 2024/11/23-09:46:13.910693 139957349447232 (Original Log Time 2024/11/23-09:46:13.909234) [compaction_job.cc:2022] [default] [JOB 23773] Compacted 1@2 + 14@3 files to L3 => 495895239 bytes 2024/11/23-09:46:13.910695 139957349447232 (Original Log Time 2024/11/23-09:46:13.910626) [compaction_job.cc:1224] [default] compacted to: files[0 0 0 14 0 0 0] max score 0.02, MB/sec: 10.0 rd, 9.6 wr, level 3, files in(1, 14) out(14 +0 blob) MB in(27.2, 467.0 +0.0 blob) out(472.9 +0.0 blob), read-write-amplify(35.6) write-amplify(17.4) OK, records in: 12658408, records dropped: 68191 output_compression: Snappy 2024/11/23-09:46:13.910701 139957349447232 (Original Log Time 2024/11/23-09:46:13.910668) EVENT_LOG_v1 {"time_micros": 1732326373910648, "cf": "default", "job": 23773, "event": "compaction_finished", "compaction_time_micros": 51839077, "compaction_time_cpu_micros": 21719437, "output_level": 3, "num_output_files": 14, "total_output_size": 495895239, "num_input_records": 12658408, "num_output_records": 12590217, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "file_write_nanos": 397236164, "file_range_sync_nanos": 0, "file_fsync_nanos": 10144, "file_prepare_write_nanos": 36786, "lsm_state": [0, 0, 0, 14, 0, 0, 0]} 2024/11/23-09:46:14.030712 139957349447232 DEBG dcompact_worker.cpp:240: HttpPost: 200 OK: url = http://nlb-7zny4kaa1poal01o64.cn-shenzhen.nlb.aliyuncs.com:8443, body = {"instanceId":"nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137","labourId":"","dbId":"d89b4006-2803-486e-b7a2-759bcf348921","dbStarts":1732256054,"starts":1732326321,"executesMs":52090,"compactionJobId":23773,"attempt":0,"compactionInputRawBytes":1827196056,"compactionInputZipBytes":518138385,"compactionOutputRawBytes":0,"compactionOutputZipBytes":495895239,"headers":{"Accept":"*/*","Connection":"close","Host":"aliyun-topling-saas.topling.cn:18443","RemoteIp":"120.24.192.169","X-Forwarded-For":"120.24.192.169","region":"cn-shenzhen","token":"e6474c481bd4415abc537135cc03626b","instance-token":"e6474c481bd4415abc537135cc03626b","provider":"aliyun","CloudMarketInstanceId":"si-59c0ae5c955845588903","MeteringAssit":"","Transfer-Encoding":"chunked","traceparent":"00-038c34157ed7c650fc21ea6e474b4c5e-aaa69a2298b9f62c-00"}}, response = 2024/11/23-09:46:14.030784 139957349447232 INFO dcompact_worker.cpp:1459: finish /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-23773/att-00: olev 3, work 52.090 s, result 7.688 ms, install 1.487 ms, input{raw 1.702 GiB zip 494.135 MiB}