2024/11/23-07:05:32.542198 140024743433792 DEBG dcompact_worker.cpp:2214: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21563/att-00: fork to child time = 0.009108 sec 2024/11/23-07:05:32.543059 140024743433792 DEBG dcompact_worker.cpp:1013: Beg SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21563/att-00 2024/11/23-07:05:32.551179 140024743433792 DEBG dcompact_worker.cpp:1033: End SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21563/att-00 2024/11/23-07:05:32.552336 140024743433792 TRAC dcompact_worker.cpp:1083: INFO_LOG_LEVEL: rpc = INFO_LEVEL, env_var = undefined 2024/11/23-07:05:32.552619 140024743433792 [WARN] [column_family.cc:386] multiple cf_paths/db_paths and level_compaction_dynamic_level_bytes can't be used together 2024/11/23-07:05:32.600007 140024743433792 [version_set.cc:6208] Recovering from manifest file: /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-21563/att-00/MANIFEST-206347 2024/11/23-07:05:32.633045 140024743433792 [version_set.cc:6251] Recovered from manifest file:/worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-21563/att-00/MANIFEST-206347 succeeded,manifest_file_number is 206347, next_file_number is 249806, last_sequence is 3851228676, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 249596 2024/11/23-07:05:32.633053 140024743433792 [version_set.cc:6266] Column family [default] (ID 0), log number is 0 2024/11/23-07:05:32.633151 140024743433792 [version_set.cc:5721] Creating manifest 249806 2024/11/23-07:05:32.664537 140024743433792 DEBG dcompact_worker.cpp:1218: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21563/att-00: bottommost_level: fake = 1, rpc = 0 2024/11/23-07:05:32.682832 140024743433792 [compaction_job.cc:2437] [default] [JOB 21563] Compacting 1@2 + 15@3 files to L3, score 1.00, subcompactions 1 : 1 2024/11/23-07:05:32.682851 140024743433792 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 16161 Base level 2, inputs: [249749(26MB)], [249803(33MB) 249804(7447KB) 249693(7366KB) 249654(35MB) 249655(35MB) 249656(35MB) 249694(34MB) 249695(36MB) 249696(35MB) 249697(35MB) 249698(36MB) 249699(34MB) 249700(34MB) 249701(33MB) 249779(35MB)] 2024/11/23-07:05:32.690103 140024743433792 [top_zip_table.cc:59] core git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-07:05:32.690136 140024743433792 [top_zip_table.cc:60] fsa git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-07:05:32.690157 140024743433792 [top_zip_table.cc:61] zbs git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-07:05:32.690162 140024743433792 [top_zip_table.cc:62] topling-zip_table_reader: git_version_hash_info_is: commit a4a382006cb82713acf5b3425835f22711877681 Author: leipeng Date: 2024-04-11 19:44:14 +0800 fixed_len_hole_index.cc: Add env bool FixedLenHoleIndexUseAVX512 for ut & debug 1. FixedLenHoleIndexUseAVX512 is only in unit tests or debug 2. In release mode, use avx512 by compile options(-march=) g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/23-07:05:32.690173 140024743433792 [top_zip_table.cc:64] topling-rocks git_version_hash_info_is: commit feab587e468621ba0204d47b4ffacc52e7c4290d Author: leipeng Date: 2024-03-22 13:35:06 +0800 ToplingZipTableBuilder::Add: immediately return after error This function returns void, and caller does not check builder->status() after calling this function and graceful abandon. So immediately return after error, and return error status in Finish(). g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/23-07:05:33.151429 140024743433792 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21563/att-00/249807.sst) /dev/shm/ToplingTemp/Topling-442727-CxnFB8 2024/11/23-07:05:33.702527 140024743433792 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21563/att-00/249807.sst): first pass time = 0.55's, 243.567'MB/sec 2024/11/23-07:05:35.216020 140024743433792 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21563/att-00/249807.sst): old prealloc_size = 147639500, real_size = 30988544 2024/11/23-07:05:35.216609 140024743433792 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21563/att-00/249807.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 928968 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1082 GB zip-val = 0.0290 GB avg-val = 116.48 avg-zval = 31.19 2024/11/23-07:05:35.217396 140024743433792 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21563/att-00/249807.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-07:05:36.259423 140024743433792 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21563/att-00/249807.sst): second pass time = 1.51's, 71.535'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.04's, 33.633'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3125.316'MB/sec (index lex order gen) rebuild zvType time = 0.91's, 0.255'MB/sec write SST data time = 0.13's, 268.011'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 34263.577'MB/sec zip my value time = 1.51's, unzip length = 0.108'GB zip my value throughput = 71.535'MB/sec zip pipeline throughput = 71.535'MB/sec entries = 928968 avg-key = 28.00 avg-zkey = 1.92 avg-val = 116.48 avg-zval = 31.19 usrkeys = 928968 avg-key = 20.00 avg-zkey = 1.92 avg-val = 123.48 avg-zval = 31.19 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 928968 bytes = 3251408 } seq expand size = 6502776 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0290 GB dict = 1.08 MB all = 0.0351 GB } UnZip/Zip{ index = 10.4437 value = 3.7342 dict = 1.00 all = 3.8246 } Zip/UnZip{ index = 0.0958 value = 0.2678 dict = 1.00 all = 0.2615 } ---------------------------- total value len = 0.114709 GB avg = 0.123 KB (by entry num) total key len = 0.026011 GB avg = 0.028 KB total ukey len = 0.018579 GB avg = 0.020 KB total ukey num = 0.000928968 Billion total entry num = 0.000928968 Billion write speed all = 0.001759157 MB/sec (with seq num) write speed all = 0.001666252 MB/sec (without seq num) 2024/11/23-07:05:36.294167 140024743433792 [compaction_job.cc:1948] [default] [JOB 21563] Generated table #249807: 928968 keys, 35093058 bytes, temperature: kWarm 2024/11/23-07:05:36.294259 140024743433792 EVENT_LOG_v1 {"time_micros": 1732316736294200, "cf_name": "default", "job": 21563, "event": "table_file_creation", "file_number": 249807, "file_size": 35093058, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3586972665, "largest_seqno": 3850859894, "table_properties": {"data_size": 28977136, "index_size": 1779008, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26011104, "raw_average_key_size": 28, "raw_value_size": 108206656, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 928968, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732316733, "oldest_key_time": 0, "file_creation_time": 1732316733, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 249807, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-07:05:36.330340 140024743433792 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21563/att-00/249808.sst) /dev/shm/ToplingTemp/Topling-442727-0V4Hq7 2024/11/23-07:05:37.444191 140024743433792 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21563/att-00/249808.sst): first pass time = 1.11's, 120.503'MB/sec 2024/11/23-07:05:38.946758 140024743433792 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21563/att-00/249808.sst): old prealloc_size = 147639500, real_size = 32335088 2024/11/23-07:05:38.947467 140024743433792 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21563/att-00/249808.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 928727 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1082 GB zip-val = 0.0303 GB avg-val = 116.52 avg-zval = 32.65 2024/11/23-07:05:38.948310 140024743433792 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21563/att-00/249808.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-07:05:39.905992 140024743433792 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21563/att-00/249808.sst): second pass time = 1.50's, 72.068'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.96's, 38.109'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2627.027'MB/sec (index lex order gen) rebuild zvType time = 0.80's, 0.289'MB/sec write SST data time = 0.15's, 235.886'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 35001.945'MB/sec zip my value time = 1.50's, unzip length = 0.108'GB zip my value throughput = 72.068'MB/sec zip pipeline throughput = 72.068'MB/sec entries = 928727 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.52 avg-zval = 32.65 usrkeys = 928727 avg-key = 20.00 avg-zkey = 1.91 avg-val = 123.52 avg-zval = 32.65 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 928727 bytes = 3366656 } seq expand size = 6501089 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0303 GB dict = 1.08 MB all = 0.0366 GB } UnZip/Zip{ index = 10.4455 value = 3.5685 dict = 1.00 all = 3.6716 } Zip/UnZip{ index = 0.0957 value = 0.2802 dict = 1.00 all = 0.2724 } ---------------------------- total value len = 0.229424 GB avg = 0.123 KB (by entry num) total key len = 0.052015 GB avg = 0.028 KB total ukey len = 0.037154 GB avg = 0.020 KB total ukey num = 0.001857695 Billion total entry num = 0.001857695 Billion write speed all = 0.003518133 MB/sec (with seq num) write speed all = 0.003332356 MB/sec (without seq num) 2024/11/23-07:05:39.940978 140024743433792 [compaction_job.cc:1948] [default] [JOB 21563] Generated table #249808: 928727 keys, 36555352 bytes, temperature: kWarm 2024/11/23-07:05:39.941047 140024743433792 EVENT_LOG_v1 {"time_micros": 1732316739941005, "cf_name": "default", "job": 21563, "event": "table_file_creation", "file_number": 249808, "file_size": 36555352, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3376774746, "largest_seqno": 3850857912, "table_properties": {"data_size": 30324512, "index_size": 1778240, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26004356, "raw_average_key_size": 28, "raw_value_size": 108213402, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 928727, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732316736, "oldest_key_time": 0, "file_creation_time": 1732316736, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 249808, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-07:05:39.974772 140024743433792 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21563/att-00/249809.sst) /dev/shm/ToplingTemp/Topling-442727-z92hOa 2024/11/23-07:05:40.793042 140024743433792 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21563/att-00/249809.sst): first pass time = 0.82's, 164.035'MB/sec 2024/11/23-07:05:42.291820 140024743433792 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21563/att-00/249809.sst): old prealloc_size = 147639500, real_size = 30926288 2024/11/23-07:05:42.292476 140024743433792 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21563/att-00/249809.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 928717 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0289 GB avg-val = 116.52 avg-zval = 31.15 2024/11/23-07:05:42.293294 140024743433792 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21563/att-00/249809.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-07:05:43.285978 140024743433792 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21563/att-00/249809.sst): second pass time = 1.50's, 72.239'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.99's, 35.353'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2788.824'MB/sec (index lex order gen) rebuild zvType time = 0.83's, 0.278'MB/sec write SST data time = 0.16's, 221.339'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 38107.856'MB/sec zip my value time = 1.50's, unzip length = 0.108'GB zip my value throughput = 72.239'MB/sec zip pipeline throughput = 72.239'MB/sec entries = 928717 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.52 avg-zval = 31.15 usrkeys = 928717 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.52 avg-zval = 31.15 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 928717 bytes = 3366608 } seq expand size = 6501019 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0289 GB dict = 1.08 MB all = 0.0351 GB } UnZip/Zip{ index = 10.5131 value = 3.7409 dict = 1.00 all = 3.8188 } Zip/UnZip{ index = 0.0951 value = 0.2673 dict = 1.00 all = 0.2619 } ---------------------------- total value len = 0.344139 GB avg = 0.124 KB (by entry num) total key len = 0.078020 GB avg = 0.028 KB total ukey len = 0.055728 GB avg = 0.020 KB total ukey num = 0.002786412 Billion total entry num = 0.002786412 Billion write speed all = 0.005276964 MB/sec (with seq num) write speed all = 0.004998324 MB/sec (without seq num) 2024/11/23-07:05:43.323635 140024743433792 [compaction_job.cc:1948] [default] [JOB 21563] Generated table #249809: 928717 keys, 35146324 bytes, temperature: kWarm 2024/11/23-07:05:43.323693 140024743433792 EVENT_LOG_v1 {"time_micros": 1732316743323662, "cf_name": "default", "job": 21563, "event": "table_file_creation", "file_number": 249809, "file_size": 35146324, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3563652023, "largest_seqno": 3850860052, "table_properties": {"data_size": 28927168, "index_size": 1766784, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26004076, "raw_average_key_size": 28, "raw_value_size": 108213670, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 928717, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732316739, "oldest_key_time": 0, "file_creation_time": 1732316739, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 249809, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-07:05:43.365849 140024743433792 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21563/att-00/249810.sst) /dev/shm/ToplingTemp/Topling-442727-4O9ro7 2024/11/23-07:05:44.360809 140024743433792 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21563/att-00/249810.sst): first pass time = 0.99's, 134.903'MB/sec 2024/11/23-07:05:45.738134 140024743433792 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21563/att-00/249810.sst): old prealloc_size = 147639500, real_size = 34167488 2024/11/23-07:05:45.738713 140024743433792 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21563/att-00/249810.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 928274 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0322 GB avg-val = 116.59 avg-zval = 34.65 2024/11/23-07:05:45.739533 140024743433792 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21563/att-00/249810.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-07:05:46.668068 140024743433792 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21563/att-00/249810.sst): second pass time = 1.36's, 79.336'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.93's, 41.279'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3160.887'MB/sec (index lex order gen) rebuild zvType time = 0.80's, 0.290'MB/sec write SST data time = 0.13's, 295.512'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 36559.781'MB/sec zip my value time = 1.36's, unzip length = 0.108'GB zip my value throughput = 79.336'MB/sec zip pipeline throughput = 79.336'MB/sec entries = 928274 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.59 avg-zval = 34.65 usrkeys = 928274 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.59 avg-zval = 34.65 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 928274 bytes = 3365008 } seq expand size = 6497918 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0322 GB dict = 1.08 MB all = 0.0384 GB } UnZip/Zip{ index = 10.5126 value = 3.3643 dict = 1.00 all = 3.4965 } Zip/UnZip{ index = 0.0951 value = 0.2972 dict = 1.00 all = 0.2860 } ---------------------------- total value len = 0.458863 GB avg = 0.124 KB (by entry num) total key len = 0.104011 GB avg = 0.028 KB total ukey len = 0.074294 GB avg = 0.020 KB total ukey num = 0.003714686 Billion total entry num = 0.003714686 Billion write speed all = 0.007035609 MB/sec (with seq num) write speed all = 0.006664157 MB/sec (without seq num) 2024/11/23-07:05:46.721616 140024743433792 [compaction_job.cc:1948] [default] [JOB 21563] Generated table #249810: 928274 keys, 38385976 bytes, temperature: kWarm 2024/11/23-07:05:46.721679 140024743433792 EVENT_LOG_v1 {"time_micros": 1732316746721648, "cf_name": "default", "job": 21563, "event": "table_file_creation", "file_number": 249810, "file_size": 38385976, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3568308837, "largest_seqno": 3850859634, "table_properties": {"data_size": 32169200, "index_size": 1766016, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25991672, "raw_average_key_size": 28, "raw_value_size": 108226092, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 928274, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732316743, "oldest_key_time": 0, "file_creation_time": 1732316743, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 249810, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-07:05:46.756932 140024743433792 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21563/att-00/249811.sst) /dev/shm/ToplingTemp/Topling-442727-ZDbiE8 2024/11/23-07:05:47.529969 140024743433792 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21563/att-00/249811.sst): first pass time = 0.77's, 173.633'MB/sec 2024/11/23-07:05:48.924956 140024743433792 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21563/att-00/249811.sst): old prealloc_size = 147639500, real_size = 34310864 2024/11/23-07:05:48.925519 140024743433792 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21563/att-00/249811.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 932642 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1081 GB zip-val = 0.0323 GB avg-val = 115.91 avg-zval = 34.62 2024/11/23-07:05:48.925996 140024743433792 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21563/att-00/249811.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-07:05:49.746475 140024743433792 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21563/att-00/249811.sst): second pass time = 1.39's, 77.530'MB/sec, value only(80.5% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.82's, 44.943'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3297.411'MB/sec (index lex order gen) rebuild zvType time = 0.69's, 0.338'MB/sec write SST data time = 0.13's, 281.494'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 33830.347'MB/sec zip my value time = 1.39's, unzip length = 0.108'GB zip my value throughput = 77.530'MB/sec zip pipeline throughput = 77.530'MB/sec entries = 932642 avg-key = 28.00 avg-zkey = 1.91 avg-val = 115.91 avg-zval = 34.62 usrkeys = 932642 avg-key = 20.00 avg-zkey = 1.91 avg-val = 119.63 avg-zval = 34.62 TagRS{ kinds = RS_Key0_TagN bytes = 145840 } TagArray{ size = 495428 bytes = 1610160 } seq expand size = 3467996 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0187 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0323 GB dict = 1.08 MB all = 0.0369 GB } UnZip/Zip{ index = 10.4451 value = 3.3477 dict = 1.00 all = 3.6352 } Zip/UnZip{ index = 0.0957 value = 0.2987 dict = 1.00 all = 0.2751 } ---------------------------- total value len = 0.570434 GB avg = 0.123 KB (by entry num) total key len = 0.130125 GB avg = 0.028 KB total ukey len = 0.092947 GB avg = 0.020 KB total ukey num = 0.004647328 Billion total entry num = 0.004647328 Billion write speed all = 0.008756268 MB/sec (with seq num) write speed all = 0.008291573 MB/sec (without seq num) 2024/11/23-07:05:49.788956 140024743433792 [compaction_job.cc:1948] [default] [JOB 21563] Generated table #249811: 932642 keys, 36921283 bytes, temperature: kWarm 2024/11/23-07:05:49.789021 140024743433792 EVENT_LOG_v1 {"time_micros": 1732316749788987, "cf_name": "default", "job": 21563, "event": "table_file_creation", "file_number": 249811, "file_size": 36921283, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3850860130, "table_properties": {"data_size": 32291712, "index_size": 1785792, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26113976, "raw_average_key_size": 28, "raw_value_size": 108103836, "raw_average_value_size": 115, "num_data_blocks": 1, "num_entries": 932642, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732316746, "oldest_key_time": 0, "file_creation_time": 1732316746, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 249811, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-07:05:49.824884 140024743433792 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21563/att-00/249812.sst) /dev/shm/ToplingTemp/Topling-442727-F0ZKd7 2024/11/23-07:05:50.763183 140024743433792 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21563/att-00/249812.sst): first pass time = 0.94's, 143.050'MB/sec 2024/11/23-07:05:52.157902 140024743433792 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21563/att-00/249812.sst): old prealloc_size = 147639500, real_size = 35449856 2024/11/23-07:05:52.158529 140024743433792 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21563/att-00/249812.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 1080437 prefix = 4 raw-key = 0.0173 GB zip-key = 0.0021 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1040 GB zip-val = 0.0331 GB avg-val = 96.23 avg-zval = 30.65 2024/11/23-07:05:52.158752 140024743433792 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21563/att-00/249812.sst: sumWaitingMem = 0.003 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0028 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-07:05:52.804440 140024743433792 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21563/att-00/249812.sst): second pass time = 1.39's, 74.578'MB/sec, value only(77.5% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.65's, 56.959'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3414.577'MB/sec (index lex order gen) rebuild zvType time = 0.50's, 0.536'MB/sec write SST data time = 0.14's, 259.629'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.029'MB, throughput = 34053.695'MB/sec zip my value time = 1.39's, unzip length = 0.104'GB zip my value throughput = 74.578'MB/sec zip pipeline throughput = 74.578'MB/sec entries = 1080437 avg-key = 28.00 avg-zkey = 1.91 avg-val = 96.23 avg-zval = 30.65 usrkeys = 1080437 avg-key = 20.00 avg-zkey = 1.91 avg-val = 97.06 avg-zval = 30.65 TagRS{ kinds = RS_Key0_TagN bytes = 168920 } TagArray{ size = 129248 bytes = 436224 } seq expand size = 904736 multi value expand size = 0 cnt WriteAppend = 18 UnZipSize{ index = 0.0216 GB value = 0.1040 GB dict = 1.03 MB all = 0.1342 GB } __ZipSize{ index = 0.0021 GB value = 0.0331 GB dict = 1.03 MB all = 0.0368 GB } UnZip/Zip{ index = 10.4464 value = 3.1399 dict = 1.00 all = 3.6447 } Zip/UnZip{ index = 0.0957 value = 0.3185 dict = 1.00 all = 0.2744 } ---------------------------- total value len = 0.675305 GB avg = 0.118 KB (by entry num) total key len = 0.160377 GB avg = 0.028 KB total ukey len = 0.114555 GB avg = 0.020 KB total ukey num = 0.005727765 Billion total entry num = 0.005727765 Billion write speed all = 0.010444760 MB/sec (with seq num) write speed all = 0.009872053 MB/sec (without seq num) 2024/11/23-07:05:52.843489 140024743433792 [compaction_job.cc:1948] [default] [JOB 21563] Generated table #249812: 1080437 keys, 36825290 bytes, temperature: kWarm 2024/11/23-07:05:52.843553 140024743433792 EVENT_LOG_v1 {"time_micros": 1732316752843521, "cf_name": "default", "job": 21563, "event": "table_file_creation", "file_number": 249812, "file_size": 36825290, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3406260362, "table_properties": {"data_size": 33111024, "index_size": 2068544, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 30252236, "raw_average_key_size": 28, "raw_value_size": 103965603, "raw_average_value_size": 96, "num_data_blocks": 1, "num_entries": 1080437, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732316749, "oldest_key_time": 0, "file_creation_time": 1732316749, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 249812, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-07:05:52.893994 140024743433792 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21563/att-00/249813.sst) /dev/shm/ToplingTemp/Topling-442727-kgAwj7 2024/11/23-07:05:53.782132 140024743433792 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21563/att-00/249813.sst): first pass time = 0.89's, 151.130'MB/sec 2024/11/23-07:05:55.117143 140024743433792 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21563/att-00/249813.sst): old prealloc_size = 147639500, real_size = 32171920 2024/11/23-07:05:55.117687 140024743433792 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21563/att-00/249813.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927906 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0302 GB avg-val = 116.65 avg-zval = 32.52 2024/11/23-07:05:55.118489 140024743433792 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21563/att-00/249813.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-07:05:56.010738 140024743433792 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21563/att-00/249813.sst): second pass time = 1.33's, 81.117'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.89's, 40.723'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3371.168'MB/sec (index lex order gen) rebuild zvType time = 0.76's, 0.304'MB/sec write SST data time = 0.13's, 277.527'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 36885.276'MB/sec zip my value time = 1.33's, unzip length = 0.108'GB zip my value throughput = 81.117'MB/sec zip pipeline throughput = 81.117'MB/sec entries = 927906 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.65 avg-zval = 32.52 usrkeys = 927906 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.65 avg-zval = 32.52 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 927906 bytes = 3363680 } seq expand size = 6495342 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0302 GB dict = 1.08 MB all = 0.0364 GB } UnZip/Zip{ index = 10.5127 value = 3.5870 dict = 1.00 all = 3.6884 } Zip/UnZip{ index = 0.0951 value = 0.2788 dict = 1.00 all = 0.2711 } ---------------------------- total value len = 0.790037 GB avg = 0.119 KB (by entry num) total key len = 0.186359 GB avg = 0.028 KB total ukey len = 0.133113 GB avg = 0.020 KB total ukey num = 0.006655671 Billion total entry num = 0.006655671 Billion write speed all = 0.012202972 MB/sec (with seq num) write speed all = 0.011537512 MB/sec (without seq num) 2024/11/23-07:05:56.046690 140024743433792 [compaction_job.cc:1948] [default] [JOB 21563] Generated table #249813: 927906 keys, 36389420 bytes, temperature: kWarm 2024/11/23-07:05:56.046753 140024743433792 EVENT_LOG_v1 {"time_micros": 1732316756046721, "cf_name": "default", "job": 21563, "event": "table_file_creation", "file_number": 249813, "file_size": 36389420, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3406260363, "largest_seqno": 3850860164, "table_properties": {"data_size": 30174464, "index_size": 1765312, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25981368, "raw_average_key_size": 28, "raw_value_size": 108236436, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927906, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732316752, "oldest_key_time": 0, "file_creation_time": 1732316752, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 249813, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-07:05:56.084485 140024743433792 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21563/att-00/249814.sst) /dev/shm/ToplingTemp/Topling-442727-ae5ZD7 2024/11/23-07:05:57.007799 140024743433792 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21563/att-00/249814.sst): first pass time = 0.92's, 145.371'MB/sec 2024/11/23-07:05:58.342347 140024743433792 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21563/att-00/249814.sst): old prealloc_size = 147639500, real_size = 32331184 2024/11/23-07:05:58.342896 140024743433792 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21563/att-00/249814.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 934481 prefix = 4 raw-key = 0.0150 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1081 GB zip-val = 0.0303 GB avg-val = 115.63 avg-zval = 32.44 2024/11/23-07:05:58.343637 140024743433792 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21563/att-00/249814.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-07:05:59.291500 140024743433792 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21563/att-00/249814.sst): second pass time = 1.33's, 81.036'MB/sec, value only(80.5% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.95's, 38.160'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3366.113'MB/sec (index lex order gen) rebuild zvType time = 0.82's, 0.285'MB/sec write SST data time = 0.13's, 280.276'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 34842.547'MB/sec zip my value time = 1.33's, unzip length = 0.108'GB zip my value throughput = 81.036'MB/sec zip pipeline throughput = 81.036'MB/sec entries = 934481 avg-key = 28.00 avg-zkey = 1.90 avg-val = 115.63 avg-zval = 32.44 usrkeys = 934481 avg-key = 20.00 avg-zkey = 1.90 avg-val = 122.63 avg-zval = 32.44 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 934481 bytes = 3037072 } seq expand size = 6541367 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0187 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0303 GB dict = 1.08 MB all = 0.0362 GB } UnZip/Zip{ index = 10.5106 value = 3.5638 dict = 1.00 all = 3.7057 } Zip/UnZip{ index = 0.0951 value = 0.2806 dict = 1.00 all = 0.2699 } ---------------------------- total value len = 0.904630 GB avg = 0.119 KB (by entry num) total key len = 0.212524 GB avg = 0.028 KB total ukey len = 0.151803 GB avg = 0.020 KB total ukey num = 0.007590152 Billion total entry num = 0.007590152 Billion write speed all = 0.013961604 MB/sec (with seq num) write speed all = 0.013202743 MB/sec (without seq num) 2024/11/23-07:05:59.326713 140024743433792 [compaction_job.cc:1948] [default] [JOB 21563] Generated table #249814: 934481 keys, 36218902 bytes, temperature: kWarm 2024/11/23-07:05:59.326774 140024743433792 EVENT_LOG_v1 {"time_micros": 1732316759326741, "cf_name": "default", "job": 21563, "event": "table_file_creation", "file_number": 249814, "file_size": 36218902, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3790605499, "largest_seqno": 3850859936, "table_properties": {"data_size": 30319200, "index_size": 1778176, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26165468, "raw_average_key_size": 28, "raw_value_size": 108052262, "raw_average_value_size": 115, "num_data_blocks": 1, "num_entries": 934481, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732316756, "oldest_key_time": 0, "file_creation_time": 1732316756, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 249814, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-07:05:59.364473 140024743433792 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21563/att-00/249815.sst) /dev/shm/ToplingTemp/Topling-442727-ki11C7 2024/11/23-07:06:00.191800 140024743433792 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21563/att-00/249815.sst): first pass time = 0.83's, 162.238'MB/sec 2024/11/23-07:06:01.514154 140024743433792 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21563/att-00/249815.sst): old prealloc_size = 147639500, real_size = 33099856 2024/11/23-07:06:01.514666 140024743433792 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21563/att-00/249815.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 928979 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0311 GB avg-val = 116.48 avg-zval = 33.48 2024/11/23-07:06:01.516085 140024743433792 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21563/att-00/249815.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-07:06:02.430739 140024743433792 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21563/att-00/249815.sst): second pass time = 1.32's, 81.870'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.92's, 40.844'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3602.059'MB/sec (index lex order gen) rebuild zvType time = 0.78's, 0.296'MB/sec write SST data time = 0.13's, 283.521'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 32384.978'MB/sec zip my value time = 1.32's, unzip length = 0.108'GB zip my value throughput = 81.870'MB/sec zip pipeline throughput = 81.870'MB/sec entries = 928979 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.48 avg-zval = 33.48 usrkeys = 928979 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.48 avg-zval = 33.48 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 928979 bytes = 3483680 } seq expand size = 6502853 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0311 GB dict = 1.08 MB all = 0.0374 GB } UnZip/Zip{ index = 10.5130 value = 3.4793 dict = 1.00 all = 3.5852 } Zip/UnZip{ index = 0.0951 value = 0.2874 dict = 1.00 all = 0.2789 } ---------------------------- total value len = 1.019339 GB avg = 0.120 KB (by entry num) total key len = 0.238536 GB avg = 0.028 KB total ukey len = 0.170383 GB avg = 0.020 KB total ukey num = 0.008519131 Billion total entry num = 0.008519131 Billion write speed all = 0.015719640 MB/sec (with seq num) write speed all = 0.014867933 MB/sec (without seq num) 2024/11/23-07:06:02.482895 140024743433792 [compaction_job.cc:1948] [default] [JOB 21563] Generated table #249815: 928979 keys, 37436754 bytes, temperature: kWarm 2024/11/23-07:06:02.482960 140024743433792 EVENT_LOG_v1 {"time_micros": 1732316762482927, "cf_name": "default", "job": 21563, "event": "table_file_creation", "file_number": 249815, "file_size": 37436754, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3273701103, "largest_seqno": 3850859949, "table_properties": {"data_size": 31100160, "index_size": 1767296, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26011412, "raw_average_key_size": 28, "raw_value_size": 108206394, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 928979, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732316759, "oldest_key_time": 0, "file_creation_time": 1732316759, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 249815, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-07:06:02.520088 140024743433792 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21563/att-00/249816.sst) /dev/shm/ToplingTemp/Topling-442727-JjRI47 2024/11/23-07:06:03.391467 140024743433792 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21563/att-00/249816.sst): first pass time = 0.87's, 154.037'MB/sec 2024/11/23-07:06:04.757076 140024743433792 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21563/att-00/249816.sst): old prealloc_size = 147639500, real_size = 32990960 2024/11/23-07:06:04.757615 140024743433792 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21563/att-00/249816.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 924447 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0310 GB avg-val = 117.19 avg-zval = 33.53 2024/11/23-07:06:04.760203 140024743433792 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21563/att-00/249816.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-07:06:05.678756 140024743433792 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21563/att-00/249816.sst): second pass time = 1.36's, 79.374'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.92's, 40.360'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3458.307'MB/sec (index lex order gen) rebuild zvType time = 0.79's, 0.293'MB/sec write SST data time = 0.13's, 282.259'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 33278.759'MB/sec zip my value time = 1.36's, unzip length = 0.108'GB zip my value throughput = 79.374'MB/sec zip pipeline throughput = 79.374'MB/sec entries = 924447 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.19 avg-zval = 33.53 usrkeys = 924447 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.19 avg-zval = 33.53 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 924447 bytes = 3351136 } seq expand size = 6471129 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0310 GB dict = 1.08 MB all = 0.0372 GB } UnZip/Zip{ index = 10.5116 value = 3.4945 dict = 1.00 all = 3.6082 } Zip/UnZip{ index = 0.0951 value = 0.2862 dict = 1.00 all = 0.2771 } ---------------------------- total value len = 1.134144 GB avg = 0.120 KB (by entry num) total key len = 0.264420 GB avg = 0.028 KB total ukey len = 0.188872 GB avg = 0.020 KB total ukey num = 0.009443578 Billion total entry num = 0.009443578 Billion write speed all = 0.017477116 MB/sec (with seq num) write speed all = 0.016533025 MB/sec (without seq num) 2024/11/23-07:06:05.714383 140024743433792 [compaction_job.cc:1948] [default] [JOB 21563] Generated table #249816: 924447 keys, 37198176 bytes, temperature: kWarm 2024/11/23-07:06:05.714444 140024743433792 EVENT_LOG_v1 {"time_micros": 1732316765714413, "cf_name": "default", "job": 21563, "event": "table_file_creation", "file_number": 249816, "file_size": 37198176, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3369194706, "largest_seqno": 3850859976, "table_properties": {"data_size": 31000736, "index_size": 1758912, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25884516, "raw_average_key_size": 28, "raw_value_size": 108333218, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 924447, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732316762, "oldest_key_time": 0, "file_creation_time": 1732316762, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 249816, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-07:06:05.749597 140024743433792 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21563/att-00/249817.sst) /dev/shm/ToplingTemp/Topling-442727-zRYr06 2024/11/23-07:06:06.647904 140024743433792 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21563/att-00/249817.sst): first pass time = 0.90's, 149.418'MB/sec 2024/11/23-07:06:07.996399 140024743433792 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21563/att-00/249817.sst): old prealloc_size = 147639500, real_size = 33058560 2024/11/23-07:06:07.996947 140024743433792 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21563/att-00/249817.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927524 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0311 GB avg-val = 116.71 avg-zval = 33.49 2024/11/23-07:06:07.999553 140024743433792 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21563/att-00/249817.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-07:06:08.961655 140024743433792 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21563/att-00/249817.sst): second pass time = 1.35's, 80.342'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.97's, 38.617'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3342.935'MB/sec (index lex order gen) rebuild zvType time = 0.83's, 0.279'MB/sec write SST data time = 0.13's, 280.013'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 25928.321'MB/sec zip my value time = 1.35's, unzip length = 0.108'GB zip my value throughput = 80.342'MB/sec zip pipeline throughput = 80.342'MB/sec entries = 927524 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.71 avg-zval = 33.49 usrkeys = 927524 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.71 avg-zval = 33.49 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 927524 bytes = 3362288 } seq expand size = 6492668 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0311 GB dict = 1.08 MB all = 0.0373 GB } UnZip/Zip{ index = 10.5121 value = 3.4849 dict = 1.00 all = 3.6008 } Zip/UnZip{ index = 0.0951 value = 0.2870 dict = 1.00 all = 0.2777 } ---------------------------- total value len = 1.248884 GB avg = 0.120 KB (by entry num) total key len = 0.290391 GB avg = 0.028 KB total ukey len = 0.207422 GB avg = 0.020 KB total ukey num = 0.010371102 Billion total entry num = 0.010371102 Billion write speed all = 0.019234711 MB/sec (with seq num) write speed all = 0.018197936 MB/sec (without seq num) 2024/11/23-07:06:08.999876 140024743433792 [compaction_job.cc:1948] [default] [JOB 21563] Generated table #249817: 927524 keys, 37274890 bytes, temperature: kWarm 2024/11/23-07:06:08.999941 140024743433792 EVENT_LOG_v1 {"time_micros": 1732316768999909, "cf_name": "default", "job": 21563, "event": "table_file_creation", "file_number": 249817, "file_size": 37274890, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3514720078, "largest_seqno": 3850859139, "table_properties": {"data_size": 31061808, "index_size": 1764672, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25970672, "raw_average_key_size": 28, "raw_value_size": 108247068, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927524, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732316765, "oldest_key_time": 0, "file_creation_time": 1732316765, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 249817, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-07:06:09.033923 140024743433792 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21563/att-00/249818.sst) /dev/shm/ToplingTemp/Topling-442727-FeDNPa 2024/11/23-07:06:09.828292 140024743433792 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21563/att-00/249818.sst): first pass time = 0.79's, 168.969'MB/sec 2024/11/23-07:06:11.171792 140024743433792 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21563/att-00/249818.sst): old prealloc_size = 147639500, real_size = 33045264 2024/11/23-07:06:11.172382 140024743433792 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21563/att-00/249818.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 928629 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0310 GB avg-val = 116.53 avg-zval = 33.43 2024/11/23-07:06:11.174854 140024743433792 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21563/att-00/249818.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-07:06:12.142877 140024743433792 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21563/att-00/249818.sst): second pass time = 1.34's, 80.585'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.97's, 38.255'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3116.310'MB/sec (index lex order gen) rebuild zvType time = 0.84's, 0.277'MB/sec write SST data time = 0.13's, 283.769'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 33856.982'MB/sec zip my value time = 1.34's, unzip length = 0.108'GB zip my value throughput = 80.585'MB/sec zip pipeline throughput = 80.585'MB/sec entries = 928629 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.53 avg-zval = 33.43 usrkeys = 928629 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.53 avg-zval = 33.43 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 928629 bytes = 3250224 } seq expand size = 6500403 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0310 GB dict = 1.08 MB all = 0.0371 GB } UnZip/Zip{ index = 10.5125 value = 3.4856 dict = 1.00 all = 3.6130 } Zip/UnZip{ index = 0.0951 value = 0.2869 dict = 1.00 all = 0.2768 } ---------------------------- total value len = 1.363600 GB avg = 0.121 KB (by entry num) total key len = 0.316392 GB avg = 0.028 KB total ukey len = 0.225995 GB avg = 0.020 KB total ukey num = 0.011299731 Billion total entry num = 0.011299731 Billion write speed all = 0.020992285 MB/sec (with seq num) write speed all = 0.019862722 MB/sec (without seq num) 2024/11/23-07:06:12.180192 140024743433792 [compaction_job.cc:1948] [default] [JOB 21563] Generated table #249818: 928629 keys, 37148632 bytes, temperature: kWarm 2024/11/23-07:06:12.180255 140024743433792 EVENT_LOG_v1 {"time_micros": 1732316772180223, "cf_name": "default", "job": 21563, "event": "table_file_creation", "file_number": 249818, "file_size": 37148632, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3610601794, "largest_seqno": 3850859991, "table_properties": {"data_size": 31046208, "index_size": 1766720, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26001612, "raw_average_key_size": 28, "raw_value_size": 108216186, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 928629, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732316769, "oldest_key_time": 0, "file_creation_time": 1732316769, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 249818, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-07:06:12.217453 140024743433792 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21563/att-00/249819.sst) /dev/shm/ToplingTemp/Topling-442727-uM7k0a 2024/11/23-07:06:13.059820 140024743433792 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21563/att-00/249819.sst): first pass time = 0.84's, 159.342'MB/sec 2024/11/23-07:06:14.422169 140024743433792 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21563/att-00/249819.sst): old prealloc_size = 147639500, real_size = 34091392 2024/11/23-07:06:14.422697 140024743433792 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21563/att-00/249819.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 931576 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1081 GB zip-val = 0.0321 GB avg-val = 116.08 avg-zval = 34.44 2024/11/23-07:06:14.425362 140024743433792 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21563/att-00/249819.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-07:06:15.342657 140024743433792 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21563/att-00/249819.sst): second pass time = 1.36's, 79.411'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.92's, 41.630'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3494.481'MB/sec (index lex order gen) rebuild zvType time = 0.79's, 0.296'MB/sec write SST data time = 0.13's, 286.899'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 24978.102'MB/sec zip my value time = 1.36's, unzip length = 0.108'GB zip my value throughput = 79.411'MB/sec zip pipeline throughput = 79.411'MB/sec entries = 931576 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.08 avg-zval = 34.44 usrkeys = 931576 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.08 avg-zval = 34.44 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 931576 bytes = 3376976 } seq expand size = 6521032 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0321 GB dict = 1.08 MB all = 0.0383 GB } UnZip/Zip{ index = 10.5123 value = 3.3701 dict = 1.00 all = 3.5026 } Zip/UnZip{ index = 0.0951 value = 0.2967 dict = 1.00 all = 0.2855 } ---------------------------- total value len = 1.478255 GB avg = 0.121 KB (by entry num) total key len = 0.342477 GB avg = 0.028 KB total ukey len = 0.244626 GB avg = 0.020 KB total ukey num = 0.012231307 Billion total entry num = 0.012231307 Billion write speed all = 0.022749973 MB/sec (with seq num) write speed all = 0.021527335 MB/sec (without seq num) 2024/11/23-07:06:15.382703 140024743433792 [compaction_job.cc:1948] [default] [JOB 21563] Generated table #249819: 931576 keys, 38319226 bytes, temperature: kWarm 2024/11/23-07:06:15.382765 140024743433792 EVENT_LOG_v1 {"time_micros": 1732316775382733, "cf_name": "default", "job": 21563, "event": "table_file_creation", "file_number": 249819, "file_size": 38319226, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3369353416, "largest_seqno": 3850860016, "table_properties": {"data_size": 32085936, "index_size": 1772352, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26084128, "raw_average_key_size": 28, "raw_value_size": 108133708, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 931576, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732316772, "oldest_key_time": 0, "file_creation_time": 1732316772, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 249819, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-07:06:15.424559 140024743433792 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21563/att-00/249820.sst) /dev/shm/ToplingTemp/Topling-442727-lVuq17 2024/11/23-07:06:15.712263 140024743433792 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21563/att-00/249820.sst): first pass time = 0.29's, 251.982'MB/sec 2024/11/23-07:06:16.427295 140024743433792 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21563/att-00/249820.sst): old prealloc_size = 147639500, real_size = 18643488 2024/11/23-07:06:16.427632 140024743433792 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21563/att-00/249820.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 496482 prefix = 4 raw-key = 0.0079 GB zip-key = 0.0010 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.0586 GB zip-val = 0.0176 GB avg-val = 118.00 avg-zval = 35.39 2024/11/23-07:06:16.428088 140024743433792 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21563/att-00/249820.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0012 GB, waited 0.000 sec, Key+Value = 0.072 GB 2024/11/23-07:06:16.954457 140024743433792 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21563/att-00/249820.sst): second pass time = 0.71's, 82.009'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.53's, 39.426'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3055.079'MB/sec (index lex order gen) rebuild zvType time = 0.46's, 0.272'MB/sec write SST data time = 0.07's, 292.674'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.586'MB, throughput = 21007.784'MB/sec zip my value time = 0.71's, unzip length = 0.059'GB zip my value throughput = 82.009'MB/sec zip pipeline throughput = 82.009'MB/sec entries = 496482 avg-key = 28.00 avg-zkey = 1.92 avg-val = 118.00 avg-zval = 35.39 usrkeys = 496482 avg-key = 20.00 avg-zkey = 1.92 avg-val = 125.00 avg-zval = 35.39 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 496482 bytes = 1675648 } seq expand size = 3475374 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0099 GB value = 0.0586 GB dict = 0.59 MB all = 0.0725 GB } __ZipSize{ index = 0.0010 GB value = 0.0176 GB dict = 0.59 MB all = 0.0208 GB } UnZip/Zip{ index = 10.4401 value = 3.3347 dict = 1.00 all = 3.4877 } Zip/UnZip{ index = 0.0958 value = 0.2999 dict = 1.00 all = 0.2867 } ---------------------------- total value len = 1.540315 GB avg = 0.121 KB (by entry num) total key len = 0.356378 GB avg = 0.028 KB total ukey len = 0.254556 GB avg = 0.020 KB total ukey num = 0.012727789 Billion total entry num = 0.012727789 Billion write speed all = 0.023698635 MB/sec (with seq num) write speed all = 0.022426395 MB/sec (without seq num) 2024/11/23-07:06:16.985322 140024743433792 [compaction_job.cc:1948] [default] [JOB 21563] Generated table #249820: 496482 keys, 20783361 bytes, temperature: kWarm 2024/11/23-07:06:16.985384 140024743433792 EVENT_LOG_v1 {"time_micros": 1732316776985353, "cf_name": "default", "job": 21563, "event": "table_file_creation", "file_number": 249820, "file_size": 20783361, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3715418241, "largest_seqno": 3822812317, "table_properties": {"data_size": 17568080, "index_size": 951104, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 13901496, "raw_average_key_size": 28, "raw_value_size": 58584876, "raw_average_value_size": 118, "num_data_blocks": 1, "num_entries": 496482, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 118, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732316775, "oldest_key_time": 0, "file_creation_time": 1732316775, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 249820, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-07:06:17.002911 140024743433792 [compaction_job.cc:703] job-21563: subcompact[0], size: 0.499697 G, files: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21563/att-00 [249807,249808,249809,249810,249811,249812,249813,249814,249815,249816,249817,249818,249819,249820] 2024/11/23-07:06:17.089215 140024743433792 (Original Log Time 2024/11/23-07:05:32.682908) EVENT_LOG_v1 {"time_micros": 1732316732682866, "job": 21563, "event": "compaction_started", "compaction_reason": "FilesMarkedForCompaction", "files_L2": [249749], "files_L3": [249803, 249804, 249693, 249654, 249655, 249656, 249694, 249695, 249696, 249697, 249698, 249699, 249700, 249701, 249779], "score": 0.99991, "input_data_size": 522489792, "oldest_snapshot_seqno": 3851228531} 2024/11/23-07:06:17.089218 140024743433792 (Original Log Time 2024/11/23-07:06:17.088442) [compaction_job.cc:2022] [default] [JOB 21563] Compacted 1@2 + 15@3 files to L3 => 499696644 bytes 2024/11/23-07:06:17.089220 140024743433792 (Original Log Time 2024/11/23-07:06:17.089144) [compaction_job.cc:1224] [default] compacted to: files[0 0 0 14 0 0 0] max score 0.02, MB/sec: 11.8 rd, 11.3 wr, level 3, files in(1, 15) out(14 +0 blob) MB in(26.2, 472.1 +0.0 blob) out(476.5 +0.0 blob), read-write-amplify(37.2) write-amplify(18.2) OK, records in: 12780607, records dropped: 52818 output_compression: Snappy 2024/11/23-07:06:17.089225 140024743433792 (Original Log Time 2024/11/23-07:06:17.089192) EVENT_LOG_v1 {"time_micros": 1732316777089168, "cf": "default", "job": 21563, "event": "compaction_finished", "compaction_time_micros": 44320024, "compaction_time_cpu_micros": 20092672, "output_level": 3, "num_output_files": 14, "total_output_size": 499696644, "num_input_records": 12780607, "num_output_records": 12727789, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "file_write_nanos": 322773432, "file_range_sync_nanos": 0, "file_fsync_nanos": 13577, "file_prepare_write_nanos": 32111, "lsm_state": [0, 0, 0, 14, 0, 0, 0]} 2024/11/23-07:06:17.213459 140024743433792 DEBG dcompact_worker.cpp:240: HttpPost: 200 OK: url = http://nlb-7zny4kaa1poal01o64.cn-shenzhen.nlb.aliyuncs.com:8443, body = {"instanceId":"nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137","labourId":"","dbId":"d89b4006-2803-486e-b7a2-759bcf348921","dbStarts":1732256054,"starts":1732316732,"executesMs":44541,"compactionJobId":21563,"attempt":0,"compactionInputRawBytes":1824817655,"compactionInputZipBytes":522489792,"compactionOutputRawBytes":0,"compactionOutputZipBytes":499696644,"headers":{"Accept":"*/*","Connection":"close","Host":"aliyun-topling-saas.topling.cn:18443","RemoteIp":"120.24.192.169","X-Forwarded-For":"120.24.192.169","region":"cn-shenzhen","token":"e6474c481bd4415abc537135cc03626b","instance-token":"e6474c481bd4415abc537135cc03626b","provider":"aliyun","CloudMarketInstanceId":"si-59c0ae5c955845588903","MeteringAssit":"","Transfer-Encoding":"chunked","traceparent":"00-578a2544a76979a69decb35ae12d50c4-bf672029d6ff00d8-00"}}, response = 2024/11/23-07:06:17.213543 140024743433792 INFO dcompact_worker.cpp:1459: finish /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-21563/att-00: olev 3, work 44.541 s, result 4.884 ms, install 0.802 ms, input{raw 1.699 GiB zip 498.285 MiB}