2024/11/23-16:55:30.812378 139957315876416 DEBG dcompact_worker.cpp:2214: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00: fork to child time = 0.016847 sec 2024/11/23-16:55:30.813459 139957315876416 DEBG dcompact_worker.cpp:1013: Beg SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00 2024/11/23-16:55:30.822553 139957315876416 DEBG dcompact_worker.cpp:1033: End SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00 2024/11/23-16:55:30.823882 139957315876416 TRAC dcompact_worker.cpp:1083: INFO_LOG_LEVEL: rpc = INFO_LEVEL, env_var = undefined 2024/11/23-16:55:30.824231 139957315876416 [WARN] [column_family.cc:386] multiple cf_paths/db_paths and level_compaction_dynamic_level_bytes can't be used together 2024/11/23-16:55:30.883045 139957315876416 [version_set.cc:6208] Recovering from manifest file: /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-31245/att-00/MANIFEST-206347 2024/11/23-16:55:30.921085 139957315876416 [version_set.cc:6251] Recovered from manifest file:/worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-31245/att-00/MANIFEST-206347 succeeded,manifest_file_number is 206347, next_file_number is 270804, last_sequence is 4127262382, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 270746 2024/11/23-16:55:30.921095 139957315876416 [version_set.cc:6266] Column family [default] (ID 0), log number is 0 2024/11/23-16:55:30.921276 139957315876416 [version_set.cc:5721] Creating manifest 270804 2024/11/23-16:55:30.956427 139957315876416 DEBG dcompact_worker.cpp:1218: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00: bottommost_level: fake = 1, rpc = 0 2024/11/23-16:55:30.981135 139957315876416 [compaction_job.cc:2437] [default] [JOB 31245] Compacting 1@2 + 21@3 files to L3, score 1.00, subcompactions 1 : 1 2024/11/23-16:55:30.981172 139957315876416 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 23373 Base level 2, inputs: [270794(27MB)], [270710(37MB) 270749(37MB) 270750(39MB) 270751(37MB) 270752(35MB) 270753(32MB) 270754(33MB) 270755(33MB) 270756(34MB) 270757(38MB) 270758(35MB) 270759(35MB) 270760(33MB) 270761(35MB) 270762(36MB) 270763(36MB) 270764(35MB) 270765(35MB) 270766(36MB) 270767(37MB) 270768(37MB)] 2024/11/23-16:55:30.990178 139957315876416 [top_zip_table.cc:59] core git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-16:55:30.990221 139957315876416 [top_zip_table.cc:60] fsa git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-16:55:30.990249 139957315876416 [top_zip_table.cc:61] zbs git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-16:55:30.990259 139957315876416 [top_zip_table.cc:62] topling-zip_table_reader: git_version_hash_info_is: commit a4a382006cb82713acf5b3425835f22711877681 Author: leipeng Date: 2024-04-11 19:44:14 +0800 fixed_len_hole_index.cc: Add env bool FixedLenHoleIndexUseAVX512 for ut & debug 1. FixedLenHoleIndexUseAVX512 is only in unit tests or debug 2. In release mode, use avx512 by compile options(-march=) g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/23-16:55:30.990273 139957315876416 [top_zip_table.cc:64] topling-rocks git_version_hash_info_is: commit feab587e468621ba0204d47b4ffacc52e7c4290d Author: leipeng Date: 2024-03-22 13:35:06 +0800 ToplingZipTableBuilder::Add: immediately return after error This function returns void, and caller does not check builder->status() after calling this function and graceful abandon. So immediately return after error, and return error status in Finish(). g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/23-16:55:31.579289 139957315876416 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270805.sst) /dev/shm/ToplingTemp/Topling-122846-bYFXzc 2024/11/23-16:55:32.281157 139957315876416 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270805.sst): first pass time = 0.70's, 191.244'MB/sec 2024/11/23-16:55:35.331684 139957315876416 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270805.sst): old prealloc_size = 147639500, real_size = 35541840 2024/11/23-16:55:35.332447 139957315876416 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270805.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 925507 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0335 GB avg-val = 117.02 avg-zval = 36.25 2024/11/23-16:55:35.333294 139957315876416 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270805.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:55:36.494856 139957315876416 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270805.sst): second pass time = 3.05's, 35.513'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.16's, 33.779'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2334.980'MB/sec (index lex order gen) rebuild zvType time = 0.90's, 0.256'MB/sec write SST data time = 0.26's, 152.420'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 36009.926'MB/sec zip my value time = 3.05's, unzip length = 0.108'GB zip my value throughput = 35.513'MB/sec zip pipeline throughput = 95.195'MB/sec entries = 925507 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.02 avg-zval = 36.25 usrkeys = 925507 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.02 avg-zval = 36.25 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 925507 bytes = 2892224 } seq expand size = 6478549 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0335 GB dict = 1.08 MB all = 0.0393 GB } UnZip/Zip{ index = 10.5133 value = 3.2282 dict = 1.00 all = 3.4161 } Zip/UnZip{ index = 0.0951 value = 0.3098 dict = 1.00 all = 0.2927 } ---------------------------- total value len = 8.963402 GB avg = 0.168 KB (by entry num) total key len = 1.466735 GB avg = 0.028 KB total ukey len = 1.016388 GB avg = 0.015 KB total ukey num = 0.066475942 Billion total entry num = 0.053283671 Billion write speed all = 0.361852480 MB/sec (with seq num) write speed all = 0.347063928 MB/sec (without seq num) 2024/11/23-16:55:36.547279 139957315876416 [compaction_job.cc:1948] [default] [JOB 31245] Generated table #270805: 925507 keys, 39289582 bytes, temperature: kWarm 2024/11/23-16:55:36.547411 139957315876416 EVENT_LOG_v1 {"time_micros": 1732352136547321, "cf_name": "default", "job": 31245, "event": "table_file_creation", "file_number": 270805, "file_size": 39289582, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4094024658, "largest_seqno": 4127228310, "table_properties": {"data_size": 33549632, "index_size": 1760640, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25914196, "raw_average_key_size": 28, "raw_value_size": 108303642, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 925507, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732352131, "oldest_key_time": 0, "file_creation_time": 1732352131, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 270805, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:55:36.606248 139957315876416 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270806.sst) /dev/shm/ToplingTemp/Topling-122846-NvgcXc 2024/11/23-16:55:37.589766 139957315876416 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270806.sst): first pass time = 0.98's, 136.477'MB/sec 2024/11/23-16:55:41.333703 139957315876416 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270806.sst): old prealloc_size = 147639500, real_size = 35760592 2024/11/23-16:55:41.334314 139957315876416 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270806.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927627 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0338 GB avg-val = 116.69 avg-zval = 36.40 2024/11/23-16:55:41.335129 139957315876416 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270806.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:55:42.418031 139957315876416 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270806.sst): second pass time = 3.74's, 28.919'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.08's, 36.655'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2987.604'MB/sec (index lex order gen) rebuild zvType time = 0.90's, 0.258'MB/sec write SST data time = 0.19's, 214.047'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 35652.085'MB/sec zip my value time = 3.74's, unzip length = 0.108'GB zip my value throughput = 28.919'MB/sec zip pipeline throughput = 84.590'MB/sec entries = 927627 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.69 avg-zval = 36.40 usrkeys = 927627 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.69 avg-zval = 36.40 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 927627 bytes = 3130752 } seq expand size = 6493389 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0338 GB dict = 1.08 MB all = 0.0397 GB } UnZip/Zip{ index = 10.5148 value = 3.2059 dict = 1.00 all = 3.3770 } Zip/UnZip{ index = 0.0951 value = 0.3119 dict = 1.00 all = 0.2961 } ---------------------------- total value len = 9.078140 GB avg = 0.167 KB (by entry num) total key len = 1.492709 GB avg = 0.028 KB total ukey len = 1.034941 GB avg = 0.015 KB total ukey num = 0.067403569 Billion total entry num = 0.054211298 Billion write speed all = 0.366658826 MB/sec (with seq num) write speed all = 0.351615908 MB/sec (without seq num) 2024/11/23-16:55:42.468194 139957315876416 [compaction_job.cc:1948] [default] [JOB 31245] Generated table #270806: 927627 keys, 39745162 bytes, temperature: kWarm 2024/11/23-16:55:42.468266 139957315876416 EVENT_LOG_v1 {"time_micros": 1732352142468229, "cf_name": "default", "job": 31245, "event": "table_file_creation", "file_number": 270806, "file_size": 39745162, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4051668904, "largest_seqno": 4127228527, "table_properties": {"data_size": 33764096, "index_size": 1764416, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25973556, "raw_average_key_size": 28, "raw_value_size": 108244314, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927627, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732352136, "oldest_key_time": 0, "file_creation_time": 1732352136, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 270806, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:55:42.509025 139957315876416 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270807.sst) /dev/shm/ToplingTemp/Topling-122846-Zuo8De 2024/11/23-16:55:43.626242 139957315876416 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270807.sst): first pass time = 1.12's, 120.141'MB/sec 2024/11/23-16:55:46.716535 139957315876416 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270807.sst): old prealloc_size = 147639500, real_size = 36388288 2024/11/23-16:55:46.717268 139957315876416 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270807.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 930847 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1082 GB zip-val = 0.0344 GB avg-val = 116.19 avg-zval = 36.93 2024/11/23-16:55:46.718175 139957315876416 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270807.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:55:47.991886 139957315876416 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270807.sst): second pass time = 3.09's, 35.011'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.28's, 31.940'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2495.303'MB/sec (index lex order gen) rebuild zvType time = 0.99's, 0.235'MB/sec write SST data time = 0.29's, 142.501'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 28990.562'MB/sec zip my value time = 3.09's, unzip length = 0.108'GB zip my value throughput = 35.011'MB/sec zip pipeline throughput = 94.783'MB/sec entries = 930847 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.19 avg-zval = 36.93 usrkeys = 930847 avg-key = 20.00 avg-zkey = 1.91 avg-val = 123.19 avg-zval = 36.93 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 930847 bytes = 3490688 } seq expand size = 6515929 multi value expand size = 0 cnt WriteAppend = 15 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0344 GB dict = 1.08 MB all = 0.0407 GB } UnZip/Zip{ index = 10.4449 value = 3.1465 dict = 1.00 all = 3.2950 } Zip/UnZip{ index = 0.0957 value = 0.3178 dict = 1.00 all = 0.3035 } ---------------------------- total value len = 9.192810 GB avg = 0.167 KB (by entry num) total key len = 1.518773 GB avg = 0.028 KB total ukey len = 1.053558 GB avg = 0.015 KB total ukey num = 0.068334416 Billion total entry num = 0.055142145 Billion write speed all = 0.371468475 MB/sec (with seq num) write speed all = 0.356170217 MB/sec (without seq num) 2024/11/23-16:55:48.044252 139957315876416 [compaction_job.cc:1948] [default] [JOB 31245] Generated table #270807: 930847 keys, 40733954 bytes, temperature: kWarm 2024/11/23-16:55:48.044340 139957315876416 EVENT_LOG_v1 {"time_micros": 1732352148044288, "cf_name": "default", "job": 31245, "event": "table_file_creation", "file_number": 270807, "file_size": 40733954, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3583362754, "largest_seqno": 4127228258, "table_properties": {"data_size": 34372976, "index_size": 1782400, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26063716, "raw_average_key_size": 28, "raw_value_size": 108154022, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 930847, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732352142, "oldest_key_time": 0, "file_creation_time": 1732352142, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 270807, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:55:48.112653 139957315876416 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270808.sst) /dev/shm/ToplingTemp/Topling-122846-TkfyOg 2024/11/23-16:55:49.222593 139957315876416 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270808.sst): first pass time = 1.11's, 120.928'MB/sec 2024/11/23-16:55:50.889747 139957315876416 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270808.sst): old prealloc_size = 147639500, real_size = 36528768 2024/11/23-16:55:50.890315 139957315876416 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270808.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 931923 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1081 GB zip-val = 0.0345 GB avg-val = 116.02 avg-zval = 37.03 2024/11/23-16:55:50.890911 139957315876416 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270808.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:55:52.015273 139957315876416 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270808.sst): second pass time = 1.67's, 64.914'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.13's, 35.230'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3311.785'MB/sec (index lex order gen) rebuild zvType time = 0.91's, 0.256'MB/sec write SST data time = 0.21's, 184.604'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 37616.445'MB/sec zip my value time = 1.67's, unzip length = 0.108'GB zip my value throughput = 64.914'MB/sec zip pipeline throughput = 85.091'MB/sec entries = 931923 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.02 avg-zval = 37.03 usrkeys = 931923 avg-key = 20.00 avg-zkey = 1.91 avg-val = 120.42 avg-zval = 37.03 TagRS{ kinds = RS_Key0_TagN bytes = 145720 } TagArray{ size = 585738 bytes = 2123312 } seq expand size = 4100166 multi value expand size = 0 cnt WriteAppend = 17 UnZipSize{ index = 0.0186 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0345 GB dict = 1.08 MB all = 0.0397 GB } UnZip/Zip{ index = 10.4457 value = 3.1330 dict = 1.00 all = 3.3849 } Zip/UnZip{ index = 0.0957 value = 0.3192 dict = 1.00 all = 0.2954 } ---------------------------- total value len = 9.305034 GB avg = 0.166 KB (by entry num) total key len = 1.544866 GB avg = 0.028 KB total ukey len = 1.072196 GB avg = 0.015 KB total ukey num = 0.069266339 Billion total entry num = 0.056074068 Billion write speed all = 0.376212730 MB/sec (with seq num) write speed all = 0.360658096 MB/sec (without seq num) 2024/11/23-16:55:52.064329 139957315876416 [compaction_job.cc:1948] [default] [JOB 31245] Generated table #270808: 931923 keys, 39652112 bytes, temperature: kWarm 2024/11/23-16:55:52.064395 139957315876416 EVENT_LOG_v1 {"time_micros": 1732352152064362, "cf_name": "default", "job": 31245, "event": "table_file_creation", "file_number": 270808, "file_size": 39652112, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4012776165, "table_properties": {"data_size": 34511280, "index_size": 1784320, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26093844, "raw_average_key_size": 28, "raw_value_size": 108123942, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 931923, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732352148, "oldest_key_time": 0, "file_creation_time": 1732352148, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 270808, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:55:52.104326 139957315876416 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270809.sst) /dev/shm/ToplingTemp/Topling-122846-JQ4rbh 2024/11/23-16:55:53.084763 139957315876416 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270809.sst): first pass time = 0.98's, 136.901'MB/sec 2024/11/23-16:55:54.724382 139957315876416 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270809.sst): old prealloc_size = 147639500, real_size = 35266144 2024/11/23-16:55:54.725019 139957315876416 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270809.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 1081202 prefix = 4 raw-key = 0.0173 GB zip-key = 0.0021 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1039 GB zip-val = 0.0329 GB avg-val = 96.14 avg-zval = 30.45 2024/11/23-16:55:54.725190 139957315876416 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270809.sst: sumWaitingMem = 0.003 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0028 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:55:55.583171 139957315876416 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270809.sst): second pass time = 1.64's, 63.426'MB/sec, value only(77.4% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.86's, 42.296'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3352.680'MB/sec (index lex order gen) rebuild zvType time = 0.60's, 0.450'MB/sec write SST data time = 0.26's, 141.307'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.034'MB, throughput = 27626.646'MB/sec zip my value time = 1.64's, unzip length = 0.104'GB zip my value throughput = 63.426'MB/sec zip pipeline throughput = 63.426'MB/sec entries = 1081202 avg-key = 28.00 avg-zkey = 1.91 avg-val = 96.14 avg-zval = 30.45 usrkeys = 1081202 avg-key = 20.00 avg-zkey = 1.91 avg-val = 96.39 avg-zval = 30.45 TagRS{ kinds = RS_Key0_TagN bytes = 169040 } TagArray{ size = 38984 bytes = 112096 } seq expand size = 272888 multi value expand size = 0 cnt WriteAppend = 17 UnZipSize{ index = 0.0216 GB value = 0.1039 GB dict = 1.03 MB all = 0.1342 GB } __ZipSize{ index = 0.0021 GB value = 0.0329 GB dict = 1.03 MB all = 0.0363 GB } UnZip/Zip{ index = 10.4473 value = 3.1569 dict = 1.00 all = 3.6952 } Zip/UnZip{ index = 0.0957 value = 0.3168 dict = 1.00 all = 0.2706 } ---------------------------- total value len = 9.409251 GB avg = 0.165 KB (by entry num) total key len = 1.575140 GB avg = 0.028 KB total ukey len = 1.093820 GB avg = 0.016 KB total ukey num = 0.070347541 Billion total entry num = 0.057155270 Billion write speed all = 0.380828985 MB/sec (with seq num) write speed all = 0.364976393 MB/sec (without seq num) 2024/11/23-16:55:55.631999 139957315876416 [compaction_job.cc:1948] [default] [JOB 31245] Generated table #270809: 1081202 keys, 36321788 bytes, temperature: kWarm 2024/11/23-16:55:55.632089 139957315876416 EVENT_LOG_v1 {"time_micros": 1732352155632042, "cf_name": "default", "job": 31245, "event": "table_file_creation", "file_number": 270809, "file_size": 36321788, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3281054503, "table_properties": {"data_size": 32925840, "index_size": 2069824, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 30273656, "raw_average_key_size": 28, "raw_value_size": 103944081, "raw_average_value_size": 96, "num_data_blocks": 1, "num_entries": 1081202, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732352152, "oldest_key_time": 0, "file_creation_time": 1732352152, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 270809, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:55:55.682552 139957315876416 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270810.sst) /dev/shm/ToplingTemp/Topling-122846-8y9yKf 2024/11/23-16:55:56.689258 139957315876416 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270810.sst): first pass time = 1.01's, 133.331'MB/sec 2024/11/23-16:55:58.151619 139957315876416 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270810.sst): old prealloc_size = 147639500, real_size = 30572432 2024/11/23-16:55:58.152190 139957315876416 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270810.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 928022 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1082 GB zip-val = 0.0286 GB avg-val = 116.63 avg-zval = 30.78 2024/11/23-16:55:58.153033 139957315876416 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270810.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:55:59.199287 139957315876416 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270810.sst): second pass time = 1.46's, 74.054'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.05's, 33.318'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3244.681'MB/sec (index lex order gen) rebuild zvType time = 0.81's, 0.286'MB/sec write SST data time = 0.24's, 148.448'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 26900.757'MB/sec zip my value time = 1.46's, unzip length = 0.108'GB zip my value throughput = 74.054'MB/sec zip pipeline throughput = 82.563'MB/sec entries = 928022 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.63 avg-zval = 30.78 usrkeys = 928022 avg-key = 20.00 avg-zkey = 1.91 avg-val = 123.63 avg-zval = 30.78 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 928022 bytes = 3480096 } seq expand size = 6496154 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0286 GB dict = 1.08 MB all = 0.0349 GB } UnZip/Zip{ index = 10.4462 value = 3.7892 dict = 1.00 all = 3.8453 } Zip/UnZip{ index = 0.0957 value = 0.2639 dict = 1.00 all = 0.2601 } ---------------------------- total value len = 9.523980 GB avg = 0.164 KB (by entry num) total key len = 1.601125 GB avg = 0.028 KB total ukey len = 1.112381 GB avg = 0.016 KB total ukey num = 0.071275563 Billion total entry num = 0.058083292 Billion write speed all = 0.385659190 MB/sec (with seq num) write speed all = 0.369551221 MB/sec (without seq num) 2024/11/23-16:55:59.243573 139957315876416 [compaction_job.cc:1948] [default] [JOB 31245] Generated table #270810: 928022 keys, 34904368 bytes, temperature: kWarm 2024/11/23-16:55:59.243645 139957315876416 EVENT_LOG_v1 {"time_micros": 1732352159243608, "cf_name": "default", "job": 31245, "event": "table_file_creation", "file_number": 270810, "file_size": 34904368, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3281054504, "largest_seqno": 4012775885, "table_properties": {"data_size": 28563456, "index_size": 1776768, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25984616, "raw_average_key_size": 28, "raw_value_size": 108233180, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 928022, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732352155, "oldest_key_time": 0, "file_creation_time": 1732352155, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 270810, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:55:59.279562 139957315876416 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270811.sst) /dev/shm/ToplingTemp/Topling-122846-L6wmMg 2024/11/23-16:56:00.167024 139957315876416 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270811.sst): first pass time = 0.89's, 151.244'MB/sec 2024/11/23-16:56:01.680508 139957315876416 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270811.sst): old prealloc_size = 147639500, real_size = 31616128 2024/11/23-16:56:01.681066 139957315876416 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270811.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 930646 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1082 GB zip-val = 0.0296 GB avg-val = 116.22 avg-zval = 31.81 2024/11/23-16:56:01.681841 139957315876416 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270811.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:56:02.725889 139957315876416 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270811.sst): second pass time = 1.51's, 71.504'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.05's, 34.286'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3325.674'MB/sec (index lex order gen) rebuild zvType time = 0.90's, 0.258'MB/sec write SST data time = 0.14's, 249.382'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 35660.570'MB/sec zip my value time = 1.51's, unzip length = 0.108'GB zip my value throughput = 71.504'MB/sec zip pipeline throughput = 71.504'MB/sec entries = 930646 avg-key = 28.00 avg-zkey = 1.92 avg-val = 116.22 avg-zval = 31.81 usrkeys = 930646 avg-key = 20.00 avg-zkey = 1.92 avg-val = 123.22 avg-zval = 31.81 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 930646 bytes = 3373600 } seq expand size = 6514522 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0296 GB dict = 1.08 MB all = 0.0358 GB } UnZip/Zip{ index = 10.4434 value = 3.6539 dict = 1.00 all = 3.7448 } Zip/UnZip{ index = 0.0958 value = 0.2737 dict = 1.00 all = 0.2670 } ---------------------------- total value len = 9.638654 GB avg = 0.163 KB (by entry num) total key len = 1.627183 GB avg = 0.028 KB total ukey len = 1.130993 GB avg = 0.016 KB total ukey num = 0.072206209 Billion total entry num = 0.059013938 Billion write speed all = 0.390490030 MB/sec (with seq num) write speed all = 0.374125969 MB/sec (without seq num) 2024/11/23-16:56:02.769924 139957315876416 [compaction_job.cc:1948] [default] [JOB 31245] Generated table #270811: 930646 keys, 35841022 bytes, temperature: kWarm 2024/11/23-16:56:02.770007 139957315876416 EVENT_LOG_v1 {"time_micros": 1732352162769959, "cf_name": "default", "job": 31245, "event": "table_file_creation", "file_number": 270811, "file_size": 35841022, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3487497056, "largest_seqno": 4012775902, "table_properties": {"data_size": 29601008, "index_size": 1782272, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26058088, "raw_average_key_size": 28, "raw_value_size": 108159664, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 930646, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732352159, "oldest_key_time": 0, "file_creation_time": 1732352159, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 270811, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:56:02.810168 139957315876416 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270812.sst) /dev/shm/ToplingTemp/Topling-122846-V2ikff 2024/11/23-16:56:03.704038 139957315876416 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270812.sst): first pass time = 0.89's, 150.162'MB/sec 2024/11/23-16:56:05.212013 139957315876416 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270812.sst): old prealloc_size = 147639500, real_size = 31741040 2024/11/23-16:56:05.212561 139957315876416 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270812.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 932240 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1081 GB zip-val = 0.0297 GB avg-val = 115.97 avg-zval = 31.90 2024/11/23-16:56:05.213316 139957315876416 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270812.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:56:06.239080 139957315876416 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270812.sst): second pass time = 1.51's, 71.734'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.03's, 34.910'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3365.372'MB/sec (index lex order gen) rebuild zvType time = 0.90's, 0.259'MB/sec write SST data time = 0.13's, 281.206'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 33593.679'MB/sec zip my value time = 1.51's, unzip length = 0.108'GB zip my value throughput = 71.734'MB/sec zip pipeline throughput = 71.734'MB/sec entries = 932240 avg-key = 28.00 avg-zkey = 1.90 avg-val = 115.97 avg-zval = 31.90 usrkeys = 932240 avg-key = 20.00 avg-zkey = 1.90 avg-val = 122.97 avg-zval = 31.90 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 932240 bytes = 3262848 } seq expand size = 6525680 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0297 GB dict = 1.08 MB all = 0.0359 GB } UnZip/Zip{ index = 10.5130 value = 3.6360 dict = 1.00 all = 3.7434 } Zip/UnZip{ index = 0.0951 value = 0.2750 dict = 1.00 all = 0.2671 } ---------------------------- total value len = 9.753295 GB avg = 0.163 KB (by entry num) total key len = 1.653285 GB avg = 0.028 KB total ukey len = 1.149638 GB avg = 0.016 KB total ukey num = 0.073138449 Billion total entry num = 0.059946178 Billion write speed all = 0.395320260 MB/sec (with seq num) write speed all = 0.378699722 MB/sec (without seq num) 2024/11/23-16:56:06.290399 139957315876416 [compaction_job.cc:1948] [default] [JOB 31245] Generated table #270812: 932240 keys, 35854506 bytes, temperature: kWarm 2024/11/23-16:56:06.290503 139957315876416 EVENT_LOG_v1 {"time_micros": 1732352166290433, "cf_name": "default", "job": 31245, "event": "table_file_creation", "file_number": 270812, "file_size": 35854506, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3807172320, "largest_seqno": 4012775918, "table_properties": {"data_size": 29734304, "index_size": 1773504, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26102720, "raw_average_key_size": 28, "raw_value_size": 108115060, "raw_average_value_size": 115, "num_data_blocks": 1, "num_entries": 932240, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732352162, "oldest_key_time": 0, "file_creation_time": 1732352162, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 270812, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:56:06.334243 139957315876416 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270813.sst) /dev/shm/ToplingTemp/Topling-122846-j8PMAf 2024/11/23-16:56:07.213769 139957315876416 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270813.sst): first pass time = 0.88's, 152.610'MB/sec 2024/11/23-16:56:08.748583 139957315876416 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270813.sst): old prealloc_size = 147639500, real_size = 32567072 2024/11/23-16:56:08.749113 139957315876416 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270813.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 925338 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0306 GB avg-val = 117.05 avg-zval = 33.04 2024/11/23-16:56:08.750224 139957315876416 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270813.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:56:09.803418 139957315876416 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270813.sst): second pass time = 1.53's, 70.601'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.05's, 34.975'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3481.044'MB/sec (index lex order gen) rebuild zvType time = 0.91's, 0.253'MB/sec write SST data time = 0.14's, 263.933'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 25610.715'MB/sec zip my value time = 1.53's, unzip length = 0.108'GB zip my value throughput = 70.601'MB/sec zip pipeline throughput = 70.601'MB/sec entries = 925338 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.05 avg-zval = 33.04 usrkeys = 925338 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.05 avg-zval = 33.04 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 925338 bytes = 3470032 } seq expand size = 6477366 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0306 GB dict = 1.08 MB all = 0.0369 GB } UnZip/Zip{ index = 10.5137 value = 3.5423 dict = 1.00 all = 3.6381 } Zip/UnZip{ index = 0.0951 value = 0.2823 dict = 1.00 all = 0.2749 } ---------------------------- total value len = 9.868081 GB avg = 0.162 KB (by entry num) total key len = 1.679195 GB avg = 0.028 KB total ukey len = 1.168145 GB avg = 0.016 KB total ukey num = 0.074063787 Billion total entry num = 0.060871516 Billion write speed all = 0.400146932 MB/sec (with seq num) write speed all = 0.383271921 MB/sec (without seq num) 2024/11/23-16:56:09.853831 139957315876416 [compaction_job.cc:1948] [default] [JOB 31245] Generated table #270813: 925338 keys, 36891988 bytes, temperature: kWarm 2024/11/23-16:56:09.853901 139957315876416 EVENT_LOG_v1 {"time_micros": 1732352169853866, "cf_name": "default", "job": 31245, "event": "table_file_creation", "file_number": 270813, "file_size": 36891988, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3273701103, "largest_seqno": 4012775935, "table_properties": {"data_size": 30575312, "index_size": 1760256, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25909464, "raw_average_key_size": 28, "raw_value_size": 108308324, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 925338, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732352166, "oldest_key_time": 0, "file_creation_time": 1732352166, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 270813, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:56:09.890722 139957315876416 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270814.sst) /dev/shm/ToplingTemp/Topling-122846-LrMaCf 2024/11/23-16:56:11.064864 139957315876416 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270814.sst): first pass time = 1.17's, 114.315'MB/sec 2024/11/23-16:56:12.435405 139957315876416 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270814.sst): old prealloc_size = 147639500, real_size = 35865568 2024/11/23-16:56:12.435997 139957315876416 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270814.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927233 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1083 GB zip-val = 0.0339 GB avg-val = 116.75 avg-zval = 36.52 2024/11/23-16:56:12.437613 139957315876416 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270814.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:56:13.288670 139957315876416 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270814.sst): second pass time = 1.37's, 79.031'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.85's, 46.975'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3128.767'MB/sec (index lex order gen) rebuild zvType time = 0.72's, 0.324'MB/sec write SST data time = 0.14's, 292.698'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 33974.341'MB/sec zip my value time = 1.37's, unzip length = 0.108'GB zip my value throughput = 79.031'MB/sec zip pipeline throughput = 79.031'MB/sec entries = 927233 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.75 avg-zval = 36.52 usrkeys = 927233 avg-key = 20.00 avg-zkey = 1.91 avg-val = 123.75 avg-zval = 36.52 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 927233 bytes = 3361232 } seq expand size = 6490631 multi value expand size = 0 cnt WriteAppend = 15 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0339 GB dict = 1.08 MB all = 0.0401 GB } UnZip/Zip{ index = 10.4441 value = 3.1973 dict = 1.00 all = 3.3486 } Zip/UnZip{ index = 0.0957 value = 0.3128 dict = 1.00 all = 0.2986 } ---------------------------- total value len = 9.982827 GB avg = 0.162 KB (by entry num) total key len = 1.705157 GB avg = 0.028 KB total ukey len = 1.186690 GB avg = 0.016 KB total ukey num = 0.074991020 Billion total entry num = 0.061798749 Billion write speed all = 0.404973978 MB/sec (with seq num) write speed all = 0.387843985 MB/sec (without seq num) 2024/11/23-16:56:13.341033 139957315876416 [compaction_job.cc:1948] [default] [JOB 31245] Generated table #270814: 927233 keys, 40081236 bytes, temperature: kWarm 2024/11/23-16:56:13.341104 139957315876416 EVENT_LOG_v1 {"time_micros": 1732352173341065, "cf_name": "default", "job": 31245, "event": "table_file_creation", "file_number": 270814, "file_size": 40081236, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3514720078, "largest_seqno": 4012775967, "table_properties": {"data_size": 33857936, "index_size": 1775616, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25962524, "raw_average_key_size": 28, "raw_value_size": 108255206, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927233, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732352169, "oldest_key_time": 0, "file_creation_time": 1732352169, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 270814, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:56:13.388137 139957315876416 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270815.sst) /dev/shm/ToplingTemp/Topling-122846-9VsKHf 2024/11/23-16:56:14.256419 139957315876416 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270815.sst): first pass time = 0.87's, 154.585'MB/sec 2024/11/23-16:56:15.764898 139957315876416 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270815.sst): old prealloc_size = 147639500, real_size = 32556560 2024/11/23-16:56:15.765490 139957315876416 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270815.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927972 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0306 GB avg-val = 116.64 avg-zval = 32.93 2024/11/23-16:56:15.766287 139957315876416 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270815.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:56:16.613167 139957315876416 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270815.sst): second pass time = 1.51's, 71.790'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.85's, 43.490'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3142.768'MB/sec (index lex order gen) rebuild zvType time = 0.72's, 0.321'MB/sec write SST data time = 0.12's, 295.239'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 30510.595'MB/sec zip my value time = 1.51's, unzip length = 0.108'GB zip my value throughput = 71.790'MB/sec zip pipeline throughput = 71.790'MB/sec entries = 927972 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.64 avg-zval = 32.93 usrkeys = 927972 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.64 avg-zval = 32.93 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 927972 bytes = 3479904 } seq expand size = 6495804 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0306 GB dict = 1.08 MB all = 0.0369 GB } UnZip/Zip{ index = 10.5145 value = 3.5418 dict = 1.00 all = 3.6383 } Zip/UnZip{ index = 0.0951 value = 0.2823 dict = 1.00 all = 0.2749 } ---------------------------- total value len = 10.097557 GB avg = 0.161 KB (by entry num) total key len = 1.731141 GB avg = 0.028 KB total ukey len = 1.205249 GB avg = 0.016 KB total ukey num = 0.075918992 Billion total entry num = 0.062726721 Billion write speed all = 0.409802325 MB/sec (with seq num) write speed all = 0.392417110 MB/sec (without seq num) 2024/11/23-16:56:16.660693 139957315876416 [compaction_job.cc:1948] [default] [JOB 31245] Generated table #270815: 927972 keys, 36890148 bytes, temperature: kWarm 2024/11/23-16:56:16.660765 139957315876416 EVENT_LOG_v1 {"time_micros": 1732352176660730, "cf_name": "default", "job": 31245, "event": "table_file_creation", "file_number": 270815, "file_size": 36890148, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3369353416, "largest_seqno": 4012776021, "table_properties": {"data_size": 30559232, "index_size": 1765120, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25983216, "raw_average_key_size": 28, "raw_value_size": 108234644, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927972, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732352173, "oldest_key_time": 0, "file_creation_time": 1732352173, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 270815, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:56:16.698239 139957315876416 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270816.sst) /dev/shm/ToplingTemp/Topling-122846-Qb0HPe 2024/11/23-16:56:17.711752 139957315876416 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270816.sst): first pass time = 1.01's, 132.433'MB/sec 2024/11/23-16:56:19.030635 139957315876416 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270816.sst): old prealloc_size = 147639500, real_size = 34103024 2024/11/23-16:56:19.031205 139957315876416 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270816.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 928612 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1082 GB zip-val = 0.0321 GB avg-val = 116.54 avg-zval = 34.56 2024/11/23-16:56:19.032999 139957315876416 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270816.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:56:19.848892 139957315876416 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270816.sst): second pass time = 1.32's, 82.099'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.82's, 46.321'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3234.473'MB/sec (index lex order gen) rebuild zvType time = 0.69's, 0.338'MB/sec write SST data time = 0.13's, 289.655'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 33551.916'MB/sec zip my value time = 1.32's, unzip length = 0.108'GB zip my value throughput = 82.099'MB/sec zip pipeline throughput = 82.099'MB/sec entries = 928612 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.54 avg-zval = 34.56 usrkeys = 928612 avg-key = 20.00 avg-zkey = 1.91 avg-val = 122.16 avg-zval = 34.56 TagRS{ kinds = RS_Key0_TagN bytes = 145200 } TagArray{ size = 745615 bytes = 2796064 } seq expand size = 5219305 multi value expand size = 0 cnt WriteAppend = 16 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0321 GB dict = 1.08 MB all = 0.0379 GB } UnZip/Zip{ index = 10.4453 value = 3.3720 dict = 1.00 all = 3.5412 } Zip/UnZip{ index = 0.0957 value = 0.2966 dict = 1.00 all = 0.2824 } ---------------------------- total value len = 10.210993 GB avg = 0.160 KB (by entry num) total key len = 1.757142 GB avg = 0.028 KB total ukey len = 1.223821 GB avg = 0.016 KB total ukey num = 0.076847604 Billion total entry num = 0.063655333 Billion write speed all = 0.414586615 MB/sec (with seq num) write speed all = 0.396946006 MB/sec (without seq num) 2024/11/23-16:56:19.895635 139957315876416 [compaction_job.cc:1948] [default] [JOB 31245] Generated table #270816: 928612 keys, 37901312 bytes, temperature: kWarm 2024/11/23-16:56:19.895704 139957315876416 EVENT_LOG_v1 {"time_micros": 1732352179895668, "cf_name": "default", "job": 31245, "event": "table_file_creation", "file_number": 270816, "file_size": 37901312, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4012776210, "table_properties": {"data_size": 32092640, "index_size": 1778048, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26001136, "raw_average_key_size": 28, "raw_value_size": 108216704, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 928612, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732352176, "oldest_key_time": 0, "file_creation_time": 1732352176, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 270816, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:56:19.932645 139957315876416 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270817.sst) /dev/shm/ToplingTemp/Topling-122846-n20Sze 2024/11/23-16:56:20.927221 139957315876416 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270817.sst): first pass time = 0.99's, 134.955'MB/sec 2024/11/23-16:56:22.215734 139957315876416 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270817.sst): old prealloc_size = 147639500, real_size = 31264528 2024/11/23-16:56:22.216336 139957315876416 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270817.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 933457 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1081 GB zip-val = 0.0293 GB avg-val = 115.79 avg-zval = 31.34 2024/11/23-16:56:22.217137 139957315876416 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270817.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:56:23.061440 139957315876416 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270817.sst): second pass time = 1.29's, 83.930'MB/sec, value only(80.5% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.85's, 41.977'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3061.982'MB/sec (index lex order gen) rebuild zvType time = 0.72's, 0.325'MB/sec write SST data time = 0.13's, 281.235'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 33737.293'MB/sec zip my value time = 1.29's, unzip length = 0.108'GB zip my value throughput = 83.930'MB/sec zip pipeline throughput = 83.930'MB/sec entries = 933457 avg-key = 28.00 avg-zkey = 1.90 avg-val = 115.79 avg-zval = 31.34 usrkeys = 933457 avg-key = 20.00 avg-zkey = 1.90 avg-val = 122.79 avg-zval = 31.34 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 933457 bytes = 3383792 } seq expand size = 6534199 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0187 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0293 GB dict = 1.08 MB all = 0.0355 GB } UnZip/Zip{ index = 10.5138 value = 3.6944 dict = 1.00 all = 3.7809 } Zip/UnZip{ index = 0.0951 value = 0.2707 dict = 1.00 all = 0.2645 } ---------------------------- total value len = 10.325608 GB avg = 0.160 KB (by entry num) total key len = 1.783279 GB avg = 0.028 KB total ukey len = 1.242491 GB avg = 0.016 KB total ukey num = 0.077781061 Billion total entry num = 0.064588790 Billion write speed all = 0.419415714 MB/sec (with seq num) write speed all = 0.401518410 MB/sec (without seq num) 2024/11/23-16:56:23.105050 139957315876416 [compaction_job.cc:1948] [default] [JOB 31245] Generated table #270817: 933457 keys, 35498790 bytes, temperature: kWarm 2024/11/23-16:56:23.105118 139957315876416 EVENT_LOG_v1 {"time_micros": 1732352183105083, "cf_name": "default", "job": 31245, "event": "table_file_creation", "file_number": 270817, "file_size": 35498790, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3480997236, "largest_seqno": 4012776228, "table_properties": {"data_size": 29255296, "index_size": 1775680, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26136796, "raw_average_key_size": 28, "raw_value_size": 108081050, "raw_average_value_size": 115, "num_data_blocks": 1, "num_entries": 933457, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732352179, "oldest_key_time": 0, "file_creation_time": 1732352179, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 270817, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:56:23.145186 139957315876416 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270818.sst) /dev/shm/ToplingTemp/Topling-122846-VBKuoe 2024/11/23-16:56:23.971206 139957315876416 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270818.sst): first pass time = 0.83's, 162.495'MB/sec 2024/11/23-16:56:25.286322 139957315876416 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270818.sst): old prealloc_size = 147639500, real_size = 33139280 2024/11/23-16:56:25.286908 139957315876416 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270818.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 931033 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1081 GB zip-val = 0.0311 GB avg-val = 116.16 avg-zval = 33.43 2024/11/23-16:56:25.287717 139957315876416 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270818.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:56:26.135519 139957315876416 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270818.sst): second pass time = 1.31's, 82.284'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.85's, 44.003'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3153.099'MB/sec (index lex order gen) rebuild zvType time = 0.72's, 0.323'MB/sec write SST data time = 0.13's, 290.832'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 28906.411'MB/sec zip my value time = 1.31's, unzip length = 0.108'GB zip my value throughput = 82.284'MB/sec zip pipeline throughput = 82.284'MB/sec entries = 931033 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.16 avg-zval = 33.43 usrkeys = 931033 avg-key = 20.00 avg-zkey = 1.91 avg-val = 123.16 avg-zval = 33.43 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 931033 bytes = 3375008 } seq expand size = 6517231 multi value expand size = 0 cnt WriteAppend = 15 UnZipSize{ index = 0.0186 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0311 GB dict = 1.08 MB all = 0.0374 GB } UnZip/Zip{ index = 10.4458 value = 3.4748 dict = 1.00 all = 3.5920 } Zip/UnZip{ index = 0.0957 value = 0.2878 dict = 1.00 all = 0.2784 } ---------------------------- total value len = 10.440274 GB avg = 0.159 KB (by entry num) total key len = 1.809348 GB avg = 0.028 KB total ukey len = 1.261111 GB avg = 0.016 KB total ukey num = 0.078712094 Billion total entry num = 0.065519823 Billion write speed all = 0.424245185 MB/sec (with seq num) write speed all = 0.406091829 MB/sec (without seq num) 2024/11/23-16:56:26.182183 139957315876416 [compaction_job.cc:1948] [default] [JOB 31245] Generated table #270818: 931033 keys, 37365996 bytes, temperature: kWarm 2024/11/23-16:56:26.182253 139957315876416 EVENT_LOG_v1 {"time_micros": 1732352186182217, "cf_name": "default", "job": 31245, "event": "table_file_creation", "file_number": 270818, "file_size": 37365996, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3512539342, "largest_seqno": 4012776268, "table_properties": {"data_size": 31123776, "index_size": 1782592, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26068924, "raw_average_key_size": 28, "raw_value_size": 108148938, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 931033, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732352183, "oldest_key_time": 0, "file_creation_time": 1732352183, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 270818, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:56:26.218651 139957315876416 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270819.sst) /dev/shm/ToplingTemp/Topling-122846-h6JdVf 2024/11/23-16:56:27.262283 139957315876416 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270819.sst): first pass time = 1.04's, 128.611'MB/sec 2024/11/23-16:56:28.580873 139957315876416 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270819.sst): old prealloc_size = 147639500, real_size = 34540208 2024/11/23-16:56:28.581499 139957315876416 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270819.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 923986 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1083 GB zip-val = 0.0325 GB avg-val = 117.26 avg-zval = 35.22 2024/11/23-16:56:28.582339 139957315876416 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270819.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:56:29.435870 139957315876416 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270819.sst): second pass time = 1.32's, 82.222'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.85's, 45.454'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2932.931'MB/sec (index lex order gen) rebuild zvType time = 0.73's, 0.317'MB/sec write SST data time = 0.13's, 308.316'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.082'MB, throughput = 34066.110'MB/sec zip my value time = 1.32's, unzip length = 0.108'GB zip my value throughput = 82.222'MB/sec zip pipeline throughput = 82.222'MB/sec entries = 923986 avg-key = 28.00 avg-zkey = 1.92 avg-val = 117.26 avg-zval = 35.22 usrkeys = 923986 avg-key = 20.00 avg-zkey = 1.92 avg-val = 124.26 avg-zval = 35.22 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 923986 bytes = 3464960 } seq expand size = 6467902 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0325 GB dict = 1.08 MB all = 0.0389 GB } UnZip/Zip{ index = 10.4417 value = 3.3297 dict = 1.00 all = 3.4537 } Zip/UnZip{ index = 0.0958 value = 0.3003 dict = 1.00 all = 0.2895 } ---------------------------- total value len = 10.555089 GB avg = 0.159 KB (by entry num) total key len = 1.835219 GB avg = 0.028 KB total ukey len = 1.279591 GB avg = 0.016 KB total ukey num = 0.079636080 Billion total entry num = 0.066443809 Billion write speed all = 0.429068558 MB/sec (with seq num) write speed all = 0.410661300 MB/sec (without seq num) 2024/11/23-16:56:29.484544 139957315876416 [compaction_job.cc:1948] [default] [JOB 31245] Generated table #270819: 923986 keys, 38862222 bytes, temperature: kWarm 2024/11/23-16:56:29.484614 139957315876416 EVENT_LOG_v1 {"time_micros": 1732352189484578, "cf_name": "default", "job": 31245, "event": "table_file_creation", "file_number": 270819, "file_size": 38862222, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3411274482, "largest_seqno": 4012774796, "table_properties": {"data_size": 32539232, "index_size": 1769792, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25871608, "raw_average_key_size": 28, "raw_value_size": 108346256, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 923986, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732352186, "oldest_key_time": 0, "file_creation_time": 1732352186, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 270819, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:56:29.526229 139957315876416 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270820.sst) /dev/shm/ToplingTemp/Topling-122846-BUa07f 2024/11/23-16:56:30.562501 139957315876416 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270820.sst): first pass time = 1.04's, 129.525'MB/sec 2024/11/23-16:56:31.887844 139957315876416 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270820.sst): old prealloc_size = 147639500, real_size = 32795312 2024/11/23-16:56:31.888433 139957315876416 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270820.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 933794 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1081 GB zip-val = 0.0308 GB avg-val = 115.73 avg-zval = 32.97 2024/11/23-16:56:31.889578 139957315876416 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270820.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:56:32.769557 139957315876416 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270820.sst): second pass time = 1.32's, 81.588'MB/sec, value only(80.5% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.88's, 42.000'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3135.715'MB/sec (index lex order gen) rebuild zvType time = 0.75's, 0.311'MB/sec write SST data time = 0.13's, 283.886'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 33395.051'MB/sec zip my value time = 1.32's, unzip length = 0.108'GB zip my value throughput = 81.588'MB/sec zip pipeline throughput = 81.588'MB/sec entries = 933794 avg-key = 28.00 avg-zkey = 1.90 avg-val = 115.73 avg-zval = 32.97 usrkeys = 933794 avg-key = 20.00 avg-zkey = 1.90 avg-val = 122.73 avg-zval = 32.97 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 933794 bytes = 3385024 } seq expand size = 6536558 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0187 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0308 GB dict = 1.08 MB all = 0.0370 GB } UnZip/Zip{ index = 10.5138 value = 3.5105 dict = 1.00 all = 3.6245 } Zip/UnZip{ index = 0.0951 value = 0.2849 dict = 1.00 all = 0.2759 } ---------------------------- total value len = 10.669697 GB avg = 0.158 KB (by entry num) total key len = 1.861365 GB avg = 0.028 KB total ukey len = 1.298267 GB avg = 0.016 KB total ukey num = 0.080569874 Billion total entry num = 0.067377603 Billion write speed all = 0.433892705 MB/sec (with seq num) write speed all = 0.415228908 MB/sec (without seq num) 2024/11/23-16:56:32.815381 139957315876416 [compaction_job.cc:1948] [default] [JOB 31245] Generated table #270820: 933794 keys, 37031074 bytes, temperature: kWarm 2024/11/23-16:56:32.815463 139957315876416 EVENT_LOG_v1 {"time_micros": 1732352192815417, "cf_name": "default", "job": 31245, "event": "table_file_creation", "file_number": 270820, "file_size": 37031074, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3525889795, "largest_seqno": 4012776316, "table_properties": {"data_size": 30785376, "index_size": 1776320, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26146232, "raw_average_key_size": 28, "raw_value_size": 108071628, "raw_average_value_size": 115, "num_data_blocks": 1, "num_entries": 933794, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732352189, "oldest_key_time": 0, "file_creation_time": 1732352189, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 270820, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:56:32.853192 139957315876416 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270821.sst) /dev/shm/ToplingTemp/Topling-122846-SKOlFd 2024/11/23-16:56:33.828124 139957315876416 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270821.sst): first pass time = 0.97's, 137.675'MB/sec 2024/11/23-16:56:35.124137 139957315876416 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270821.sst): old prealloc_size = 147639500, real_size = 33362112 2024/11/23-16:56:35.124672 139957315876416 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270821.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 923800 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1084 GB zip-val = 0.0314 GB avg-val = 117.29 avg-zval = 33.96 2024/11/23-16:56:35.125785 139957315876416 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270821.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:56:35.975055 139957315876416 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270821.sst): second pass time = 1.30's, 83.653'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.85's, 44.288'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3433.633'MB/sec (index lex order gen) rebuild zvType time = 0.73's, 0.318'MB/sec write SST data time = 0.12's, 302.825'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.083'MB, throughput = 32013.544'MB/sec zip my value time = 1.30's, unzip length = 0.108'GB zip my value throughput = 83.653'MB/sec zip pipeline throughput = 83.653'MB/sec entries = 923800 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.29 avg-zval = 33.96 usrkeys = 923800 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.29 avg-zval = 33.96 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 923800 bytes = 3464272 } seq expand size = 6466600 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0314 GB dict = 1.08 MB all = 0.0377 GB } UnZip/Zip{ index = 10.5119 value = 3.4536 dict = 1.00 all = 3.5617 } Zip/UnZip{ index = 0.0951 value = 0.2896 dict = 1.00 all = 0.2808 } ---------------------------- total value len = 10.784515 GB avg = 0.158 KB (by entry num) total key len = 1.887232 GB avg = 0.028 KB total ukey len = 1.316743 GB avg = 0.016 KB total ukey num = 0.081493674 Billion total entry num = 0.068301403 Billion write speed all = 0.438715263 MB/sec (with seq num) write speed all = 0.419797670 MB/sec (without seq num) 2024/11/23-16:56:36.021126 139957315876416 [compaction_job.cc:1948] [default] [JOB 31245] Generated table #270821: 923800 keys, 37683834 bytes, temperature: kWarm 2024/11/23-16:56:36.021197 139957315876416 EVENT_LOG_v1 {"time_micros": 1732352196021161, "cf_name": "default", "job": 31245, "event": "table_file_creation", "file_number": 270821, "file_size": 37683834, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3405268578, "largest_seqno": 4012776344, "table_properties": {"data_size": 31373360, "index_size": 1757632, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25866400, "raw_average_key_size": 28, "raw_value_size": 108351456, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 923800, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732352192, "oldest_key_time": 0, "file_creation_time": 1732352192, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 270821, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:56:36.056932 139957315876416 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270822.sst) /dev/shm/ToplingTemp/Topling-122846-901SBc 2024/11/23-16:56:37.081415 139957315876416 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270822.sst): first pass time = 1.02's, 131.015'MB/sec 2024/11/23-16:56:38.424445 139957315876416 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270822.sst): old prealloc_size = 147639500, real_size = 33187904 2024/11/23-16:56:38.425034 139957315876416 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270822.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927429 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.93 raw-val = 0.1082 GB zip-val = 0.0312 GB avg-val = 116.72 avg-zval = 33.61 2024/11/23-16:56:38.426821 139957315876416 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270822.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:56:39.281835 139957315876416 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270822.sst): second pass time = 1.34's, 80.679'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.86's, 43.762'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3188.578'MB/sec (index lex order gen) rebuild zvType time = 0.73's, 0.319'MB/sec write SST data time = 0.13's, 289.102'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 35584.909'MB/sec zip my value time = 1.34's, unzip length = 0.108'GB zip my value throughput = 80.679'MB/sec zip pipeline throughput = 80.679'MB/sec entries = 927429 avg-key = 28.00 avg-zkey = 1.93 avg-val = 116.72 avg-zval = 33.61 usrkeys = 927429 avg-key = 20.00 avg-zkey = 1.93 avg-val = 123.72 avg-zval = 33.61 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 927429 bytes = 3477872 } seq expand size = 6492003 multi value expand size = 0 cnt WriteAppend = 18 UnZipSize{ index = 0.0185 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0312 GB dict = 1.08 MB all = 0.0375 GB } UnZip/Zip{ index = 10.3763 value = 3.4731 dict = 1.00 all = 3.5773 } Zip/UnZip{ index = 0.0964 value = 0.2879 dict = 1.00 all = 0.2795 } ---------------------------- total value len = 10.899257 GB avg = 0.157 KB (by entry num) total key len = 1.913200 GB avg = 0.028 KB total ukey len = 1.335291 GB avg = 0.016 KB total ukey num = 0.082421103 Billion total entry num = 0.069228832 Billion write speed all = 0.443536074 MB/sec (with seq num) write speed all = 0.424363804 MB/sec (without seq num) 2024/11/23-16:56:39.327521 139957315876416 [compaction_job.cc:1948] [default] [JOB 31245] Generated table #270822: 927429 keys, 37519698 bytes, temperature: kWarm 2024/11/23-16:56:39.327595 139957315876416 EVENT_LOG_v1 {"time_micros": 1732352199327557, "cf_name": "default", "job": 31245, "event": "table_file_creation", "file_number": 270822, "file_size": 37519698, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3471845708, "largest_seqno": 4012771944, "table_properties": {"data_size": 31168304, "index_size": 1787584, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25968012, "raw_average_key_size": 28, "raw_value_size": 108249810, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927429, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732352196, "oldest_key_time": 0, "file_creation_time": 1732352196, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 270822, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:56:39.365345 139957315876416 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270823.sst) /dev/shm/ToplingTemp/Topling-122846-6tC76e 2024/11/23-16:56:40.176083 139957315876416 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270823.sst): first pass time = 0.81's, 165.558'MB/sec 2024/11/23-16:56:41.605680 139957315876416 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270823.sst): old prealloc_size = 147639500, real_size = 35542688 2024/11/23-16:56:41.606244 139957315876416 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270823.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 929660 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0335 GB avg-val = 116.37 avg-zval = 36.08 2024/11/23-16:56:41.606637 139957315876416 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270823.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:56:42.372023 139957315876416 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270823.sst): second pass time = 1.43's, 75.721'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.77's, 49.220'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3246.653'MB/sec (index lex order gen) rebuild zvType time = 0.64's, 0.363'MB/sec write SST data time = 0.12's, 302.570'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 38324.670'MB/sec zip my value time = 1.43's, unzip length = 0.108'GB zip my value throughput = 75.721'MB/sec zip pipeline throughput = 75.721'MB/sec entries = 929660 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.37 avg-zval = 36.08 usrkeys = 929660 avg-key = 20.00 avg-zkey = 1.90 avg-val = 119.09 avg-zval = 36.08 TagRS{ kinds = RS_Key0_TagN bytes = 145360 } TagArray{ size = 360740 bytes = 1172416 } seq expand size = 2525180 multi value expand size = 0 cnt WriteAppend = 11 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0335 GB dict = 1.08 MB all = 0.0377 GB } UnZip/Zip{ index = 10.5116 value = 3.2255 dict = 1.00 all = 3.5585 } Zip/UnZip{ index = 0.0951 value = 0.3100 dict = 1.00 all = 0.2810 } ---------------------------- total value len = 11.009969 GB avg = 0.157 KB (by entry num) total key len = 1.939230 GB avg = 0.028 KB total ukey len = 1.353885 GB avg = 0.016 KB total ukey num = 0.083350763 Billion total entry num = 0.070158492 Billion write speed all = 0.448221837 MB/sec (with seq num) write speed all = 0.428794184 MB/sec (without seq num) 2024/11/23-16:56:42.417607 139957315876416 [compaction_job.cc:1948] [default] [JOB 31245] Generated table #270823: 929660 keys, 37717919 bytes, temperature: kWarm 2024/11/23-16:56:42.417676 139957315876416 EVENT_LOG_v1 {"time_micros": 1732352202417640, "cf_name": "default", "job": 31245, "event": "table_file_creation", "file_number": 270823, "file_size": 37717919, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4012776360, "table_properties": {"data_size": 33541264, "index_size": 1768832, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26030480, "raw_average_key_size": 28, "raw_value_size": 108187360, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 929660, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732352199, "oldest_key_time": 0, "file_creation_time": 1732352199, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 270823, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:56:42.455093 139957315876416 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270824.sst) /dev/shm/ToplingTemp/Topling-122846-AjOoVf 2024/11/23-16:56:43.353736 139957315876416 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270824.sst): first pass time = 0.90's, 149.361'MB/sec 2024/11/23-16:56:44.855059 139957315876416 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270824.sst): old prealloc_size = 147639500, real_size = 37133952 2024/11/23-16:56:44.855589 139957315876416 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270824.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 926452 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1083 GB zip-val = 0.0351 GB avg-val = 116.87 avg-zval = 37.92 2024/11/23-16:56:44.855857 139957315876416 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270824.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:56:45.576117 139957315876416 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270824.sst): second pass time = 1.50's, 72.174'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.72's, 53.900'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3487.783'MB/sec (index lex order gen) rebuild zvType time = 0.59's, 0.390'MB/sec write SST data time = 0.13's, 307.494'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 35560.237'MB/sec zip my value time = 1.50's, unzip length = 0.108'GB zip my value throughput = 72.174'MB/sec zip pipeline throughput = 72.174'MB/sec entries = 926452 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.87 avg-zval = 37.92 usrkeys = 926452 avg-key = 20.00 avg-zkey = 1.91 avg-val = 118.34 avg-zval = 37.92 TagRS{ kinds = RS_Key0_TagN bytes = 144840 } TagArray{ size = 193779 bytes = 726688 } seq expand size = 1356453 multi value expand size = 0 cnt WriteAppend = 16 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0351 GB dict = 1.08 MB all = 0.0389 GB } UnZip/Zip{ index = 10.4469 value = 3.0823 dict = 1.00 all = 3.4536 } Zip/UnZip{ index = 0.0957 value = 0.3244 dict = 1.00 all = 0.2896 } ---------------------------- total value len = 11.119603 GB avg = 0.156 KB (by entry num) total key len = 1.965171 GB avg = 0.028 KB total ukey len = 1.372414 GB avg = 0.016 KB total ukey num = 0.084277215 Billion total entry num = 0.071084944 Billion write speed all = 0.452864359 MB/sec (with seq num) write speed all = 0.433182344 MB/sec (without seq num) 2024/11/23-16:56:45.623380 139957315876416 [compaction_job.cc:1948] [default] [JOB 31245] Generated table #270824: 926452 keys, 38863631 bytes, temperature: kWarm 2024/11/23-16:56:45.623458 139957315876416 EVENT_LOG_v1 {"time_micros": 1732352205623415, "cf_name": "default", "job": 31245, "event": "table_file_creation", "file_number": 270824, "file_size": 38863631, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4020407213, "table_properties": {"data_size": 35128496, "index_size": 1773632, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25940656, "raw_average_key_size": 28, "raw_value_size": 108277104, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 926452, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732352202, "oldest_key_time": 0, "file_creation_time": 1732352202, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 270824, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:56:45.662047 139957315876416 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270825.sst) /dev/shm/ToplingTemp/Topling-122846-2w4qtd 2024/11/23-16:56:46.719399 139957315876416 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270825.sst): first pass time = 1.06's, 126.942'MB/sec 2024/11/23-16:56:48.052326 139957315876416 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270825.sst): old prealloc_size = 147639500, real_size = 35486704 2024/11/23-16:56:48.052850 139957315876416 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270825.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 926048 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0335 GB avg-val = 116.94 avg-zval = 36.17 2024/11/23-16:56:48.053589 139957315876416 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270825.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:56:48.892206 139957315876416 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270825.sst): second pass time = 1.33's, 81.287'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.84's, 46.993'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3528.142'MB/sec (index lex order gen) rebuild zvType time = 0.71's, 0.324'MB/sec write SST data time = 0.13's, 313.601'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 34571.255'MB/sec zip my value time = 1.33's, unzip length = 0.108'GB zip my value throughput = 81.287'MB/sec zip pipeline throughput = 81.287'MB/sec entries = 926048 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.94 avg-zval = 36.17 usrkeys = 926048 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.94 avg-zval = 36.17 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 926048 bytes = 3125424 } seq expand size = 6482336 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0335 GB dict = 1.08 MB all = 0.0395 GB } UnZip/Zip{ index = 10.5126 value = 3.2331 dict = 1.00 all = 3.4008 } Zip/UnZip{ index = 0.0951 value = 0.3093 dict = 1.00 all = 0.2941 } ---------------------------- total value len = 11.234373 GB avg = 0.156 KB (by entry num) total key len = 1.991100 GB avg = 0.028 KB total ukey len = 1.390935 GB avg = 0.016 KB total ukey num = 0.085203263 Billion total entry num = 0.072010992 Billion write speed all = 0.457681466 MB/sec (with seq num) write speed all = 0.437745335 MB/sec (without seq num) 2024/11/23-16:56:48.941426 139957315876416 [compaction_job.cc:1948] [default] [JOB 31245] Generated table #270825: 926048 keys, 39466938 bytes, temperature: kWarm 2024/11/23-16:56:48.941507 139957315876416 EVENT_LOG_v1 {"time_micros": 1732352208941470, "cf_name": "default", "job": 31245, "event": "table_file_creation", "file_number": 270825, "file_size": 39466938, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4020410882, "largest_seqno": 4127228624, "table_properties": {"data_size": 33493216, "index_size": 1761792, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25929344, "raw_average_key_size": 28, "raw_value_size": 108288456, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 926048, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732352205, "oldest_key_time": 0, "file_creation_time": 1732352205, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 270825, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:56:49.030569 139957315876416 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270826.sst) /dev/shm/ToplingTemp/Topling-122846-vOP3Sc 2024/11/23-16:56:49.108793 139957315876416 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270826.sst): first pass time = 0.08's, 224.481'MB/sec 2024/11/23-16:56:49.266740 139957315876416 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270826.sst): old prealloc_size = 147639500, real_size = 5194832 2024/11/23-16:56:49.266871 139957315876416 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270826.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 122237 prefix = 4 raw-key = 0.0020 GB zip-key = 0.0002 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.0141 GB zip-val = 0.0049 GB avg-val = 115.55 avg-zval = 40.33 2024/11/23-16:56:49.267032 139957315876416 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270826.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.018 GB 2024/11/23-16:56:49.371857 139957315876416 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00/270826.sst): second pass time = 0.16's, 89.807'MB/sec, value only(80.5% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.11's, 54.345'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2202.743'MB/sec (index lex order gen) rebuild zvType time = 0.09's, 0.348'MB/sec write SST data time = 0.02's, 332.468'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.148'MB, throughput = 4787.103'MB/sec zip my value time = 0.16's, unzip length = 0.014'GB zip my value throughput = 89.807'MB/sec zip pipeline throughput = 89.807'MB/sec entries = 122237 avg-key = 28.00 avg-zkey = 1.91 avg-val = 115.55 avg-zval = 40.33 usrkeys = 122237 avg-key = 20.00 avg-zkey = 1.91 avg-val = 122.55 avg-zval = 40.33 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 122237 bytes = 397280 } seq expand size = 855659 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0024 GB value = 0.0141 GB dict = 0.15 MB all = 0.0175 GB } __ZipSize{ index = 0.0002 GB value = 0.0049 GB dict = 0.15 MB all = 0.0057 GB } UnZip/Zip{ index = 10.4455 value = 2.8651 dict = 1.00 all = 3.0723 } Zip/UnZip{ index = 0.0957 value = 0.3490 dict = 1.00 all = 0.3255 } ---------------------------- total value len = 11.249354 GB avg = 0.156 KB (by entry num) total key len = 1.994523 GB avg = 0.028 KB total ukey len = 1.393379 GB avg = 0.016 KB total ukey num = 0.085325500 Billion total entry num = 0.072133229 Billion write speed all = 0.458310724 MB/sec (with seq num) write speed all = 0.438341083 MB/sec (without seq num) 2024/11/23-16:56:49.385134 139957315876416 [compaction_job.cc:1948] [default] [JOB 31245] Generated table #270826: 122237 keys, 5711523 bytes, temperature: kWarm 2024/11/23-16:56:49.385194 139957315876416 EVENT_LOG_v1 {"time_micros": 1732352209385162, "cf_name": "default", "job": 31245, "event": "table_file_creation", "file_number": 270826, "file_size": 5711523, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4072856654, "largest_seqno": 4127141123, "table_properties": {"data_size": 4930048, "index_size": 234048, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 3422636, "raw_average_key_size": 28, "raw_value_size": 14124994, "raw_average_value_size": 115, "num_data_blocks": 1, "num_entries": 122237, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732352208, "oldest_key_time": 0, "file_creation_time": 1732352208, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 270826, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:56:49.405134 139957315876416 [compaction_job.cc:703] job-31245: subcompact[0], size: 0.799829 G, files: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31245/att-00 [270805,270806,270807,270808,270809,270810,270811,270812,270813,270814,270815,270816,270817,270818,270819,270820,270821,270822,270823,270824,270825,270826] 2024/11/23-16:56:49.537055 139957315876416 (Original Log Time 2024/11/23-16:55:30.981256) EVENT_LOG_v1 {"time_micros": 1732352130981193, "job": 31245, "event": "compaction_started", "compaction_reason": "FilesMarkedForCompaction", "files_L2": [270794], "files_L3": [270710, 270749, 270750, 270751, 270752, 270753, 270754, 270755, 270756, 270757, 270758, 270759, 270760, 270761, 270762, 270763, 270764, 270765, 270766, 270767, 270768], "score": 0.999499, "input_data_size": 818017918, "oldest_snapshot_seqno": 4127262337} 2024/11/23-16:56:49.537059 139957315876416 (Original Log Time 2024/11/23-16:56:49.535432) [compaction_job.cc:2022] [default] [JOB 31245] Compacted 1@2 + 21@3 files to L3 => 799828803 bytes 2024/11/23-16:56:49.537061 139957315876416 (Original Log Time 2024/11/23-16:56:49.536953) [compaction_job.cc:1224] [default] compacted to: files[0 0 0 22 0 0 0] max score 0.03, MB/sec: 10.4 rd, 10.2 wr, level 3, files in(1, 21) out(22 +0 blob) MB in(27.1, 753.0 +0.0 blob) out(762.8 +0.0 blob), read-write-amplify(56.9) write-amplify(28.1) OK, records in: 19887534, records dropped: 112469 output_compression: Snappy 2024/11/23-16:56:49.537064 139957315876416 (Original Log Time 2024/11/23-16:56:49.537029) EVENT_LOG_v1 {"time_micros": 1732352209537000, "cf": "default", "job": 31245, "event": "compaction_finished", "compaction_time_micros": 78423886, "compaction_time_cpu_micros": 31778504, "output_level": 3, "num_output_files": 22, "total_output_size": 799828803, "num_input_records": 19887534, "num_output_records": 19775065, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "file_write_nanos": 631796216, "file_range_sync_nanos": 0, "file_fsync_nanos": 16378, "file_prepare_write_nanos": 63812, "lsm_state": [0, 0, 0, 22, 0, 0, 0]} 2024/11/23-16:56:49.675515 139957315876416 DEBG dcompact_worker.cpp:240: HttpPost: 200 OK: url = http://nlb-7zny4kaa1poal01o64.cn-shenzhen.nlb.aliyuncs.com:8443, body = {"instanceId":"nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137","labourId":"","dbId":"d89b4006-2803-486e-b7a2-759bcf348921","dbStarts":1732256054,"starts":1732352130,"executesMs":78714,"compactionJobId":31245,"attempt":0,"compactionInputRawBytes":2852092253,"compactionInputZipBytes":818017918,"compactionOutputRawBytes":0,"compactionOutputZipBytes":799828803,"headers":{"Accept":"*/*","Connection":"close","Host":"aliyun-topling-saas.topling.cn:18443","RemoteIp":"120.24.192.169","X-Forwarded-For":"120.24.192.169","region":"cn-shenzhen","token":"e6474c481bd4415abc537135cc03626b","instance-token":"e6474c481bd4415abc537135cc03626b","provider":"aliyun","CloudMarketInstanceId":"si-59c0ae5c955845588903","MeteringAssit":"","Transfer-Encoding":"chunked","traceparent":"00-46ef91e08f16c2341c39090954105356-737d09e584210a00-00"}}, response = 2024/11/23-16:56:49.675607 139957315876416 INFO dcompact_worker.cpp:1459: finish /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-31245/att-00: olev 3, work 78.715 s, result 7.802 ms, install 1.648 ms, input{raw 2.656 GiB zip 780.123 MiB}