2024/11/24-01:12:31.378967 139957601228352 DEBG dcompact_worker.cpp:2214: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39153/att-00: fork to child time = 0.006301 sec 2024/11/24-01:12:31.379658 139957601228352 DEBG dcompact_worker.cpp:1013: Beg SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39153/att-00 2024/11/24-01:12:31.384567 139957601228352 DEBG dcompact_worker.cpp:1033: End SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39153/att-00 2024/11/24-01:12:31.385170 139957601228352 TRAC dcompact_worker.cpp:1083: INFO_LOG_LEVEL: rpc = INFO_LEVEL, env_var = undefined 2024/11/24-01:12:31.385372 139957601228352 [WARN] [column_family.cc:386] multiple cf_paths/db_paths and level_compaction_dynamic_level_bytes can't be used together 2024/11/24-01:12:31.440047 139957601228352 [version_set.cc:6208] Recovering from manifest file: /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-39153/att-00/MANIFEST-206347 2024/11/24-01:12:31.472346 139957601228352 [version_set.cc:6251] Recovered from manifest file:/worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-39153/att-00/MANIFEST-206347 succeeded,manifest_file_number is 206347, next_file_number is 286879, last_sequence is 4366507664, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 286716 2024/11/24-01:12:31.472352 139957601228352 [version_set.cc:6266] Column family [default] (ID 0), log number is 0 2024/11/24-01:12:31.472543 139957601228352 [version_set.cc:5721] Creating manifest 286879 2024/11/24-01:12:31.507294 139957601228352 DEBG dcompact_worker.cpp:1218: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39153/att-00: bottommost_level: fake = 1, rpc = 0 2024/11/24-01:12:31.533075 139957601228352 [compaction_job.cc:2437] [default] [JOB 39153] Compacting 1@2 + 14@3 files to L3, score 0.66, subcompactions 1 : 1 2024/11/24-01:12:31.533088 139957601228352 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 29336 Base level 2, inputs: [286833(27MB)], [286876(35MB) 286877(1050KB) 286784(35MB) 286791(35MB) 286792(35MB) 286793(35MB) 286794(35MB) 286795(34MB) 286796(33MB) 286797(34MB) 286798(31MB) 286799(34MB) 286800(34MB) 286855(34MB)] 2024/11/24-01:12:31.541045 139957601228352 [top_zip_table.cc:59] core git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/24-01:12:31.541071 139957601228352 [top_zip_table.cc:60] fsa git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/24-01:12:31.541086 139957601228352 [top_zip_table.cc:61] zbs git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/24-01:12:31.541090 139957601228352 [top_zip_table.cc:62] topling-zip_table_reader: git_version_hash_info_is: commit a4a382006cb82713acf5b3425835f22711877681 Author: leipeng Date: 2024-04-11 19:44:14 +0800 fixed_len_hole_index.cc: Add env bool FixedLenHoleIndexUseAVX512 for ut & debug 1. FixedLenHoleIndexUseAVX512 is only in unit tests or debug 2. In release mode, use avx512 by compile options(-march=) g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/24-01:12:31.541157 139957601228352 [top_zip_table.cc:64] topling-rocks git_version_hash_info_is: commit feab587e468621ba0204d47b4ffacc52e7c4290d Author: leipeng Date: 2024-03-22 13:35:06 +0800 ToplingZipTableBuilder::Add: immediately return after error This function returns void, and caller does not check builder->status() after calling this function and graceful abandon. So immediately return after error, and return error status in Finish(). g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/24-01:12:32.081847 139957601228352 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39153/att-00/286880.sst) /dev/shm/ToplingTemp/Topling-234918-1SXw6A 2024/11/24-01:12:32.662093 139957601228352 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39153/att-00/286880.sst): first pass time = 0.58's, 231.331'MB/sec 2024/11/24-01:12:34.242047 139957601228352 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39153/att-00/286880.sst): old prealloc_size = 147639500, real_size = 32832624 2024/11/24-01:12:34.242589 139957601228352 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39153/att-00/286880.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 925655 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0308 GB avg-val = 117.00 avg-zval = 33.32 2024/11/24-01:12:34.243396 139957601228352 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39153/att-00/286880.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-01:12:35.259864 139957601228352 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39153/att-00/286880.sst): second pass time = 1.58's, 68.608'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.02's, 36.168'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3384.617'MB/sec (index lex order gen) rebuild zvType time = 0.89's, 0.260'MB/sec write SST data time = 0.13's, 291.029'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 35791.486'MB/sec zip my value time = 1.58's, unzip length = 0.108'GB zip my value throughput = 68.608'MB/sec zip pipeline throughput = 68.608'MB/sec entries = 925655 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.00 avg-zval = 33.32 usrkeys = 925655 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.00 avg-zval = 33.32 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 925655 bytes = 3124096 } seq expand size = 6479585 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0308 GB dict = 1.08 MB all = 0.0368 GB } UnZip/Zip{ index = 10.5112 value = 3.5117 dict = 1.00 all = 3.6461 } Zip/UnZip{ index = 0.0951 value = 0.2848 dict = 1.00 all = 0.2743 } ---------------------------- total value len = 8.963399 GB avg = 0.168 KB (by entry num) total key len = 1.466739 GB avg = 0.028 KB total ukey len = 1.016391 GB avg = 0.015 KB total ukey num = 0.066476090 Billion total entry num = 0.053283819 Billion write speed all = 0.177858060 MB/sec (with seq num) write speed all = 0.170589158 MB/sec (without seq num) 2024/11/24-01:12:35.326159 139957601228352 [compaction_job.cc:1948] [default] [JOB 39153] Generated table #286880: 925655 keys, 36811582 bytes, temperature: kWarm 2024/11/24-01:12:35.326298 139957601228352 EVENT_LOG_v1 {"time_micros": 1732381955326217, "cf_name": "default", "job": 39153, "event": "table_file_creation", "file_number": 286880, "file_size": 36811582, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4261178686, "largest_seqno": 4366178188, "table_properties": {"data_size": 30839776, "index_size": 1761280, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25918340, "raw_average_key_size": 28, "raw_value_size": 108299450, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 925655, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732381952, "oldest_key_time": 0, "file_creation_time": 1732381952, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 286880, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-01:12:35.382704 139957601228352 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39153/att-00/286881.sst) /dev/shm/ToplingTemp/Topling-234918-3jFFcC 2024/11/24-01:12:36.260309 139957601228352 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39153/att-00/286881.sst): first pass time = 0.88's, 152.944'MB/sec 2024/11/24-01:12:37.598020 139957601228352 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39153/att-00/286881.sst): old prealloc_size = 147639500, real_size = 33161216 2024/11/24-01:12:37.598551 139957601228352 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39153/att-00/286881.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 925689 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1083 GB zip-val = 0.0312 GB avg-val = 116.99 avg-zval = 33.66 2024/11/24-01:12:37.599303 139957601228352 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39153/att-00/286881.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-01:12:38.444741 139957601228352 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39153/att-00/286881.sst): second pass time = 1.34's, 81.027'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.85's, 43.864'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3483.101'MB/sec (index lex order gen) rebuild zvType time = 0.72's, 0.321'MB/sec write SST data time = 0.13's, 294.763'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 34446.712'MB/sec zip my value time = 1.34's, unzip length = 0.108'GB zip my value throughput = 81.027'MB/sec zip pipeline throughput = 81.027'MB/sec entries = 925689 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.99 avg-zval = 33.66 usrkeys = 925689 avg-key = 20.00 avg-zkey = 1.91 avg-val = 123.99 avg-zval = 33.66 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 925689 bytes = 3124208 } seq expand size = 6479823 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0312 GB dict = 1.08 MB all = 0.0371 GB } UnZip/Zip{ index = 10.4440 value = 3.4759 dict = 1.00 all = 3.6138 } Zip/UnZip{ index = 0.0957 value = 0.2877 dict = 1.00 all = 0.2767 } ---------------------------- total value len = 9.078177 GB avg = 0.167 KB (by entry num) total key len = 1.492659 GB avg = 0.028 KB total ukey len = 1.034905 GB avg = 0.015 KB total ukey num = 0.067401779 Billion total entry num = 0.054209508 Billion write speed all = 0.180247492 MB/sec (with seq num) write speed all = 0.172852710 MB/sec (without seq num) 2024/11/24-01:12:38.490569 139957601228352 [compaction_job.cc:1948] [default] [JOB 39153] Generated table #286881: 925689 keys, 37140282 bytes, temperature: kWarm 2024/11/24-01:12:38.490642 139957601228352 EVENT_LOG_v1 {"time_micros": 1732381958490605, "cf_name": "default", "job": 39153, "event": "table_file_creation", "file_number": 286881, "file_size": 37140282, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4261178700, "largest_seqno": 4366178204, "table_properties": {"data_size": 31156912, "index_size": 1772672, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25919292, "raw_average_key_size": 28, "raw_value_size": 108298530, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 925689, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732381955, "oldest_key_time": 0, "file_creation_time": 1732381955, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 286881, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-01:12:38.558921 139957601228352 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39153/att-00/286882.sst) /dev/shm/ToplingTemp/Topling-234918-EWeVfA 2024/11/24-01:12:39.429074 139957601228352 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39153/att-00/286882.sst): first pass time = 0.87's, 154.255'MB/sec 2024/11/24-01:12:40.772478 139957601228352 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39153/att-00/286882.sst): old prealloc_size = 147639500, real_size = 33312704 2024/11/24-01:12:40.773029 139957601228352 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39153/att-00/286882.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 925642 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0313 GB avg-val = 117.00 avg-zval = 33.84 2024/11/24-01:12:40.773774 139957601228352 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39153/att-00/286882.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-01:12:41.621349 139957601228352 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39153/att-00/286882.sst): second pass time = 1.34's, 80.700'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.85's, 43.932'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3322.014'MB/sec (index lex order gen) rebuild zvType time = 0.72's, 0.321'MB/sec write SST data time = 0.13's, 294.743'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 35065.485'MB/sec zip my value time = 1.34's, unzip length = 0.108'GB zip my value throughput = 80.700'MB/sec zip pipeline throughput = 80.700'MB/sec entries = 925642 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.00 avg-zval = 33.84 usrkeys = 925642 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.00 avg-zval = 33.84 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 925642 bytes = 3124064 } seq expand size = 6479494 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0313 GB dict = 1.08 MB all = 0.0373 GB } UnZip/Zip{ index = 10.5129 value = 3.4578 dict = 1.00 all = 3.5991 } Zip/UnZip{ index = 0.0951 value = 0.2892 dict = 1.00 all = 0.2778 } ---------------------------- total value len = 9.192957 GB avg = 0.167 KB (by entry num) total key len = 1.518577 GB avg = 0.028 KB total ukey len = 1.053418 GB avg = 0.015 KB total ukey num = 0.068327421 Billion total entry num = 0.055135150 Billion write speed all = 0.182636686 MB/sec (with seq num) write speed all = 0.175116044 MB/sec (without seq num) 2024/11/24-01:12:41.667624 139957601228352 [compaction_job.cc:1948] [default] [JOB 39153] Generated table #286882: 925642 keys, 37291794 bytes, temperature: kWarm 2024/11/24-01:12:41.667694 139957601228352 EVENT_LOG_v1 {"time_micros": 1732381961667659, "cf_name": "default", "job": 39153, "event": "table_file_creation", "file_number": 286882, "file_size": 37291794, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4261178719, "largest_seqno": 4366178481, "table_properties": {"data_size": 31320176, "index_size": 1760960, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25917976, "raw_average_key_size": 28, "raw_value_size": 108299896, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 925642, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732381958, "oldest_key_time": 0, "file_creation_time": 1732381958, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 286882, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-01:12:41.709090 139957601228352 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39153/att-00/286883.sst) /dev/shm/ToplingTemp/Topling-234918-16icLA 2024/11/24-01:12:42.583569 139957601228352 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39153/att-00/286883.sst): first pass time = 0.87's, 153.490'MB/sec 2024/11/24-01:12:43.949876 139957601228352 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39153/att-00/286883.sst): old prealloc_size = 147639500, real_size = 33486752 2024/11/24-01:12:43.950456 139957601228352 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39153/att-00/286883.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 925922 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0315 GB avg-val = 116.96 avg-zval = 34.01 2024/11/24-01:12:43.951229 139957601228352 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39153/att-00/286883.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-01:12:44.805662 139957601228352 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39153/att-00/286883.sst): second pass time = 1.36's, 79.338'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.86's, 43.782'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3156.765'MB/sec (index lex order gen) rebuild zvType time = 0.73's, 0.317'MB/sec write SST data time = 0.13's, 297.470'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 29758.385'MB/sec zip my value time = 1.36's, unzip length = 0.108'GB zip my value throughput = 79.338'MB/sec zip pipeline throughput = 79.338'MB/sec entries = 925922 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.96 avg-zval = 34.01 usrkeys = 925922 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.96 avg-zval = 34.01 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 925922 bytes = 3125008 } seq expand size = 6481454 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0315 GB dict = 1.08 MB all = 0.0375 GB } UnZip/Zip{ index = 10.5119 value = 3.4386 dict = 1.00 all = 3.5823 } Zip/UnZip{ index = 0.0951 value = 0.2908 dict = 1.00 all = 0.2791 } ---------------------------- total value len = 9.307730 GB avg = 0.166 KB (by entry num) total key len = 1.544503 GB avg = 0.028 KB total ukey len = 1.071936 GB avg = 0.015 KB total ukey num = 0.069253343 Billion total entry num = 0.056061072 Billion write speed all = 0.185025628 MB/sec (with seq num) write speed all = 0.177379101 MB/sec (without seq num) 2024/11/24-01:12:44.855320 139957601228352 [compaction_job.cc:1948] [default] [JOB 39153] Generated table #286883: 925922 keys, 37466710 bytes, temperature: kWarm 2024/11/24-01:12:44.855392 139957601228352 EVENT_LOG_v1 {"time_micros": 1732381964855356, "cf_name": "default", "job": 39153, "event": "table_file_creation", "file_number": 286883, "file_size": 37466710, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4261178730, "largest_seqno": 4366178238, "table_properties": {"data_size": 31493392, "index_size": 1761664, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25925816, "raw_average_key_size": 28, "raw_value_size": 108291936, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 925922, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732381961, "oldest_key_time": 0, "file_creation_time": 1732381961, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 286883, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-01:12:44.894266 139957601228352 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39153/att-00/286884.sst) /dev/shm/ToplingTemp/Topling-234918-6uQOlB 2024/11/24-01:12:45.735578 139957601228352 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39153/att-00/286884.sst): first pass time = 0.84's, 159.541'MB/sec 2024/11/24-01:12:47.066600 139957601228352 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39153/att-00/286884.sst): old prealloc_size = 147639500, real_size = 33630096 2024/11/24-01:12:47.067171 139957601228352 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39153/att-00/286884.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 925698 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0316 GB avg-val = 116.99 avg-zval = 34.18 2024/11/24-01:12:47.067934 139957601228352 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39153/att-00/286884.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-01:12:47.920947 139957601228352 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39153/att-00/286884.sst): second pass time = 1.33's, 81.439'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.85's, 44.022'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3230.528'MB/sec (index lex order gen) rebuild zvType time = 0.73's, 0.318'MB/sec write SST data time = 0.13's, 297.909'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 28793.850'MB/sec zip my value time = 1.33's, unzip length = 0.108'GB zip my value throughput = 81.439'MB/sec zip pipeline throughput = 81.439'MB/sec entries = 925698 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.99 avg-zval = 34.18 usrkeys = 925698 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.99 avg-zval = 34.18 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 925698 bytes = 3124240 } seq expand size = 6479886 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0316 GB dict = 1.08 MB all = 0.0376 GB } UnZip/Zip{ index = 10.5139 value = 3.4231 dict = 1.00 all = 3.5687 } Zip/UnZip{ index = 0.0951 value = 0.2921 dict = 1.00 all = 0.2802 } ---------------------------- total value len = 9.422508 GB avg = 0.165 KB (by entry num) total key len = 1.570422 GB avg = 0.028 KB total ukey len = 1.090450 GB avg = 0.016 KB total ukey num = 0.070179041 Billion total entry num = 0.056986770 Billion write speed all = 0.187414504 MB/sec (with seq num) write speed all = 0.179642128 MB/sec (without seq num) 2024/11/24-01:12:47.966793 139957601228352 [compaction_job.cc:1948] [default] [JOB 39153] Generated table #286884: 925698 keys, 37609238 bytes, temperature: kWarm 2024/11/24-01:12:47.966866 139957601228352 EVENT_LOG_v1 {"time_micros": 1732381967966831, "cf_name": "default", "job": 39153, "event": "table_file_creation", "file_number": 286884, "file_size": 37609238, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4265680186, "largest_seqno": 4366179234, "table_properties": {"data_size": 31637568, "index_size": 1760896, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25919544, "raw_average_key_size": 28, "raw_value_size": 108298188, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 925698, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732381964, "oldest_key_time": 0, "file_creation_time": 1732381964, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 286884, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-01:12:48.004304 139957601228352 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39153/att-00/286885.sst) /dev/shm/ToplingTemp/Topling-234918-ziMk2B 2024/11/24-01:12:48.906315 139957601228352 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39153/att-00/286885.sst): first pass time = 0.90's, 148.805'MB/sec 2024/11/24-01:12:50.239697 139957601228352 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39153/att-00/286885.sst): old prealloc_size = 147639500, real_size = 33562832 2024/11/24-01:12:50.240285 139957601228352 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39153/att-00/286885.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 925731 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1083 GB zip-val = 0.0316 GB avg-val = 116.99 avg-zval = 34.09 2024/11/24-01:12:50.241047 139957601228352 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39153/att-00/286885.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-01:12:51.097909 139957601228352 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39153/att-00/286885.sst): second pass time = 1.33's, 81.270'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.86's, 43.746'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3137.367'MB/sec (index lex order gen) rebuild zvType time = 0.73's, 0.316'MB/sec write SST data time = 0.13's, 297.247'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 32986.567'MB/sec zip my value time = 1.33's, unzip length = 0.108'GB zip my value throughput = 81.270'MB/sec zip pipeline throughput = 81.270'MB/sec entries = 925731 avg-key = 28.00 avg-zkey = 1.92 avg-val = 116.99 avg-zval = 34.09 usrkeys = 925731 avg-key = 20.00 avg-zkey = 1.92 avg-val = 123.99 avg-zval = 34.09 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 925731 bytes = 3124352 } seq expand size = 6480117 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0316 GB dict = 1.08 MB all = 0.0375 GB } UnZip/Zip{ index = 10.4426 value = 3.4317 dict = 1.00 all = 3.5751 } Zip/UnZip{ index = 0.0958 value = 0.2914 dict = 1.00 all = 0.2797 } ---------------------------- total value len = 9.537286 GB avg = 0.165 KB (by entry num) total key len = 1.596343 GB avg = 0.028 KB total ukey len = 1.108965 GB avg = 0.016 KB total ukey num = 0.071104772 Billion total entry num = 0.057912501 Billion write speed all = 0.189802933 MB/sec (with seq num) write speed all = 0.181904725 MB/sec (without seq num) 2024/11/24-01:12:51.143714 139957601228352 [compaction_job.cc:1948] [default] [JOB 39153] Generated table #286885: 925731 keys, 37542026 bytes, temperature: kWarm 2024/11/24-01:12:51.143789 139957601228352 EVENT_LOG_v1 {"time_micros": 1732381971143752, "cf_name": "default", "job": 39153, "event": "table_file_creation", "file_number": 286885, "file_size": 37542026, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4265680199, "largest_seqno": 4366178580, "table_properties": {"data_size": 31558208, "index_size": 1772992, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25920468, "raw_average_key_size": 28, "raw_value_size": 108297398, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 925731, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732381967, "oldest_key_time": 0, "file_creation_time": 1732381967, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 286885, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-01:12:51.187912 139957601228352 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39153/att-00/286886.sst) /dev/shm/ToplingTemp/Topling-234918-ooWakz 2024/11/24-01:12:52.195512 139957601228352 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39153/att-00/286886.sst): first pass time = 1.01's, 133.210'MB/sec 2024/11/24-01:12:53.533150 139957601228352 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39153/att-00/286886.sst): old prealloc_size = 147639500, real_size = 32965200 2024/11/24-01:12:53.533727 139957601228352 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39153/att-00/286886.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927111 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1083 GB zip-val = 0.0310 GB avg-val = 116.77 avg-zval = 33.39 2024/11/24-01:12:53.534481 139957601228352 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39153/att-00/286886.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-01:12:54.385207 139957601228352 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39153/att-00/286886.sst): second pass time = 1.34's, 81.009'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.85's, 43.366'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3207.274'MB/sec (index lex order gen) rebuild zvType time = 0.72's, 0.320'MB/sec write SST data time = 0.13's, 289.075'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 31181.839'MB/sec zip my value time = 1.34's, unzip length = 0.108'GB zip my value throughput = 81.009'MB/sec zip pipeline throughput = 81.009'MB/sec entries = 927111 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.77 avg-zval = 33.39 usrkeys = 927111 avg-key = 20.00 avg-zkey = 1.91 avg-val = 123.77 avg-zval = 33.39 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 927111 bytes = 3129008 } seq expand size = 6489777 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0310 GB dict = 1.08 MB all = 0.0369 GB } UnZip/Zip{ index = 10.4465 value = 3.4969 dict = 1.00 all = 3.6326 } Zip/UnZip{ index = 0.0957 value = 0.2860 dict = 1.00 all = 0.2753 } ---------------------------- total value len = 9.652034 GB avg = 0.164 KB (by entry num) total key len = 1.622302 GB avg = 0.028 KB total ukey len = 1.127507 GB avg = 0.016 KB total ukey num = 0.072031883 Billion total entry num = 0.058839612 Billion write speed all = 0.192190905 MB/sec (with seq num) write speed all = 0.184166707 MB/sec (without seq num) 2024/11/24-01:12:54.431299 139957601228352 [compaction_job.cc:1948] [default] [JOB 39153] Generated table #286886: 927111 keys, 36948502 bytes, temperature: kWarm 2024/11/24-01:12:54.431370 139957601228352 EVENT_LOG_v1 {"time_micros": 1732381974431335, "cf_name": "default", "job": 39153, "event": "table_file_creation", "file_number": 286886, "file_size": 36948502, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4265680212, "largest_seqno": 4366178842, "table_properties": {"data_size": 30958272, "index_size": 1774976, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25959108, "raw_average_key_size": 28, "raw_value_size": 108258714, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927111, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732381971, "oldest_key_time": 0, "file_creation_time": 1732381971, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 286886, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-01:12:54.477666 139957601228352 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39153/att-00/286887.sst) /dev/shm/ToplingTemp/Topling-234918-rUfB7C 2024/11/24-01:12:55.450057 139957601228352 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39153/att-00/286887.sst): first pass time = 0.97's, 138.037'MB/sec 2024/11/24-01:12:56.773001 139957601228352 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39153/att-00/286887.sst): old prealloc_size = 147639500, real_size = 31799568 2024/11/24-01:12:56.773590 139957601228352 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39153/att-00/286887.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 934253 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1081 GB zip-val = 0.0298 GB avg-val = 115.66 avg-zval = 31.87 2024/11/24-01:12:56.774365 139957601228352 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39153/att-00/286887.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-01:12:57.619653 139957601228352 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39153/att-00/286887.sst): second pass time = 1.32's, 81.754'MB/sec, value only(80.5% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.85's, 42.293'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3163.271'MB/sec (index lex order gen) rebuild zvType time = 0.72's, 0.326'MB/sec write SST data time = 0.13's, 278.480'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 33233.648'MB/sec zip my value time = 1.32's, unzip length = 0.108'GB zip my value throughput = 81.754'MB/sec zip pipeline throughput = 81.754'MB/sec entries = 934253 avg-key = 28.00 avg-zkey = 1.92 avg-val = 115.66 avg-zval = 31.87 usrkeys = 934253 avg-key = 20.00 avg-zkey = 1.92 avg-val = 122.66 avg-zval = 31.87 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 934253 bytes = 3153120 } seq expand size = 6539771 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0187 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0298 GB dict = 1.08 MB all = 0.0358 GB } UnZip/Zip{ index = 10.4433 value = 3.6290 dict = 1.00 all = 3.7484 } Zip/UnZip{ index = 0.0958 value = 0.2756 dict = 1.00 all = 0.2668 } ---------------------------- total value len = 9.766633 GB avg = 0.163 KB (by entry num) total key len = 1.648461 GB avg = 0.028 KB total ukey len = 1.146192 GB avg = 0.016 KB total ukey num = 0.072966136 Billion total entry num = 0.059773865 Billion write speed all = 0.194579638 MB/sec (with seq num) write speed all = 0.186428481 MB/sec (without seq num) 2024/11/24-01:12:57.665374 139957601228352 [compaction_job.cc:1948] [default] [JOB 39153] Generated table #286887: 934253 keys, 35806886 bytes, temperature: kWarm 2024/11/24-01:12:57.665454 139957601228352 EVENT_LOG_v1 {"time_micros": 1732381977665413, "cf_name": "default", "job": 39153, "event": "table_file_creation", "file_number": 286887, "file_size": 35806886, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4265679834, "largest_seqno": 4366178916, "table_properties": {"data_size": 29776640, "index_size": 1789184, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26159084, "raw_average_key_size": 28, "raw_value_size": 108058738, "raw_average_value_size": 115, "num_data_blocks": 1, "num_entries": 934253, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732381974, "oldest_key_time": 0, "file_creation_time": 1732381974, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 286887, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-01:12:57.701541 139957601228352 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39153/att-00/286888.sst) /dev/shm/ToplingTemp/Topling-234918-xKKiCz 2024/11/24-01:12:58.727244 139957601228352 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39153/att-00/286888.sst): first pass time = 1.03's, 130.861'MB/sec 2024/11/24-01:13:00.058596 139957601228352 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39153/att-00/286888.sst): old prealloc_size = 147639500, real_size = 32151856 2024/11/24-01:13:00.059154 139957601228352 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39153/att-00/286888.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 935321 prefix = 4 raw-key = 0.0150 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1080 GB zip-val = 0.0301 GB avg-val = 115.50 avg-zval = 32.22 2024/11/24-01:13:00.059911 139957601228352 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39153/att-00/286888.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-01:13:00.917103 139957601228352 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39153/att-00/286888.sst): second pass time = 1.33's, 81.193'MB/sec, value only(80.5% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.86's, 42.119'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3331.709'MB/sec (index lex order gen) rebuild zvType time = 0.73's, 0.320'MB/sec write SST data time = 0.13's, 283.376'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 27511.909'MB/sec zip my value time = 1.33's, unzip length = 0.108'GB zip my value throughput = 81.193'MB/sec zip pipeline throughput = 81.193'MB/sec entries = 935321 avg-key = 28.00 avg-zkey = 1.90 avg-val = 115.50 avg-zval = 32.22 usrkeys = 935321 avg-key = 20.00 avg-zkey = 1.90 avg-val = 122.50 avg-zval = 32.22 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 935321 bytes = 3156720 } seq expand size = 6547247 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0187 GB value = 0.1080 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0301 GB dict = 1.08 MB all = 0.0362 GB } UnZip/Zip{ index = 10.5124 value = 3.5844 dict = 1.00 all = 3.7119 } Zip/UnZip{ index = 0.0951 value = 0.2790 dict = 1.00 all = 0.2694 } ---------------------------- total value len = 9.881209 GB avg = 0.163 KB (by entry num) total key len = 1.674650 GB avg = 0.028 KB total ukey len = 1.164898 GB avg = 0.016 KB total ukey num = 0.073901457 Billion total entry num = 0.060709186 Billion write speed all = 0.196968021 MB/sec (with seq num) write speed all = 0.188689783 MB/sec (without seq num) 2024/11/24-01:13:00.961599 139957601228352 [compaction_job.cc:1948] [default] [JOB 39153] Generated table #286888: 935321 keys, 36158380 bytes, temperature: kWarm 2024/11/24-01:13:00.961673 139957601228352 EVENT_LOG_v1 {"time_micros": 1732381980961637, "cf_name": "default", "job": 39153, "event": "table_file_creation", "file_number": 286888, "file_size": 36158380, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4265679848, "largest_seqno": 4366179159, "table_properties": {"data_size": 30138400, "index_size": 1779456, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26188988, "raw_average_key_size": 28, "raw_value_size": 108028750, "raw_average_value_size": 115, "num_data_blocks": 1, "num_entries": 935321, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732381977, "oldest_key_time": 0, "file_creation_time": 1732381977, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 286888, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-01:13:00.997234 139957601228352 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39153/att-00/286889.sst) /dev/shm/ToplingTemp/Topling-234918-gV3tEz 2024/11/24-01:13:01.986367 139957601228352 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39153/att-00/286889.sst): first pass time = 0.99's, 135.699'MB/sec 2024/11/24-01:13:03.279876 139957601228352 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39153/att-00/286889.sst): old prealloc_size = 147639500, real_size = 29341824 2024/11/24-01:13:03.280459 139957601228352 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39153/att-00/286889.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 936606 prefix = 4 raw-key = 0.0150 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1080 GB zip-val = 0.0273 GB avg-val = 115.30 avg-zval = 29.16 2024/11/24-01:13:03.281221 139957601228352 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39153/att-00/286889.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-01:13:04.110614 139957601228352 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39153/att-00/286889.sst): second pass time = 1.29's, 83.537'MB/sec, value only(80.5% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.83's, 40.146'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3186.713'MB/sec (index lex order gen) rebuild zvType time = 0.70's, 0.333'MB/sec write SST data time = 0.13's, 260.981'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.077'MB, throughput = 31679.579'MB/sec zip my value time = 1.29's, unzip length = 0.108'GB zip my value throughput = 83.537'MB/sec zip pipeline throughput = 83.537'MB/sec entries = 936606 avg-key = 28.00 avg-zkey = 1.91 avg-val = 115.30 avg-zval = 29.16 usrkeys = 936606 avg-key = 20.00 avg-zkey = 1.91 avg-val = 122.30 avg-zval = 29.16 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 936606 bytes = 3161056 } seq expand size = 6556242 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0187 GB value = 0.1080 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0273 GB dict = 1.08 MB all = 0.0333 GB } UnZip/Zip{ index = 10.4439 value = 3.9538 dict = 1.00 all = 4.0245 } Zip/UnZip{ index = 0.0957 value = 0.2529 dict = 1.00 all = 0.2485 } ---------------------------- total value len = 9.995758 GB avg = 0.162 KB (by entry num) total key len = 1.700875 GB avg = 0.028 KB total ukey len = 1.183631 GB avg = 0.016 KB total ukey num = 0.074838063 Billion total entry num = 0.061645792 Billion write speed all = 0.199356644 MB/sec (with seq num) write speed all = 0.190951148 MB/sec (without seq num) 2024/11/24-01:13:04.152586 139957601228352 [compaction_job.cc:1948] [default] [JOB 39153] Generated table #286889: 936606 keys, 33349794 bytes, temperature: kWarm 2024/11/24-01:13:04.152662 139957601228352 EVENT_LOG_v1 {"time_micros": 1732381984152619, "cf_name": "default", "job": 39153, "event": "table_file_creation", "file_number": 286889, "file_size": 33349794, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4276611082, "largest_seqno": 4366178612, "table_properties": {"data_size": 27313904, "index_size": 1793600, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26224968, "raw_average_key_size": 28, "raw_value_size": 107992796, "raw_average_value_size": 115, "num_data_blocks": 1, "num_entries": 936606, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732381980, "oldest_key_time": 0, "file_creation_time": 1732381980, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 286889, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-01:13:04.201709 139957601228352 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39153/att-00/286890.sst) /dev/shm/ToplingTemp/Topling-234918-4CxHaz 2024/11/24-01:13:05.223738 139957601228352 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39153/att-00/286890.sst): first pass time = 1.02's, 131.330'MB/sec 2024/11/24-01:13:06.521961 139957601228352 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39153/att-00/286890.sst): old prealloc_size = 147639500, real_size = 32946080 2024/11/24-01:13:06.522536 139957601228352 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39153/att-00/286890.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 925073 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0310 GB avg-val = 117.09 avg-zval = 33.46 2024/11/24-01:13:06.523329 139957601228352 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39153/att-00/286890.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-01:13:07.370234 139957601228352 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39153/att-00/286890.sst): second pass time = 1.30's, 83.488'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.85's, 43.529'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3335.283'MB/sec (index lex order gen) rebuild zvType time = 0.72's, 0.322'MB/sec write SST data time = 0.13's, 287.560'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 34788.564'MB/sec zip my value time = 1.30's, unzip length = 0.108'GB zip my value throughput = 83.488'MB/sec zip pipeline throughput = 83.488'MB/sec entries = 925073 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.09 avg-zval = 33.46 usrkeys = 925073 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.09 avg-zval = 33.46 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 925073 bytes = 3122144 } seq expand size = 6475511 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0310 GB dict = 1.08 MB all = 0.0369 GB } UnZip/Zip{ index = 10.5149 value = 3.4991 dict = 1.00 all = 3.6350 } Zip/UnZip{ index = 0.0951 value = 0.2858 dict = 1.00 all = 0.2751 } ---------------------------- total value len = 10.110549 GB avg = 0.162 KB (by entry num) total key len = 1.726777 GB avg = 0.028 KB total ukey len = 1.202132 GB avg = 0.016 KB total ukey num = 0.075763136 Billion total entry num = 0.062570865 Billion write speed all = 0.201743402 MB/sec (with seq num) write speed all = 0.193212246 MB/sec (without seq num) 2024/11/24-01:13:07.416055 139957601228352 [compaction_job.cc:1948] [default] [JOB 39153] Generated table #286890: 925073 keys, 36923266 bytes, temperature: kWarm 2024/11/24-01:13:07.416126 139957601228352 EVENT_LOG_v1 {"time_micros": 1732381987416090, "cf_name": "default", "job": 39153, "event": "table_file_creation", "file_number": 286890, "file_size": 36923266, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4265679865, "largest_seqno": 4366178888, "table_properties": {"data_size": 30955088, "index_size": 1759552, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25902044, "raw_average_key_size": 28, "raw_value_size": 108315706, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 925073, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732381984, "oldest_key_time": 0, "file_creation_time": 1732381984, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 286890, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-01:13:07.475571 139957601228352 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39153/att-00/286891.sst) /dev/shm/ToplingTemp/Topling-234918-FpbQWy 2024/11/24-01:13:08.460780 139957601228352 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39153/att-00/286891.sst): first pass time = 0.99's, 136.238'MB/sec 2024/11/24-01:13:09.793900 139957601228352 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39153/att-00/286891.sst): old prealloc_size = 147639500, real_size = 32505792 2024/11/24-01:13:09.794466 139957601228352 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39153/att-00/286891.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 932548 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1081 GB zip-val = 0.0305 GB avg-val = 115.93 avg-zval = 32.70 2024/11/24-01:13:09.795221 139957601228352 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39153/att-00/286891.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-01:13:10.652600 139957601228352 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39153/att-00/286891.sst): second pass time = 1.33's, 81.144'MB/sec, value only(80.5% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.86's, 42.511'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3263.456'MB/sec (index lex order gen) rebuild zvType time = 0.73's, 0.319'MB/sec write SST data time = 0.13's, 287.859'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 32841.409'MB/sec zip my value time = 1.33's, unzip length = 0.108'GB zip my value throughput = 81.144'MB/sec zip pipeline throughput = 81.144'MB/sec entries = 932548 avg-key = 28.00 avg-zkey = 1.90 avg-val = 115.93 avg-zval = 32.70 usrkeys = 932548 avg-key = 20.00 avg-zkey = 1.90 avg-val = 122.93 avg-zval = 32.70 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 932548 bytes = 3147360 } seq expand size = 6527836 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0187 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0305 GB dict = 1.08 MB all = 0.0365 GB } UnZip/Zip{ index = 10.5130 value = 3.5447 dict = 1.00 all = 3.6768 } Zip/UnZip{ index = 0.0951 value = 0.2821 dict = 1.00 all = 0.2720 } ---------------------------- total value len = 10.225183 GB avg = 0.161 KB (by entry num) total key len = 1.752888 GB avg = 0.028 KB total ukey len = 1.220783 GB avg = 0.016 KB total ukey num = 0.076695684 Billion total entry num = 0.063503413 Billion write speed all = 0.204130708 MB/sec (with seq num) write speed all = 0.195472889 MB/sec (without seq num) 2024/11/24-01:13:10.697091 139957601228352 [compaction_job.cc:1948] [default] [JOB 39153] Generated table #286891: 932548 keys, 36503530 bytes, temperature: kWarm 2024/11/24-01:13:10.697164 139957601228352 EVENT_LOG_v1 {"time_micros": 1732381990697127, "cf_name": "default", "job": 39153, "event": "table_file_creation", "file_number": 286891, "file_size": 36503530, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4265679880, "largest_seqno": 4366178631, "table_properties": {"data_size": 30498416, "index_size": 1774080, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26111344, "raw_average_key_size": 28, "raw_value_size": 108106388, "raw_average_value_size": 115, "num_data_blocks": 1, "num_entries": 932548, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732381987, "oldest_key_time": 0, "file_creation_time": 1732381987, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 286891, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-01:13:10.736608 139957601228352 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39153/att-00/286892.sst) /dev/shm/ToplingTemp/Topling-234918-RsCAPy 2024/11/24-01:13:11.648032 139957601228352 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39153/att-00/286892.sst): first pass time = 0.91's, 147.268'MB/sec 2024/11/24-01:13:12.953377 139957601228352 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39153/att-00/286892.sst): old prealloc_size = 147639500, real_size = 31004368 2024/11/24-01:13:12.953901 139957601228352 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39153/att-00/286892.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 929915 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0290 GB avg-val = 116.33 avg-zval = 31.19 2024/11/24-01:13:12.954684 139957601228352 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39153/att-00/286892.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-01:13:13.811193 139957601228352 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39153/att-00/286892.sst): second pass time = 1.30's, 82.927'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.86's, 40.797'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3551.280'MB/sec (index lex order gen) rebuild zvType time = 0.73's, 0.321'MB/sec write SST data time = 0.13's, 264.794'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 32527.179'MB/sec zip my value time = 1.30's, unzip length = 0.108'GB zip my value throughput = 82.927'MB/sec zip pipeline throughput = 82.927'MB/sec entries = 929915 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.33 avg-zval = 31.19 usrkeys = 929915 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.33 avg-zval = 31.19 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 929915 bytes = 3138480 } seq expand size = 6509405 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0290 GB dict = 1.08 MB all = 0.0350 GB } UnZip/Zip{ index = 10.5129 value = 3.7300 dict = 1.00 all = 3.8353 } Zip/UnZip{ index = 0.0951 value = 0.2681 dict = 1.00 all = 0.2607 } ---------------------------- total value len = 10.339873 GB avg = 0.160 KB (by entry num) total key len = 1.778926 GB avg = 0.028 KB total ukey len = 1.239381 GB avg = 0.016 KB total ukey num = 0.077625599 Billion total entry num = 0.064433328 Billion write speed all = 0.206517869 MB/sec (with seq num) write speed all = 0.197733742 MB/sec (without seq num) 2024/11/24-01:13:13.859677 139957601228352 [compaction_job.cc:1948] [default] [JOB 39153] Generated table #286892: 929915 keys, 34995070 bytes, temperature: kWarm 2024/11/24-01:13:13.859748 139957601228352 EVENT_LOG_v1 {"time_micros": 1732381993859712, "cf_name": "default", "job": 39153, "event": "table_file_creation", "file_number": 286892, "file_size": 34995070, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4265679891, "largest_seqno": 4366178645, "table_properties": {"data_size": 29002624, "index_size": 1769088, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26037620, "raw_average_key_size": 28, "raw_value_size": 108180194, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 929915, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732381990, "oldest_key_time": 0, "file_creation_time": 1732381990, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 286892, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-01:13:13.905486 139957601228352 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39153/att-00/286893.sst) /dev/shm/ToplingTemp/Topling-234918-0hFkCz 2024/11/24-01:13:13.999835 139957601228352 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39153/att-00/286893.sst): first pass time = 0.09's, 235.503'MB/sec 2024/11/24-01:13:14.206674 139957601228352 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39153/att-00/286893.sst): old prealloc_size = 147639500, real_size = 6495936 2024/11/24-01:13:14.206823 139957601228352 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39153/att-00/286893.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 152123 prefix = 4 raw-key = 0.0024 GB zip-key = 0.0003 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.0180 GB zip-val = 0.0062 GB avg-val = 118.00 avg-zval = 40.53 2024/11/24-01:13:14.207012 139957601228352 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39153/att-00/286893.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.022 GB 2024/11/24-01:13:14.342261 139957601228352 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39153/att-00/286893.sst): second pass time = 0.21's, 87.074'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.14's, 52.542'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2357.192'MB/sec (index lex order gen) rebuild zvType time = 0.11's, 0.333'MB/sec write SST data time = 0.02's, 335.052'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.188'MB, throughput = 5819.008'MB/sec zip my value time = 0.21's, unzip length = 0.018'GB zip my value throughput = 87.074'MB/sec zip pipeline throughput = 87.074'MB/sec entries = 152123 avg-key = 28.00 avg-zkey = 1.92 avg-val = 118.00 avg-zval = 40.53 usrkeys = 152123 avg-key = 20.00 avg-zkey = 1.92 avg-val = 125.00 avg-zval = 40.53 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 152123 bytes = 475392 } seq expand size = 1064861 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0030 GB value = 0.0180 GB dict = 0.19 MB all = 0.0222 GB } __ZipSize{ index = 0.0003 GB value = 0.0062 GB dict = 0.19 MB all = 0.0071 GB } UnZip/Zip{ index = 10.4000 value = 2.9116 dict = 1.00 all = 3.1181 } Zip/UnZip{ index = 0.0962 value = 0.3435 dict = 1.00 all = 0.3207 } ---------------------------- total value len = 10.358888 GB avg = 0.160 KB (by entry num) total key len = 1.783185 GB avg = 0.028 KB total ukey len = 1.242424 GB avg = 0.016 KB total ukey num = 0.077777722 Billion total entry num = 0.064585451 Billion write speed all = 0.206912626 MB/sec (with seq num) write speed all = 0.198107839 MB/sec (without seq num) 2024/11/24-01:13:14.358052 139957601228352 [compaction_job.cc:1948] [default] [JOB 39153] Generated table #286893: 152123 keys, 7123025 bytes, temperature: kWarm 2024/11/24-01:13:14.358102 139957601228352 EVENT_LOG_v1 {"time_micros": 1732381994358075, "cf_name": "default", "job": 39153, "event": "table_file_creation", "file_number": 286893, "file_size": 7123025, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4271731951, "largest_seqno": 4289010926, "table_properties": {"data_size": 6165168, "index_size": 292544, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 4259444, "raw_average_key_size": 28, "raw_value_size": 17950514, "raw_average_value_size": 118, "num_data_blocks": 1, "num_entries": 152123, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 118, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732381993, "oldest_key_time": 0, "file_creation_time": 1732381993, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 286893, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-01:13:14.369779 139957601228352 [compaction_job.cc:703] job-39153: subcompact[0], size: 0.481670 G, files: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39153/att-00 [286880,286881,286882,286883,286884,286885,286886,286887,286888,286889,286890,286891,286892,286893] 2024/11/24-01:13:14.452514 139957601228352 (Original Log Time 2024/11/24-01:12:31.533124) EVENT_LOG_v1 {"time_micros": 1732381951533096, "job": 39153, "event": "compaction_started", "compaction_reason": "FilesMarkedForCompaction", "files_L2": [286833], "files_L3": [286876, 286877, 286784, 286791, 286792, 286793, 286794, 286795, 286796, 286797, 286798, 286799, 286800, 286855], "score": 0.655307, "input_data_size": 502707881, "oldest_snapshot_seqno": 4366507578} 2024/11/24-01:13:14.452517 139957601228352 (Original Log Time 2024/11/24-01:13:14.451365) [compaction_job.cc:2022] [default] [JOB 39153] Compacted 1@2 + 14@3 files to L3 => 481670085 bytes 2024/11/24-01:13:14.452518 139957601228352 (Original Log Time 2024/11/24-01:13:14.452452) [compaction_job.cc:1224] [default] compacted to: files[0 0 0 14 0 0 0] max score 0.02, MB/sec: 11.7 rd, 11.2 wr, level 3, files in(1, 14) out(14 +0 blob) MB in(27.1, 452.3 +0.0 blob) out(459.4 +0.0 blob), read-write-amplify(34.7) write-amplify(17.0) OK, records in: 12327923, records dropped: 100636 output_compression: Snappy 2024/11/24-01:13:14.452524 139957601228352 (Original Log Time 2024/11/24-01:13:14.452494) EVENT_LOG_v1 {"time_micros": 1732381994452475, "cf": "default", "job": 39153, "event": "compaction_finished", "compaction_time_micros": 42836659, "compaction_time_cpu_micros": 18732855, "output_level": 3, "num_output_files": 14, "total_output_size": 481670085, "num_input_records": 12327923, "num_output_records": 12227287, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "file_write_nanos": 332342101, "file_range_sync_nanos": 0, "file_fsync_nanos": 9980, "file_prepare_write_nanos": 51539, "lsm_state": [0, 0, 0, 14, 0, 0, 0]} 2024/11/24-01:13:14.597180 139957601228352 DEBG dcompact_worker.cpp:240: HttpPost: 200 OK: url = http://nlb-7zny4kaa1poal01o64.cn-shenzhen.nlb.aliyuncs.com:8443, body = {"instanceId":"nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137","labourId":"","dbId":"d89b4006-2803-486e-b7a2-759bcf348921","dbStarts":1732256054,"starts":1732381951,"executesMs":43066,"compactionJobId":39153,"attempt":0,"compactionInputRawBytes":1781331546,"compactionInputZipBytes":502707881,"compactionOutputRawBytes":0,"compactionOutputZipBytes":481670085,"headers":{"Accept":"*/*","Connection":"close","Host":"aliyun-topling-saas.topling.cn:18443","RemoteIp":"120.24.192.169","X-Forwarded-For":"120.24.192.169","region":"cn-shenzhen","token":"e6474c481bd4415abc537135cc03626b","instance-token":"e6474c481bd4415abc537135cc03626b","provider":"aliyun","CloudMarketInstanceId":"si-59c0ae5c955845588903","MeteringAssit":"","Transfer-Encoding":"chunked","traceparent":"00-a24241626a583d87387dcc4fb866e379-d5ca3854a1400637-00"}}, response = 2024/11/24-01:13:14.597272 139957601228352 INFO dcompact_worker.cpp:1459: finish /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-39153/att-00: olev 3, work 43.066 s, result 5.917 ms, install 1.174 ms, input{raw 1.659 GiB zip 479.420 MiB}