2024/11/24-01:11:43.835370 139957676762688 DEBG dcompact_worker.cpp:2214: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39137/att-00: fork to child time = 0.022382 sec 2024/11/24-01:11:43.836379 139957676762688 DEBG dcompact_worker.cpp:1013: Beg SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39137/att-00 2024/11/24-01:11:43.846557 139957676762688 DEBG dcompact_worker.cpp:1033: End SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39137/att-00 2024/11/24-01:11:43.847794 139957676762688 TRAC dcompact_worker.cpp:1083: INFO_LOG_LEVEL: rpc = INFO_LEVEL, env_var = undefined 2024/11/24-01:11:43.848197 139957676762688 [WARN] [column_family.cc:386] multiple cf_paths/db_paths and level_compaction_dynamic_level_bytes can't be used together 2024/11/24-01:11:43.899514 139957676762688 [version_set.cc:6208] Recovering from manifest file: /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-39137/att-00/MANIFEST-206347 2024/11/24-01:11:43.929396 139957676762688 [version_set.cc:6251] Recovered from manifest file:/worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-39137/att-00/MANIFEST-206347 succeeded,manifest_file_number is 206347, next_file_number is 286840, last_sequence is 4366198569, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 286716 2024/11/24-01:11:43.929407 139957676762688 [version_set.cc:6266] Column family [default] (ID 0), log number is 0 2024/11/24-01:11:43.929573 139957676762688 [version_set.cc:5721] Creating manifest 286840 2024/11/24-01:11:43.966406 139957676762688 DEBG dcompact_worker.cpp:1218: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39137/att-00: bottommost_level: fake = 1, rpc = 0 2024/11/24-01:11:43.990410 139957676762688 [compaction_job.cc:2437] [default] [JOB 39137] Compacting 1@2 + 14@3 files to L3, score 0.47, subcompactions 1 : 1 2024/11/24-01:11:43.990435 139957676762688 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 29322 Base level 2, inputs: [286832(26MB)], [286787(34MB) 286788(34MB) 286789(35MB) 286790(1152KB) 286774(35MB) 286775(35MB) 286776(35MB) 286777(35MB) 286778(35MB) 286779(35MB) 286780(6951KB) 286781(34MB) 286782(34MB) 286783(35MB)] 2024/11/24-01:11:44.000309 139957676762688 [top_zip_table.cc:59] core git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/24-01:11:44.000355 139957676762688 [top_zip_table.cc:60] fsa git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/24-01:11:44.000385 139957676762688 [top_zip_table.cc:61] zbs git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/24-01:11:44.000394 139957676762688 [top_zip_table.cc:62] topling-zip_table_reader: git_version_hash_info_is: commit a4a382006cb82713acf5b3425835f22711877681 Author: leipeng Date: 2024-04-11 19:44:14 +0800 fixed_len_hole_index.cc: Add env bool FixedLenHoleIndexUseAVX512 for ut & debug 1. FixedLenHoleIndexUseAVX512 is only in unit tests or debug 2. In release mode, use avx512 by compile options(-march=) g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/24-01:11:44.000410 139957676762688 [top_zip_table.cc:64] topling-rocks git_version_hash_info_is: commit feab587e468621ba0204d47b4ffacc52e7c4290d Author: leipeng Date: 2024-03-22 13:35:06 +0800 ToplingZipTableBuilder::Add: immediately return after error This function returns void, and caller does not check builder->status() after calling this function and graceful abandon. So immediately return after error, and return error status in Finish(). g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/24-01:11:44.601378 139957676762688 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39137/att-00/286841.sst) /dev/shm/ToplingTemp/Topling-234661-gYkAx8 2024/11/24-01:11:45.494580 139957676762688 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39137/att-00/286841.sst): first pass time = 0.89's, 150.274'MB/sec 2024/11/24-01:11:48.962101 139957676762688 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39137/att-00/286841.sst): old prealloc_size = 147639500, real_size = 31572992 2024/11/24-01:11:48.962770 139957676762688 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39137/att-00/286841.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 925762 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0296 GB avg-val = 116.98 avg-zval = 31.95 2024/11/24-01:11:48.963639 139957676762688 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39137/att-00/286841.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-01:11:50.073856 139957676762688 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39137/att-00/286841.sst): second pass time = 3.47's, 31.245'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.11's, 31.979'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2718.100'MB/sec (index lex order gen) rebuild zvType time = 0.86's, 0.270'MB/sec write SST data time = 0.25's, 140.775'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 31018.576'MB/sec zip my value time = 3.47's, unzip length = 0.108'GB zip my value throughput = 31.245'MB/sec zip pipeline throughput = 97.926'MB/sec entries = 925762 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.98 avg-zval = 31.95 usrkeys = 925762 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.98 avg-zval = 31.95 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 925762 bytes = 3124464 } seq expand size = 6480334 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0296 GB dict = 1.08 MB all = 0.0356 GB } UnZip/Zip{ index = 10.5131 value = 3.6611 dict = 1.00 all = 3.7752 } Zip/UnZip{ index = 0.0951 value = 0.2731 dict = 1.00 all = 0.2649 } ---------------------------- total value len = 8.963397 GB avg = 0.168 KB (by entry num) total key len = 1.466742 GB avg = 0.028 KB total ukey len = 1.016393 GB avg = 0.015 KB total ukey num = 0.066476197 Billion total entry num = 0.053283926 Billion write speed all = 0.177995223 MB/sec (with seq num) write speed all = 0.170720701 MB/sec (without seq num) 2024/11/24-01:11:50.122342 139957676762688 [compaction_job.cc:1948] [default] [JOB 39137] Generated table #286841: 925762 keys, 35552170 bytes, temperature: kWarm 2024/11/24-01:11:50.122485 139957676762688 EVENT_LOG_v1 {"time_micros": 1732381910122404, "cf_name": "default", "job": 39137, "event": "table_file_creation", "file_number": 286841, "file_size": 35552170, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4259662629, "largest_seqno": 4366179206, "table_properties": {"data_size": 29580208, "index_size": 1761152, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25921336, "raw_average_key_size": 28, "raw_value_size": 108296444, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 925762, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732381904, "oldest_key_time": 0, "file_creation_time": 1732381904, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 286841, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-01:11:50.198968 139957676762688 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39137/att-00/286842.sst) /dev/shm/ToplingTemp/Topling-234661-lq6E2a 2024/11/24-01:11:51.312880 139957676762688 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39137/att-00/286842.sst): first pass time = 1.11's, 120.498'MB/sec 2024/11/24-01:11:53.317001 139957676762688 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39137/att-00/286842.sst): old prealloc_size = 147639500, real_size = 32038960 2024/11/24-01:11:53.317573 139957676762688 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39137/att-00/286842.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 925702 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0300 GB avg-val = 116.99 avg-zval = 32.46 2024/11/24-01:11:53.318380 139957676762688 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39137/att-00/286842.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-01:11:54.269211 139957676762688 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39137/att-00/286842.sst): second pass time = 2.00's, 54.064'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.95's, 37.826'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3202.630'MB/sec (index lex order gen) rebuild zvType time = 0.82's, 0.284'MB/sec write SST data time = 0.14's, 265.422'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 35350.978'MB/sec zip my value time = 2.00's, unzip length = 0.108'GB zip my value throughput = 54.064'MB/sec zip pipeline throughput = 54.064'MB/sec entries = 925702 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.99 avg-zval = 32.46 usrkeys = 925702 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.99 avg-zval = 32.46 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 925702 bytes = 3124256 } seq expand size = 6479914 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0300 GB dict = 1.08 MB all = 0.0360 GB } UnZip/Zip{ index = 10.5106 value = 3.6044 dict = 1.00 all = 3.7264 } Zip/UnZip{ index = 0.0951 value = 0.2774 dict = 1.00 all = 0.2684 } ---------------------------- total value len = 9.078175 GB avg = 0.167 KB (by entry num) total key len = 1.492662 GB avg = 0.028 KB total ukey len = 1.034907 GB avg = 0.015 KB total ukey num = 0.067401899 Billion total entry num = 0.054209628 Billion write speed all = 0.180383379 MB/sec (with seq num) write speed all = 0.172983007 MB/sec (without seq num) 2024/11/24-01:11:54.314328 139957676762688 [compaction_job.cc:1948] [default] [JOB 39137] Generated table #286842: 925702 keys, 36018154 bytes, temperature: kWarm 2024/11/24-01:11:54.314422 139957676762688 EVENT_LOG_v1 {"time_micros": 1732381914314361, "cf_name": "default", "job": 39137, "event": "table_file_creation", "file_number": 286842, "file_size": 36018154, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4261178503, "largest_seqno": 4366178979, "table_properties": {"data_size": 30045856, "index_size": 1761472, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25919656, "raw_average_key_size": 28, "raw_value_size": 108298080, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 925702, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732381910, "oldest_key_time": 0, "file_creation_time": 1732381910, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 286842, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-01:11:54.355828 139957676762688 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39137/att-00/286843.sst) /dev/shm/ToplingTemp/Topling-234661-mKy2ia 2024/11/24-01:11:55.351795 139957676762688 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39137/att-00/286843.sst): first pass time = 1.00's, 134.766'MB/sec 2024/11/24-01:11:56.708136 139957676762688 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39137/att-00/286843.sst): old prealloc_size = 147639500, real_size = 32589456 2024/11/24-01:11:56.708706 139957676762688 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39137/att-00/286843.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 925608 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0306 GB avg-val = 117.00 avg-zval = 33.06 2024/11/24-01:11:56.709467 139957676762688 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39137/att-00/286843.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-01:11:57.670176 139957676762688 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39137/att-00/286843.sst): second pass time = 1.36's, 79.896'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.96's, 38.012'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3221.567'MB/sec (index lex order gen) rebuild zvType time = 0.83's, 0.279'MB/sec write SST data time = 0.13's, 278.048'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 35216.674'MB/sec zip my value time = 1.36's, unzip length = 0.108'GB zip my value throughput = 79.896'MB/sec zip pipeline throughput = 79.896'MB/sec entries = 925608 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.00 avg-zval = 33.06 usrkeys = 925608 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.00 avg-zval = 33.06 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 925608 bytes = 3123936 } seq expand size = 6479256 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0306 GB dict = 1.08 MB all = 0.0366 GB } UnZip/Zip{ index = 10.5125 value = 3.5396 dict = 1.00 all = 3.6703 } Zip/UnZip{ index = 0.0951 value = 0.2825 dict = 1.00 all = 0.2725 } ---------------------------- total value len = 9.192955 GB avg = 0.167 KB (by entry num) total key len = 1.518579 GB avg = 0.028 KB total ukey len = 1.053419 GB avg = 0.015 KB total ukey num = 0.068327507 Billion total entry num = 0.055135236 Billion write speed all = 0.182773660 MB/sec (with seq num) write speed all = 0.175247366 MB/sec (without seq num) 2024/11/24-01:11:57.716460 139957676762688 [compaction_job.cc:1948] [default] [JOB 39137] Generated table #286843: 925608 keys, 36568342 bytes, temperature: kWarm 2024/11/24-01:11:57.716527 139957676762688 EVENT_LOG_v1 {"time_micros": 1732381917716494, "cf_name": "default", "job": 39137, "event": "table_file_creation", "file_number": 286843, "file_size": 36568342, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4261178518, "largest_seqno": 4366178998, "table_properties": {"data_size": 30596928, "index_size": 1760960, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25917024, "raw_average_key_size": 28, "raw_value_size": 108300704, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 925608, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732381914, "oldest_key_time": 0, "file_creation_time": 1732381914, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 286843, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-01:11:57.758588 139957676762688 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39137/att-00/286844.sst) /dev/shm/ToplingTemp/Topling-234661-rVD4C9 2024/11/24-01:11:58.816147 139957676762688 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39137/att-00/286844.sst): first pass time = 1.06's, 126.917'MB/sec 2024/11/24-01:12:00.190114 139957676762688 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39137/att-00/286844.sst): old prealloc_size = 147639500, real_size = 33044496 2024/11/24-01:12:00.190657 139957676762688 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39137/att-00/286844.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 925777 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1083 GB zip-val = 0.0310 GB avg-val = 116.98 avg-zval = 33.53 2024/11/24-01:12:00.191424 139957676762688 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39137/att-00/286844.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-01:12:01.149355 139957676762688 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39137/att-00/286844.sst): second pass time = 1.37's, 78.864'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.96's, 38.598'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3417.892'MB/sec (index lex order gen) rebuild zvType time = 0.83's, 0.280'MB/sec write SST data time = 0.13's, 282.285'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 32526.601'MB/sec zip my value time = 1.37's, unzip length = 0.108'GB zip my value throughput = 78.864'MB/sec zip pipeline throughput = 78.864'MB/sec entries = 925777 avg-key = 28.00 avg-zkey = 1.92 avg-val = 116.98 avg-zval = 33.53 usrkeys = 925777 avg-key = 20.00 avg-zkey = 1.92 avg-val = 123.98 avg-zval = 33.53 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 925777 bytes = 3124512 } seq expand size = 6480439 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0310 GB dict = 1.08 MB all = 0.0370 GB } UnZip/Zip{ index = 10.4439 value = 3.4889 dict = 1.00 all = 3.6252 } Zip/UnZip{ index = 0.0958 value = 0.2866 dict = 1.00 all = 0.2758 } ---------------------------- total value len = 9.307731 GB avg = 0.166 KB (by entry num) total key len = 1.544501 GB avg = 0.028 KB total ukey len = 1.071935 GB avg = 0.015 KB total ukey num = 0.069253284 Billion total entry num = 0.056061013 Billion write speed all = 0.185163439 MB/sec (with seq num) write speed all = 0.177511225 MB/sec (without seq num) 2024/11/24-01:12:01.194416 139957676762688 [compaction_job.cc:1948] [default] [JOB 39137] Generated table #286844: 925777 keys, 37023618 bytes, temperature: kWarm 2024/11/24-01:12:01.194485 139957676762688 EVENT_LOG_v1 {"time_micros": 1732381921194449, "cf_name": "default", "job": 39137, "event": "table_file_creation", "file_number": 286844, "file_size": 37023618, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4261178530, "largest_seqno": 4366179017, "table_properties": {"data_size": 31040000, "index_size": 1772864, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25921756, "raw_average_key_size": 28, "raw_value_size": 108296082, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 925777, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732381917, "oldest_key_time": 0, "file_creation_time": 1732381917, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 286844, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-01:12:01.236507 139957676762688 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39137/att-00/286845.sst) /dev/shm/ToplingTemp/Topling-234661-cjWl98 2024/11/24-01:12:02.188248 139957676762688 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39137/att-00/286845.sst): first pass time = 0.95's, 141.029'MB/sec 2024/11/24-01:12:03.569776 139957676762688 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39137/att-00/286845.sst): old prealloc_size = 147639500, real_size = 33264960 2024/11/24-01:12:03.570385 139957676762688 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39137/att-00/286845.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 925674 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0313 GB avg-val = 116.99 avg-zval = 33.78 2024/11/24-01:12:03.571216 139957676762688 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39137/att-00/286845.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-01:12:04.534839 139957676762688 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39137/att-00/286845.sst): second pass time = 1.38's, 78.440'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.97's, 38.593'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3008.459'MB/sec (index lex order gen) rebuild zvType time = 0.81's, 0.285'MB/sec write SST data time = 0.15's, 245.886'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 21912.604'MB/sec zip my value time = 1.38's, unzip length = 0.108'GB zip my value throughput = 78.440'MB/sec zip pipeline throughput = 78.440'MB/sec entries = 925674 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.99 avg-zval = 33.78 usrkeys = 925674 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.99 avg-zval = 33.78 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 925674 bytes = 3124160 } seq expand size = 6479718 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0313 GB dict = 1.08 MB all = 0.0372 GB } UnZip/Zip{ index = 10.5137 value = 3.4631 dict = 1.00 all = 3.6037 } Zip/UnZip{ index = 0.0951 value = 0.2888 dict = 1.00 all = 0.2775 } ---------------------------- total value len = 9.422510 GB avg = 0.165 KB (by entry num) total key len = 1.570420 GB avg = 0.028 KB total ukey len = 1.090448 GB avg = 0.016 KB total ukey num = 0.070178958 Billion total entry num = 0.056986687 Billion write speed all = 0.187553222 MB/sec (with seq num) write speed all = 0.179775104 MB/sec (without seq num) 2024/11/24-01:12:04.580528 139957676762688 [compaction_job.cc:1948] [default] [JOB 39137] Generated table #286845: 925674 keys, 37244178 bytes, temperature: kWarm 2024/11/24-01:12:04.580600 139957676762688 EVENT_LOG_v1 {"time_micros": 1732381924580565, "cf_name": "default", "job": 39137, "event": "table_file_creation", "file_number": 286845, "file_size": 37244178, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4261178548, "largest_seqno": 4366179032, "table_properties": {"data_size": 31272432, "index_size": 1760896, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25918872, "raw_average_key_size": 28, "raw_value_size": 108298992, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 925674, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732381921, "oldest_key_time": 0, "file_creation_time": 1732381921, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 286845, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-01:12:04.625466 139957676762688 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39137/att-00/286846.sst) /dev/shm/ToplingTemp/Topling-234661-QNfsB8 2024/11/24-01:12:05.652390 139957676762688 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39137/att-00/286846.sst): first pass time = 1.03's, 130.704'MB/sec 2024/11/24-01:12:07.023298 139957676762688 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39137/att-00/286846.sst): old prealloc_size = 147639500, real_size = 33398000 2024/11/24-01:12:07.023905 139957676762688 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39137/att-00/286846.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 925644 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1083 GB zip-val = 0.0314 GB avg-val = 117.00 avg-zval = 33.92 2024/11/24-01:12:07.024722 139957676762688 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39137/att-00/286846.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-01:12:07.992122 139957676762688 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39137/att-00/286846.sst): second pass time = 1.37's, 79.048'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.97's, 38.581'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3045.650'MB/sec (index lex order gen) rebuild zvType time = 0.82's, 0.283'MB/sec write SST data time = 0.15's, 249.029'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 35653.800'MB/sec zip my value time = 1.37's, unzip length = 0.108'GB zip my value throughput = 79.048'MB/sec zip pipeline throughput = 79.048'MB/sec entries = 925644 avg-key = 28.00 avg-zkey = 1.91 avg-val = 117.00 avg-zval = 33.92 usrkeys = 925644 avg-key = 20.00 avg-zkey = 1.91 avg-val = 124.00 avg-zval = 33.92 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 925644 bytes = 3124064 } seq expand size = 6479508 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0314 GB dict = 1.08 MB all = 0.0374 GB } UnZip/Zip{ index = 10.4450 value = 3.4497 dict = 1.00 all = 3.5909 } Zip/UnZip{ index = 0.0957 value = 0.2899 dict = 1.00 all = 0.2785 } ---------------------------- total value len = 9.537289 GB avg = 0.165 KB (by entry num) total key len = 1.596338 GB avg = 0.028 KB total ukey len = 1.108961 GB avg = 0.016 KB total ukey num = 0.071104602 Billion total entry num = 0.057912331 Billion write speed all = 0.189942492 MB/sec (with seq num) write speed all = 0.182038500 MB/sec (without seq num) 2024/11/24-01:12:08.037223 139957676762688 [compaction_job.cc:1948] [default] [JOB 39137] Generated table #286846: 925644 keys, 37377202 bytes, temperature: kWarm 2024/11/24-01:12:08.037282 139957676762688 EVENT_LOG_v1 {"time_micros": 1732381928037250, "cf_name": "default", "job": 39137, "event": "table_file_creation", "file_number": 286846, "file_size": 37377202, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4261178559, "largest_seqno": 4366179049, "table_properties": {"data_size": 31394016, "index_size": 1772416, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25918032, "raw_average_key_size": 28, "raw_value_size": 108299816, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 925644, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732381924, "oldest_key_time": 0, "file_creation_time": 1732381924, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 286846, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-01:12:08.077485 139957676762688 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39137/att-00/286847.sst) /dev/shm/ToplingTemp/Topling-234661-WLJBz9 2024/11/24-01:12:09.116370 139957676762688 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39137/att-00/286847.sst): first pass time = 1.04's, 129.198'MB/sec 2024/11/24-01:12:10.495626 139957676762688 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39137/att-00/286847.sst): old prealloc_size = 147639500, real_size = 33539472 2024/11/24-01:12:10.496171 139957676762688 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39137/att-00/286847.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 925695 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0315 GB avg-val = 116.99 avg-zval = 34.08 2024/11/24-01:12:10.496929 139957676762688 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39137/att-00/286847.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-01:12:11.462621 139957676762688 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39137/att-00/286847.sst): second pass time = 1.38's, 78.564'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.97's, 38.800'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3373.170'MB/sec (index lex order gen) rebuild zvType time = 0.84's, 0.277'MB/sec write SST data time = 0.13's, 288.681'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 32945.032'MB/sec zip my value time = 1.38's, unzip length = 0.108'GB zip my value throughput = 78.564'MB/sec zip pipeline throughput = 78.564'MB/sec entries = 925695 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.99 avg-zval = 34.08 usrkeys = 925695 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.99 avg-zval = 34.08 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 925695 bytes = 3124240 } seq expand size = 6479865 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0315 GB dict = 1.08 MB all = 0.0375 GB } UnZip/Zip{ index = 10.5147 value = 3.4329 dict = 1.00 all = 3.5774 } Zip/UnZip{ index = 0.0951 value = 0.2913 dict = 1.00 all = 0.2795 } ---------------------------- total value len = 9.652067 GB avg = 0.164 KB (by entry num) total key len = 1.622257 GB avg = 0.028 KB total ukey len = 1.127475 GB avg = 0.016 KB total ukey num = 0.072030297 Billion total entry num = 0.058838026 Billion write speed all = 0.192331441 MB/sec (with seq num) write speed all = 0.184301584 MB/sec (without seq num) 2024/11/24-01:12:11.507470 139957676762688 [compaction_job.cc:1948] [default] [JOB 39137] Generated table #286847: 925695 keys, 37518726 bytes, temperature: kWarm 2024/11/24-01:12:11.507539 139957676762688 EVENT_LOG_v1 {"time_micros": 1732381931507503, "cf_name": "default", "job": 39137, "event": "table_file_creation", "file_number": 286847, "file_size": 37518726, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4261178575, "largest_seqno": 4366179067, "table_properties": {"data_size": 31547072, "index_size": 1760768, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25919460, "raw_average_key_size": 28, "raw_value_size": 108298302, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 925695, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732381928, "oldest_key_time": 0, "file_creation_time": 1732381928, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 286847, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-01:12:11.546324 139957676762688 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39137/att-00/286848.sst) /dev/shm/ToplingTemp/Topling-234661-RhVeu8 2024/11/24-01:12:12.577235 139957676762688 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39137/att-00/286848.sst): first pass time = 1.03's, 130.198'MB/sec 2024/11/24-01:12:13.980692 139957676762688 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39137/att-00/286848.sst): old prealloc_size = 147639500, real_size = 33630752 2024/11/24-01:12:13.981253 139957676762688 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39137/att-00/286848.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 925647 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0316 GB avg-val = 117.00 avg-zval = 34.18 2024/11/24-01:12:13.982008 139957676762688 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39137/att-00/286848.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-01:12:14.839987 139957676762688 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39137/att-00/286848.sst): second pass time = 1.40's, 77.209'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.86's, 43.770'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3288.014'MB/sec (index lex order gen) rebuild zvType time = 0.73's, 0.317'MB/sec write SST data time = 0.13's, 293.188'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 35007.678'MB/sec zip my value time = 1.40's, unzip length = 0.108'GB zip my value throughput = 77.209'MB/sec zip pipeline throughput = 77.209'MB/sec entries = 925647 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.00 avg-zval = 34.18 usrkeys = 925647 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.00 avg-zval = 34.18 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 925647 bytes = 3124080 } seq expand size = 6479529 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0316 GB dict = 1.08 MB all = 0.0376 GB } UnZip/Zip{ index = 10.5134 value = 3.4231 dict = 1.00 all = 3.5687 } Zip/UnZip{ index = 0.0951 value = 0.2921 dict = 1.00 all = 0.2802 } ---------------------------- total value len = 9.766846 GB avg = 0.163 KB (by entry num) total key len = 1.648175 GB avg = 0.028 KB total ukey len = 1.145988 GB avg = 0.016 KB total ukey num = 0.072955944 Billion total entry num = 0.059763673 Billion write speed all = 0.194720412 MB/sec (with seq num) write speed all = 0.186564697 MB/sec (without seq num) 2024/11/24-01:12:14.885002 139957676762688 [compaction_job.cc:1948] [default] [JOB 39137] Generated table #286848: 925647 keys, 37609814 bytes, temperature: kWarm 2024/11/24-01:12:14.885070 139957676762688 EVENT_LOG_v1 {"time_micros": 1732381934885037, "cf_name": "default", "job": 39137, "event": "table_file_creation", "file_number": 286848, "file_size": 37609814, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4261178589, "largest_seqno": 4366179082, "table_properties": {"data_size": 31638288, "index_size": 1760896, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25918116, "raw_average_key_size": 28, "raw_value_size": 108299622, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 925647, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732381931, "oldest_key_time": 0, "file_creation_time": 1732381931, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 286848, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-01:12:14.937680 139957676762688 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39137/att-00/286849.sst) /dev/shm/ToplingTemp/Topling-234661-Gzkboc 2024/11/24-01:12:15.916896 139957676762688 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39137/att-00/286849.sst): first pass time = 0.98's, 137.071'MB/sec 2024/11/24-01:12:17.222658 139957676762688 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39137/att-00/286849.sst): old prealloc_size = 147639500, real_size = 33488368 2024/11/24-01:12:17.223228 139957676762688 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39137/att-00/286849.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 925712 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0315 GB avg-val = 116.99 avg-zval = 34.02 2024/11/24-01:12:17.224120 139957676762688 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39137/att-00/286849.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-01:12:18.080266 139957676762688 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39137/att-00/286849.sst): second pass time = 1.30's, 82.991'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.86's, 43.689'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3230.013'MB/sec (index lex order gen) rebuild zvType time = 0.73's, 0.318'MB/sec write SST data time = 0.13's, 287.508'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 34616.025'MB/sec zip my value time = 1.30's, unzip length = 0.108'GB zip my value throughput = 82.991'MB/sec zip pipeline throughput = 82.991'MB/sec entries = 925712 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.99 avg-zval = 34.02 usrkeys = 925712 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.99 avg-zval = 34.02 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 925712 bytes = 3124288 } seq expand size = 6479984 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0315 GB dict = 1.08 MB all = 0.0375 GB } UnZip/Zip{ index = 10.5122 value = 3.4385 dict = 1.00 all = 3.5822 } Zip/UnZip{ index = 0.0951 value = 0.2908 dict = 1.00 all = 0.2792 } ---------------------------- total value len = 9.881624 GB avg = 0.163 KB (by entry num) total key len = 1.674095 GB avg = 0.028 KB total ukey len = 1.164502 GB avg = 0.016 KB total ukey num = 0.073881656 Billion total entry num = 0.060689385 Billion write speed all = 0.197109576 MB/sec (with seq num) write speed all = 0.188827992 MB/sec (without seq num) 2024/11/24-01:12:18.125294 139957676762688 [compaction_job.cc:1948] [default] [JOB 39137] Generated table #286849: 925712 keys, 37467558 bytes, temperature: kWarm 2024/11/24-01:12:18.125366 139957676762688 EVENT_LOG_v1 {"time_micros": 1732381938125330, "cf_name": "default", "job": 39137, "event": "table_file_creation", "file_number": 286849, "file_size": 37467558, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4261178599, "largest_seqno": 4366179093, "table_properties": {"data_size": 31495520, "index_size": 1761216, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25919936, "raw_average_key_size": 28, "raw_value_size": 108297892, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 925712, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732381934, "oldest_key_time": 0, "file_creation_time": 1732381934, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 286849, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-01:12:18.172839 139957676762688 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39137/att-00/286850.sst) /dev/shm/ToplingTemp/Topling-234661-TwEE87 2024/11/24-01:12:18.908025 139957676762688 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39137/att-00/286850.sst): first pass time = 0.74's, 57.627'MB/sec 2024/11/24-01:12:19.309955 139957676762688 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39137/att-00/286850.sst): old prealloc_size = 147639500, real_size = 10891248 2024/11/24-01:12:19.310196 139957676762688 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39137/att-00/286850.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 296630 prefix = 4 raw-key = 0.0047 GB zip-key = 0.0006 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.0341 GB zip-val = 0.0102 GB avg-val = 114.82 avg-zval = 34.55 2024/11/24-01:12:19.310495 139957676762688 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39137/att-00/286850.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0007 GB, waited 0.000 sec, Key+Value = 0.042 GB 2024/11/24-01:12:19.582063 139957676762688 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39137/att-00/286850.sst): second pass time = 0.40's, 84.890'MB/sec, value only(80.4% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.27's, 44.582'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2714.798'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.323'MB/sec write SST data time = 0.04's, 285.228'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.347'MB, throughput = 11435.803'MB/sec zip my value time = 0.40's, unzip length = 0.034'GB zip my value throughput = 84.890'MB/sec zip pipeline throughput = 84.890'MB/sec entries = 296630 avg-key = 28.00 avg-zkey = 1.92 avg-val = 114.82 avg-zval = 34.55 usrkeys = 296630 avg-key = 20.00 avg-zkey = 1.92 avg-val = 121.82 avg-zval = 34.55 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 296630 bytes = 964064 } seq expand size = 2076410 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0059 GB value = 0.0341 GB dict = 0.35 MB all = 0.0424 GB } __ZipSize{ index = 0.0006 GB value = 0.0102 GB dict = 0.35 MB all = 0.0121 GB } UnZip/Zip{ index = 10.4236 value = 3.3235 dict = 1.00 all = 3.4924 } Zip/UnZip{ index = 0.0959 value = 0.3009 dict = 1.00 all = 0.2863 } ---------------------------- total value len = 9.917759 GB avg = 0.163 KB (by entry num) total key len = 1.682401 GB avg = 0.028 KB total ukey len = 1.170435 GB avg = 0.016 KB total ukey num = 0.074178286 Billion total entry num = 0.060986015 Billion write speed all = 0.197862543 MB/sec (with seq num) write speed all = 0.189540694 MB/sec (without seq num) 2024/11/24-01:12:19.601608 139957676762688 [compaction_job.cc:1948] [default] [JOB 39137] Generated table #286850: 296630 keys, 12130255 bytes, temperature: kWarm 2024/11/24-01:12:19.601677 139957676762688 EVENT_LOG_v1 {"time_micros": 1732381939601642, "cf_name": "default", "job": 39137, "event": "table_file_creation", "file_number": 286850, "file_size": 12130255, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4331497644, "largest_seqno": 4366179112, "table_properties": {"data_size": 10247776, "index_size": 569152, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 8305640, "raw_average_key_size": 28, "raw_value_size": 34058432, "raw_average_value_size": 114, "num_data_blocks": 1, "num_entries": 296630, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732381938, "oldest_key_time": 0, "file_creation_time": 1732381938, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 286850, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-01:12:19.628761 139957676762688 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39137/att-00/286851.sst) /dev/shm/ToplingTemp/Topling-234661-Bd6uOb 2024/11/24-01:12:20.171728 139957676762688 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39137/att-00/286851.sst): first pass time = 0.54's, 247.216'MB/sec 2024/11/24-01:12:21.488092 139957676762688 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39137/att-00/286851.sst): old prealloc_size = 147639500, real_size = 31616272 2024/11/24-01:12:21.488674 139957676762688 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39137/att-00/286851.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 925774 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0296 GB avg-val = 116.98 avg-zval = 32.00 2024/11/24-01:12:21.489471 139957676762688 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39137/att-00/286851.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-01:12:22.323474 139957676762688 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39137/att-00/286851.sst): second pass time = 1.32's, 82.320'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.84's, 42.611'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3145.195'MB/sec (index lex order gen) rebuild zvType time = 0.70's, 0.330'MB/sec write SST data time = 0.13's, 268.804'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 35758.168'MB/sec zip my value time = 1.32's, unzip length = 0.108'GB zip my value throughput = 82.320'MB/sec zip pipeline throughput = 82.320'MB/sec entries = 925774 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.98 avg-zval = 32.00 usrkeys = 925774 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.98 avg-zval = 32.00 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 925774 bytes = 3124496 } seq expand size = 6480418 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0296 GB dict = 1.08 MB all = 0.0356 GB } UnZip/Zip{ index = 10.5133 value = 3.6558 dict = 1.00 all = 3.7706 } Zip/UnZip{ index = 0.0951 value = 0.2735 dict = 1.00 all = 0.2652 } ---------------------------- total value len = 10.032536 GB avg = 0.162 KB (by entry num) total key len = 1.708323 GB avg = 0.028 KB total ukey len = 1.188951 GB avg = 0.016 KB total ukey num = 0.075104060 Billion total entry num = 0.061911789 Billion write speed all = 0.200253051 MB/sec (with seq num) write speed all = 0.191805270 MB/sec (without seq num) 2024/11/24-01:12:22.366693 139957676762688 [compaction_job.cc:1948] [default] [JOB 39137] Generated table #286851: 925774 keys, 35595442 bytes, temperature: kWarm 2024/11/24-01:12:22.366771 139957676762688 EVENT_LOG_v1 {"time_micros": 1732381942366729, "cf_name": "default", "job": 39137, "event": "table_file_creation", "file_number": 286851, "file_size": 35595442, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4261178645, "largest_seqno": 4366178461, "table_properties": {"data_size": 29623488, "index_size": 1761152, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25921672, "raw_average_key_size": 28, "raw_value_size": 108296076, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 925774, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732381939, "oldest_key_time": 0, "file_creation_time": 1732381939, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 286851, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-01:12:22.404598 139957676762688 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39137/att-00/286852.sst) /dev/shm/ToplingTemp/Topling-234661-Z9Txs8 2024/11/24-01:12:23.436180 139957676762688 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39137/att-00/286852.sst): first pass time = 1.03's, 130.113'MB/sec 2024/11/24-01:12:24.721606 139957676762688 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39137/att-00/286852.sst): old prealloc_size = 147639500, real_size = 32463008 2024/11/24-01:12:24.722220 139957676762688 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39137/att-00/286852.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 925527 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0305 GB avg-val = 117.02 avg-zval = 32.92 2024/11/24-01:12:24.723001 139957676762688 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39137/att-00/286852.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-01:12:25.560257 139957676762688 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39137/att-00/286852.sst): second pass time = 1.28's, 84.307'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.84's, 43.455'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2982.512'MB/sec (index lex order gen) rebuild zvType time = 0.71's, 0.326'MB/sec write SST data time = 0.13's, 283.319'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 34357.770'MB/sec zip my value time = 1.28's, unzip length = 0.108'GB zip my value throughput = 84.307'MB/sec zip pipeline throughput = 84.307'MB/sec entries = 925527 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.02 avg-zval = 32.92 usrkeys = 925527 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.02 avg-zval = 32.92 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 925527 bytes = 3123664 } seq expand size = 6478689 multi value expand size = 0 cnt WriteAppend = 11 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0305 GB dict = 1.08 MB all = 0.0364 GB } UnZip/Zip{ index = 10.5120 value = 3.5544 dict = 1.00 all = 3.6831 } Zip/UnZip{ index = 0.0951 value = 0.2813 dict = 1.00 all = 0.2715 } ---------------------------- total value len = 10.147317 GB avg = 0.161 KB (by entry num) total key len = 1.734237 GB avg = 0.028 KB total ukey len = 1.207461 GB avg = 0.016 KB total ukey num = 0.076029587 Billion total entry num = 0.062837316 Billion write speed all = 0.202641595 MB/sec (with seq num) write speed all = 0.194068000 MB/sec (without seq num) 2024/11/24-01:12:25.605270 139957676762688 [compaction_job.cc:1948] [default] [JOB 39137] Generated table #286852: 925527 keys, 36441862 bytes, temperature: kWarm 2024/11/24-01:12:25.605346 139957676762688 EVENT_LOG_v1 {"time_micros": 1732381945605307, "cf_name": "default", "job": 39137, "event": "table_file_creation", "file_number": 286852, "file_size": 36441862, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4261178675, "largest_seqno": 4366178169, "table_properties": {"data_size": 30470544, "index_size": 1760896, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25914756, "raw_average_key_size": 28, "raw_value_size": 108303026, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 925527, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732381942, "oldest_key_time": 0, "file_creation_time": 1732381942, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 286852, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-01:12:25.651275 139957676762688 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39137/att-00/286853.sst) /dev/shm/ToplingTemp/Topling-234661-A9HBVb 2024/11/24-01:12:26.565805 139957676762688 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39137/att-00/286853.sst): first pass time = 0.91's, 146.768'MB/sec 2024/11/24-01:12:27.880224 139957676762688 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39137/att-00/286853.sst): old prealloc_size = 147639500, real_size = 32873536 2024/11/24-01:12:27.880784 139957676762688 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39137/att-00/286853.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 925571 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0309 GB avg-val = 117.01 avg-zval = 33.36 2024/11/24-01:12:27.881574 139957676762688 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39137/att-00/286853.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-01:12:28.721808 139957676762688 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39137/att-00/286853.sst): second pass time = 1.31's, 82.455'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.84's, 43.790'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3319.586'MB/sec (index lex order gen) rebuild zvType time = 0.71's, 0.325'MB/sec write SST data time = 0.13's, 285.124'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 33791.031'MB/sec zip my value time = 1.31's, unzip length = 0.108'GB zip my value throughput = 82.455'MB/sec zip pipeline throughput = 82.455'MB/sec entries = 925571 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.01 avg-zval = 33.36 usrkeys = 925571 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.01 avg-zval = 33.36 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 925571 bytes = 3123824 } seq expand size = 6478997 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0309 GB dict = 1.08 MB all = 0.0369 GB } UnZip/Zip{ index = 10.5117 value = 3.5071 dict = 1.00 all = 3.6420 } Zip/UnZip{ index = 0.0951 value = 0.2851 dict = 1.00 all = 0.2746 } ---------------------------- total value len = 10.262098 GB avg = 0.161 KB (by entry num) total key len = 1.760153 GB avg = 0.028 KB total ukey len = 1.225972 GB avg = 0.016 KB total ukey num = 0.076955158 Billion total entry num = 0.063762887 Billion write speed all = 0.205030144 MB/sec (with seq num) write speed all = 0.196330732 MB/sec (without seq num) 2024/11/24-01:12:28.768255 139957676762688 [compaction_job.cc:1948] [default] [JOB 39137] Generated table #286853: 925571 keys, 36852294 bytes, temperature: kWarm 2024/11/24-01:12:28.768323 139957676762688 EVENT_LOG_v1 {"time_micros": 1732381948768289, "cf_name": "default", "job": 39137, "event": "table_file_creation", "file_number": 286853, "file_size": 36852294, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4261178686, "largest_seqno": 4365038175, "table_properties": {"data_size": 30880944, "index_size": 1761024, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25915988, "raw_average_key_size": 28, "raw_value_size": 108301834, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 925571, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732381945, "oldest_key_time": 0, "file_creation_time": 1732381945, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 286853, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-01:12:28.806805 139957676762688 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39137/att-00/286854.sst) /dev/shm/ToplingTemp/Topling-234661-4c2zd8 2024/11/24-01:12:28.822854 139957676762688 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39137/att-00/286854.sst): first pass time = 0.02's, 186.909'MB/sec 2024/11/24-01:12:28.862803 139957676762688 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39137/att-00/286854.sst): old prealloc_size = 147639500, real_size = 998880 2024/11/24-01:12:28.862849 139957676762688 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39137/att-00/286854.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 20502 prefix = 4 raw-key = 0.0003 GB zip-key = 0.0000 GB avg-key = 16.00 avg-zkey = 1.99 raw-val = 0.0024 GB zip-val = 0.0010 GB avg-val = 118.00 avg-zval = 46.47 2024/11/24-01:12:28.862884 139957676762688 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39137/att-00/286854.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0000 GB, waited 0.000 sec, Key+Value = 0.003 GB 2024/11/24-01:12:28.881661 139957676762688 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39137/att-00/286854.sst): second pass time = 0.04's, 61.197'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.02's, 57.066'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1262.351'MB/sec (index lex order gen) rebuild zvType time = 0.02's, 0.321'MB/sec write SST data time = 0.00's, 378.515'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.024'MB, throughput = 1060.581'MB/sec zip my value time = 0.04's, unzip length = 0.002'GB zip my value throughput = 61.197'MB/sec zip pipeline throughput = 61.197'MB/sec entries = 20502 avg-key = 28.00 avg-zkey = 1.99 avg-val = 118.00 avg-zval = 46.47 usrkeys = 20502 avg-key = 20.00 avg-zkey = 1.99 avg-val = 125.00 avg-zval = 46.47 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 20502 bytes = 56400 } seq expand size = 143514 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0004 GB value = 0.0024 GB dict = 0.02 MB all = 0.0030 GB } __ZipSize{ index = 0.0000 GB value = 0.0010 GB dict = 0.02 MB all = 0.0011 GB } UnZip/Zip{ index = 10.0421 value = 2.5393 dict = 1.00 all = 2.7834 } Zip/UnZip{ index = 0.0996 value = 0.3938 dict = 1.00 all = 0.3593 } ---------------------------- total value len = 10.264661 GB avg = 0.161 KB (by entry num) total key len = 1.760727 GB avg = 0.028 KB total ukey len = 1.226383 GB avg = 0.016 KB total ukey num = 0.076975660 Billion total entry num = 0.063783389 Billion write speed all = 0.205083080 MB/sec (with seq num) write speed all = 0.196380895 MB/sec (without seq num) 2024/11/24-01:12:28.892701 139957676762688 [compaction_job.cc:1948] [default] [JOB 39137] Generated table #286854: 20502 keys, 1075425 bytes, temperature: kWarm 2024/11/24-01:12:28.892749 139957676762688 EVENT_LOG_v1 {"time_micros": 1732381948892722, "cf_name": "default", "job": 39137, "event": "table_file_creation", "file_number": 286854, "file_size": 1075425, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4297604498, "largest_seqno": 4301033239, "table_properties": {"data_size": 952720, "index_size": 40832, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 574056, "raw_average_key_size": 28, "raw_value_size": 2419236, "raw_average_value_size": 118, "num_data_blocks": 1, "num_entries": 20502, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 118, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732381948, "oldest_key_time": 0, "file_creation_time": 1732381948, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 286854, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-01:12:28.901559 139957676762688 [compaction_job.cc:703] job-39137: subcompact[0], size: 0.454475 G, files: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39137/att-00 [286841,286842,286843,286844,286845,286846,286847,286848,286849,286850,286851,286852,286853,286854] 2024/11/24-01:12:28.981567 139957676762688 (Original Log Time 2024/11/24-01:11:43.990516) EVENT_LOG_v1 {"time_micros": 1732381903990458, "job": 39137, "event": "compaction_started", "compaction_reason": "FilesMarkedForCompaction", "files_L2": [286832], "files_L3": [286787, 286788, 286789, 286790, 286774, 286775, 286776, 286777, 286778, 286779, 286780, 286781, 286782, 286783], "score": 0.468063, "input_data_size": 478481198, "oldest_snapshot_seqno": 4366198489} 2024/11/24-01:12:28.981571 139957676762688 (Original Log Time 2024/11/24-01:12:28.980375) [compaction_job.cc:2022] [default] [JOB 39137] Compacted 1@2 + 14@3 files to L3 => 454475040 bytes 2024/11/24-01:12:28.981573 139957676762688 (Original Log Time 2024/11/24-01:12:28.981503) [compaction_job.cc:1224] [default] compacted to: files[0 0 0 14 0 0 0] max score 0.02, MB/sec: 10.7 rd, 10.1 wr, level 3, files in(1, 14) out(14 +0 blob) MB in(26.7, 429.6 +0.0 blob) out(433.4 +0.0 blob), read-write-amplify(33.3) write-amplify(16.2) OK, records in: 11531016, records dropped: 105791 output_compression: Snappy 2024/11/24-01:12:28.981579 139957676762688 (Original Log Time 2024/11/24-01:12:28.981546) EVENT_LOG_v1 {"time_micros": 1732381948981527, "cf": "default", "job": 39137, "event": "compaction_finished", "compaction_time_micros": 44911047, "compaction_time_cpu_micros": 18627476, "output_level": 3, "num_output_files": 14, "total_output_size": 454475040, "num_input_records": 11531016, "num_output_records": 11425225, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "file_write_nanos": 317216923, "file_range_sync_nanos": 0, "file_fsync_nanos": 9791, "file_prepare_write_nanos": 36996, "lsm_state": [0, 0, 0, 14, 0, 0, 0]} 2024/11/24-01:12:29.116040 139957676762688 DEBG dcompact_worker.cpp:240: HttpPost: 200 OK: url = http://nlb-7zny4kaa1poal01o64.cn-shenzhen.nlb.aliyuncs.com:8443, body = {"instanceId":"nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137","labourId":"","dbId":"d89b4006-2803-486e-b7a2-759bcf348921","dbStarts":1732256054,"starts":1732381903,"executesMs":45137,"compactionJobId":39137,"attempt":0,"compactionInputRawBytes":1670993160,"compactionInputZipBytes":478481198,"compactionOutputRawBytes":0,"compactionOutputZipBytes":454475040,"headers":{"Accept":"*/*","Connection":"close","Host":"aliyun-topling-saas.topling.cn:18443","RemoteIp":"120.24.192.169","X-Forwarded-For":"120.24.192.169","region":"cn-shenzhen","token":"e6474c481bd4415abc537135cc03626b","instance-token":"e6474c481bd4415abc537135cc03626b","provider":"aliyun","CloudMarketInstanceId":"si-59c0ae5c955845588903","MeteringAssit":"","Transfer-Encoding":"chunked","traceparent":"00-869bdd7a9bf5f44ebec7f70970bcae0e-3c77567dfde68d9d-00"}}, response = 2024/11/24-01:12:29.116128 139957676762688 INFO dcompact_worker.cpp:1459: finish /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-39137/att-00: olev 3, work 45.137 s, result 7.674 ms, install 1.219 ms, input{raw 1.556 GiB zip 456.315 MiB}