2024/11/24-01:31:18.728808 139957315876416 DEBG dcompact_worker.cpp:2214: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39391/att-00: fork to child time = 0.027515 sec 2024/11/24-01:31:18.729807 139957315876416 DEBG dcompact_worker.cpp:1013: Beg SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39391/att-00 2024/11/24-01:31:18.738212 139957315876416 DEBG dcompact_worker.cpp:1033: End SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39391/att-00 2024/11/24-01:31:18.739426 139957315876416 TRAC dcompact_worker.cpp:1083: INFO_LOG_LEVEL: rpc = INFO_LEVEL, env_var = undefined 2024/11/24-01:31:18.739846 139957315876416 [WARN] [column_family.cc:386] multiple cf_paths/db_paths and level_compaction_dynamic_level_bytes can't be used together 2024/11/24-01:31:18.791285 139957315876416 [version_set.cc:6208] Recovering from manifest file: /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-39391/att-00/MANIFEST-206347 2024/11/24-01:31:18.819573 139957315876416 [version_set.cc:6251] Recovered from manifest file:/worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-39391/att-00/MANIFEST-206347 succeeded,manifest_file_number is 206347, next_file_number is 287343, last_sequence is 4373805734, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 287193 2024/11/24-01:31:18.819591 139957315876416 [version_set.cc:6266] Column family [default] (ID 0), log number is 0 2024/11/24-01:31:18.819876 139957315876416 [version_set.cc:5721] Creating manifest 287343 2024/11/24-01:31:18.853643 139957315876416 DEBG dcompact_worker.cpp:1218: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39391/att-00: bottommost_level: fake = 1, rpc = 0 2024/11/24-01:31:18.873308 139957315876416 [compaction_job.cc:2437] [default] [JOB 39391] Compacting 1@2 + 13@3 files to L3, score 0.53, subcompactions 1 : 1 2024/11/24-01:31:18.873323 139957315876416 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 29515 Base level 2, inputs: [287323(27MB)], [287248(33MB) 287249(33MB) 287250(33MB) 287251(34MB) 287252(34MB) 287253(34MB) 287254(34MB) 287255(34MB) 287274(35MB) 287275(25MB) 287276(33MB) 287277(33MB) 287334(34MB)] 2024/11/24-01:31:18.880172 139957315876416 [top_zip_table.cc:59] core git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/24-01:31:18.880208 139957315876416 [top_zip_table.cc:60] fsa git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/24-01:31:18.880227 139957315876416 [top_zip_table.cc:61] zbs git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/24-01:31:18.880232 139957315876416 [top_zip_table.cc:62] topling-zip_table_reader: git_version_hash_info_is: commit a4a382006cb82713acf5b3425835f22711877681 Author: leipeng Date: 2024-04-11 19:44:14 +0800 fixed_len_hole_index.cc: Add env bool FixedLenHoleIndexUseAVX512 for ut & debug 1. FixedLenHoleIndexUseAVX512 is only in unit tests or debug 2. In release mode, use avx512 by compile options(-march=) g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/24-01:31:18.880243 139957315876416 [top_zip_table.cc:64] topling-rocks git_version_hash_info_is: commit feab587e468621ba0204d47b4ffacc52e7c4290d Author: leipeng Date: 2024-03-22 13:35:06 +0800 ToplingZipTableBuilder::Add: immediately return after error This function returns void, and caller does not check builder->status() after calling this function and graceful abandon. So immediately return after error, and return error status in Finish(). g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/24-01:31:19.477674 139957315876416 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39391/att-00/287344.sst) /dev/shm/ToplingTemp/Topling-238281-vtyNPT 2024/11/24-01:31:20.212704 139957315876416 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39391/att-00/287344.sst): first pass time = 0.73's, 182.613'MB/sec 2024/11/24-01:31:21.712592 139957315876416 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39391/att-00/287344.sst): old prealloc_size = 147639500, real_size = 30942048 2024/11/24-01:31:21.713171 139957315876416 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39391/att-00/287344.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 925870 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0289 GB avg-val = 116.96 avg-zval = 31.27 2024/11/24-01:31:21.713939 139957315876416 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39391/att-00/287344.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-01:31:22.538593 139957315876416 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39391/att-00/287344.sst): second pass time = 1.50's, 72.267'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.83's, 42.279'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3175.956'MB/sec (index lex order gen) rebuild zvType time = 0.70's, 0.332'MB/sec write SST data time = 0.13's, 274.035'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 38307.376'MB/sec zip my value time = 1.50's, unzip length = 0.108'GB zip my value throughput = 72.267'MB/sec zip pipeline throughput = 73.289'MB/sec entries = 925870 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.96 avg-zval = 31.27 usrkeys = 925870 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.96 avg-zval = 31.27 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 925870 bytes = 3124832 } seq expand size = 6481090 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0289 GB dict = 1.08 MB all = 0.0349 GB } UnZip/Zip{ index = 10.5132 value = 3.7408 dict = 1.00 all = 3.8434 } Zip/UnZip{ index = 0.0951 value = 0.2673 dict = 1.00 all = 0.2602 } ---------------------------- total value len = 8.963394 GB avg = 0.168 KB (by entry num) total key len = 1.466745 GB avg = 0.028 KB total ukey len = 1.016395 GB avg = 0.015 KB total ukey num = 0.066476305 Billion total entry num = 0.053284034 Billion write speed all = 0.174503652 MB/sec (with seq num) write speed all = 0.167371813 MB/sec (without seq num) 2024/11/24-01:31:22.582517 139957315876416 [compaction_job.cc:1948] [default] [JOB 39391] Generated table #287344: 925870 keys, 34921998 bytes, temperature: kWarm 2024/11/24-01:31:22.582611 139957315876416 EVENT_LOG_v1 {"time_micros": 1732383082582554, "cf_name": "default", "job": 39391, "event": "table_file_creation", "file_number": 287344, "file_size": 34921998, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4259662629, "largest_seqno": 4373702739, "table_properties": {"data_size": 28949072, "index_size": 1761344, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25924360, "raw_average_key_size": 28, "raw_value_size": 108293460, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 925870, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732383079, "oldest_key_time": 0, "file_creation_time": 1732383079, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 287344, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-01:31:22.618623 139957315876416 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39391/att-00/287345.sst) /dev/shm/ToplingTemp/Topling-238281-do1yhU 2024/11/24-01:31:23.741287 139957315876416 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39391/att-00/287345.sst): first pass time = 1.12's, 119.556'MB/sec 2024/11/24-01:31:25.070758 139957315876416 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39391/att-00/287345.sst): old prealloc_size = 147639500, real_size = 31043456 2024/11/24-01:31:25.071323 139957315876416 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39391/att-00/287345.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 925796 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1083 GB zip-val = 0.0290 GB avg-val = 116.98 avg-zval = 31.37 2024/11/24-01:31:25.072110 139957315876416 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39391/att-00/287345.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-01:31:25.902745 139957315876416 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39391/att-00/287345.sst): second pass time = 1.33's, 81.498'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.83's, 42.097'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3273.537'MB/sec (index lex order gen) rebuild zvType time = 0.70's, 0.328'MB/sec write SST data time = 0.13's, 276.602'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 34654.009'MB/sec zip my value time = 1.33's, unzip length = 0.108'GB zip my value throughput = 81.498'MB/sec zip pipeline throughput = 81.498'MB/sec entries = 925796 avg-key = 28.00 avg-zkey = 1.92 avg-val = 116.98 avg-zval = 31.37 usrkeys = 925796 avg-key = 20.00 avg-zkey = 1.92 avg-val = 123.98 avg-zval = 31.37 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 925796 bytes = 3124576 } seq expand size = 6480572 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0290 GB dict = 1.08 MB all = 0.0350 GB } UnZip/Zip{ index = 10.4437 value = 3.7293 dict = 1.00 all = 3.8323 } Zip/UnZip{ index = 0.0958 value = 0.2681 dict = 1.00 all = 0.2609 } ---------------------------- total value len = 9.078170 GB avg = 0.167 KB (by entry num) total key len = 1.492668 GB avg = 0.028 KB total ukey len = 1.034911 GB avg = 0.015 KB total ukey num = 0.067402101 Billion total entry num = 0.054209830 Billion write speed all = 0.176847680 MB/sec (with seq num) write speed all = 0.169592337 MB/sec (without seq num) 2024/11/24-01:31:25.947035 139957315876416 [compaction_job.cc:1948] [default] [JOB 39391] Generated table #287345: 925796 keys, 35022800 bytes, temperature: kWarm 2024/11/24-01:31:25.947101 139957315876416 EVENT_LOG_v1 {"time_micros": 1732383085947067, "cf_name": "default", "job": 39391, "event": "table_file_creation", "file_number": 287345, "file_size": 35022800, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4260101527, "largest_seqno": 4373701670, "table_properties": {"data_size": 29038896, "index_size": 1772928, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25922288, "raw_average_key_size": 28, "raw_value_size": 108295448, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 925796, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732383082, "oldest_key_time": 0, "file_creation_time": 1732383082, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 287345, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-01:31:25.991957 139957315876416 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39391/att-00/287346.sst) /dev/shm/ToplingTemp/Topling-238281-BayJ0R 2024/11/24-01:31:26.928097 139957315876416 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39391/att-00/287346.sst): first pass time = 0.94's, 143.383'MB/sec 2024/11/24-01:31:28.309411 139957315876416 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39391/att-00/287346.sst): old prealloc_size = 147639500, real_size = 31217344 2024/11/24-01:31:28.309954 139957315876416 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39391/att-00/287346.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 925733 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0292 GB avg-val = 116.99 avg-zval = 31.57 2024/11/24-01:31:28.310747 139957315876416 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39391/att-00/287346.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-01:31:29.168485 139957315876416 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39391/att-00/287346.sst): second pass time = 1.38's, 78.480'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.86's, 40.972'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3262.319'MB/sec (index lex order gen) rebuild zvType time = 0.73's, 0.315'MB/sec write SST data time = 0.12's, 284.878'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 36226.715'MB/sec zip my value time = 1.38's, unzip length = 0.108'GB zip my value throughput = 78.480'MB/sec zip pipeline throughput = 78.480'MB/sec entries = 925733 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.99 avg-zval = 31.57 usrkeys = 925733 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.99 avg-zval = 31.57 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 925733 bytes = 3124368 } seq expand size = 6480131 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0292 GB dict = 1.08 MB all = 0.0352 GB } UnZip/Zip{ index = 10.5101 value = 3.7057 dict = 1.00 all = 3.8134 } Zip/UnZip{ index = 0.0951 value = 0.2699 dict = 1.00 all = 0.2622 } ---------------------------- total value len = 9.192948 GB avg = 0.167 KB (by entry num) total key len = 1.518588 GB avg = 0.028 KB total ukey len = 1.053426 GB avg = 0.015 KB total ukey num = 0.068327834 Billion total entry num = 0.055135563 Billion write speed all = 0.179191733 MB/sec (with seq num) write speed all = 0.171812895 MB/sec (without seq num) 2024/11/24-01:31:29.212007 139957315876416 [compaction_job.cc:1948] [default] [JOB 39391] Generated table #287346: 925733 keys, 35196610 bytes, temperature: kWarm 2024/11/24-01:31:29.212077 139957315876416 EVENT_LOG_v1 {"time_micros": 1732383089212043, "cf_name": "default", "job": 39391, "event": "table_file_creation", "file_number": 287346, "file_size": 35196610, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4261178518, "largest_seqno": 4373702397, "table_properties": {"data_size": 29224112, "index_size": 1761600, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25920524, "raw_average_key_size": 28, "raw_value_size": 108297226, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 925733, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732383085, "oldest_key_time": 0, "file_creation_time": 1732383085, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 287346, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-01:31:29.254310 139957315876416 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39391/att-00/287347.sst) /dev/shm/ToplingTemp/Topling-238281-pm2IgU 2024/11/24-01:31:30.392816 139957315876416 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39391/att-00/287347.sst): first pass time = 1.14's, 117.894'MB/sec 2024/11/24-01:31:31.696699 139957315876416 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39391/att-00/287347.sst): old prealloc_size = 147639500, real_size = 31336928 2024/11/24-01:31:31.697262 139957315876416 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39391/att-00/287347.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 925882 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0293 GB avg-val = 116.96 avg-zval = 31.69 2024/11/24-01:31:31.698084 139957315876416 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39391/att-00/287347.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-01:31:32.536159 139957315876416 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39391/att-00/287347.sst): second pass time = 1.30's, 83.110'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.84's, 42.072'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3257.503'MB/sec (index lex order gen) rebuild zvType time = 0.71's, 0.324'MB/sec write SST data time = 0.12's, 283.608'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 37397.259'MB/sec zip my value time = 1.30's, unzip length = 0.108'GB zip my value throughput = 83.110'MB/sec zip pipeline throughput = 83.110'MB/sec entries = 925882 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.96 avg-zval = 31.69 usrkeys = 925882 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.96 avg-zval = 31.69 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 925882 bytes = 3124864 } seq expand size = 6481174 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0293 GB dict = 1.08 MB all = 0.0353 GB } UnZip/Zip{ index = 10.5137 value = 3.6905 dict = 1.00 all = 3.8004 } Zip/UnZip{ index = 0.0951 value = 0.2710 dict = 1.00 all = 0.2631 } ---------------------------- total value len = 9.307722 GB avg = 0.166 KB (by entry num) total key len = 1.544513 GB avg = 0.028 KB total ukey len = 1.071944 GB avg = 0.015 KB total ukey num = 0.069253716 Billion total entry num = 0.056061445 Billion write speed all = 0.181535239 MB/sec (with seq num) write speed all = 0.174032911 MB/sec (without seq num) 2024/11/24-01:31:32.580740 139957315876416 [compaction_job.cc:1948] [default] [JOB 39391] Generated table #287347: 925882 keys, 35316882 bytes, temperature: kWarm 2024/11/24-01:31:32.580812 139957315876416 EVENT_LOG_v1 {"time_micros": 1732383092580777, "cf_name": "default", "job": 39391, "event": "table_file_creation", "file_number": 287347, "file_size": 35316882, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4261178530, "largest_seqno": 4373701702, "table_properties": {"data_size": 29344016, "index_size": 1761280, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25924696, "raw_average_key_size": 28, "raw_value_size": 108293088, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 925882, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732383089, "oldest_key_time": 0, "file_creation_time": 1732383089, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 287347, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-01:31:32.631072 139957315876416 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39391/att-00/287348.sst) /dev/shm/ToplingTemp/Topling-238281-SWjywV 2024/11/24-01:31:33.699584 139957315876416 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39391/att-00/287348.sst): first pass time = 1.07's, 125.617'MB/sec 2024/11/24-01:31:35.050474 139957315876416 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39391/att-00/287348.sst): old prealloc_size = 147639500, real_size = 31622464 2024/11/24-01:31:35.051022 139957315876416 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39391/att-00/287348.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 925768 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0296 GB avg-val = 116.98 avg-zval = 32.01 2024/11/24-01:31:35.051782 139957315876416 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39391/att-00/287348.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-01:31:35.869357 139957315876416 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39391/att-00/287348.sst): second pass time = 1.35's, 80.221'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.82's, 43.477'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3319.733'MB/sec (index lex order gen) rebuild zvType time = 0.69's, 0.333'MB/sec write SST data time = 0.12's, 286.475'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 32840.771'MB/sec zip my value time = 1.35's, unzip length = 0.108'GB zip my value throughput = 80.221'MB/sec zip pipeline throughput = 80.221'MB/sec entries = 925768 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.98 avg-zval = 32.01 usrkeys = 925768 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.98 avg-zval = 32.01 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 925768 bytes = 3124480 } seq expand size = 6480376 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0296 GB dict = 1.08 MB all = 0.0356 GB } UnZip/Zip{ index = 10.5121 value = 3.6550 dict = 1.00 all = 3.7700 } Zip/UnZip{ index = 0.0951 value = 0.2736 dict = 1.00 all = 0.2653 } ---------------------------- total value len = 9.422499 GB avg = 0.165 KB (by entry num) total key len = 1.570434 GB avg = 0.028 KB total ukey len = 1.090459 GB avg = 0.016 KB total ukey num = 0.070179484 Billion total entry num = 0.056987213 Billion write speed all = 0.183878573 MB/sec (with seq num) write speed all = 0.176252781 MB/sec (without seq num) 2024/11/24-01:31:35.913316 139957315876416 [compaction_job.cc:1948] [default] [JOB 39391] Generated table #287348: 925768 keys, 35601690 bytes, temperature: kWarm 2024/11/24-01:31:35.913385 139957315876416 EVENT_LOG_v1 {"time_micros": 1732383095913350, "cf_name": "default", "job": 39391, "event": "table_file_creation", "file_number": 287348, "file_size": 35601690, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4261178548, "largest_seqno": 4373702473, "table_properties": {"data_size": 29629488, "index_size": 1761344, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25921504, "raw_average_key_size": 28, "raw_value_size": 108296296, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 925768, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732383092, "oldest_key_time": 0, "file_creation_time": 1732383092, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 287348, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-01:31:35.948247 139957315876416 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39391/att-00/287349.sst) /dev/shm/ToplingTemp/Topling-238281-xgcGkU 2024/11/24-01:31:36.808451 139957315876416 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39391/att-00/287349.sst): first pass time = 0.86's, 156.036'MB/sec 2024/11/24-01:31:38.152151 139957315876416 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39391/att-00/287349.sst): old prealloc_size = 147639500, real_size = 31756736 2024/11/24-01:31:38.152680 139957315876416 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39391/att-00/287349.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 925730 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0298 GB avg-val = 116.99 avg-zval = 32.15 2024/11/24-01:31:38.153439 139957315876416 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39391/att-00/287349.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-01:31:39.070961 139957315876416 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39391/att-00/287349.sst): second pass time = 1.34's, 80.644'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.92's, 38.895'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3464.472'MB/sec (index lex order gen) rebuild zvType time = 0.79's, 0.292'MB/sec write SST data time = 0.13's, 283.193'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 35424.140'MB/sec zip my value time = 1.34's, unzip length = 0.108'GB zip my value throughput = 80.644'MB/sec zip pipeline throughput = 80.644'MB/sec entries = 925730 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.99 avg-zval = 32.15 usrkeys = 925730 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.99 avg-zval = 32.15 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 925730 bytes = 3124352 } seq expand size = 6480110 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0298 GB dict = 1.08 MB all = 0.0357 GB } UnZip/Zip{ index = 10.5147 value = 3.6385 dict = 1.00 all = 3.7558 } Zip/UnZip{ index = 0.0951 value = 0.2748 dict = 1.00 all = 0.2663 } ---------------------------- total value len = 9.537276 GB avg = 0.165 KB (by entry num) total key len = 1.596355 GB avg = 0.028 KB total ukey len = 1.108974 GB avg = 0.016 KB total ukey num = 0.071105214 Billion total entry num = 0.057912943 Billion write speed all = 0.186222051 MB/sec (with seq num) write speed all = 0.178472797 MB/sec (without seq num) 2024/11/24-01:31:39.117726 139957315876416 [compaction_job.cc:1948] [default] [JOB 39391] Generated table #287349: 925730 keys, 35735834 bytes, temperature: kWarm 2024/11/24-01:31:39.117792 139957315876416 EVENT_LOG_v1 {"time_micros": 1732383099117758, "cf_name": "default", "job": 39391, "event": "table_file_creation", "file_number": 287349, "file_size": 35735834, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4261178559, "largest_seqno": 4373702636, "table_properties": {"data_size": 29764272, "index_size": 1760832, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25920440, "raw_average_key_size": 28, "raw_value_size": 108297372, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 925730, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732383095, "oldest_key_time": 0, "file_creation_time": 1732383095, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 287349, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-01:31:39.167625 139957315876416 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39391/att-00/287350.sst) /dev/shm/ToplingTemp/Topling-238281-IASO8S 2024/11/24-01:31:40.184332 139957315876416 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39391/att-00/287350.sst): first pass time = 1.02's, 132.017'MB/sec 2024/11/24-01:31:41.542074 139957315876416 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39391/att-00/287350.sst): old prealloc_size = 147639500, real_size = 31870208 2024/11/24-01:31:41.542611 139957315876416 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39391/att-00/287350.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 925815 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0299 GB avg-val = 116.97 avg-zval = 32.27 2024/11/24-01:31:41.543380 139957315876416 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39391/att-00/287350.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-01:31:42.471191 139957315876416 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39391/att-00/287350.sst): second pass time = 1.36's, 79.809'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.93's, 38.586'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3421.613'MB/sec (index lex order gen) rebuild zvType time = 0.80's, 0.289'MB/sec write SST data time = 0.13's, 283.700'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 36680.678'MB/sec zip my value time = 1.36's, unzip length = 0.108'GB zip my value throughput = 79.809'MB/sec zip pipeline throughput = 79.809'MB/sec entries = 925815 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.97 avg-zval = 32.27 usrkeys = 925815 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.97 avg-zval = 32.27 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 925815 bytes = 3124640 } seq expand size = 6480705 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0299 GB dict = 1.08 MB all = 0.0358 GB } UnZip/Zip{ index = 10.5137 value = 3.6246 dict = 1.00 all = 3.7439 } Zip/UnZip{ index = 0.0951 value = 0.2759 dict = 1.00 all = 0.2671 } ---------------------------- total value len = 9.652052 GB avg = 0.164 KB (by entry num) total key len = 1.622278 GB avg = 0.028 KB total ukey len = 1.127490 GB avg = 0.016 KB total ukey num = 0.072031029 Billion total entry num = 0.058838758 Billion write speed all = 0.188564661 MB/sec (with seq num) write speed all = 0.180691973 MB/sec (without seq num) 2024/11/24-01:31:42.519390 139957315876416 [compaction_job.cc:1948] [default] [JOB 39391] Generated table #287350: 925815 keys, 35849588 bytes, temperature: kWarm 2024/11/24-01:31:42.519491 139957315876416 EVENT_LOG_v1 {"time_micros": 1732383102519425, "cf_name": "default", "job": 39391, "event": "table_file_creation", "file_number": 287350, "file_size": 35849588, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4261178575, "largest_seqno": 4373702546, "table_properties": {"data_size": 29877424, "index_size": 1761152, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25922820, "raw_average_key_size": 28, "raw_value_size": 108294926, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 925815, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732383099, "oldest_key_time": 0, "file_creation_time": 1732383099, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 287350, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-01:31:42.558286 139957315876416 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39391/att-00/287351.sst) /dev/shm/ToplingTemp/Topling-238281-SqlEDS 2024/11/24-01:31:43.546872 139957315876416 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39391/att-00/287351.sst): first pass time = 0.99's, 135.772'MB/sec 2024/11/24-01:31:44.836448 139957315876416 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39391/att-00/287351.sst): old prealloc_size = 147639500, real_size = 32059168 2024/11/24-01:31:44.836966 139957315876416 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39391/att-00/287351.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 925716 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0301 GB avg-val = 116.99 avg-zval = 32.48 2024/11/24-01:31:44.837751 139957315876416 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39391/att-00/287351.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-01:31:45.761640 139957315876416 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39391/att-00/287351.sst): second pass time = 1.29's, 84.032'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.93's, 38.953'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3490.535'MB/sec (index lex order gen) rebuild zvType time = 0.80's, 0.290'MB/sec write SST data time = 0.13's, 286.365'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 35169.026'MB/sec zip my value time = 1.29's, unzip length = 0.108'GB zip my value throughput = 84.032'MB/sec zip pipeline throughput = 84.032'MB/sec entries = 925716 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.99 avg-zval = 32.48 usrkeys = 925716 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.99 avg-zval = 32.48 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 925716 bytes = 3124304 } seq expand size = 6480012 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0301 GB dict = 1.08 MB all = 0.0360 GB } UnZip/Zip{ index = 10.5122 value = 3.6020 dict = 1.00 all = 3.7243 } Zip/UnZip{ index = 0.0951 value = 0.2776 dict = 1.00 all = 0.2685 } ---------------------------- total value len = 9.766829 GB avg = 0.163 KB (by entry num) total key len = 1.648198 GB avg = 0.028 KB total ukey len = 1.146004 GB avg = 0.016 KB total ukey num = 0.072956745 Billion total entry num = 0.059764474 Billion write speed all = 0.190907344 MB/sec (with seq num) write speed all = 0.182911234 MB/sec (without seq num) 2024/11/24-01:31:45.807842 139957315876416 [compaction_job.cc:1948] [default] [JOB 39391] Generated table #287351: 925716 keys, 36038338 bytes, temperature: kWarm 2024/11/24-01:31:45.807898 139957315876416 EVENT_LOG_v1 {"time_micros": 1732383105807866, "cf_name": "default", "job": 39391, "event": "table_file_creation", "file_number": 287351, "file_size": 36038338, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4261178589, "largest_seqno": 4373701850, "table_properties": {"data_size": 30066320, "index_size": 1761216, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25920048, "raw_average_key_size": 28, "raw_value_size": 108297712, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 925716, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732383102, "oldest_key_time": 0, "file_creation_time": 1732383102, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 287351, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-01:31:45.844447 139957315876416 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39391/att-00/287352.sst) /dev/shm/ToplingTemp/Topling-238281-9xYduT 2024/11/24-01:31:46.865840 139957315876416 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39391/att-00/287352.sst): first pass time = 1.02's, 131.411'MB/sec 2024/11/24-01:31:48.211362 139957315876416 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39391/att-00/287352.sst): old prealloc_size = 147639500, real_size = 32181968 2024/11/24-01:31:48.211872 139957315876416 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39391/att-00/287352.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 925828 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0302 GB avg-val = 116.97 avg-zval = 32.61 2024/11/24-01:31:48.212654 139957315876416 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39391/att-00/287352.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-01:31:49.146816 139957315876416 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39391/att-00/287352.sst): second pass time = 1.34's, 80.553'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.94's, 38.658'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3613.660'MB/sec (index lex order gen) rebuild zvType time = 0.81's, 0.286'MB/sec write SST data time = 0.13's, 286.558'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 36132.745'MB/sec zip my value time = 1.34's, unzip length = 0.108'GB zip my value throughput = 80.553'MB/sec zip pipeline throughput = 80.553'MB/sec entries = 925828 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.97 avg-zval = 32.61 usrkeys = 925828 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.97 avg-zval = 32.61 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 925828 bytes = 3124688 } seq expand size = 6480796 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0302 GB dict = 1.08 MB all = 0.0362 GB } UnZip/Zip{ index = 10.5131 value = 3.5872 dict = 1.00 all = 3.7116 } Zip/UnZip{ index = 0.0951 value = 0.2788 dict = 1.00 all = 0.2694 } ---------------------------- total value len = 9.881605 GB avg = 0.163 KB (by entry num) total key len = 1.674121 GB avg = 0.028 KB total ukey len = 1.164521 GB avg = 0.016 KB total ukey num = 0.073882573 Billion total entry num = 0.060690302 Billion write speed all = 0.193249477 MB/sec (with seq num) write speed all = 0.185129956 MB/sec (without seq num) 2024/11/24-01:31:49.192641 139957315876416 [compaction_job.cc:1948] [default] [JOB 39391] Generated table #287352: 925828 keys, 36161662 bytes, temperature: kWarm 2024/11/24-01:31:49.193211 139957315876416 EVENT_LOG_v1 {"time_micros": 1732383109192677, "cf_name": "default", "job": 39391, "event": "table_file_creation", "file_number": 287352, "file_size": 36161662, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4261178599, "largest_seqno": 4373701778, "table_properties": {"data_size": 30189056, "index_size": 1761280, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25923184, "raw_average_key_size": 28, "raw_value_size": 108294628, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 925828, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732383105, "oldest_key_time": 0, "file_creation_time": 1732383105, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 287352, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-01:31:49.231283 139957315876416 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39391/att-00/287353.sst) /dev/shm/ToplingTemp/Topling-238281-5kbAOS 2024/11/24-01:31:50.399469 139957315876416 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39391/att-00/287353.sst): first pass time = 1.17's, 98.889'MB/sec 2024/11/24-01:31:51.532627 139957315876416 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39391/att-00/287353.sst): old prealloc_size = 147639500, real_size = 27080064 2024/11/24-01:31:51.533168 139957315876416 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39391/att-00/287353.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 797779 prefix = 4 raw-key = 0.0128 GB zip-key = 0.0015 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.0932 GB zip-val = 0.0254 GB avg-val = 116.80 avg-zval = 31.78 2024/11/24-01:31:51.534879 139957315876416 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39391/att-00/287353.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0020 GB, waited 0.000 sec, Key+Value = 0.116 GB 2024/11/24-01:31:52.351682 139957315876416 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39391/att-00/287353.sst): second pass time = 1.13's, 82.285'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.82's, 37.249'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2926.403'MB/sec (index lex order gen) rebuild zvType time = 0.71's, 0.281'MB/sec write SST data time = 0.11's, 280.093'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.931'MB, throughput = 27657.016'MB/sec zip my value time = 1.13's, unzip length = 0.093'GB zip my value throughput = 82.285'MB/sec zip pipeline throughput = 82.285'MB/sec entries = 797779 avg-key = 28.00 avg-zkey = 1.92 avg-val = 116.80 avg-zval = 31.78 usrkeys = 797779 avg-key = 20.00 avg-zkey = 1.92 avg-val = 123.80 avg-zval = 31.78 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 797779 bytes = 2692512 } seq expand size = 5584453 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0160 GB value = 0.0932 GB dict = 0.93 MB all = 0.1155 GB } __ZipSize{ index = 0.0015 GB value = 0.0254 GB dict = 0.93 MB all = 0.0305 GB } UnZip/Zip{ index = 10.4430 value = 3.6754 dict = 1.00 all = 3.7865 } Zip/UnZip{ index = 0.0958 value = 0.2721 dict = 1.00 all = 0.2641 } ---------------------------- total value len = 9.980369 GB avg = 0.162 KB (by entry num) total key len = 1.696459 GB avg = 0.028 KB total ukey len = 1.180476 GB avg = 0.016 KB total ukey num = 0.074680352 Billion total entry num = 0.061488081 Billion write speed all = 0.195264234 MB/sec (with seq num) write speed all = 0.187038423 MB/sec (without seq num) 2024/11/24-01:31:52.391234 139957315876416 [compaction_job.cc:1948] [default] [JOB 39391] Generated table #287353: 797779 keys, 30508070 bytes, temperature: kWarm 2024/11/24-01:31:52.391304 139957315876416 EVENT_LOG_v1 {"time_micros": 1732383112391269, "cf_name": "default", "job": 39391, "event": "table_file_creation", "file_number": 287353, "file_size": 30508070, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4280814656, "largest_seqno": 4373701796, "table_properties": {"data_size": 25352560, "index_size": 1527872, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 22337812, "raw_average_key_size": 28, "raw_value_size": 93179838, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 797779, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732383109, "oldest_key_time": 0, "file_creation_time": 1732383109, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 287353, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-01:31:52.426438 139957315876416 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39391/att-00/287354.sst) /dev/shm/ToplingTemp/Topling-238281-MLqm5S 2024/11/24-01:31:52.958760 139957315876416 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39391/att-00/287354.sst): first pass time = 0.53's, 252.151'MB/sec 2024/11/24-01:31:54.275262 139957315876416 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39391/att-00/287354.sst): old prealloc_size = 147639500, real_size = 30946624 2024/11/24-01:31:54.275809 139957315876416 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39391/att-00/287354.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 925970 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0290 GB avg-val = 116.95 avg-zval = 31.27 2024/11/24-01:31:54.277515 139957315876416 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39391/att-00/287354.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-01:31:55.148475 139957315876416 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39391/att-00/287354.sst): second pass time = 1.32's, 82.309'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.87's, 40.000'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3369.858'MB/sec (index lex order gen) rebuild zvType time = 0.69's, 0.338'MB/sec write SST data time = 0.19's, 186.949'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 35747.420'MB/sec zip my value time = 1.32's, unzip length = 0.108'GB zip my value throughput = 82.309'MB/sec zip pipeline throughput = 82.309'MB/sec entries = 925970 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.95 avg-zval = 31.27 usrkeys = 925970 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.95 avg-zval = 31.27 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 925970 bytes = 3125168 } seq expand size = 6481790 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0290 GB dict = 1.08 MB all = 0.0349 GB } UnZip/Zip{ index = 10.5144 value = 3.7401 dict = 1.00 all = 3.8428 } Zip/UnZip{ index = 0.0951 value = 0.2674 dict = 1.00 all = 0.2602 } ---------------------------- total value len = 10.095142 GB avg = 0.162 KB (by entry num) total key len = 1.722386 GB avg = 0.028 KB total ukey len = 1.198996 GB avg = 0.016 KB total ukey num = 0.075606322 Billion total entry num = 0.062414051 Billion write speed all = 0.197607824 MB/sec (with seq num) write speed all = 0.189258528 MB/sec (without seq num) 2024/11/24-01:31:55.195745 139957315876416 [compaction_job.cc:1948] [default] [JOB 39391] Generated table #287354: 925970 keys, 34926812 bytes, temperature: kWarm 2024/11/24-01:31:55.195842 139957315876416 EVENT_LOG_v1 {"time_micros": 1732383115195790, "cf_name": "default", "job": 39391, "event": "table_file_creation", "file_number": 287354, "file_size": 34926812, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4261178645, "largest_seqno": 4373701873, "table_properties": {"data_size": 28953584, "index_size": 1761344, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25927160, "raw_average_key_size": 28, "raw_value_size": 108290704, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 925970, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732383112, "oldest_key_time": 0, "file_creation_time": 1732383112, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 287354, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-01:31:55.246103 139957315876416 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39391/att-00/287355.sst) /dev/shm/ToplingTemp/Topling-238281-WF7YSS 2024/11/24-01:31:56.137359 139957315876416 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39391/att-00/287355.sst): first pass time = 0.89's, 150.604'MB/sec 2024/11/24-01:31:57.481642 139957315876416 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39391/att-00/287355.sst): old prealloc_size = 147639500, real_size = 31334720 2024/11/24-01:31:57.482213 139957315876416 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39391/att-00/287355.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 925654 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1083 GB zip-val = 0.0293 GB avg-val = 117.00 avg-zval = 31.69 2024/11/24-01:31:57.483969 139957315876416 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39391/att-00/287355.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-01:31:58.312790 139957315876416 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39391/att-00/287355.sst): second pass time = 1.34's, 80.612'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.83's, 42.490'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3232.497'MB/sec (index lex order gen) rebuild zvType time = 0.70's, 0.330'MB/sec write SST data time = 0.13's, 274.169'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 40398.744'MB/sec zip my value time = 1.34's, unzip length = 0.108'GB zip my value throughput = 80.612'MB/sec zip pipeline throughput = 80.612'MB/sec entries = 925654 avg-key = 28.00 avg-zkey = 1.92 avg-val = 117.00 avg-zval = 31.69 usrkeys = 925654 avg-key = 20.00 avg-zkey = 1.92 avg-val = 124.00 avg-zval = 31.69 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 925654 bytes = 3124096 } seq expand size = 6479578 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0293 GB dict = 1.08 MB all = 0.0353 GB } UnZip/Zip{ index = 10.4436 value = 3.6924 dict = 1.00 all = 3.8007 } Zip/UnZip{ index = 0.0958 value = 0.2708 dict = 1.00 all = 0.2631 } ---------------------------- total value len = 10.209921 GB avg = 0.161 KB (by entry num) total key len = 1.748304 GB avg = 0.028 KB total ukey len = 1.217509 GB avg = 0.016 KB total ukey num = 0.076531976 Billion total entry num = 0.063339705 Billion write speed all = 0.199949926 MB/sec (with seq num) write speed all = 0.191477251 MB/sec (without seq num) 2024/11/24-01:31:58.356772 139957315876416 [compaction_job.cc:1948] [default] [JOB 39391] Generated table #287355: 925654 keys, 35314114 bytes, temperature: kWarm 2024/11/24-01:31:58.356847 139957315876416 EVENT_LOG_v1 {"time_micros": 1732383118356810, "cf_name": "default", "job": 39391, "event": "table_file_creation", "file_number": 287355, "file_size": 35314114, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4261178675, "largest_seqno": 4373701888, "table_properties": {"data_size": 29330480, "index_size": 1772672, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25918312, "raw_average_key_size": 28, "raw_value_size": 108299416, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 925654, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732383115, "oldest_key_time": 0, "file_creation_time": 1732383115, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 287355, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-01:31:58.394546 139957315876416 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39391/att-00/287356.sst) /dev/shm/ToplingTemp/Topling-238281-UvUCDR 2024/11/24-01:31:59.423541 139957315876416 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39391/att-00/287356.sst): first pass time = 1.03's, 130.444'MB/sec 2024/11/24-01:32:00.782600 139957315876416 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39391/att-00/287356.sst): old prealloc_size = 147639500, real_size = 31621136 2024/11/24-01:32:00.783156 139957315876416 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39391/att-00/287356.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 925804 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0296 GB avg-val = 116.97 avg-zval = 32.00 2024/11/24-01:32:00.784860 139957315876416 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39391/att-00/287356.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-01:32:01.609568 139957315876416 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39391/att-00/287356.sst): second pass time = 1.36's, 79.731'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.83's, 43.051'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3297.588'MB/sec (index lex order gen) rebuild zvType time = 0.70's, 0.331'MB/sec write SST data time = 0.13's, 280.280'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 35349.409'MB/sec zip my value time = 1.36's, unzip length = 0.108'GB zip my value throughput = 79.731'MB/sec zip pipeline throughput = 79.731'MB/sec entries = 925804 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.97 avg-zval = 32.00 usrkeys = 925804 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.97 avg-zval = 32.00 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 925804 bytes = 3124608 } seq expand size = 6480628 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0296 GB dict = 1.08 MB all = 0.0356 GB } UnZip/Zip{ index = 10.5106 value = 3.6552 dict = 1.00 all = 3.7701 } Zip/UnZip{ index = 0.0951 value = 0.2736 dict = 1.00 all = 0.2652 } ---------------------------- total value len = 10.324697 GB avg = 0.161 KB (by entry num) total key len = 1.774227 GB avg = 0.028 KB total ukey len = 1.236025 GB avg = 0.016 KB total ukey num = 0.077457780 Billion total entry num = 0.064265509 Billion write speed all = 0.202291353 MB/sec (with seq num) write speed all = 0.193695311 MB/sec (without seq num) 2024/11/24-01:32:01.654040 139957315876416 [compaction_job.cc:1948] [default] [JOB 39391] Generated table #287356: 925804 keys, 35600528 bytes, temperature: kWarm 2024/11/24-01:32:01.654115 139957315876416 EVENT_LOG_v1 {"time_micros": 1732383121654078, "cf_name": "default", "job": 39391, "event": "table_file_creation", "file_number": 287356, "file_size": 35600528, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4261178686, "largest_seqno": 4373702111, "table_properties": {"data_size": 29627840, "index_size": 1761664, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25922512, "raw_average_key_size": 28, "raw_value_size": 108295348, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 925804, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732383118, "oldest_key_time": 0, "file_creation_time": 1732383118, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 287356, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-01:32:01.690707 139957315876416 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39391/att-00/287357.sst) /dev/shm/ToplingTemp/Topling-238281-eGvIvV 2024/11/24-01:32:01.707482 139957315876416 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39391/att-00/287357.sst): first pass time = 0.02's, 178.513'MB/sec 2024/11/24-01:32:01.761965 139957315876416 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39391/att-00/287357.sst): old prealloc_size = 147639500, real_size = 992160 2024/11/24-01:32:01.762059 139957315876416 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39391/att-00/287357.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 20449 prefix = 4 raw-key = 0.0003 GB zip-key = 0.0000 GB avg-key = 16.00 avg-zkey = 1.98 raw-val = 0.0024 GB zip-val = 0.0009 GB avg-val = 118.00 avg-zval = 46.27 2024/11/24-01:32:01.762131 139957315876416 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39391/att-00/287357.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0000 GB, waited 0.000 sec, Key+Value = 0.003 GB 2024/11/24-01:32:01.804754 139957315876416 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39391/att-00/287357.sst): second pass time = 0.05's, 44.933'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.04's, 25.005'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 692.329'MB/sec (index lex order gen) rebuild zvType time = 0.03's, 0.157'MB/sec write SST data time = 0.01's, 106.392'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.024'MB, throughput = 569.186'MB/sec zip my value time = 0.05's, unzip length = 0.002'GB zip my value throughput = 44.933'MB/sec zip pipeline throughput = 136.969'MB/sec entries = 20449 avg-key = 28.00 avg-zkey = 1.98 avg-val = 118.00 avg-zval = 46.27 usrkeys = 20449 avg-key = 20.00 avg-zkey = 1.98 avg-val = 125.00 avg-zval = 46.27 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 20449 bytes = 56256 } seq expand size = 143143 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0004 GB value = 0.0024 GB dict = 0.02 MB all = 0.0030 GB } __ZipSize{ index = 0.0000 GB value = 0.0009 GB dict = 0.02 MB all = 0.0011 GB } UnZip/Zip{ index = 10.0794 value = 2.5500 dict = 1.00 all = 2.7949 } Zip/UnZip{ index = 0.0992 value = 0.3922 dict = 1.00 all = 0.3578 } ---------------------------- total value len = 10.327253 GB avg = 0.161 KB (by entry num) total key len = 1.774799 GB avg = 0.028 KB total ukey len = 1.236434 GB avg = 0.016 KB total ukey num = 0.077478229 Billion total entry num = 0.064285958 Billion write speed all = 0.202343004 MB/sec (with seq num) write speed all = 0.193744255 MB/sec (without seq num) 2024/11/24-01:32:01.816327 139957315876416 [compaction_job.cc:1948] [default] [JOB 39391] Generated table #287357: 20449 keys, 1068223 bytes, temperature: kWarm 2024/11/24-01:32:01.816412 139957315876416 EVENT_LOG_v1 {"time_micros": 1732383121816366, "cf_name": "default", "job": 39391, "event": "table_file_creation", "file_number": 287357, "file_size": 1068223, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4270331337, "largest_seqno": 4273864166, "table_properties": {"data_size": 946256, "index_size": 40576, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 572572, "raw_average_key_size": 28, "raw_value_size": 2412982, "raw_average_value_size": 118, "num_data_blocks": 1, "num_entries": 20449, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 118, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732383121, "oldest_key_time": 0, "file_creation_time": 1732383121, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 287357, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-01:32:01.827152 139957315876416 [compaction_job.cc:703] job-39391: subcompact[0], size: 0.457263 G, files: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-39391/att-00 [287344,287345,287346,287347,287348,287349,287350,287351,287352,287353,287354,287355,287356,287357] 2024/11/24-01:32:01.983897 139957315876416 (Original Log Time 2024/11/24-01:31:18.873383) EVENT_LOG_v1 {"time_micros": 1732383078873340, "job": 39391, "event": "compaction_started", "compaction_reason": "FilesMarkedForCompaction", "files_L2": [287323], "files_L3": [287248, 287249, 287250, 287251, 287252, 287253, 287254, 287255, 287274, 287275, 287276, 287277, 287334], "score": 0.531274, "input_data_size": 485911578, "oldest_snapshot_seqno": 4373805668} 2024/11/24-01:32:01.983901 139957315876416 (Original Log Time 2024/11/24-01:32:01.982571) [compaction_job.cc:2022] [default] [JOB 39391] Compacted 1@2 + 13@3 files to L3 => 457263149 bytes 2024/11/24-01:32:01.983902 139957315876416 (Original Log Time 2024/11/24-01:32:01.983826) [compaction_job.cc:1224] [default] compacted to: files[0 0 0 14 0 0 0] max score 0.02, MB/sec: 11.3 rd, 10.6 wr, level 3, files in(1, 13) out(14 +0 blob) MB in(27.2, 436.2 +0.0 blob) out(436.1 +0.0 blob), read-write-amplify(33.1) write-amplify(16.1) OK, records in: 12038433, records dropped: 110639 output_compression: Snappy 2024/11/24-01:32:01.983909 139957315876416 (Original Log Time 2024/11/24-01:32:01.983874) EVENT_LOG_v1 {"time_micros": 1732383121983852, "cf": "default", "job": 39391, "event": "compaction_finished", "compaction_time_micros": 42953785, "compaction_time_cpu_micros": 18960358, "output_level": 3, "num_output_files": 14, "total_output_size": 457263149, "num_input_records": 12038433, "num_output_records": 11927794, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "file_write_nanos": 314790625, "file_range_sync_nanos": 0, "file_fsync_nanos": 11045, "file_prepare_write_nanos": 31199, "lsm_state": [0, 0, 0, 14, 0, 0, 0]} 2024/11/24-01:32:02.113138 139957315876416 DEBG dcompact_worker.cpp:240: HttpPost: 200 OK: url = http://nlb-7zny4kaa1poal01o64.cn-shenzhen.nlb.aliyuncs.com:8443, body = {"instanceId":"nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137","labourId":"","dbId":"d89b4006-2803-486e-b7a2-759bcf348921","dbStarts":1732256054,"starts":1732383078,"executesMs":43242,"compactionJobId":39391,"attempt":0,"compactionInputRawBytes":1744827414,"compactionInputZipBytes":485911578,"compactionOutputRawBytes":0,"compactionOutputZipBytes":457263149,"headers":{"Accept":"*/*","Connection":"close","Host":"aliyun-topling-saas.topling.cn:18443","RemoteIp":"120.24.192.169","X-Forwarded-For":"120.24.192.169","region":"cn-shenzhen","token":"e6474c481bd4415abc537135cc03626b","instance-token":"e6474c481bd4415abc537135cc03626b","provider":"aliyun","CloudMarketInstanceId":"si-59c0ae5c955845588903","MeteringAssit":"","Transfer-Encoding":"chunked","traceparent":"00-a32d758a0dbcae251d81675b3b858d0d-c3db4d5fa6eef402-00"}}, response = 2024/11/24-01:32:02.113253 139957315876416 INFO dcompact_worker.cpp:1459: finish /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-39391/att-00: olev 3, work 43.242 s, result 11.201 ms, install 1.363 ms, input{raw 1.625 GiB zip 463.401 MiB}