2024/11/23-04:09:32.600222 140024961644096 DEBG dcompact_worker.cpp:2214: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18990/att-00: fork to child time = 0.011032 sec 2024/11/23-04:09:32.601071 140024961644096 DEBG dcompact_worker.cpp:1013: Beg SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18990/att-00 2024/11/23-04:09:32.607569 140024961644096 DEBG dcompact_worker.cpp:1033: End SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18990/att-00 2024/11/23-04:09:32.608685 140024961644096 TRAC dcompact_worker.cpp:1083: INFO_LOG_LEVEL: rpc = INFO_LEVEL, env_var = undefined 2024/11/23-04:09:32.608933 140024961644096 [WARN] [column_family.cc:386] multiple cf_paths/db_paths and level_compaction_dynamic_level_bytes can't be used together 2024/11/23-04:09:32.651564 140024961644096 [version_set.cc:6208] Recovering from manifest file: /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-18990/att-00/MANIFEST-206347 2024/11/23-04:09:32.665321 140024961644096 [version_set.cc:6251] Recovered from manifest file:/worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-18990/att-00/MANIFEST-206347 succeeded,manifest_file_number is 206347, next_file_number is 244066, last_sequence is 3777715094, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 243870 2024/11/23-04:09:32.665327 140024961644096 [version_set.cc:6266] Column family [default] (ID 0), log number is 0 2024/11/23-04:09:32.665618 140024961644096 [version_set.cc:5721] Creating manifest 244066 2024/11/23-04:09:32.697423 140024961644096 DEBG dcompact_worker.cpp:1218: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18990/att-00: bottommost_level: fake = 1, rpc = 0 2024/11/23-04:09:32.717495 140024961644096 [compaction_job.cc:2437] [default] [JOB 18990] Compacting 1@2 + 15@3 files to L3, score 0.99, subcompactions 1 : 1 2024/11/23-04:09:32.717510 140024961644096 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 14195 Base level 2, inputs: [244004(27MB)], [244053(36MB) 244054(7067KB) 243978(8073KB) 243930(35MB) 243931(35MB) 243932(35MB) 243933(35MB) 243934(33MB) 243935(34MB) 243936(34MB) 243937(34MB) 243938(34MB) 243939(34MB) 243956(35MB) 244055(35MB)] 2024/11/23-04:09:32.723393 140024961644096 [top_zip_table.cc:59] core git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-04:09:32.723421 140024961644096 [top_zip_table.cc:60] fsa git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-04:09:32.723440 140024961644096 [top_zip_table.cc:61] zbs git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-04:09:32.723444 140024961644096 [top_zip_table.cc:62] topling-zip_table_reader: git_version_hash_info_is: commit a4a382006cb82713acf5b3425835f22711877681 Author: leipeng Date: 2024-04-11 19:44:14 +0800 fixed_len_hole_index.cc: Add env bool FixedLenHoleIndexUseAVX512 for ut & debug 1. FixedLenHoleIndexUseAVX512 is only in unit tests or debug 2. In release mode, use avx512 by compile options(-march=) g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/23-04:09:32.723455 140024961644096 [top_zip_table.cc:64] topling-rocks git_version_hash_info_is: commit feab587e468621ba0204d47b4ffacc52e7c4290d Author: leipeng Date: 2024-03-22 13:35:06 +0800 ToplingZipTableBuilder::Add: immediately return after error This function returns void, and caller does not check builder->status() after calling this function and graceful abandon. So immediately return after error, and return error status in Finish(). g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/23-04:09:33.167771 140024961644096 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18990/att-00/244067.sst) /dev/shm/ToplingTemp/Topling-404331-CbqqHP 2024/11/23-04:09:33.727244 140024961644096 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18990/att-00/244067.sst): first pass time = 0.56's, 239.923'MB/sec 2024/11/23-04:09:36.924769 140024961644096 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18990/att-00/244067.sst): old prealloc_size = 147639500, real_size = 33482576 2024/11/23-04:09:36.925367 140024961644096 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18990/att-00/244067.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 932618 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1081 GB zip-val = 0.0315 GB avg-val = 115.92 avg-zval = 33.74 2024/11/23-04:09:36.926186 140024961644096 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18990/att-00/244067.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-04:09:38.008447 140024961644096 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18990/att-00/244067.sst): second pass time = 3.20's, 33.818'MB/sec, value only(80.5% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.08's, 34.695'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3127.583'MB/sec (index lex order gen) rebuild zvType time = 0.84's, 0.277'MB/sec write SST data time = 0.24's, 155.070'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 33677.113'MB/sec zip my value time = 3.20's, unzip length = 0.108'GB zip my value throughput = 33.818'MB/sec zip pipeline throughput = 97.864'MB/sec entries = 932618 avg-key = 28.00 avg-zkey = 1.91 avg-val = 115.92 avg-zval = 33.74 usrkeys = 932618 avg-key = 20.00 avg-zkey = 1.91 avg-val = 122.92 avg-zval = 33.74 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 932618 bytes = 3264176 } seq expand size = 6528326 multi value expand size = 0 cnt WriteAppend = 15 UnZipSize{ index = 0.0187 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0315 GB dict = 1.08 MB all = 0.0376 GB } UnZip/Zip{ index = 10.4445 value = 3.4359 dict = 1.00 all = 3.5699 } Zip/UnZip{ index = 0.0957 value = 0.2910 dict = 1.00 all = 0.2801 } ---------------------------- total value len = 0.114633 GB avg = 0.123 KB (by entry num) total key len = 0.026113 GB avg = 0.028 KB total ukey len = 0.018652 GB avg = 0.020 KB total ukey num = 0.000932618 Billion total entry num = 0.000932618 Billion write speed all = 0.002027022 MB/sec (with seq num) write speed all = 0.001919569 MB/sec (without seq num) 2024/11/23-04:09:38.043720 140024961644096 [compaction_job.cc:1948] [default] [JOB 18990] Generated table #244067: 932618 keys, 37597276 bytes, temperature: kWarm 2024/11/23-04:09:38.043842 140024961644096 EVENT_LOG_v1 {"time_micros": 1732306178043762, "cf_name": "default", "job": 18990, "event": "table_file_creation", "file_number": 244067, "file_size": 37597276, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3583362754, "largest_seqno": 3777164693, "table_properties": {"data_size": 31463360, "index_size": 1785856, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26113304, "raw_average_key_size": 28, "raw_value_size": 108104448, "raw_average_value_size": 115, "num_data_blocks": 1, "num_entries": 932618, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732306173, "oldest_key_time": 0, "file_creation_time": 1732306173, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 244067, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-04:09:38.093787 140024961644096 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18990/att-00/244068.sst) /dev/shm/ToplingTemp/Topling-404331-KI7D8M 2024/11/23-04:09:39.767365 140024961644096 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18990/att-00/244068.sst): first pass time = 1.67's, 80.201'MB/sec 2024/11/23-04:09:41.462876 140024961644096 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18990/att-00/244068.sst): old prealloc_size = 147639500, real_size = 34300288 2024/11/23-04:09:41.463459 140024961644096 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18990/att-00/244068.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 930464 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0323 GB avg-val = 116.25 avg-zval = 34.71 2024/11/23-04:09:41.464337 140024961644096 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18990/att-00/244068.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-04:09:42.511338 140024961644096 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18990/att-00/244068.sst): second pass time = 1.69's, 64.137'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.05's, 36.745'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3159.535'MB/sec (index lex order gen) rebuild zvType time = 0.89's, 0.261'MB/sec write SST data time = 0.16's, 244.593'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 37278.145'MB/sec zip my value time = 1.69's, unzip length = 0.108'GB zip my value throughput = 64.137'MB/sec zip pipeline throughput = 65.218'MB/sec entries = 930464 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.25 avg-zval = 34.71 usrkeys = 930464 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.25 avg-zval = 34.71 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 930464 bytes = 3372944 } seq expand size = 6513248 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0323 GB dict = 1.08 MB all = 0.0385 GB } UnZip/Zip{ index = 10.5123 value = 3.3490 dict = 1.00 all = 3.4839 } Zip/UnZip{ index = 0.0951 value = 0.2986 dict = 1.00 all = 0.2870 } ---------------------------- total value len = 0.229311 GB avg = 0.123 KB (by entry num) total key len = 0.052166 GB avg = 0.028 KB total ukey len = 0.037262 GB avg = 0.020 KB total ukey num = 0.001863082 Billion total entry num = 0.001863082 Billion write speed all = 0.004053564 MB/sec (with seq num) write speed all = 0.003838921 MB/sec (without seq num) 2024/11/23-04:09:42.546079 140024961644096 [compaction_job.cc:1948] [default] [JOB 18990] Generated table #244068: 930464 keys, 38524974 bytes, temperature: kWarm 2024/11/23-04:09:42.546149 140024961644096 EVENT_LOG_v1 {"time_micros": 1732306182546112, "cf_name": "default", "job": 18990, "event": "table_file_creation", "file_number": 244068, "file_size": 38524974, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3376774746, "largest_seqno": 3777163826, "table_properties": {"data_size": 32297264, "index_size": 1770240, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26052992, "raw_average_key_size": 28, "raw_value_size": 108164788, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 930464, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732306178, "oldest_key_time": 0, "file_creation_time": 1732306178, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 244068, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-04:09:42.588940 140024961644096 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18990/att-00/244069.sst) /dev/shm/ToplingTemp/Topling-404331-R8rK2N 2024/11/23-04:09:43.509908 140024961644096 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18990/att-00/244069.sst): first pass time = 0.92's, 145.742'MB/sec 2024/11/23-04:09:44.808568 140024961644096 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18990/att-00/244069.sst): old prealloc_size = 147639500, real_size = 32555248 2024/11/23-04:09:44.809165 140024961644096 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18990/att-00/244069.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 936110 prefix = 4 raw-key = 0.0150 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1080 GB zip-val = 0.0305 GB avg-val = 115.38 avg-zval = 32.62 2024/11/23-04:09:44.809978 140024961644096 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18990/att-00/244069.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-04:09:45.751896 140024961644096 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18990/att-00/244069.sst): second pass time = 1.30's, 83.215'MB/sec, value only(80.5% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.94's, 39.009'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3119.247'MB/sec (index lex order gen) rebuild zvType time = 0.81's, 0.289'MB/sec write SST data time = 0.13's, 277.648'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.077'MB, throughput = 32920.880'MB/sec zip my value time = 1.30's, unzip length = 0.108'GB zip my value throughput = 83.215'MB/sec zip pipeline throughput = 83.215'MB/sec entries = 936110 avg-key = 28.00 avg-zkey = 1.90 avg-val = 115.38 avg-zval = 32.62 usrkeys = 936110 avg-key = 20.00 avg-zkey = 1.90 avg-val = 122.38 avg-zval = 32.62 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 936110 bytes = 3393408 } seq expand size = 6552770 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0187 GB value = 0.1080 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0305 GB dict = 1.08 MB all = 0.0368 GB } UnZip/Zip{ index = 10.5141 value = 3.5365 dict = 1.00 all = 3.6475 } Zip/UnZip{ index = 0.0951 value = 0.2828 dict = 1.00 all = 0.2742 } ---------------------------- total value len = 0.343870 GB avg = 0.123 KB (by entry num) total key len = 0.078377 GB avg = 0.028 KB total ukey len = 0.055984 GB avg = 0.020 KB total ukey num = 0.002799192 Billion total entry num = 0.002799192 Billion write speed all = 0.006080523 MB/sec (with seq num) write speed all = 0.005758048 MB/sec (without seq num) 2024/11/23-04:09:45.783861 140024961644096 [compaction_job.cc:1948] [default] [JOB 18990] Generated table #244069: 936110 keys, 36797434 bytes, temperature: kWarm 2024/11/23-04:09:45.783926 140024961644096 EVENT_LOG_v1 {"time_micros": 1732306185783891, "cf_name": "default", "job": 18990, "event": "table_file_creation", "file_number": 244069, "file_size": 36797434, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3504428200, "largest_seqno": 3777164416, "table_properties": {"data_size": 30540384, "index_size": 1780672, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26211080, "raw_average_key_size": 28, "raw_value_size": 108006736, "raw_average_value_size": 115, "num_data_blocks": 1, "num_entries": 936110, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732306182, "oldest_key_time": 0, "file_creation_time": 1732306182, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 244069, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-04:09:45.819400 140024961644096 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18990/att-00/244070.sst) /dev/shm/ToplingTemp/Topling-404331-pF372N 2024/11/23-04:09:46.728765 140024961644096 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18990/att-00/244070.sst): first pass time = 0.91's, 147.601'MB/sec 2024/11/23-04:09:48.076187 140024961644096 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18990/att-00/244070.sst): old prealloc_size = 147639500, real_size = 33283904 2024/11/23-04:09:48.076751 140024961644096 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18990/att-00/244070.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 929437 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1082 GB zip-val = 0.0313 GB avg-val = 116.41 avg-zval = 33.65 2024/11/23-04:09:48.077543 140024961644096 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18990/att-00/244070.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-04:09:49.022551 140024961644096 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18990/att-00/244070.sst): second pass time = 1.35's, 80.343'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.95's, 39.547'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3294.426'MB/sec (index lex order gen) rebuild zvType time = 0.81's, 0.287'MB/sec write SST data time = 0.13's, 277.400'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 28283.820'MB/sec zip my value time = 1.35's, unzip length = 0.108'GB zip my value throughput = 80.343'MB/sec zip pipeline throughput = 80.343'MB/sec entries = 929437 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.41 avg-zval = 33.65 usrkeys = 929437 avg-key = 20.00 avg-zkey = 1.91 avg-val = 123.16 avg-zval = 33.65 TagRS{ kinds = RS_Key0_TagN bytes = 145320 } TagArray{ size = 897076 bytes = 3139776 } seq expand size = 6279532 multi value expand size = 0 cnt WriteAppend = 15 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0313 GB dict = 1.08 MB all = 0.0374 GB } UnZip/Zip{ index = 10.4467 value = 3.4598 dict = 1.00 all = 3.5863 } Zip/UnZip{ index = 0.0957 value = 0.2890 dict = 1.00 all = 0.2788 } ---------------------------- total value len = 0.458343 GB avg = 0.123 KB (by entry num) total key len = 0.104402 GB avg = 0.028 KB total ukey len = 0.074573 GB avg = 0.020 KB total ukey num = 0.003728629 Billion total entry num = 0.003728629 Billion write speed all = 0.008103356 MB/sec (with seq num) write speed all = 0.007673827 MB/sec (without seq num) 2024/11/23-04:09:49.055148 140024961644096 [compaction_job.cc:1948] [default] [JOB 18990] Generated table #244070: 929437 keys, 37425510 bytes, temperature: kWarm 2024/11/23-04:09:49.055211 140024961644096 EVENT_LOG_v1 {"time_micros": 1732306189055179, "cf_name": "default", "job": 18990, "event": "table_file_creation", "file_number": 244070, "file_size": 37425510, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3777164593, "table_properties": {"data_size": 31271984, "index_size": 1779392, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26024236, "raw_average_key_size": 28, "raw_value_size": 108193602, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 929437, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732306185, "oldest_key_time": 0, "file_creation_time": 1732306185, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 244070, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-04:09:49.095830 140024961644096 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18990/att-00/244071.sst) /dev/shm/ToplingTemp/Topling-404331-icxedO 2024/11/23-04:09:50.016622 140024961644096 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18990/att-00/244071.sst): first pass time = 0.92's, 145.769'MB/sec 2024/11/23-04:09:51.400848 140024961644096 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18990/att-00/244071.sst): old prealloc_size = 147639500, real_size = 34973408 2024/11/23-04:09:51.401488 140024961644096 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18990/att-00/244071.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 1081561 prefix = 4 raw-key = 0.0173 GB zip-key = 0.0021 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1039 GB zip-val = 0.0326 GB avg-val = 96.10 avg-zval = 30.17 2024/11/23-04:09:51.401538 140024961644096 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18990/att-00/244071.sst: sumWaitingMem = 0.003 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0028 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-04:09:52.031174 140024961644096 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18990/att-00/244071.sst): second pass time = 1.38's, 75.129'MB/sec, value only(77.4% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.63's, 56.710'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3349.051'MB/sec (index lex order gen) rebuild zvType time = 0.49's, 0.556'MB/sec write SST data time = 0.14's, 249.786'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.031'MB, throughput = 29962.488'MB/sec zip my value time = 1.38's, unzip length = 0.104'GB zip my value throughput = 75.129'MB/sec zip pipeline throughput = 75.129'MB/sec entries = 1081561 avg-key = 28.00 avg-zkey = 1.91 avg-val = 96.10 avg-zval = 30.17 usrkeys = 1081561 avg-key = 20.00 avg-zkey = 1.91 avg-val = 96.10 avg-zval = 30.17 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0216 GB value = 0.1039 GB dict = 1.03 MB all = 0.1342 GB } __ZipSize{ index = 0.0021 GB value = 0.0326 GB dict = 1.03 MB all = 0.0357 GB } UnZip/Zip{ index = 10.4475 value = 3.1850 dict = 1.00 all = 3.7549 } Zip/UnZip{ index = 0.0957 value = 0.3140 dict = 1.00 all = 0.2663 } ---------------------------- total value len = 0.562278 GB avg = 0.117 KB (by entry num) total key len = 0.134685 GB avg = 0.028 KB total ukey len = 0.096204 GB avg = 0.020 KB total ukey num = 0.004810190 Billion total entry num = 0.004810190 Billion write speed all = 0.010035617 MB/sec (with seq num) write speed all = 0.009481519 MB/sec (without seq num) 2024/11/23-04:09:52.062084 140024961644096 [compaction_job.cc:1948] [default] [JOB 18990] Generated table #244071: 1081561 keys, 35745175 bytes, temperature: kWarm 2024/11/23-04:09:52.062149 140024961644096 EVENT_LOG_v1 {"time_micros": 1732306192062116, "cf_name": "default", "job": 18990, "event": "table_file_creation", "file_number": 244071, "file_size": 35745175, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 32632400, "index_size": 2070464, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 30283708, "raw_average_key_size": 28, "raw_value_size": 103934131, "raw_average_value_size": 96, "num_data_blocks": 1, "num_entries": 1081561, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732306189, "oldest_key_time": 0, "file_creation_time": 1732306189, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 244071, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-04:09:52.098010 140024961644096 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18990/att-00/244072.sst) /dev/shm/ToplingTemp/Topling-404331-DILlvP 2024/11/23-04:09:52.866572 140024961644096 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18990/att-00/244072.sst): first pass time = 0.77's, 174.644'MB/sec 2024/11/23-04:09:54.223229 140024961644096 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18990/att-00/244072.sst): old prealloc_size = 147639500, real_size = 34282752 2024/11/23-04:09:54.223812 140024961644096 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18990/att-00/244072.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 921619 prefix = 4 raw-key = 0.0147 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1084 GB zip-val = 0.0323 GB avg-val = 117.63 avg-zval = 35.05 2024/11/23-04:09:54.224434 140024961644096 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18990/att-00/244072.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-04:09:55.095652 140024961644096 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18990/att-00/244072.sst): second pass time = 1.36's, 79.953'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.87's, 43.140'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3130.549'MB/sec (index lex order gen) rebuild zvType time = 0.74's, 0.311'MB/sec write SST data time = 0.13's, 284.883'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.084'MB, throughput = 30140.127'MB/sec zip my value time = 1.36's, unzip length = 0.108'GB zip my value throughput = 79.953'MB/sec zip pipeline throughput = 79.953'MB/sec entries = 921619 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.63 avg-zval = 35.05 usrkeys = 921619 avg-key = 20.00 avg-zkey = 1.90 avg-val = 122.55 avg-zval = 35.05 TagRS{ kinds = RS_Key0_TagN bytes = 144120 } TagArray{ size = 647138 bytes = 2345888 } seq expand size = 4529966 multi value expand size = 0 cnt WriteAppend = 15 UnZipSize{ index = 0.0184 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0323 GB dict = 1.08 MB all = 0.0376 GB } UnZip/Zip{ index = 10.5123 value = 3.3566 dict = 1.00 all = 3.5662 } Zip/UnZip{ index = 0.0951 value = 0.2979 dict = 1.00 all = 0.2804 } ---------------------------- total value len = 0.675220 GB avg = 0.118 KB (by entry num) total key len = 0.160491 GB avg = 0.028 KB total ukey len = 0.114636 GB avg = 0.020 KB total ukey num = 0.005731809 Billion total entry num = 0.005731809 Billion write speed all = 0.012032925 MB/sec (with seq num) write speed all = 0.011372692 MB/sec (without seq num) 2024/11/23-04:09:55.132965 140024961644096 [compaction_job.cc:1948] [default] [JOB 18990] Generated table #244072: 921619 keys, 37635708 bytes, temperature: kWarm 2024/11/23-04:09:55.133034 140024961644096 EVENT_LOG_v1 {"time_micros": 1732306195133000, "cf_name": "default", "job": 18990, "event": "table_file_creation", "file_number": 244072, "file_size": 37635708, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3735203823, "table_properties": {"data_size": 32298736, "index_size": 1753408, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25805332, "raw_average_key_size": 28, "raw_value_size": 108412494, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 921619, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732306192, "oldest_key_time": 0, "file_creation_time": 1732306192, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 244072, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-04:09:55.170376 140024961644096 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18990/att-00/244073.sst) /dev/shm/ToplingTemp/Topling-404331-jQxe0O 2024/11/23-04:09:56.080998 140024961644096 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18990/att-00/244073.sst): first pass time = 0.91's, 147.398'MB/sec 2024/11/23-04:09:57.412043 140024961644096 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18990/att-00/244073.sst): old prealloc_size = 147639500, real_size = 33269392 2024/11/23-04:09:57.412625 140024961644096 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18990/att-00/244073.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927508 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0313 GB avg-val = 116.71 avg-zval = 33.72 2024/11/23-04:09:57.413427 140024961644096 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18990/att-00/244073.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-04:09:58.364711 140024961644096 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18990/att-00/244073.sst): second pass time = 1.33's, 81.370'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.95's, 39.349'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3149.114'MB/sec (index lex order gen) rebuild zvType time = 0.82's, 0.283'MB/sec write SST data time = 0.13's, 284.037'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 18972.453'MB/sec zip my value time = 1.33's, unzip length = 0.108'GB zip my value throughput = 81.370'MB/sec zip pipeline throughput = 81.370'MB/sec entries = 927508 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.71 avg-zval = 33.72 usrkeys = 927508 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.71 avg-zval = 33.72 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 927508 bytes = 3362224 } seq expand size = 6492556 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0313 GB dict = 1.08 MB all = 0.0375 GB } UnZip/Zip{ index = 10.5131 value = 3.4614 dict = 1.00 all = 3.5805 } Zip/UnZip{ index = 0.0951 value = 0.2889 dict = 1.00 all = 0.2793 } ---------------------------- total value len = 0.789960 GB avg = 0.119 KB (by entry num) total key len = 0.186461 GB avg = 0.028 KB total ukey len = 0.133186 GB avg = 0.020 KB total ukey num = 0.006659317 Billion total entry num = 0.006659317 Billion write speed all = 0.014058271 MB/sec (with seq num) write speed all = 0.013291238 MB/sec (without seq num) 2024/11/23-04:09:58.399665 140024961644096 [compaction_job.cc:1948] [default] [JOB 18990] Generated table #244073: 927508 keys, 37486134 bytes, temperature: kWarm 2024/11/23-04:09:58.399732 140024961644096 EVENT_LOG_v1 {"time_micros": 1732306198399699, "cf_name": "default", "job": 18990, "event": "table_file_creation", "file_number": 244073, "file_size": 37486134, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3487497056, "largest_seqno": 3777164298, "table_properties": {"data_size": 31272832, "index_size": 1764480, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25970224, "raw_average_key_size": 28, "raw_value_size": 108247536, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927508, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732306195, "oldest_key_time": 0, "file_creation_time": 1732306195, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 244073, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-04:09:58.434181 140024961644096 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18990/att-00/244074.sst) /dev/shm/ToplingTemp/Topling-404331-PYrHEM 2024/11/23-04:09:59.270679 140024961644096 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18990/att-00/244074.sst): first pass time = 0.84's, 160.459'MB/sec 2024/11/23-04:10:00.564098 140024961644096 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18990/att-00/244074.sst): old prealloc_size = 147639500, real_size = 32514416 2024/11/23-04:10:00.564652 140024961644096 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18990/att-00/244074.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927582 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0305 GB avg-val = 116.70 avg-zval = 32.90 2024/11/23-04:10:00.565459 140024961644096 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18990/att-00/244074.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-04:10:01.476202 140024961644096 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18990/att-00/244074.sst): second pass time = 1.29's, 83.737'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.91's, 40.272'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3333.414'MB/sec (index lex order gen) rebuild zvType time = 0.78's, 0.297'MB/sec write SST data time = 0.13's, 282.176'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 31697.178'MB/sec zip my value time = 1.29's, unzip length = 0.108'GB zip my value throughput = 83.737'MB/sec zip pipeline throughput = 83.737'MB/sec entries = 927582 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.70 avg-zval = 32.90 usrkeys = 927582 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.70 avg-zval = 32.90 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 927582 bytes = 3362496 } seq expand size = 6493074 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0305 GB dict = 1.08 MB all = 0.0367 GB } UnZip/Zip{ index = 10.5124 value = 3.5470 dict = 1.00 all = 3.6540 } Zip/UnZip{ index = 0.0951 value = 0.2819 dict = 1.00 all = 0.2737 } ---------------------------- total value len = 0.904699 GB avg = 0.119 KB (by entry num) total key len = 0.212433 GB avg = 0.028 KB total ukey len = 0.151738 GB avg = 0.020 KB total ukey num = 0.007586899 Billion total entry num = 0.007586899 Billion write speed all = 0.016083471 MB/sec (with seq num) write speed all = 0.015209636 MB/sec (without seq num) 2024/11/23-04:10:01.509714 140024961644096 [compaction_job.cc:1948] [default] [JOB 18990] Generated table #244074: 927582 keys, 36731326 bytes, temperature: kWarm 2024/11/23-04:10:01.509793 140024961644096 EVENT_LOG_v1 {"time_micros": 1732306201509751, "cf_name": "default", "job": 18990, "event": "table_file_creation", "file_number": 244074, "file_size": 36731326, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3375334738, "largest_seqno": 3777163056, "table_properties": {"data_size": 30517600, "index_size": 1764736, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25972296, "raw_average_key_size": 28, "raw_value_size": 108245492, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927582, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732306198, "oldest_key_time": 0, "file_creation_time": 1732306198, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 244074, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-04:10:01.545311 140024961644096 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18990/att-00/244075.sst) /dev/shm/ToplingTemp/Topling-404331-wO7OKO 2024/11/23-04:10:02.448473 140024961644096 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18990/att-00/244075.sst): first pass time = 0.90's, 148.616'MB/sec 2024/11/23-04:10:03.793878 140024961644096 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18990/att-00/244075.sst): old prealloc_size = 147639500, real_size = 33517056 2024/11/23-04:10:03.794435 140024961644096 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18990/att-00/244075.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927538 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1082 GB zip-val = 0.0315 GB avg-val = 116.70 avg-zval = 33.97 2024/11/23-04:10:03.796510 140024961644096 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18990/att-00/244075.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-04:10:04.743185 140024961644096 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18990/att-00/244075.sst): second pass time = 1.34's, 80.563'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.95's, 39.750'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3294.679'MB/sec (index lex order gen) rebuild zvType time = 0.82's, 0.284'MB/sec write SST data time = 0.13's, 286.537'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 23861.620'MB/sec zip my value time = 1.34's, unzip length = 0.108'GB zip my value throughput = 80.563'MB/sec zip pipeline throughput = 80.563'MB/sec entries = 927538 avg-key = 28.00 avg-zkey = 1.92 avg-val = 116.70 avg-zval = 33.97 usrkeys = 927538 avg-key = 20.00 avg-zkey = 1.92 avg-val = 123.70 avg-zval = 33.97 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 927538 bytes = 3362336 } seq expand size = 6492766 multi value expand size = 0 cnt WriteAppend = 15 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0315 GB dict = 1.08 MB all = 0.0377 GB } UnZip/Zip{ index = 10.4426 value = 3.4355 dict = 1.00 all = 3.5570 } Zip/UnZip{ index = 0.0958 value = 0.2911 dict = 1.00 all = 0.2811 } ---------------------------- total value len = 1.019438 GB avg = 0.120 KB (by entry num) total key len = 0.238404 GB avg = 0.028 KB total ukey len = 0.170289 GB avg = 0.020 KB total ukey num = 0.008514437 Billion total entry num = 0.008514437 Billion write speed all = 0.018108446 MB/sec (with seq num) write speed all = 0.017127826 MB/sec (without seq num) 2024/11/23-04:10:04.779199 140024961644096 [compaction_job.cc:1948] [default] [JOB 18990] Generated table #244075: 927538 keys, 37733806 bytes, temperature: kWarm 2024/11/23-04:10:04.779272 140024961644096 EVENT_LOG_v1 {"time_micros": 1732306204779240, "cf_name": "default", "job": 18990, "event": "table_file_creation", "file_number": 244075, "file_size": 37733806, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3273701103, "largest_seqno": 3777163072, "table_properties": {"data_size": 31508528, "index_size": 1776448, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25971064, "raw_average_key_size": 28, "raw_value_size": 108246796, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927538, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732306201, "oldest_key_time": 0, "file_creation_time": 1732306201, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 244075, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-04:10:04.817179 140024961644096 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18990/att-00/244076.sst) /dev/shm/ToplingTemp/Topling-404331-Bvs7DQ 2024/11/23-04:10:05.721142 140024961644096 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18990/att-00/244076.sst): first pass time = 0.90's, 148.483'MB/sec 2024/11/23-04:10:07.035590 140024961644096 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18990/att-00/244076.sst): old prealloc_size = 147639500, real_size = 32752864 2024/11/23-04:10:07.036147 140024961644096 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18990/att-00/244076.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927908 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0308 GB avg-val = 116.65 avg-zval = 33.14 2024/11/23-04:10:07.036934 140024961644096 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18990/att-00/244076.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-04:10:07.956717 140024961644096 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18990/att-00/244076.sst): second pass time = 1.31's, 82.394'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.92's, 39.885'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3309.104'MB/sec (index lex order gen) rebuild zvType time = 0.79's, 0.293'MB/sec write SST data time = 0.13's, 283.850'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 31663.060'MB/sec zip my value time = 1.31's, unzip length = 0.108'GB zip my value throughput = 82.394'MB/sec zip pipeline throughput = 82.394'MB/sec entries = 927908 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.65 avg-zval = 33.14 usrkeys = 927908 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.65 avg-zval = 33.14 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 927908 bytes = 3131712 } seq expand size = 6495356 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0308 GB dict = 1.08 MB all = 0.0367 GB } UnZip/Zip{ index = 10.5131 value = 3.5193 dict = 1.00 all = 3.6533 } Zip/UnZip{ index = 0.0951 value = 0.2842 dict = 1.00 all = 0.2737 } ---------------------------- total value len = 1.134170 GB avg = 0.120 KB (by entry num) total key len = 0.264386 GB avg = 0.028 KB total ukey len = 0.188847 GB avg = 0.020 KB total ukey num = 0.009442345 Billion total entry num = 0.009442345 Billion write speed all = 0.020133282 MB/sec (with seq num) write speed all = 0.019045844 MB/sec (without seq num) 2024/11/23-04:10:07.989650 140024961644096 [compaction_job.cc:1948] [default] [JOB 18990] Generated table #244076: 927908 keys, 36738380 bytes, temperature: kWarm 2024/11/23-04:10:07.989717 140024961644096 EVENT_LOG_v1 {"time_micros": 1732306207989681, "cf_name": "default", "job": 18990, "event": "table_file_creation", "file_number": 244076, "file_size": 36738380, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3680980241, "largest_seqno": 3777164158, "table_properties": {"data_size": 30755472, "index_size": 1765248, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25981424, "raw_average_key_size": 28, "raw_value_size": 108236356, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927908, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732306204, "oldest_key_time": 0, "file_creation_time": 1732306204, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 244076, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-04:10:08.024308 140024961644096 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18990/att-00/244077.sst) /dev/shm/ToplingTemp/Topling-404331-ROmFsN 2024/11/23-04:10:08.918929 140024961644096 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18990/att-00/244077.sst): first pass time = 0.89's, 150.033'MB/sec 2024/11/23-04:10:10.274214 140024961644096 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18990/att-00/244077.sst): old prealloc_size = 147639500, real_size = 33301952 2024/11/23-04:10:10.274765 140024961644096 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18990/att-00/244077.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927679 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0313 GB avg-val = 116.68 avg-zval = 33.75 2024/11/23-04:10:10.277109 140024961644096 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18990/att-00/244077.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-04:10:11.223070 140024961644096 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18990/att-00/244077.sst): second pass time = 1.35's, 79.943'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.95's, 39.542'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3372.720'MB/sec (index lex order gen) rebuild zvType time = 0.82's, 0.284'MB/sec write SST data time = 0.13's, 286.207'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 24575.322'MB/sec zip my value time = 1.35's, unzip length = 0.108'GB zip my value throughput = 79.943'MB/sec zip pipeline throughput = 79.943'MB/sec entries = 927679 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.68 avg-zval = 33.75 usrkeys = 927679 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.68 avg-zval = 33.75 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 927679 bytes = 3362848 } seq expand size = 6493753 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0313 GB dict = 1.08 MB all = 0.0375 GB } UnZip/Zip{ index = 10.5112 value = 3.4577 dict = 1.00 all = 3.5773 } Zip/UnZip{ index = 0.0951 value = 0.2892 dict = 1.00 all = 0.2795 } ---------------------------- total value len = 1.248907 GB avg = 0.120 KB (by entry num) total key len = 0.290361 GB avg = 0.028 KB total ukey len = 0.207400 GB avg = 0.020 KB total ukey num = 0.010370024 Billion total entry num = 0.010370024 Billion write speed all = 0.022157891 MB/sec (with seq num) write speed all = 0.020963672 MB/sec (without seq num) 2024/11/23-04:10:11.255217 140024961644096 [compaction_job.cc:1948] [default] [JOB 18990] Generated table #244077: 927679 keys, 37519018 bytes, temperature: kWarm 2024/11/23-04:10:11.255287 140024961644096 EVENT_LOG_v1 {"time_micros": 1732306211255253, "cf_name": "default", "job": 18990, "event": "table_file_creation", "file_number": 244077, "file_size": 37519018, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3369194706, "largest_seqno": 3777163597, "table_properties": {"data_size": 31304752, "index_size": 1765120, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25975012, "raw_average_key_size": 28, "raw_value_size": 108242802, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927679, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732306208, "oldest_key_time": 0, "file_creation_time": 1732306208, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 244077, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-04:10:11.296496 140024961644096 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18990/att-00/244078.sst) /dev/shm/ToplingTemp/Topling-404331-2XaIyM 2024/11/23-04:10:12.203161 140024961644096 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18990/att-00/244078.sst): first pass time = 0.91's, 148.042'MB/sec 2024/11/23-04:10:13.540813 140024961644096 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18990/att-00/244078.sst): old prealloc_size = 147639500, real_size = 32624768 2024/11/23-04:10:13.541407 140024961644096 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18990/att-00/244078.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927645 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1082 GB zip-val = 0.0306 GB avg-val = 116.69 avg-zval = 33.00 2024/11/23-04:10:13.544042 140024961644096 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18990/att-00/244078.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-04:10:14.454088 140024961644096 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18990/att-00/244078.sst): second pass time = 1.34's, 80.964'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.91's, 40.341'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3108.527'MB/sec (index lex order gen) rebuild zvType time = 0.78's, 0.297'MB/sec write SST data time = 0.13's, 279.886'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 32297.844'MB/sec zip my value time = 1.34's, unzip length = 0.108'GB zip my value throughput = 80.964'MB/sec zip pipeline throughput = 80.964'MB/sec entries = 927645 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.69 avg-zval = 33.00 usrkeys = 927645 avg-key = 20.00 avg-zkey = 1.91 avg-val = 123.69 avg-zval = 33.00 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 927645 bytes = 3362736 } seq expand size = 6493515 multi value expand size = 0 cnt WriteAppend = 15 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0306 GB dict = 1.08 MB all = 0.0368 GB } UnZip/Zip{ index = 10.4449 value = 3.5355 dict = 1.00 all = 3.6431 } Zip/UnZip{ index = 0.0957 value = 0.2828 dict = 1.00 all = 0.2745 } ---------------------------- total value len = 1.363644 GB avg = 0.121 KB (by entry num) total key len = 0.316335 GB avg = 0.028 KB total ukey len = 0.225953 GB avg = 0.020 KB total ukey num = 0.011297669 Billion total entry num = 0.011297669 Billion write speed all = 0.024182319 MB/sec (with seq num) write speed all = 0.022881332 MB/sec (without seq num) 2024/11/23-04:10:14.488167 140024961644096 [compaction_job.cc:1948] [default] [JOB 18990] Generated table #244078: 927645 keys, 36841818 bytes, temperature: kWarm 2024/11/23-04:10:14.488231 140024961644096 EVENT_LOG_v1 {"time_micros": 1732306214488197, "cf_name": "default", "job": 18990, "event": "table_file_creation", "file_number": 244078, "file_size": 36841818, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3339428666, "largest_seqno": 3777163112, "table_properties": {"data_size": 30616432, "index_size": 1776256, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25974060, "raw_average_key_size": 28, "raw_value_size": 108243786, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927645, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732306211, "oldest_key_time": 0, "file_creation_time": 1732306211, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 244078, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-04:10:14.525247 140024961644096 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18990/att-00/244079.sst) /dev/shm/ToplingTemp/Topling-404331-JzbwFP 2024/11/23-04:10:15.371297 140024961644096 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18990/att-00/244079.sst): first pass time = 0.85's, 158.647'MB/sec 2024/11/23-04:10:16.681121 140024961644096 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18990/att-00/244079.sst): old prealloc_size = 147639500, real_size = 32794912 2024/11/23-04:10:16.681709 140024961644096 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18990/att-00/244079.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 931842 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1081 GB zip-val = 0.0308 GB avg-val = 116.03 avg-zval = 33.03 2024/11/23-04:10:16.684239 140024961644096 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18990/att-00/244079.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-04:10:17.641819 140024961644096 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18990/att-00/244079.sst): second pass time = 1.31's, 82.593'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.96's, 38.418'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3166.300'MB/sec (index lex order gen) rebuild zvType time = 0.83's, 0.281'MB/sec write SST data time = 0.13's, 281.760'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 28301.113'MB/sec zip my value time = 1.31's, unzip length = 0.108'GB zip my value throughput = 82.593'MB/sec zip pipeline throughput = 82.593'MB/sec entries = 931842 avg-key = 28.00 avg-zkey = 1.92 avg-val = 116.03 avg-zval = 33.03 usrkeys = 931842 avg-key = 20.00 avg-zkey = 1.92 avg-val = 123.03 avg-zval = 33.03 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 931842 bytes = 3261456 } seq expand size = 6522894 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0308 GB dict = 1.08 MB all = 0.0369 GB } UnZip/Zip{ index = 10.4425 value = 3.5132 dict = 1.00 all = 3.6366 } Zip/UnZip{ index = 0.0958 value = 0.2846 dict = 1.00 all = 0.2750 } ---------------------------- total value len = 1.478293 GB avg = 0.121 KB (by entry num) total key len = 0.342426 GB avg = 0.028 KB total ukey len = 0.244590 GB avg = 0.020 KB total ukey num = 0.012229511 Billion total entry num = 0.012229511 Billion write speed all = 0.026206997 MB/sec (with seq num) write speed all = 0.024798767 MB/sec (without seq num) 2024/11/23-04:10:17.676667 140024961644096 [compaction_job.cc:1948] [default] [JOB 18990] Generated table #244079: 931842 keys, 36907246 bytes, temperature: kWarm 2024/11/23-04:10:17.676733 140024961644096 EVENT_LOG_v1 {"time_micros": 1732306217676700, "cf_name": "default", "job": 18990, "event": "table_file_creation", "file_number": 244079, "file_size": 36907246, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3610601794, "largest_seqno": 3777163139, "table_properties": {"data_size": 30777040, "index_size": 1784704, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26091576, "raw_average_key_size": 28, "raw_value_size": 108126156, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 931842, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732306214, "oldest_key_time": 0, "file_creation_time": 1732306214, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 244079, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-04:10:17.712200 140024961644096 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18990/att-00/244080.sst) /dev/shm/ToplingTemp/Topling-404331-UrXUoQ 2024/11/23-04:10:18.006719 140024961644096 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18990/att-00/244080.sst): first pass time = 0.29's, 247.067'MB/sec 2024/11/23-04:10:18.741692 140024961644096 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18990/att-00/244080.sst): old prealloc_size = 147639500, real_size = 19390064 2024/11/23-04:10:18.742057 140024961644096 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18990/att-00/244080.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 502314 prefix = 4 raw-key = 0.0080 GB zip-key = 0.0010 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.0587 GB zip-val = 0.0183 GB avg-val = 116.85 avg-zval = 36.45 2024/11/23-04:10:18.742506 140024961644096 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18990/att-00/244080.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0012 GB, waited 0.000 sec, Key+Value = 0.073 GB 2024/11/23-04:10:19.242975 140024961644096 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18990/att-00/244080.sst): second pass time = 0.73's, 79.931'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.50's, 43.118'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2804.056'MB/sec (index lex order gen) rebuild zvType time = 0.43's, 0.292'MB/sec write SST data time = 0.07's, 306.701'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.587'MB, throughput = 16678.326'MB/sec zip my value time = 0.73's, unzip length = 0.059'GB zip my value throughput = 79.931'MB/sec zip pipeline throughput = 79.931'MB/sec entries = 502314 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.85 avg-zval = 36.45 usrkeys = 502314 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.85 avg-zval = 36.45 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 502314 bytes = 1758112 } seq expand size = 3516198 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0100 GB value = 0.0587 GB dict = 0.59 MB all = 0.0728 GB } __ZipSize{ index = 0.0010 GB value = 0.0183 GB dict = 0.59 MB all = 0.0216 GB } UnZip/Zip{ index = 10.5076 value = 3.2058 dict = 1.00 all = 3.3663 } Zip/UnZip{ index = 0.0952 value = 0.3119 dict = 1.00 all = 0.2971 } ---------------------------- total value len = 1.540502 GB avg = 0.121 KB (by entry num) total key len = 0.356491 GB avg = 0.028 KB total ukey len = 0.254636 GB avg = 0.020 KB total ukey num = 0.012731825 Billion total entry num = 0.012731825 Billion write speed all = 0.027304238 MB/sec (with seq num) write speed all = 0.025838201 MB/sec (without seq num) 2024/11/23-04:10:19.264022 140024961644096 [compaction_job.cc:1948] [default] [JOB 18990] Generated table #244080: 502314 keys, 21613763 bytes, temperature: kWarm 2024/11/23-04:10:19.264090 140024961644096 EVENT_LOG_v1 {"time_micros": 1732306219264058, "cf_name": "default", "job": 18990, "event": "table_file_creation", "file_number": 244080, "file_size": 21613763, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3516470397, "largest_seqno": 3777163550, "table_properties": {"data_size": 18308192, "index_size": 956096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 14064792, "raw_average_key_size": 28, "raw_value_size": 58693040, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 502314, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732306217, "oldest_key_time": 0, "file_creation_time": 1732306217, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 244080, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-04:10:19.282810 140024961644096 [compaction_job.cc:703] job-18990: subcompact[0], size: 0.505298 G, files: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-18990/att-00 [244067,244068,244069,244070,244071,244072,244073,244074,244075,244076,244077,244078,244079,244080] 2024/11/23-04:10:19.370472 140024961644096 (Original Log Time 2024/11/23-04:09:32.717548) EVENT_LOG_v1 {"time_micros": 1732306172717520, "job": 18990, "event": "compaction_started", "compaction_reason": "FilesMarkedForCompaction", "files_L2": [244004], "files_L3": [244053, 244054, 243978, 243930, 243931, 243932, 243933, 243934, 243935, 243936, 243937, 243938, 243939, 243956, 244055], "score": 0.993185, "input_data_size": 520903426, "oldest_snapshot_seqno": 3777715058} 2024/11/23-04:10:19.370475 140024961644096 (Original Log Time 2024/11/23-04:10:19.369761) [compaction_job.cc:2022] [default] [JOB 18990] Compacted 1@2 + 15@3 files to L3 => 505297568 bytes 2024/11/23-04:10:19.370477 140024961644096 (Original Log Time 2024/11/23-04:10:19.370408) [compaction_job.cc:1224] [default] compacted to: files[0 0 0 14 0 0 0] max score 0.02, MB/sec: 11.2 rd, 10.9 wr, level 3, files in(1, 15) out(14 +0 blob) MB in(27.1, 469.7 +0.0 blob) out(481.9 +0.0 blob), read-write-amplify(36.1) write-amplify(17.8) OK, records in: 12811128, records dropped: 79303 output_compression: Snappy 2024/11/23-04:10:19.370483 140024961644096 (Original Log Time 2024/11/23-04:10:19.370452) EVENT_LOG_v1 {"time_micros": 1732306219370431, "cf": "default", "job": 18990, "event": "compaction_finished", "compaction_time_micros": 46565271, "compaction_time_cpu_micros": 20242195, "output_level": 3, "num_output_files": 14, "total_output_size": 505297568, "num_input_records": 12811128, "num_output_records": 12731825, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "file_write_nanos": 328842423, "file_range_sync_nanos": 0, "file_fsync_nanos": 13317, "file_prepare_write_nanos": 33142, "lsm_state": [0, 0, 0, 14, 0, 0, 0]} 2024/11/23-04:10:19.490959 140024961644096 DEBG dcompact_worker.cpp:240: HttpPost: 200 OK: url = http://nlb-7zny4kaa1poal01o64.cn-shenzhen.nlb.aliyuncs.com:8443, body = {"instanceId":"nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137","labourId":"","dbId":"d89b4006-2803-486e-b7a2-759bcf348921","dbStarts":1732256054,"starts":1732306172,"executesMs":46764,"compactionJobId":18990,"attempt":0,"compactionInputRawBytes":1828850289,"compactionInputZipBytes":520903426,"compactionOutputRawBytes":0,"compactionOutputZipBytes":505297568,"headers":{"Accept":"*/*","Connection":"close","Host":"aliyun-topling-saas.topling.cn:18443","RemoteIp":"120.24.192.169","X-Forwarded-For":"120.24.192.169","region":"cn-shenzhen","token":"e6474c481bd4415abc537135cc03626b","instance-token":"e6474c481bd4415abc537135cc03626b","provider":"aliyun","CloudMarketInstanceId":"si-59c0ae5c955845588903","MeteringAssit":"","Transfer-Encoding":"chunked","traceparent":"00-0b2aa892a5a67381d8dacd88c6b59f22-35d2e99a4226fcf4-00"}}, response = 2024/11/23-04:10:19.491026 140024961644096 INFO dcompact_worker.cpp:1459: finish /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-18990/att-00: olev 3, work 46.764 s, result 4.870 ms, install 0.740 ms, input{raw 1.703 GiB zip 496.772 MiB}