2024/11/23-02:39:28.128577 140025079141952 DEBG dcompact_worker.cpp:2214: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17574/att-00: fork to child time = 0.008984 sec 2024/11/23-02:39:28.129486 140025079141952 DEBG dcompact_worker.cpp:1013: Beg SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17574/att-00 2024/11/23-02:39:28.136410 140025079141952 DEBG dcompact_worker.cpp:1033: End SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17574/att-00 2024/11/23-02:39:28.137521 140025079141952 TRAC dcompact_worker.cpp:1083: INFO_LOG_LEVEL: rpc = INFO_LEVEL, env_var = undefined 2024/11/23-02:39:28.137811 140025079141952 [WARN] [column_family.cc:386] multiple cf_paths/db_paths and level_compaction_dynamic_level_bytes can't be used together 2024/11/23-02:39:28.196635 140025079141952 [version_set.cc:6208] Recovering from manifest file: /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-17574/att-00/MANIFEST-206347 2024/11/23-02:39:28.224657 140025079141952 [version_set.cc:6251] Recovered from manifest file:/worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-17574/att-00/MANIFEST-206347 succeeded,manifest_file_number is 206347, next_file_number is 241131, last_sequence is 3738637320, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 240952 2024/11/23-02:39:28.224663 140025079141952 [version_set.cc:6266] Column family [default] (ID 0), log number is 0 2024/11/23-02:39:28.224752 140025079141952 [version_set.cc:5721] Creating manifest 241131 2024/11/23-02:39:28.267794 140025079141952 DEBG dcompact_worker.cpp:1218: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17574/att-00: bottommost_level: fake = 1, rpc = 0 2024/11/23-02:39:28.297546 140025079141952 [compaction_job.cc:2437] [default] [JOB 17574] Compacting 1@2 + 14@3 files to L3, score 0.99, subcompactions 1 : 1 2024/11/23-02:39:28.297562 140025079141952 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 13132 Base level 2, inputs: [241091(27MB)], [241032(35MB) 241033(36MB) 241034(34MB) 241035(35MB) 241036(35MB) 241037(33MB) 241038(36MB) 241039(36MB) 241040(35MB) 241041(35MB) 241042(35MB) 241043(35MB) 241044(5662KB) 241119(35MB)] 2024/11/23-02:39:28.304602 140025079141952 [top_zip_table.cc:59] core git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-02:39:28.304630 140025079141952 [top_zip_table.cc:60] fsa git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-02:39:28.304649 140025079141952 [top_zip_table.cc:61] zbs git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-02:39:28.304653 140025079141952 [top_zip_table.cc:62] topling-zip_table_reader: git_version_hash_info_is: commit a4a382006cb82713acf5b3425835f22711877681 Author: leipeng Date: 2024-04-11 19:44:14 +0800 fixed_len_hole_index.cc: Add env bool FixedLenHoleIndexUseAVX512 for ut & debug 1. FixedLenHoleIndexUseAVX512 is only in unit tests or debug 2. In release mode, use avx512 by compile options(-march=) g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/23-02:39:28.304663 140025079141952 [top_zip_table.cc:64] topling-rocks git_version_hash_info_is: commit feab587e468621ba0204d47b4ffacc52e7c4290d Author: leipeng Date: 2024-03-22 13:35:06 +0800 ToplingZipTableBuilder::Add: immediately return after error This function returns void, and caller does not check builder->status() after calling this function and graceful abandon. So immediately return after error, and return error status in Finish(). g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/23-02:39:28.744022 140025079141952 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17574/att-00/241132.sst) /dev/shm/ToplingTemp/Topling-383953-xVvIcX 2024/11/23-02:39:29.290299 140025079141952 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17574/att-00/241132.sst): first pass time = 0.55's, 245.714'MB/sec 2024/11/23-02:39:31.132794 140025079141952 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17574/att-00/241132.sst): old prealloc_size = 147639500, real_size = 33431776 2024/11/23-02:39:31.133488 140025079141952 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17574/att-00/241132.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 929225 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0314 GB avg-val = 116.44 avg-zval = 33.83 2024/11/23-02:39:31.134361 140025079141952 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17574/att-00/241132.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-02:39:32.245195 140025079141952 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17574/att-00/241132.sst): second pass time = 1.84's, 58.781'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.11's, 33.848'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2670.340'MB/sec (index lex order gen) rebuild zvType time = 0.96's, 0.243'MB/sec write SST data time = 0.16's, 242.814'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 27174.116'MB/sec zip my value time = 1.84's, unzip length = 0.108'GB zip my value throughput = 58.781'MB/sec zip pipeline throughput = 108.217'MB/sec entries = 929225 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.44 avg-zval = 33.83 usrkeys = 929225 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.44 avg-zval = 33.83 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 929225 bytes = 3368448 } seq expand size = 6504575 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0314 GB dict = 1.08 MB all = 0.0377 GB } UnZip/Zip{ index = 10.5124 value = 3.4424 dict = 1.00 all = 3.5646 } Zip/UnZip{ index = 0.0951 value = 0.2905 dict = 1.00 all = 0.2805 } ---------------------------- total value len = 0.114704 GB avg = 0.123 KB (by entry num) total key len = 0.026018 GB avg = 0.028 KB total ukey len = 0.018585 GB avg = 0.020 KB total ukey num = 0.000929225 Billion total entry num = 0.000929225 Billion write speed all = 0.002197785 MB/sec (with seq num) write speed all = 0.002081685 MB/sec (without seq num) 2024/11/23-02:39:32.281641 140025079141952 [compaction_job.cc:1948] [default] [JOB 17574] Generated table #241132: 929225 keys, 37652996 bytes, temperature: kWarm 2024/11/23-02:39:32.281748 140025079141952 EVENT_LOG_v1 {"time_micros": 1732300772281676, "cf_name": "default", "job": 17574, "event": "table_file_creation", "file_number": 241132, "file_size": 37652996, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3434038037, "largest_seqno": 3738335001, "table_properties": {"data_size": 31431440, "index_size": 1767872, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26018300, "raw_average_key_size": 28, "raw_value_size": 108199458, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 929225, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732300768, "oldest_key_time": 0, "file_creation_time": 1732300768, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 241132, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-02:39:32.328202 140025079141952 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17574/att-00/241133.sst) /dev/shm/ToplingTemp/Topling-383953-0vtEtT 2024/11/23-02:39:33.425994 140025079141952 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17574/att-00/241133.sst): first pass time = 1.10's, 122.266'MB/sec 2024/11/23-02:39:34.941968 140025079141952 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17574/att-00/241133.sst): old prealloc_size = 147639500, real_size = 33746176 2024/11/23-02:39:34.942503 140025079141952 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17574/att-00/241133.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 932009 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1081 GB zip-val = 0.0317 GB avg-val = 116.01 avg-zval = 34.06 2024/11/23-02:39:34.943308 140025079141952 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17574/att-00/241133.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-02:39:35.860037 140025079141952 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17574/att-00/241133.sst): second pass time = 1.52's, 71.352'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.92's, 41.367'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3443.848'MB/sec (index lex order gen) rebuild zvType time = 0.79's, 0.296'MB/sec write SST data time = 0.13's, 293.654'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 34167.872'MB/sec zip my value time = 1.52's, unzip length = 0.108'GB zip my value throughput = 71.352'MB/sec zip pipeline throughput = 95.129'MB/sec entries = 932009 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.01 avg-zval = 34.06 usrkeys = 932009 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.01 avg-zval = 34.06 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 932009 bytes = 3378544 } seq expand size = 6524063 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0317 GB dict = 1.08 MB all = 0.0380 GB } UnZip/Zip{ index = 10.5126 value = 3.4065 dict = 1.00 all = 3.5344 } Zip/UnZip{ index = 0.0951 value = 0.2936 dict = 1.00 all = 0.2829 } ---------------------------- total value len = 0.229350 GB avg = 0.123 KB (by entry num) total key len = 0.052115 GB avg = 0.028 KB total ukey len = 0.037225 GB avg = 0.020 KB total ukey num = 0.001861234 Billion total entry num = 0.001861234 Billion write speed all = 0.004395629 MB/sec (with seq num) write speed all = 0.004163093 MB/sec (without seq num) 2024/11/23-02:39:35.894865 140025079141952 [compaction_job.cc:1948] [default] [JOB 17574] Generated table #241133: 932009 keys, 37975070 bytes, temperature: kWarm 2024/11/23-02:39:35.894925 140025079141952 EVENT_LOG_v1 {"time_micros": 1732300775894894, "cf_name": "default", "job": 17574, "event": "table_file_creation", "file_number": 241133, "file_size": 37975070, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3434038075, "largest_seqno": 3738334304, "table_properties": {"data_size": 31739888, "index_size": 1773120, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26096252, "raw_average_key_size": 28, "raw_value_size": 108121602, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 932009, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732300772, "oldest_key_time": 0, "file_creation_time": 1732300772, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 241133, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-02:39:35.931058 140025079141952 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17574/att-00/241134.sst) /dev/shm/ToplingTemp/Topling-383953-vw1daW 2024/11/23-02:39:36.774420 140025079141952 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17574/att-00/241134.sst): first pass time = 0.84's, 159.154'MB/sec 2024/11/23-02:39:38.212414 140025079141952 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17574/att-00/241134.sst): old prealloc_size = 147639500, real_size = 32808752 2024/11/23-02:39:38.212967 140025079141952 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17574/att-00/241134.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 931487 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1081 GB zip-val = 0.0308 GB avg-val = 116.09 avg-zval = 33.07 2024/11/23-02:39:38.213651 140025079141952 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17574/att-00/241134.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-02:39:39.159796 140025079141952 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17574/att-00/241134.sst): second pass time = 1.44's, 75.269'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.95's, 38.726'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3346.675'MB/sec (index lex order gen) rebuild zvType time = 0.82's, 0.283'MB/sec write SST data time = 0.12's, 296.199'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 30098.758'MB/sec zip my value time = 1.44's, unzip length = 0.108'GB zip my value throughput = 75.269'MB/sec zip pipeline throughput = 83.078'MB/sec entries = 931487 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.09 avg-zval = 33.07 usrkeys = 931487 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.09 avg-zval = 33.07 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 931487 bytes = 3027344 } seq expand size = 6520409 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0308 GB dict = 1.08 MB all = 0.0367 GB } UnZip/Zip{ index = 10.5140 value = 3.5105 dict = 1.00 all = 3.6584 } Zip/UnZip{ index = 0.0951 value = 0.2849 dict = 1.00 all = 0.2733 } ---------------------------- total value len = 0.344006 GB avg = 0.123 KB (by entry num) total key len = 0.078196 GB avg = 0.028 KB total ukey len = 0.055854 GB avg = 0.020 KB total ukey num = 0.002792721 Billion total entry num = 0.002792721 Billion write speed all = 0.006593199 MB/sec (with seq num) write speed all = 0.006244305 MB/sec (without seq num) 2024/11/23-02:39:39.195867 140025079141952 [compaction_job.cc:1948] [default] [JOB 17574] Generated table #241134: 931487 keys, 36687392 bytes, temperature: kWarm 2024/11/23-02:39:39.195927 140025079141952 EVENT_LOG_v1 {"time_micros": 1732300779195894, "cf_name": "default", "job": 17574, "event": "table_file_creation", "file_number": 241134, "file_size": 36687392, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3677945118, "largest_seqno": 3738334336, "table_properties": {"data_size": 30803808, "index_size": 1771904, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26081636, "raw_average_key_size": 28, "raw_value_size": 108136190, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 931487, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732300775, "oldest_key_time": 0, "file_creation_time": 1732300775, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 241134, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-02:39:39.232371 140025079141952 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17574/att-00/241135.sst) /dev/shm/ToplingTemp/Topling-383953-5pj4XV 2024/11/23-02:39:40.111123 140025079141952 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17574/att-00/241135.sst): first pass time = 0.88's, 152.743'MB/sec 2024/11/23-02:39:41.523421 140025079141952 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17574/att-00/241135.sst): old prealloc_size = 147639500, real_size = 32551520 2024/11/23-02:39:41.523975 140025079141952 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17574/att-00/241135.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 928691 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1082 GB zip-val = 0.0305 GB avg-val = 116.52 avg-zval = 32.89 2024/11/23-02:39:41.524735 140025079141952 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17574/att-00/241135.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-02:39:42.412999 140025079141952 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17574/att-00/241135.sst): second pass time = 1.41's, 76.674'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.89's, 41.337'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3329.910'MB/sec (index lex order gen) rebuild zvType time = 0.76's, 0.304'MB/sec write SST data time = 0.13's, 293.031'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 35345.512'MB/sec zip my value time = 1.41's, unzip length = 0.108'GB zip my value throughput = 76.674'MB/sec zip pipeline throughput = 76.674'MB/sec entries = 928691 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.52 avg-zval = 32.89 usrkeys = 928691 avg-key = 20.00 avg-zkey = 1.91 avg-val = 123.52 avg-zval = 32.89 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 928691 bytes = 3366512 } seq expand size = 6500837 multi value expand size = 0 cnt WriteAppend = 15 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0305 GB dict = 1.08 MB all = 0.0368 GB } UnZip/Zip{ index = 10.4458 value = 3.5432 dict = 1.00 all = 3.6501 } Zip/UnZip{ index = 0.0957 value = 0.2822 dict = 1.00 all = 0.2740 } ---------------------------- total value len = 0.458722 GB avg = 0.123 KB (by entry num) total key len = 0.104200 GB avg = 0.028 KB total ukey len = 0.074428 GB avg = 0.020 KB total ukey num = 0.003721412 Billion total entry num = 0.003721412 Billion write speed all = 0.008790242 MB/sec (with seq num) write speed all = 0.008325351 MB/sec (without seq num) 2024/11/23-02:39:42.448168 140025079141952 [compaction_job.cc:1948] [default] [JOB 17574] Generated table #241135: 928691 keys, 36771328 bytes, temperature: kWarm 2024/11/23-02:39:42.448231 140025079141952 EVENT_LOG_v1 {"time_micros": 1732300782448198, "cf_name": "default", "job": 17574, "event": "table_file_creation", "file_number": 241135, "file_size": 36771328, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3434038106, "largest_seqno": 3738334521, "table_properties": {"data_size": 30541072, "index_size": 1778112, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26003348, "raw_average_key_size": 28, "raw_value_size": 108214422, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 928691, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732300779, "oldest_key_time": 0, "file_creation_time": 1732300779, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 241135, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-02:39:42.482955 140025079141952 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17574/att-00/241136.sst) /dev/shm/ToplingTemp/Topling-383953-u1TCrW 2024/11/23-02:39:43.300596 140025079141952 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17574/att-00/241136.sst): first pass time = 0.82's, 164.160'MB/sec 2024/11/23-02:39:44.723978 140025079141952 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17574/att-00/241136.sst): old prealloc_size = 147639500, real_size = 33132400 2024/11/23-02:39:44.724481 140025079141952 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17574/att-00/241136.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 928680 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0311 GB avg-val = 116.53 avg-zval = 33.52 2024/11/23-02:39:44.725264 140025079141952 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17574/att-00/241136.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-02:39:45.672852 140025079141952 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17574/att-00/241136.sst): second pass time = 1.42's, 76.064'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.95's, 39.366'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3639.785'MB/sec (index lex order gen) rebuild zvType time = 0.82's, 0.282'MB/sec write SST data time = 0.13's, 295.852'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 28709.866'MB/sec zip my value time = 1.42's, unzip length = 0.108'GB zip my value throughput = 76.064'MB/sec zip pipeline throughput = 76.064'MB/sec entries = 928680 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.53 avg-zval = 33.52 usrkeys = 928680 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.53 avg-zval = 33.52 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 928680 bytes = 3366480 } seq expand size = 6500760 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0311 GB dict = 1.08 MB all = 0.0374 GB } UnZip/Zip{ index = 10.5119 value = 3.4759 dict = 1.00 all = 3.5933 } Zip/UnZip{ index = 0.0951 value = 0.2877 dict = 1.00 all = 0.2783 } ---------------------------- total value len = 0.573437 GB avg = 0.123 KB (by entry num) total key len = 0.130203 GB avg = 0.028 KB total ukey len = 0.093002 GB avg = 0.020 KB total ukey num = 0.004650092 Billion total entry num = 0.004650092 Billion write speed all = 0.010987061 MB/sec (with seq num) write speed all = 0.010406186 MB/sec (without seq num) 2024/11/23-02:39:45.707181 140025079141952 [compaction_job.cc:1948] [default] [JOB 17574] Generated table #241136: 928680 keys, 37352772 bytes, temperature: kWarm 2024/11/23-02:39:45.707244 140025079141952 EVENT_LOG_v1 {"time_micros": 1732300785707210, "cf_name": "default", "job": 17574, "event": "table_file_creation", "file_number": 241136, "file_size": 37352772, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3434038136, "largest_seqno": 3738334379, "table_properties": {"data_size": 31133152, "index_size": 1766912, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26003040, "raw_average_key_size": 28, "raw_value_size": 108214812, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 928680, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732300782, "oldest_key_time": 0, "file_creation_time": 1732300782, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 241136, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-02:39:45.745026 140025079141952 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17574/att-00/241137.sst) /dev/shm/ToplingTemp/Topling-383953-TztHdW 2024/11/23-02:39:46.536106 140025079141952 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17574/att-00/241137.sst): first pass time = 0.79's, 169.673'MB/sec 2024/11/23-02:39:47.944526 140025079141952 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17574/att-00/241137.sst): old prealloc_size = 147639500, real_size = 32392064 2024/11/23-02:39:47.945072 140025079141952 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17574/att-00/241137.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 929381 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0304 GB avg-val = 116.42 avg-zval = 32.70 2024/11/23-02:39:47.945799 140025079141952 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17574/att-00/241137.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-02:39:48.873459 140025079141952 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17574/att-00/241137.sst): second pass time = 1.41's, 76.859'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.93's, 39.165'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3352.750'MB/sec (index lex order gen) rebuild zvType time = 0.80's, 0.289'MB/sec write SST data time = 0.12's, 291.786'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 35728.061'MB/sec zip my value time = 1.41's, unzip length = 0.108'GB zip my value throughput = 76.859'MB/sec zip pipeline throughput = 76.859'MB/sec entries = 929381 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.42 avg-zval = 32.70 usrkeys = 929381 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.42 avg-zval = 32.70 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 929381 bytes = 3136672 } seq expand size = 6505667 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0304 GB dict = 1.08 MB all = 0.0364 GB } UnZip/Zip{ index = 10.5149 value = 3.5600 dict = 1.00 all = 3.6892 } Zip/UnZip{ index = 0.0951 value = 0.2809 dict = 1.00 all = 0.2711 } ---------------------------- total value len = 0.688138 GB avg = 0.123 KB (by entry num) total key len = 0.156225 GB avg = 0.028 KB total ukey len = 0.111589 GB avg = 0.020 KB total ukey num = 0.005579473 Billion total entry num = 0.005579473 Billion write speed all = 0.013183745 MB/sec (with seq num) write speed all = 0.012486809 MB/sec (without seq num) 2024/11/23-02:39:48.904789 140025079141952 [compaction_job.cc:1948] [default] [JOB 17574] Generated table #241137: 929381 keys, 36381140 bytes, temperature: kWarm 2024/11/23-02:39:48.904846 140025079141952 EVENT_LOG_v1 {"time_micros": 1732300788904816, "cf_name": "default", "job": 17574, "event": "table_file_creation", "file_number": 241137, "file_size": 36381140, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3623744215, "largest_seqno": 3738334635, "table_properties": {"data_size": 30391792, "index_size": 1767744, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26022668, "raw_average_key_size": 28, "raw_value_size": 108195142, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 929381, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732300785, "oldest_key_time": 0, "file_creation_time": 1732300785, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 241137, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-02:39:48.939389 140025079141952 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17574/att-00/241138.sst) /dev/shm/ToplingTemp/Topling-383953-W0uKCV 2024/11/23-02:39:49.682451 140025079141952 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17574/att-00/241138.sst): first pass time = 0.74's, 180.637'MB/sec 2024/11/23-02:39:51.313522 140025079141952 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17574/att-00/241138.sst): old prealloc_size = 147639500, real_size = 36850464 2024/11/23-02:39:51.314068 140025079141952 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17574/att-00/241138.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 928648 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.93 raw-val = 0.1082 GB zip-val = 0.0348 GB avg-val = 116.53 avg-zval = 37.50 2024/11/23-02:39:51.314319 140025079141952 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17574/att-00/241138.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-02:39:51.971858 140025079141952 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17574/att-00/241138.sst): second pass time = 1.63's, 66.389'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.66's, 58.313'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3455.920'MB/sec (index lex order gen) rebuild zvType time = 0.53's, 0.434'MB/sec write SST data time = 0.12's, 312.285'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 35029.847'MB/sec zip my value time = 1.63's, unzip length = 0.108'GB zip my value throughput = 66.389'MB/sec zip pipeline throughput = 66.389'MB/sec entries = 928648 avg-key = 28.00 avg-zkey = 1.93 avg-val = 116.53 avg-zval = 37.50 usrkeys = 928648 avg-key = 20.00 avg-zkey = 1.93 avg-val = 117.65 avg-zval = 37.50 TagRS{ kinds = RS_Key0_TagN bytes = 145200 } TagArray{ size = 147900 bytes = 536160 } seq expand size = 1035300 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0348 GB dict = 1.08 MB all = 0.0384 GB } UnZip/Zip{ index = 10.3755 value = 3.1071 dict = 1.00 all = 3.4963 } Zip/UnZip{ index = 0.0964 value = 0.3218 dict = 1.00 all = 0.2860 } ---------------------------- total value len = 0.797389 GB avg = 0.123 KB (by entry num) total key len = 0.182227 GB avg = 0.028 KB total ukey len = 0.130162 GB avg = 0.020 KB total ukey num = 0.006508121 Billion total entry num = 0.006508121 Billion write speed all = 0.015294824 MB/sec (with seq num) write speed all = 0.014481929 MB/sec (without seq num) 2024/11/23-02:39:52.005604 140025079141952 [compaction_job.cc:1948] [default] [JOB 17574] Generated table #241138: 928648 keys, 38388959 bytes, temperature: kWarm 2024/11/23-02:39:52.005665 140025079141952 EVENT_LOG_v1 {"time_micros": 1732300792005635, "cf_name": "default", "job": 17574, "event": "table_file_creation", "file_number": 241138, "file_size": 38388959, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3738334674, "table_properties": {"data_size": 34828048, "index_size": 1790080, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26002144, "raw_average_key_size": 28, "raw_value_size": 108215644, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 928648, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732300788, "oldest_key_time": 0, "file_creation_time": 1732300788, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 241138, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-02:39:52.044445 140025079141952 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17574/att-00/241139.sst) /dev/shm/ToplingTemp/Topling-383953-yCqbkW 2024/11/23-02:39:52.811861 140025079141952 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17574/att-00/241139.sst): first pass time = 0.77's, 174.904'MB/sec 2024/11/23-02:39:54.452189 140025079141952 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17574/att-00/241139.sst): old prealloc_size = 147639500, real_size = 36908704 2024/11/23-02:39:54.452790 140025079141952 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17574/att-00/241139.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 926467 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1083 GB zip-val = 0.0349 GB avg-val = 116.87 avg-zval = 37.67 2024/11/23-02:39:54.452977 140025079141952 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17574/att-00/241139.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-02:39:55.099185 140025079141952 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17574/att-00/241139.sst): second pass time = 1.64's, 66.038'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.65's, 59.034'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3071.468'MB/sec (index lex order gen) rebuild zvType time = 0.52's, 0.444'MB/sec write SST data time = 0.13's, 304.799'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 36264.295'MB/sec zip my value time = 1.64's, unzip length = 0.108'GB zip my value throughput = 66.038'MB/sec zip pipeline throughput = 66.038'MB/sec entries = 926467 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.87 avg-zval = 37.67 usrkeys = 926467 avg-key = 20.00 avg-zkey = 1.91 avg-val = 117.46 avg-zval = 37.67 TagRS{ kinds = RS_Key0_TagN bytes = 144880 } TagArray{ size = 77724 bytes = 281760 } seq expand size = 544068 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0349 GB dict = 1.08 MB all = 0.0382 GB } UnZip/Zip{ index = 10.4445 value = 3.1022 dict = 1.00 all = 3.5141 } Zip/UnZip{ index = 0.0957 value = 0.3223 dict = 1.00 all = 0.2846 } ---------------------------- total value len = 0.906210 GB avg = 0.122 KB (by entry num) total key len = 0.208168 GB avg = 0.028 KB total ukey len = 0.148692 GB avg = 0.020 KB total ukey num = 0.007434588 Billion total entry num = 0.007434588 Billion write speed all = 0.017398022 MB/sec (with seq num) write speed all = 0.016469453 MB/sec (without seq num) 2024/11/23-02:39:55.157051 140025079141952 [compaction_job.cc:1948] [default] [JOB 17574] Generated table #241139: 926467 keys, 38193907 bytes, temperature: kWarm 2024/11/23-02:39:55.157776 140025079141952 EVENT_LOG_v1 {"time_micros": 1732300795157083, "cf_name": "default", "job": 17574, "event": "table_file_creation", "file_number": 241139, "file_size": 38193907, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3668853369, "table_properties": {"data_size": 34902800, "index_size": 1774080, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25941076, "raw_average_key_size": 28, "raw_value_size": 108276762, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 926467, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732300792, "oldest_key_time": 0, "file_creation_time": 1732300792, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 241139, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-02:39:55.194279 140025079141952 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17574/att-00/241140.sst) /dev/shm/ToplingTemp/Topling-383953-rYCJNV 2024/11/23-02:39:56.030456 140025079141952 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17574/att-00/241140.sst): first pass time = 0.84's, 160.522'MB/sec 2024/11/23-02:39:57.589294 140025079141952 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17574/att-00/241140.sst): old prealloc_size = 147639500, real_size = 33174608 2024/11/23-02:39:57.589858 140025079141952 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17574/att-00/241140.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 926946 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0312 GB avg-val = 116.80 avg-zval = 33.64 2024/11/23-02:39:57.590643 140025079141952 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17574/att-00/241140.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-02:39:58.514341 140025079141952 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17574/att-00/241140.sst): second pass time = 1.56's, 69.482'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.93's, 40.294'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3260.738'MB/sec (index lex order gen) rebuild zvType time = 0.80's, 0.291'MB/sec write SST data time = 0.13's, 292.687'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 28326.194'MB/sec zip my value time = 1.56's, unzip length = 0.108'GB zip my value throughput = 69.482'MB/sec zip pipeline throughput = 136.472'MB/sec entries = 926946 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.80 avg-zval = 33.64 usrkeys = 926946 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.80 avg-zval = 33.64 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 926946 bytes = 3244320 } seq expand size = 6488622 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0312 GB dict = 1.08 MB all = 0.0373 GB } UnZip/Zip{ index = 10.5128 value = 3.4723 dict = 1.00 all = 3.6009 } Zip/UnZip{ index = 0.0951 value = 0.2880 dict = 1.00 all = 0.2777 } ---------------------------- total value len = 1.020962 GB avg = 0.122 KB (by entry num) total key len = 0.234123 GB avg = 0.028 KB total ukey len = 0.167231 GB avg = 0.020 KB total ukey num = 0.008361534 Billion total entry num = 0.008361534 Billion write speed all = 0.019593731 MB/sec (with seq num) write speed all = 0.018549444 MB/sec (without seq num) 2024/11/23-02:39:58.546820 140025079141952 [compaction_job.cc:1948] [default] [JOB 17574] Generated table #241140: 926946 keys, 37273422 bytes, temperature: kWarm 2024/11/23-02:39:58.546875 140025079141952 EVENT_LOG_v1 {"time_micros": 1732300798546846, "cf_name": "default", "job": 17574, "event": "table_file_creation", "file_number": 241140, "file_size": 37273422, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3509327862, "largest_seqno": 3738334247, "table_properties": {"data_size": 31179200, "index_size": 1763456, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25954488, "raw_average_key_size": 28, "raw_value_size": 108263352, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 926946, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732300795, "oldest_key_time": 0, "file_creation_time": 1732300795, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 241140, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-02:39:58.634991 140025079141952 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17574/att-00/241141.sst) /dev/shm/ToplingTemp/Topling-383953-UgOS4U 2024/11/23-02:39:59.444595 140025079141952 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17574/att-00/241141.sst): first pass time = 0.81's, 165.791'MB/sec 2024/11/23-02:40:00.971405 140025079141952 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17574/att-00/241141.sst): old prealloc_size = 147639500, real_size = 32841280 2024/11/23-02:40:00.971955 140025079141952 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17574/att-00/241141.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 926836 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0308 GB avg-val = 116.81 avg-zval = 33.28 2024/11/23-02:40:00.972688 140025079141952 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17574/att-00/241141.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-02:40:01.883264 140025079141952 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17574/att-00/241141.sst): second pass time = 1.53's, 70.938'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.91's, 40.384'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3395.654'MB/sec (index lex order gen) rebuild zvType time = 0.79's, 0.295'MB/sec write SST data time = 0.13's, 292.101'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 26768.274'MB/sec zip my value time = 1.53's, unzip length = 0.108'GB zip my value throughput = 70.938'MB/sec zip pipeline throughput = 117.695'MB/sec entries = 926836 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.81 avg-zval = 33.28 usrkeys = 926836 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.81 avg-zval = 33.28 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 926836 bytes = 3128080 } seq expand size = 6487852 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0308 GB dict = 1.08 MB all = 0.0368 GB } UnZip/Zip{ index = 10.5108 value = 3.5099 dict = 1.00 all = 3.6449 } Zip/UnZip{ index = 0.0951 value = 0.2849 dict = 1.00 all = 0.2744 } ---------------------------- total value len = 1.135716 GB avg = 0.122 KB (by entry num) total key len = 0.260074 GB avg = 0.028 KB total ukey len = 0.185767 GB avg = 0.020 KB total ukey num = 0.009288370 Billion total entry num = 0.009288370 Billion write speed all = 0.021789209 MB/sec (with seq num) write speed all = 0.020629228 MB/sec (without seq num) 2024/11/23-02:40:01.915635 140025079141952 [compaction_job.cc:1948] [default] [JOB 17574] Generated table #241141: 926836 keys, 36823818 bytes, temperature: kWarm 2024/11/23-02:40:01.915694 140025079141952 EVENT_LOG_v1 {"time_micros": 1732300801915664, "cf_name": "default", "job": 17574, "event": "table_file_creation", "file_number": 241141, "file_size": 36823818, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3631595348, "largest_seqno": 3738334150, "table_properties": {"data_size": 30845808, "index_size": 1763584, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25951408, "raw_average_key_size": 28, "raw_value_size": 108266404, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 926836, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732300798, "oldest_key_time": 0, "file_creation_time": 1732300798, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 241141, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-02:40:01.954750 140025079141952 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17574/att-00/241142.sst) /dev/shm/ToplingTemp/Topling-383953-sU6PUT 2024/11/23-02:40:02.788260 140025079141952 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17574/att-00/241142.sst): first pass time = 0.83's, 161.035'MB/sec 2024/11/23-02:40:04.359893 140025079141952 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17574/att-00/241142.sst): old prealloc_size = 147639500, real_size = 33356592 2024/11/23-02:40:04.360433 140025079141952 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17574/att-00/241142.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 926929 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0314 GB avg-val = 116.80 avg-zval = 33.83 2024/11/23-02:40:04.361221 140025079141952 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17574/att-00/241142.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-02:40:05.297099 140025079141952 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17574/att-00/241142.sst): second pass time = 1.57's, 68.914'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.94's, 40.089'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3382.415'MB/sec (index lex order gen) rebuild zvType time = 0.81's, 0.287'MB/sec write SST data time = 0.13's, 290.016'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 26967.793'MB/sec zip my value time = 1.57's, unzip length = 0.108'GB zip my value throughput = 68.914'MB/sec zip pipeline throughput = 109.381'MB/sec entries = 926929 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.80 avg-zval = 33.83 usrkeys = 926929 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.80 avg-zval = 33.83 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 926929 bytes = 3360128 } seq expand size = 6488503 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0314 GB dict = 1.08 MB all = 0.0376 GB } UnZip/Zip{ index = 10.5126 value = 3.4522 dict = 1.00 all = 3.5724 } Zip/UnZip{ index = 0.0951 value = 0.2897 dict = 1.00 all = 0.2799 } ---------------------------- total value len = 1.250468 GB avg = 0.122 KB (by entry num) total key len = 0.286028 GB avg = 0.028 KB total ukey len = 0.204306 GB avg = 0.020 KB total ukey num = 0.010215299 Billion total entry num = 0.010215299 Billion write speed all = 0.023984449 MB/sec (with seq num) write speed all = 0.022708776 MB/sec (without seq num) 2024/11/23-02:40:05.333257 140025079141952 [compaction_job.cc:1948] [default] [JOB 17574] Generated table #241142: 926929 keys, 37571064 bytes, temperature: kWarm 2024/11/23-02:40:05.333319 140025079141952 EVENT_LOG_v1 {"time_micros": 1732300805333287, "cf_name": "default", "job": 17574, "event": "table_file_creation", "file_number": 241142, "file_size": 37571064, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3273701386, "largest_seqno": 3738334560, "table_properties": {"data_size": 31361248, "index_size": 1763456, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25954012, "raw_average_key_size": 28, "raw_value_size": 108263766, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 926929, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732300801, "oldest_key_time": 0, "file_creation_time": 1732300801, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 241142, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-02:40:05.369163 140025079141952 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17574/att-00/241143.sst) /dev/shm/ToplingTemp/Topling-383953-N6TiJX 2024/11/23-02:40:06.284627 140025079141952 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17574/att-00/241143.sst): first pass time = 0.92's, 146.617'MB/sec 2024/11/23-02:40:07.597162 140025079141952 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17574/att-00/241143.sst): old prealloc_size = 147639500, real_size = 33105328 2024/11/23-02:40:07.597739 140025079141952 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17574/att-00/241143.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927167 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1083 GB zip-val = 0.0311 GB avg-val = 116.76 avg-zval = 33.54 2024/11/23-02:40:07.598514 140025079141952 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17574/att-00/241143.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-02:40:08.524036 140025079141952 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17574/att-00/241143.sst): second pass time = 1.31's, 82.521'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.93's, 40.141'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3200.952'MB/sec (index lex order gen) rebuild zvType time = 0.80's, 0.290'MB/sec write SST data time = 0.13's, 295.216'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 34822.999'MB/sec zip my value time = 1.31's, unzip length = 0.108'GB zip my value throughput = 82.521'MB/sec zip pipeline throughput = 82.521'MB/sec entries = 927167 avg-key = 28.00 avg-zkey = 1.92 avg-val = 116.76 avg-zval = 33.54 usrkeys = 927167 avg-key = 20.00 avg-zkey = 1.92 avg-val = 123.76 avg-zval = 33.54 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 927167 bytes = 3245104 } seq expand size = 6490169 multi value expand size = 0 cnt WriteAppend = 15 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0311 GB dict = 1.08 MB all = 0.0372 GB } UnZip/Zip{ index = 10.4426 value = 3.4812 dict = 1.00 all = 3.6075 } Zip/UnZip{ index = 0.0958 value = 0.2873 dict = 1.00 all = 0.2772 } ---------------------------- total value len = 1.365216 GB avg = 0.123 KB (by entry num) total key len = 0.311989 GB avg = 0.028 KB total ukey len = 0.222849 GB avg = 0.020 KB total ukey num = 0.011142466 Billion total entry num = 0.011142466 Billion write speed all = 0.026179557 MB/sec (with seq num) write speed all = 0.024788172 MB/sec (without seq num) 2024/11/23-02:40:08.560704 140025079141952 [compaction_job.cc:1948] [default] [JOB 17574] Generated table #241143: 927167 keys, 37204920 bytes, temperature: kWarm 2024/11/23-02:40:08.560766 140025079141952 EVENT_LOG_v1 {"time_micros": 1732300808560734, "cf_name": "default", "job": 17574, "event": "table_file_creation", "file_number": 241143, "file_size": 37204920, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3583362754, "largest_seqno": 3738334960, "table_properties": {"data_size": 31097632, "index_size": 1775744, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25960676, "raw_average_key_size": 28, "raw_value_size": 108257126, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927167, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732300805, "oldest_key_time": 0, "file_creation_time": 1732300805, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 241143, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-02:40:08.595772 140025079141952 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17574/att-00/241144.sst) /dev/shm/ToplingTemp/Topling-383953-GaqWEW 2024/11/23-02:40:09.437104 140025079141952 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17574/att-00/241144.sst): first pass time = 0.84's, 159.538'MB/sec 2024/11/23-02:40:10.809960 140025079141952 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17574/att-00/241144.sst): old prealloc_size = 147639500, real_size = 32305232 2024/11/23-02:40:10.810494 140025079141952 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17574/att-00/241144.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927133 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0303 GB avg-val = 116.77 avg-zval = 32.69 2024/11/23-02:40:10.811228 140025079141952 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17574/att-00/241144.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-02:40:11.708203 140025079141952 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17574/att-00/241144.sst): second pass time = 1.37's, 78.893'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.90's, 40.400'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3438.669'MB/sec (index lex order gen) rebuild zvType time = 0.77's, 0.301'MB/sec write SST data time = 0.13's, 283.681'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 22900.670'MB/sec zip my value time = 1.37's, unzip length = 0.108'GB zip my value throughput = 78.893'MB/sec zip pipeline throughput = 78.893'MB/sec entries = 927133 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.77 avg-zval = 32.69 usrkeys = 927133 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.77 avg-zval = 32.69 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 927133 bytes = 3129088 } seq expand size = 6489931 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0303 GB dict = 1.08 MB all = 0.0363 GB } UnZip/Zip{ index = 10.5150 value = 3.5717 dict = 1.00 all = 3.6986 } Zip/UnZip{ index = 0.0951 value = 0.2800 dict = 1.00 all = 0.2704 } ---------------------------- total value len = 1.479964 GB avg = 0.123 KB (by entry num) total key len = 0.337949 GB avg = 0.028 KB total ukey len = 0.241392 GB avg = 0.020 KB total ukey num = 0.012069599 Billion total entry num = 0.012069599 Billion write speed all = 0.028374461 MB/sec (with seq num) write speed all = 0.026867377 MB/sec (without seq num) 2024/11/23-02:40:11.742056 140025079141952 [compaction_job.cc:1948] [default] [JOB 17574] Generated table #241144: 927133 keys, 36288762 bytes, temperature: kWarm 2024/11/23-02:40:11.742118 140025079141952 EVENT_LOG_v1 {"time_micros": 1732300811742087, "cf_name": "default", "job": 17574, "event": "table_file_creation", "file_number": 241144, "file_size": 36288762, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3621075956, "largest_seqno": 3738333993, "table_properties": {"data_size": 30309824, "index_size": 1763456, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25959724, "raw_average_key_size": 28, "raw_value_size": 108258114, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927133, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732300808, "oldest_key_time": 0, "file_creation_time": 1732300808, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 241144, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-02:40:11.779196 140025079141952 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17574/att-00/241145.sst) /dev/shm/ToplingTemp/Topling-383953-pMV5QT 2024/11/23-02:40:11.930486 140025079141952 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17574/att-00/241145.sst): first pass time = 0.15's, 248.248'MB/sec 2024/11/23-02:40:12.294036 140025079141952 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17574/att-00/241145.sst): old prealloc_size = 147639500, real_size = 10451504 2024/11/23-02:40:12.294227 140025079141952 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17574/att-00/241145.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 257174 prefix = 4 raw-key = 0.0041 GB zip-key = 0.0005 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.0303 GB zip-val = 0.0099 GB avg-val = 118.00 avg-zval = 38.47 2024/11/23-02:40:12.294471 140025079141952 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17574/att-00/241145.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.038 GB 2024/11/23-02:40:12.548372 140025079141952 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17574/att-00/241145.sst): second pass time = 0.36's, 83.610'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.25's, 45.354'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2952.179'MB/sec (index lex order gen) rebuild zvType time = 0.22's, 0.295'MB/sec write SST data time = 0.04's, 318.652'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.310'MB, throughput = 10739.556'MB/sec zip my value time = 0.36's, unzip length = 0.030'GB zip my value throughput = 83.610'MB/sec zip pipeline throughput = 83.610'MB/sec entries = 257174 avg-key = 28.00 avg-zkey = 1.92 avg-val = 118.00 avg-zval = 38.47 usrkeys = 257174 avg-key = 20.00 avg-zkey = 1.92 avg-val = 125.00 avg-zval = 38.47 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 257174 bytes = 835824 } seq expand size = 1800218 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0051 GB value = 0.0303 GB dict = 0.31 MB all = 0.0375 GB } __ZipSize{ index = 0.0005 GB value = 0.0099 GB dict = 0.31 MB all = 0.0115 GB } UnZip/Zip{ index = 10.4224 value = 3.0673 dict = 1.00 all = 3.2552 } Zip/UnZip{ index = 0.0959 value = 0.3260 dict = 1.00 all = 0.3072 } ---------------------------- total value len = 1.512110 GB avg = 0.123 KB (by entry num) total key len = 0.345150 GB avg = 0.028 KB total ukey len = 0.246535 GB avg = 0.020 KB total ukey num = 0.012326773 Billion total entry num = 0.012326773 Billion write speed all = 0.028988229 MB/sec (with seq num) write speed all = 0.027449052 MB/sec (without seq num) 2024/11/23-02:40:12.564516 140025079141952 [compaction_job.cc:1948] [default] [JOB 17574] Generated table #241145: 257174 keys, 11534569 bytes, temperature: kWarm 2024/11/23-02:40:12.564571 140025079141952 EVENT_LOG_v1 {"time_micros": 1732300812564542, "cf_name": "default", "job": 17574, "event": "table_file_creation", "file_number": 241145, "file_size": 11534569, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3651973160, "largest_seqno": 3703734678, "table_properties": {"data_size": 9893536, "index_size": 493504, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 7200872, "raw_average_key_size": 28, "raw_value_size": 30346532, "raw_average_value_size": 118, "num_data_blocks": 1, "num_entries": 257174, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 118, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732300811, "oldest_key_time": 0, "file_creation_time": 1732300811, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 241145, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-02:40:12.579118 140025079141952 [compaction_job.cc:703] job-17574: subcompact[0], size: 0.496100 G, files: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-17574/att-00 [241132,241133,241134,241135,241136,241137,241138,241139,241140,241141,241142,241143,241144,241145] 2024/11/23-02:40:12.666974 140025079141952 (Original Log Time 2024/11/23-02:39:28.297598) EVENT_LOG_v1 {"time_micros": 1732300768297573, "job": 17574, "event": "compaction_started", "compaction_reason": "FilesMarkedForCompaction", "files_L2": [241091], "files_L3": [241032, 241033, 241034, 241035, 241036, 241037, 241038, 241039, 241040, 241041, 241042, 241043, 241044, 241119], "score": 0.990945, "input_data_size": 519621043, "oldest_snapshot_seqno": 3738637161} 2024/11/23-02:40:12.666977 140025079141952 (Original Log Time 2024/11/23-02:40:12.666252) [compaction_job.cc:2022] [default] [JOB 17574] Compacted 1@2 + 14@3 files to L3 => 496100119 bytes 2024/11/23-02:40:12.666979 140025079141952 (Original Log Time 2024/11/23-02:40:12.666910) [compaction_job.cc:1224] [default] compacted to: files[0 0 0 14 0 0 0] max score 0.02, MB/sec: 11.7 rd, 11.2 wr, level 3, files in(1, 14) out(14 +0 blob) MB in(27.1, 468.4 +0.0 blob) out(473.1 +0.0 blob), read-write-amplify(35.7) write-amplify(17.4) OK, records in: 12423665, records dropped: 96892 output_compression: Snappy 2024/11/23-02:40:12.666985 140025079141952 (Original Log Time 2024/11/23-02:40:12.666955) EVENT_LOG_v1 {"time_micros": 1732300812666933, "cf": "default", "job": 17574, "event": "compaction_finished", "compaction_time_micros": 44281527, "compaction_time_cpu_micros": 19128068, "output_level": 3, "num_output_files": 14, "total_output_size": 496100119, "num_input_records": 12423665, "num_output_records": 12326773, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "file_write_nanos": 311583226, "file_range_sync_nanos": 0, "file_fsync_nanos": 12491, "file_prepare_write_nanos": 31697, "lsm_state": [0, 0, 0, 14, 0, 0, 0]} 2024/11/23-02:40:12.799116 140025079141952 DEBG dcompact_worker.cpp:240: HttpPost: 200 OK: url = http://nlb-7zny4kaa1poal01o64.cn-shenzhen.nlb.aliyuncs.com:8443, body = {"instanceId":"nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137","labourId":"","dbId":"d89b4006-2803-486e-b7a2-759bcf348921","dbStarts":1732256054,"starts":1732300768,"executesMs":44532,"compactionJobId":17574,"attempt":0,"compactionInputRawBytes":1796137634,"compactionInputZipBytes":519621043,"compactionOutputRawBytes":0,"compactionOutputZipBytes":496100119,"headers":{"Accept":"*/*","Connection":"close","Host":"aliyun-topling-saas.topling.cn:18443","RemoteIp":"120.24.192.169","X-Forwarded-For":"120.24.192.169","region":"cn-shenzhen","token":"e6474c481bd4415abc537135cc03626b","instance-token":"e6474c481bd4415abc537135cc03626b","provider":"aliyun","CloudMarketInstanceId":"si-59c0ae5c955845588903","MeteringAssit":"","Transfer-Encoding":"chunked","traceparent":"00-fee91002f00d9383c993348783a7f607-a89d826dd7112837-00"}}, response = 2024/11/23-02:40:12.799194 140025079141952 INFO dcompact_worker.cpp:1459: finish /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-17574/att-00: olev 3, work 44.533 s, result 4.949 ms, install 0.751 ms, input{raw 1.673 GiB zip 495.549 MiB}