2024/11/20-20:24:23.576490 140008056243776 DEBG dcompact_worker.cpp:2219: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10449/att-00: fork to child time = 0.009163 sec 2024/11/20-20:24:23.576985 140008056243776 DEBG dcompact_worker.cpp:1013: Beg SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10449/att-00 2024/11/20-20:24:23.583436 140008056243776 DEBG dcompact_worker.cpp:1033: End SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10449/att-00 2024/11/20-20:24:23.585067 140008056243776 TRAC dcompact_worker.cpp:1083: INFO_LOG_LEVEL: rpc = INFO_LEVEL, env_var = undefined 2024/11/20-20:24:23.585293 140008056243776 [WARN] [column_family.cc:386] multiple cf_paths/db_paths and level_compaction_dynamic_level_bytes can't be used together 2024/11/20-20:24:23.628890 140008056243776 [version_set.cc:6211] Recovering from manifest file: /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-20T17.53.03/.rocksdb/job-10449/att-00/MANIFEST-049091 2024/11/20-20:24:23.695107 140008056243776 [version_set.cc:6254] Recovered from manifest file:/worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-20T17.53.03/.rocksdb/job-10449/att-00/MANIFEST-049091 succeeded,manifest_file_number is 49091, next_file_number is 66345, last_sequence is 1078761552, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 66198 2024/11/20-20:24:23.695115 140008056243776 [version_set.cc:6269] Column family [default] (ID 0), log number is 0 2024/11/20-20:24:23.695196 140008056243776 [version_set.cc:5724] Creating manifest 66345 2024/11/20-20:24:23.728638 140008056243776 DEBG dcompact_worker.cpp:1225: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10449/att-00: bottommost_level: fake = 1, rpc = 0 2024/11/20-20:24:23.749904 140008056243776 [compaction_job.cc:2437] [default] [JOB 10449] Compacting 1@2 + 14@3 files to L3, score 0.86, subcompactions 1 : 1 2024/11/20-20:24:23.749917 140008056243776 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 8900 Base level 2, inputs: [66343(27MB)], [66315(39MB) 66316(7179KB) 66260(37MB) 66261(36MB) 66262(36MB) 66263(36MB) 66264(36MB) 66329(36MB) 66330(37MB) 66331(36MB) 66332(35MB) 66333(37MB) 66334(37MB) 66335(37MB)] 2024/11/20-20:24:23.758086 140008056243776 [top_zip_table.cc:59] core git_version_hash_info_is:commit 81964c21ebbcc178d8e99dae0fbf61bded2729cc Author: rockeet Date: Mon Nov 11 21:28:46 2024 +0800 Makefile: fix gen git-version-*.cpp GIT_PATH_ARG = :!src/terark/fsa :!tools/fsa :!src/terark/zbs :!tools/zbs g++ (GCC) 12.2.1 20221121 (Red Hat 12.2.1-7) Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/zstd -Iboost-include DEFS = -DTOPLING_IO_WITH_URING=1 -DDIVSUFSORT_API= CXXFLAGS = -fPIC -time -fdiagnostics-color -mcx16 -fno-stack-protector WARNINGS = -Wno-class-memaccess -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -Wno-deprecated-declarations -Wstrict-aliasing=3 RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 LDFLAGS = -fPIC -rdynamic 2024/11/20-20:24:23.758110 140008056243776 [top_zip_table.cc:60] fsa git_version_hash_info_is:commit 5dfecb7d107196f044ff5bf78dc39d2e725b9d9b Author: leipeng Date: Thu Nov 7 15:22:45 2024 +0800 Makefile: fix for x86_64 CPU older than haswell GIT_PATH_ARG = src/terark/fsa tools/fsa g++ (GCC) 12.2.1 20221121 (Red Hat 12.2.1-7) Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/zstd -Iboost-include DEFS = -DTOPLING_IO_WITH_URING=1 -DDIVSUFSORT_API= CXXFLAGS = -fPIC -time -fdiagnostics-color -mcx16 -fno-stack-protector WARNINGS = -Wno-class-memaccess -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -Wno-deprecated-declarations -Wstrict-aliasing=3 RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 LDFLAGS = -fPIC -rdynamic 2024/11/20-20:24:23.758131 140008056243776 [top_zip_table.cc:61] zbs git_version_hash_info_is:commit d44dd5ff72707128fe3c916077b43d2093c01f7c Author: leipeng Date: Sun Oct 27 23:38:26 2024 +0800 Fix for msvc, when toplingdb on msvc GIT_PATH_ARG = src/terark/zbs tools/zbs g++ (GCC) 12.2.1 20221121 (Red Hat 12.2.1-7) Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/zstd -Iboost-include DEFS = -DTOPLING_IO_WITH_URING=1 -DDIVSUFSORT_API= CXXFLAGS = -fPIC -time -fdiagnostics-color -mcx16 -fno-stack-protector WARNINGS = -Wno-class-memaccess -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -Wno-deprecated-declarations -Wstrict-aliasing=3 RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 LDFLAGS = -fPIC -rdynamic 2024/11/20-20:24:23.758139 140008056243776 [top_zip_table.cc:62] topling-zip_table_reader: git_version_hash_info_is: commit 79614a7e7dc27362fc5151b0797eb7d83c674c7b Author: rockeet Date: Sun Nov 10 15:02:21 2024 +0800 cpu_has_bmi2.sh: detect by compile c++ code check __BMI2__ g++ (GCC) 12.2.1 20221121 (Red Hat 12.2.1-7) Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/20-20:24:23.758149 140008056243776 [top_zip_table.cc:64] topling-rocks git_version_hash_info_is: commit c46b65a52d9c74aa8b87aeb8438620ff2dbc669c Author: rockeet Date: Sun Nov 10 15:02:42 2024 +0800 cpu_has_bmi2.sh: detect by compile c++ code check __BMI2__ g++ (GCC) 12.2.1 20221121 (Red Hat 12.2.1-7) Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/20-20:24:24.328605 140008056243776 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10449/att-00/066346.sst) /dev/shm/ToplingTemp/Topling-937398-dMENWP 2024/11/20-20:24:25.170081 140008056243776 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10449/att-00/066346.sst): first pass time = 0.84's, 159.514'MB/sec 2024/11/20-20:24:26.385174 140008056243776 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10449/att-00/066346.sst): old prealloc_size = 147639500, real_size = 38343536 2024/11/20-20:24:26.385766 140008056243776 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10449/att-00/066346.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 924582 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0017 GB avg-key = 16.00 avg-zkey = 1.89 raw-val = 0.1083 GB zip-val = 0.0364 GB avg-val = 117.17 avg-zval = 39.33 2024/11/20-20:24:26.387085 140008056243776 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10449/att-00/066346.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-20:24:27.202725 140008056243776 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10449/att-00/066346.sst): second pass time = 1.21's, 89.217'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.82's, 51.009'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3026.248'MB/sec (index lex order gen) rebuild zvType time = 0.69's, 0.337'MB/sec write SST data time = 0.13's, 316.291'MB/sec dict compress time = 3472337126.98's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.082'MB, throughput = 34486.928'MB/sec zip my value time = 1.21's, unzip length = 0.108'GB zip my value throughput = 89.217'MB/sec zip pipeline throughput = 89.217'MB/sec entries = 924582 avg-key = 28.00 avg-zkey = 1.89 avg-val = 117.17 avg-zval = 39.33 usrkeys = 924582 avg-key = 20.00 avg-zkey = 1.89 avg-val = 122.87 avg-zval = 39.33 TagRS{ kinds = RS_Key0_TagN bytes = 144560 } TagArray{ size = 753273 bytes = 2354000 } seq expand size = 5272911 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0017 GB value = 0.0364 GB dict = 1.08 MB all = 0.0417 GB } UnZip/Zip{ index = 10.5824 value = 2.9790 dict = 1.00 all = 3.2185 } Zip/UnZip{ index = 0.0945 value = 0.3357 dict = 1.00 all = 0.3107 } ---------------------------- total value len = 563.179335 GB avg = 0.331 KB (by entry num) total key len = 44.340295 GB avg = 0.026 KB total ukey len = 32.812633 GB avg = 0.014 KB total ukey num = 2.321939158 Billion total entry num = 1.701441180 Billion write speed all = 71.939623445 MB/sec (with seq num) write speed all = 70.327810006 MB/sec (without seq num) 2024/11/20-20:24:27.255426 140008056243776 [compaction_job.cc:1948] [default] [JOB 10449] Generated table #66346: 924582 keys, 41702208 bytes, temperature: kWarm 2024/11/20-20:24:27.255532 140008056243776 EVENT_LOG_v1 {"time_micros": 1732105467255489, "cf_name": "default", "job": 10449, "event": "table_file_creation", "file_number": 66346, "file_size": 41702208, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 1077209115, "table_properties": {"data_size": 36364832, "index_size": 1747392, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25888296, "raw_average_key_size": 28, "raw_value_size": 108329436, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 924582, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732105464, "oldest_key_time": 0, "file_creation_time": 1732105464, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "6MZ3RU376XPAYLWHL32R", "orig_file_number": 66346, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-20:24:27.293551 140008056243776 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10449/att-00/066347.sst) /dev/shm/ToplingTemp/Topling-937398-bFyxXR 2024/11/20-20:24:28.372996 140008056243776 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10449/att-00/066347.sst): first pass time = 1.08's, 124.345'MB/sec 2024/11/20-20:24:29.634410 140008056243776 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10449/att-00/066347.sst): old prealloc_size = 147639500, real_size = 38053616 2024/11/20-20:24:29.634967 140008056243776 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10449/att-00/066347.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927447 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1082 GB zip-val = 0.0360 GB avg-val = 116.72 avg-zval = 38.87 2024/11/20-20:24:29.635524 140008056243776 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10449/att-00/066347.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-20:24:30.370855 140008056243776 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10449/att-00/066347.sst): second pass time = 1.26's, 85.873'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.74's, 55.671'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3334.966'MB/sec (index lex order gen) rebuild zvType time = 0.61's, 0.383'MB/sec write SST data time = 0.13's, 316.007'MB/sec dict compress time = 0.00's, 1080468.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 20129.818'MB/sec zip my value time = 1.26's, unzip length = 0.108'GB zip my value throughput = 85.873'MB/sec zip pipeline throughput = 85.873'MB/sec entries = 927447 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.72 avg-zval = 38.87 usrkeys = 927447 avg-key = 20.00 avg-zkey = 1.91 avg-val = 120.90 avg-zval = 38.87 TagRS{ kinds = RS_Key0_TagN bytes = 145000 } TagArray{ size = 554463 bytes = 1940640 } seq expand size = 3881241 multi value expand size = 0 cnt WriteAppend = 21 UnZipSize{ index = 0.0185 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0360 GB dict = 1.08 MB all = 0.0410 GB } UnZip/Zip{ index = 10.4446 value = 3.0031 dict = 1.00 all = 3.2738 } Zip/UnZip{ index = 0.0957 value = 0.3330 dict = 1.00 all = 0.3055 } ---------------------------- total value len = 563.291465 GB avg = 0.331 KB (by entry num) total key len = 44.366263 GB avg = 0.026 KB total ukey len = 32.831182 GB avg = 0.014 KB total ukey num = 2.322866605 Billion total entry num = 1.702368627 Billion write speed all = 71.928991964 MB/sec (with seq num) write speed all = 70.316904717 MB/sec (without seq num) 2024/11/20-20:24:30.430950 140008056243776 [compaction_job.cc:1948] [default] [JOB 10449] Generated table #66347: 927447 keys, 40997347 bytes, temperature: kWarm 2024/11/20-20:24:30.431055 140008056243776 EVENT_LOG_v1 {"time_micros": 1732105470430997, "cf_name": "default", "job": 10449, "event": "table_file_creation", "file_number": 66347, "file_size": 40997347, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 1077207513, "table_properties": {"data_size": 36045664, "index_size": 1775936, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25968516, "raw_average_key_size": 28, "raw_value_size": 108249298, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927447, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732105467, "oldest_key_time": 0, "file_creation_time": 1732105467, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "6MZ3RU376XPAYLWHL32R", "orig_file_number": 66347, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-20:24:30.477956 140008056243776 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10449/att-00/066348.sst) /dev/shm/ToplingTemp/Topling-937398-MavJiR 2024/11/20-20:24:31.582680 140008056243776 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10449/att-00/066348.sst): first pass time = 1.10's, 121.501'MB/sec 2024/11/20-20:24:32.762931 140008056243776 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10449/att-00/066348.sst): old prealloc_size = 147639500, real_size = 35364224 2024/11/20-20:24:32.763468 140008056243776 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10449/att-00/066348.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 922669 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1084 GB zip-val = 0.0334 GB avg-val = 117.47 avg-zval = 36.18 2024/11/20-20:24:32.764137 140008056243776 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10449/att-00/066348.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-20:24:33.750105 140008056243776 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10449/att-00/066348.sst): second pass time = 1.18's, 91.894'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.99's, 39.268'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3406.608'MB/sec (index lex order gen) rebuild zvType time = 0.73's, 0.318'MB/sec write SST data time = 0.26's, 148.901'MB/sec dict compress time = 0.00's, 1082920.000'MB/sec z-dict build time = 0.00's, sample length = 1.083'MB, throughput = 31832.799'MB/sec zip my value time = 1.18's, unzip length = 0.108'GB zip my value throughput = 91.894'MB/sec zip pipeline throughput = 91.894'MB/sec entries = 922669 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.47 avg-zval = 36.18 usrkeys = 922669 avg-key = 20.00 avg-zkey = 1.90 avg-val = 122.84 avg-zval = 36.18 TagRS{ kinds = RS_Key0_TagN bytes = 144280 } TagArray{ size = 708588 bytes = 2391504 } seq expand size = 4960116 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0185 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0334 GB dict = 1.08 MB all = 0.0388 GB } UnZip/Zip{ index = 10.5120 value = 3.2472 dict = 1.00 all = 3.4626 } Zip/UnZip{ index = 0.0951 value = 0.3080 dict = 1.00 all = 0.2888 } ---------------------------- total value len = 563.404808 GB avg = 0.331 KB (by entry num) total key len = 44.392098 GB avg = 0.026 KB total ukey len = 32.849636 GB avg = 0.014 KB total ukey num = 2.323789274 Billion total entry num = 1.703291296 Billion write speed all = 71.916699855 MB/sec (with seq num) write speed all = 70.304383799 MB/sec (without seq num) 2024/11/20-20:24:33.801656 140008056243776 [compaction_job.cc:1948] [default] [JOB 10449] Generated table #66348: 922669 keys, 38761720 bytes, temperature: kWarm 2024/11/20-20:24:33.801750 140008056243776 EVENT_LOG_v1 {"time_micros": 1732105473801702, "cf_name": "default", "job": 10449, "event": "table_file_creation", "file_number": 66348, "file_size": 38761720, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 1077208294, "table_properties": {"data_size": 33377904, "index_size": 1755456, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25834732, "raw_average_key_size": 28, "raw_value_size": 108383090, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 922669, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732105470, "oldest_key_time": 0, "file_creation_time": 1732105470, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "6MZ3RU376XPAYLWHL32R", "orig_file_number": 66348, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-20:24:33.870190 140008056243776 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10449/att-00/066349.sst) /dev/shm/ToplingTemp/Topling-937398-SFkNTR 2024/11/20-20:24:34.794017 140008056243776 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10449/att-00/066349.sst): first pass time = 0.92's, 145.294'MB/sec 2024/11/20-20:24:35.952179 140008056243776 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10449/att-00/066349.sst): old prealloc_size = 147639500, real_size = 35041280 2024/11/20-20:24:35.952803 140008056243776 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10449/att-00/066349.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 922281 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1084 GB zip-val = 0.0331 GB avg-val = 117.53 avg-zval = 35.84 2024/11/20-20:24:35.953625 140008056243776 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10449/att-00/066349.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-20:24:37.105173 140008056243776 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10449/att-00/066349.sst): second pass time = 1.16's, 93.660'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.15's, 33.836'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2916.581'MB/sec (index lex order gen) rebuild zvType time = 1.03's, 0.225'MB/sec write SST data time = 0.13's, 309.260'MB/sec dict compress time = 0.00's, 1083252.000'MB/sec z-dict build time = 0.00's, sample length = 1.083'MB, throughput = 33090.543'MB/sec zip my value time = 1.16's, unzip length = 0.108'GB zip my value throughput = 93.660'MB/sec zip pipeline throughput = 93.660'MB/sec entries = 922281 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.53 avg-zval = 35.84 usrkeys = 922281 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.53 avg-zval = 35.84 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 922281 bytes = 3112720 } seq expand size = 6455967 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0184 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0331 GB dict = 1.08 MB all = 0.0390 GB } UnZip/Zip{ index = 10.5130 value = 3.2791 dict = 1.00 all = 3.4404 } Zip/UnZip{ index = 0.0951 value = 0.3050 dict = 1.00 all = 0.2907 } ---------------------------- total value len = 563.519658 GB avg = 0.331 KB (by entry num) total key len = 44.417922 GB avg = 0.026 KB total ukey len = 32.868081 GB avg = 0.014 KB total ukey num = 2.324711555 Billion total entry num = 1.704213577 Billion write speed all = 71.904799535 MB/sec (with seq num) write speed all = 70.292250620 MB/sec (without seq num) 2024/11/20-20:24:37.153993 140008056243776 [compaction_job.cc:1948] [default] [JOB 10449] Generated table #66349: 922281 keys, 39012548 bytes, temperature: kWarm 2024/11/20-20:24:37.154072 140008056243776 EVENT_LOG_v1 {"time_micros": 1732105477154031, "cf_name": "default", "job": 10449, "event": "table_file_creation", "file_number": 66349, "file_size": 39012548, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 979921761, "largest_seqno": 1077207062, "table_properties": {"data_size": 33055984, "index_size": 1754560, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25823868, "raw_average_key_size": 28, "raw_value_size": 108393894, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 922281, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732105473, "oldest_key_time": 0, "file_creation_time": 1732105473, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "6MZ3RU376XPAYLWHL32R", "orig_file_number": 66349, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-20:24:37.188607 140008056243776 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10449/att-00/066350.sst) /dev/shm/ToplingTemp/Topling-937398-2iIFBR 2024/11/20-20:24:37.996408 140008056243776 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10449/att-00/066350.sst): first pass time = 0.81's, 166.163'MB/sec 2024/11/20-20:24:39.137283 140008056243776 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10449/att-00/066350.sst): old prealloc_size = 147639500, real_size = 35097168 2024/11/20-20:24:39.137911 140008056243776 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10449/att-00/066350.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 922225 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1084 GB zip-val = 0.0331 GB avg-val = 117.54 avg-zval = 35.90 2024/11/20-20:24:39.138711 140008056243776 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10449/att-00/066350.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-20:24:40.172138 140008056243776 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10449/att-00/066350.sst): second pass time = 1.14's, 95.076'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.03's, 37.753'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2901.329'MB/sec (index lex order gen) rebuild zvType time = 0.91's, 0.255'MB/sec write SST data time = 0.13's, 304.389'MB/sec dict compress time = 0.00's, 1083316.000'MB/sec z-dict build time = 0.00's, sample length = 1.083'MB, throughput = 34248.554'MB/sec zip my value time = 1.14's, unzip length = 0.108'GB zip my value throughput = 95.076'MB/sec zip pipeline throughput = 95.076'MB/sec entries = 922225 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.54 avg-zval = 35.90 usrkeys = 922225 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.54 avg-zval = 35.90 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 922225 bytes = 3112528 } seq expand size = 6455575 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0184 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0331 GB dict = 1.08 MB all = 0.0391 GB } UnZip/Zip{ index = 10.5158 value = 3.2736 dict = 1.00 all = 3.4355 } Zip/UnZip{ index = 0.0951 value = 0.3055 dict = 1.00 all = 0.2911 } ---------------------------- total value len = 563.634509 GB avg = 0.331 KB (by entry num) total key len = 44.443744 GB avg = 0.026 KB total ukey len = 32.886526 GB avg = 0.014 KB total ukey num = 2.325633780 Billion total entry num = 1.705135802 Billion write speed all = 71.895357851 MB/sec (with seq num) write speed all = 70.282521372 MB/sec (without seq num) 2024/11/20-20:24:40.219490 140008056243776 [compaction_job.cc:1948] [default] [JOB 10449] Generated table #66350: 922225 keys, 39068292 bytes, temperature: kWarm 2024/11/20-20:24:40.219560 140008056243776 EVENT_LOG_v1 {"time_micros": 1732105480219526, "cf_name": "default", "job": 10449, "event": "table_file_creation", "file_number": 66350, "file_size": 39068292, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 979921796, "largest_seqno": 1077207887, "table_properties": {"data_size": 33112448, "index_size": 1753984, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25822300, "raw_average_key_size": 28, "raw_value_size": 108395470, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 922225, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732105477, "oldest_key_time": 0, "file_creation_time": 1732105477, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "6MZ3RU376XPAYLWHL32R", "orig_file_number": 66350, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-20:24:40.253824 140008056243776 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10449/att-00/066351.sst) /dev/shm/ToplingTemp/Topling-937398-wNz5vP 2024/11/20-20:24:41.136643 140008056243776 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10449/att-00/066351.sst): first pass time = 0.88's, 152.041'MB/sec 2024/11/20-20:24:42.289961 140008056243776 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10449/att-00/066351.sst): old prealloc_size = 147639500, real_size = 35147984 2024/11/20-20:24:42.290717 140008056243776 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10449/att-00/066351.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 922238 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1084 GB zip-val = 0.0332 GB avg-val = 117.53 avg-zval = 35.96 2024/11/20-20:24:42.291608 140008056243776 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10449/att-00/066351.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-20:24:43.537205 140008056243776 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10449/att-00/066351.sst): second pass time = 1.15's, 94.061'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.25's, 31.365'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2411.187'MB/sec (index lex order gen) rebuild zvType time = 1.09's, 0.212'MB/sec write SST data time = 0.16's, 245.838'MB/sec dict compress time = 0.00's, 1083264.000'MB/sec z-dict build time = 0.00's, sample length = 1.083'MB, throughput = 32996.162'MB/sec zip my value time = 1.15's, unzip length = 0.108'GB zip my value throughput = 94.061'MB/sec zip pipeline throughput = 94.061'MB/sec entries = 922238 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.53 avg-zval = 35.96 usrkeys = 922238 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.53 avg-zval = 35.96 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 922238 bytes = 3112576 } seq expand size = 6455666 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0184 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0332 GB dict = 1.08 MB all = 0.0391 GB } UnZip/Zip{ index = 10.5109 value = 3.2686 dict = 1.00 all = 3.4310 } Zip/UnZip{ index = 0.0951 value = 0.3059 dict = 1.00 all = 0.2915 } ---------------------------- total value len = 563.749360 GB avg = 0.330 KB (by entry num) total key len = 44.469567 GB avg = 0.026 KB total ukey len = 32.904971 GB avg = 0.014 KB total ukey num = 2.326556018 Billion total entry num = 1.706058040 Billion write speed all = 71.883390355 MB/sec (with seq num) write speed all = 70.270323340 MB/sec (without seq num) 2024/11/20-20:24:43.584587 140008056243776 [compaction_job.cc:1948] [default] [JOB 10449] Generated table #66351: 922238 keys, 39119120 bytes, temperature: kWarm 2024/11/20-20:24:43.584654 140008056243776 EVENT_LOG_v1 {"time_micros": 1732105483584624, "cf_name": "default", "job": 10449, "event": "table_file_creation", "file_number": 66351, "file_size": 39119120, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 979921814, "largest_seqno": 1077208569, "table_properties": {"data_size": 33162432, "index_size": 1754816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25822664, "raw_average_key_size": 28, "raw_value_size": 108395076, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 922238, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732105480, "oldest_key_time": 0, "file_creation_time": 1732105480, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "6MZ3RU376XPAYLWHL32R", "orig_file_number": 66351, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-20:24:43.620690 140008056243776 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10449/att-00/066352.sst) /dev/shm/ToplingTemp/Topling-937398-b4lxYP 2024/11/20-20:24:44.463328 140008056243776 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10449/att-00/066352.sst): first pass time = 0.84's, 159.289'MB/sec 2024/11/20-20:24:45.789760 140008056243776 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10449/att-00/066352.sst): old prealloc_size = 147639500, real_size = 35086320 2024/11/20-20:24:45.790477 140008056243776 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10449/att-00/066352.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 922166 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1084 GB zip-val = 0.0331 GB avg-val = 117.55 avg-zval = 35.89 2024/11/20-20:24:45.791334 140008056243776 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10449/att-00/066352.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-20:24:46.824212 140008056243776 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10449/att-00/066352.sst): second pass time = 1.33's, 81.781'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.03's, 37.757'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2528.695'MB/sec (index lex order gen) rebuild zvType time = 0.87's, 0.265'MB/sec write SST data time = 0.16's, 240.328'MB/sec dict compress time = 0.00's, 1083452.000'MB/sec z-dict build time = 0.00's, sample length = 1.083'MB, throughput = 14978.875'MB/sec zip my value time = 1.33's, unzip length = 0.108'GB zip my value throughput = 81.781'MB/sec zip pipeline throughput = 81.781'MB/sec entries = 922166 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.55 avg-zval = 35.89 usrkeys = 922166 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.55 avg-zval = 35.89 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 922166 bytes = 3112320 } seq expand size = 6455162 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0184 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0331 GB dict = 1.08 MB all = 0.0391 GB } UnZip/Zip{ index = 10.5116 value = 3.2747 dict = 1.00 all = 3.4364 } Zip/UnZip{ index = 0.0951 value = 0.3054 dict = 1.00 all = 0.2910 } ---------------------------- total value len = 563.864212 GB avg = 0.330 KB (by entry num) total key len = 44.495387 GB avg = 0.026 KB total ukey len = 32.923414 GB avg = 0.014 KB total ukey num = 2.327478184 Billion total entry num = 1.706980206 Billion write speed all = 71.872095117 MB/sec (with seq num) write speed all = 70.258782940 MB/sec (without seq num) 2024/11/20-20:24:46.897242 140008056243776 [compaction_job.cc:1948] [default] [JOB 10449] Generated table #66352: 922166 keys, 39057420 bytes, temperature: kWarm 2024/11/20-20:24:46.897387 140008056243776 EVENT_LOG_v1 {"time_micros": 1732105486897327, "cf_name": "default", "job": 10449, "event": "table_file_creation", "file_number": 66352, "file_size": 39057420, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 979921837, "largest_seqno": 1077207430, "table_properties": {"data_size": 33101024, "index_size": 1754560, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25820648, "raw_average_key_size": 28, "raw_value_size": 108397124, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 922166, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732105483, "oldest_key_time": 0, "file_creation_time": 1732105483, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "6MZ3RU376XPAYLWHL32R", "orig_file_number": 66352, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-20:24:46.935794 140008056243776 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10449/att-00/066353.sst) /dev/shm/ToplingTemp/Topling-937398-aWiC4Q 2024/11/20-20:24:47.739968 140008056243776 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10449/att-00/066353.sst): first pass time = 0.80's, 166.910'MB/sec 2024/11/20-20:24:49.336570 140008056243776 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10449/att-00/066353.sst): old prealloc_size = 147639500, real_size = 36646688 2024/11/20-20:24:49.337192 140008056243776 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10449/att-00/066353.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 926731 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.95 raw-val = 0.1083 GB zip-val = 0.0346 GB avg-val = 116.83 avg-zval = 37.34 2024/11/20-20:24:49.338009 140008056243776 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10449/att-00/066353.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-20:24:50.072015 140008056243776 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10449/att-00/066353.sst): second pass time = 1.60's, 67.850'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.74's, 55.355'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3094.236'MB/sec (index lex order gen) rebuild zvType time = 0.60's, 0.387'MB/sec write SST data time = 0.14's, 299.458'MB/sec dict compress time = 0.00's, 1080270.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 31246.963'MB/sec zip my value time = 1.60's, unzip length = 0.108'GB zip my value throughput = 67.850'MB/sec zip pipeline throughput = 67.850'MB/sec entries = 926731 avg-key = 28.00 avg-zkey = 1.95 avg-val = 116.83 avg-zval = 37.34 usrkeys = 926731 avg-key = 20.00 avg-zkey = 1.95 avg-val = 123.43 avg-zval = 37.34 TagRS{ kinds = RS_Key0_TagN bytes = 144920 } TagArray{ size = 874488 bytes = 3060720 } seq expand size = 6121416 multi value expand size = 0 cnt WriteAppend = 46 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0346 GB dict = 1.08 MB all = 0.0407 GB } UnZip/Zip{ index = 10.2420 value = 3.1287 dict = 1.00 all = 3.2969 } Zip/UnZip{ index = 0.0976 value = 0.3196 dict = 1.00 all = 0.3033 } ---------------------------- total value len = 563.978603 GB avg = 0.330 KB (by entry num) total key len = 44.521336 GB avg = 0.026 KB total ukey len = 32.941949 GB avg = 0.014 KB total ukey num = 2.328404915 Billion total entry num = 1.707906937 Billion write speed all = 71.861101934 MB/sec (with seq num) write speed all = 70.247533003 MB/sec (without seq num) 2024/11/20-20:24:50.153579 140008056243776 [compaction_job.cc:1948] [default] [JOB 10449] Generated table #66353: 926731 keys, 40710430 bytes, temperature: kWarm 2024/11/20-20:24:50.153623 140008056243776 EVENT_LOG_v1 {"time_micros": 1732105490153599, "cf_name": "default", "job": 10449, "event": "table_file_creation", "file_number": 66353, "file_size": 40710430, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 1077206031, "table_properties": {"data_size": 34605136, "index_size": 1809664, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25948468, "raw_average_key_size": 28, "raw_value_size": 108269326, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 926731, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732105486, "oldest_key_time": 0, "file_creation_time": 1732105486, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "6MZ3RU376XPAYLWHL32R", "orig_file_number": 66353, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-20:24:50.201155 140008056243776 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10449/att-00/066354.sst) /dev/shm/ToplingTemp/Topling-937398-zPjShR 2024/11/20-20:24:51.075672 140008056243776 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10449/att-00/066354.sst): first pass time = 0.87's, 153.483'MB/sec 2024/11/20-20:24:52.409653 140008056243776 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10449/att-00/066354.sst): old prealloc_size = 147639500, real_size = 36485008 2024/11/20-20:24:52.410256 140008056243776 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10449/att-00/066354.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 926734 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.94 raw-val = 0.1083 GB zip-val = 0.0345 GB avg-val = 116.83 avg-zval = 37.18 2024/11/20-20:24:52.410562 140008056243776 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10449/att-00/066354.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-20:24:53.107181 140008056243776 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10449/att-00/066354.sst): second pass time = 1.33's, 81.215'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.70's, 54.833'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3094.797'MB/sec (index lex order gen) rebuild zvType time = 0.57's, 0.406'MB/sec write SST data time = 0.13's, 302.959'MB/sec dict compress time = 0.00's, 1080578.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 19301.895'MB/sec zip my value time = 1.33's, unzip length = 0.108'GB zip my value throughput = 81.215'MB/sec zip pipeline throughput = 81.215'MB/sec entries = 926734 avg-key = 28.00 avg-zkey = 1.94 avg-val = 116.83 avg-zval = 37.18 usrkeys = 926734 avg-key = 20.00 avg-zkey = 1.94 avg-val = 118.59 avg-zval = 37.18 TagRS{ kinds = RS_Key0_TagN bytes = 144920 } TagArray{ size = 233373 bytes = 758480 } seq expand size = 1633611 multi value expand size = 0 cnt WriteAppend = 39 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0345 GB dict = 1.08 MB all = 0.0382 GB } UnZip/Zip{ index = 10.3069 value = 3.1424 dict = 1.00 all = 3.5093 } Zip/UnZip{ index = 0.0970 value = 0.3182 dict = 1.00 all = 0.2850 } ---------------------------- total value len = 564.088506 GB avg = 0.330 KB (by entry num) total key len = 44.547284 GB avg = 0.026 KB total ukey len = 32.960483 GB avg = 0.014 KB total ukey num = 2.329331649 Billion total entry num = 1.708833671 Billion write speed all = 71.851390986 MB/sec (with seq num) write speed all = 70.237524983 MB/sec (without seq num) 2024/11/20-20:24:53.152912 140008056243776 [compaction_job.cc:1948] [default] [JOB 10449] Generated table #66354: 926734 keys, 38246801 bytes, temperature: kWarm 2024/11/20-20:24:53.152974 140008056243776 EVENT_LOG_v1 {"time_micros": 1732105493152943, "cf_name": "default", "job": 10449, "event": "table_file_creation", "file_number": 66354, "file_size": 38246801, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 973933812, "table_properties": {"data_size": 34454848, "index_size": 1798272, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25948552, "raw_average_key_size": 28, "raw_value_size": 108269208, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 926734, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732105490, "oldest_key_time": 0, "file_creation_time": 1732105490, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "6MZ3RU376XPAYLWHL32R", "orig_file_number": 66354, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-20:24:53.188272 140008056243776 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10449/att-00/066355.sst) /dev/shm/ToplingTemp/Topling-937398-esum6R 2024/11/20-20:24:53.957211 140008056243776 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10449/att-00/066355.sst): first pass time = 0.77's, 174.558'MB/sec 2024/11/20-20:24:55.303871 140008056243776 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10449/att-00/066355.sst): old prealloc_size = 147639500, real_size = 36535056 2024/11/20-20:24:55.304456 140008056243776 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10449/att-00/066355.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927071 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.96 raw-val = 0.1083 GB zip-val = 0.0345 GB avg-val = 116.78 avg-zval = 37.19 2024/11/20-20:24:55.304588 140008056243776 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10449/att-00/066355.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-20:24:56.028534 140008056243776 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10449/att-00/066355.sst): second pass time = 1.35's, 80.427'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.72's, 51.804'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3161.979'MB/sec (index lex order gen) rebuild zvType time = 0.59's, 0.394'MB/sec write SST data time = 0.14's, 276.234'MB/sec dict compress time = 0.00's, 1080502.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 34551.740'MB/sec zip my value time = 1.35's, unzip length = 0.108'GB zip my value throughput = 80.427'MB/sec zip pipeline throughput = 80.427'MB/sec entries = 927071 avg-key = 28.00 avg-zkey = 1.96 avg-val = 116.78 avg-zval = 37.19 usrkeys = 927071 avg-key = 20.00 avg-zkey = 1.96 avg-val = 116.78 avg-zval = 37.19 TagRS{ kinds = RS_Key0_TagN bytes = 144960 } TagArray{ size = 255 bytes = 784 } seq expand size = 1785 multi value expand size = 0 cnt WriteAppend = 24 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0345 GB dict = 1.08 MB all = 0.0375 GB } UnZip/Zip{ index = 10.1785 value = 3.1396 dict = 1.00 all = 3.5754 } Zip/UnZip{ index = 0.0982 value = 0.3185 dict = 1.00 all = 0.2797 } ---------------------------- total value len = 564.196767 GB avg = 0.330 KB (by entry num) total key len = 44.573242 GB avg = 0.026 KB total ukey len = 32.979025 GB avg = 0.014 KB total ukey num = 2.330258720 Billion total entry num = 1.709760742 Billion write speed all = 71.842459363 MB/sec (with seq num) write speed all = 70.228274503 MB/sec (without seq num) 2024/11/20-20:24:56.074973 140008056243776 [compaction_job.cc:1948] [default] [JOB 10449] Generated table #66355: 927071 keys, 37539013 bytes, temperature: kWarm 2024/11/20-20:24:56.075041 140008056243776 EVENT_LOG_v1 {"time_micros": 1732105496075010, "cf_name": "default", "job": 10449, "event": "table_file_creation", "file_number": 66355, "file_size": 37539013, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 965663958, "table_properties": {"data_size": 34481472, "index_size": 1821632, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25957988, "raw_average_key_size": 28, "raw_value_size": 108259746, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927071, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732105493, "oldest_key_time": 0, "file_creation_time": 1732105493, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "6MZ3RU376XPAYLWHL32R", "orig_file_number": 66355, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-20:24:56.114167 140008056243776 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10449/att-00/066356.sst) /dev/shm/ToplingTemp/Topling-937398-Hv7bgQ 2024/11/20-20:24:57.108349 140008056243776 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10449/att-00/066356.sst): first pass time = 0.99's, 135.009'MB/sec 2024/11/20-20:24:58.598993 140008056243776 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10449/att-00/066356.sst): old prealloc_size = 147639500, real_size = 36446192 2024/11/20-20:24:58.599574 140008056243776 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10449/att-00/066356.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 926709 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.94 raw-val = 0.1083 GB zip-val = 0.0344 GB avg-val = 116.83 avg-zval = 37.14 2024/11/20-20:24:58.599784 140008056243776 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10449/att-00/066356.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-20:24:59.397958 140008056243776 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10449/att-00/066356.sst): second pass time = 1.48's, 73.228'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.80's, 47.327'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3269.194'MB/sec (index lex order gen) rebuild zvType time = 0.67's, 0.346'MB/sec write SST data time = 0.13's, 291.697'MB/sec dict compress time = 0.00's, 1080238.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 31030.622'MB/sec zip my value time = 1.48's, unzip length = 0.108'GB zip my value throughput = 73.228'MB/sec zip pipeline throughput = 73.228'MB/sec entries = 926709 avg-key = 28.00 avg-zkey = 1.94 avg-val = 116.83 avg-zval = 37.14 usrkeys = 926709 avg-key = 20.00 avg-zkey = 1.94 avg-val = 117.75 avg-zval = 37.14 TagRS{ kinds = RS_Key0_TagN bytes = 144880 } TagArray{ size = 120933 bytes = 362816 } seq expand size = 846531 multi value expand size = 0 cnt WriteAppend = 20 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0344 GB dict = 1.08 MB all = 0.0378 GB } UnZip/Zip{ index = 10.3085 value = 3.1459 dict = 1.00 all = 3.5496 } Zip/UnZip{ index = 0.0970 value = 0.3179 dict = 1.00 all = 0.2817 } ---------------------------- total value len = 564.305884 GB avg = 0.330 KB (by entry num) total key len = 44.599190 GB avg = 0.026 KB total ukey len = 32.997559 GB avg = 0.014 KB total ukey num = 2.331185429 Billion total entry num = 1.710687451 Billion write speed all = 71.829836631 MB/sec (with seq num) write speed all = 70.215418813 MB/sec (without seq num) 2024/11/20-20:24:59.444259 140008056243776 [compaction_job.cc:1948] [default] [JOB 10449] Generated table #66356: 926709 keys, 37811965 bytes, temperature: kWarm 2024/11/20-20:24:59.444325 140008056243776 EVENT_LOG_v1 {"time_micros": 1732105499444294, "cf_name": "default", "job": 10449, "event": "table_file_creation", "file_number": 66356, "file_size": 37811965, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 960329456, "table_properties": {"data_size": 34416352, "index_size": 1797952, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25947852, "raw_average_key_size": 28, "raw_value_size": 108269974, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 926709, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732105496, "oldest_key_time": 0, "file_creation_time": 1732105496, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "6MZ3RU376XPAYLWHL32R", "orig_file_number": 66356, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-20:24:59.493892 140008056243776 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10449/att-00/066357.sst) /dev/shm/ToplingTemp/Topling-937398-pfSZsP 2024/11/20-20:25:00.784624 140008056243776 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10449/att-00/066357.sst): first pass time = 1.29's, 103.989'MB/sec 2024/11/20-20:25:02.124056 140008056243776 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10449/att-00/066357.sst): old prealloc_size = 147639500, real_size = 36851808 2024/11/20-20:25:02.124644 140008056243776 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10449/att-00/066357.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 925075 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0017 GB avg-key = 16.00 avg-zkey = 1.89 raw-val = 0.1083 GB zip-val = 0.0349 GB avg-val = 117.09 avg-zval = 37.70 2024/11/20-20:25:02.125420 140008056243776 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10449/att-00/066357.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-20:25:03.018543 140008056243776 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10449/att-00/066357.sst): second pass time = 1.34's, 80.913'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.89's, 45.556'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3134.592'MB/sec (index lex order gen) rebuild zvType time = 0.76's, 0.306'MB/sec write SST data time = 0.14's, 294.209'MB/sec dict compress time = 0.00's, 1080550.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 27607.307'MB/sec zip my value time = 1.34's, unzip length = 0.108'GB zip my value throughput = 80.913'MB/sec zip pipeline throughput = 80.913'MB/sec entries = 925075 avg-key = 28.00 avg-zkey = 1.89 avg-val = 117.09 avg-zval = 37.70 usrkeys = 925075 avg-key = 20.00 avg-zkey = 1.89 avg-val = 123.58 avg-zval = 37.70 TagRS{ kinds = RS_Key0_TagN bytes = 144640 } TagArray{ size = 857467 bytes = 2893968 } seq expand size = 6002269 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0017 GB value = 0.0349 GB dict = 1.08 MB all = 0.0407 GB } UnZip/Zip{ index = 10.5819 value = 3.1061 dict = 1.00 all = 3.2938 } Zip/UnZip{ index = 0.0945 value = 0.3219 dict = 1.00 all = 0.3036 } ---------------------------- total value len = 564.420202 GB avg = 0.330 KB (by entry num) total key len = 44.625092 GB avg = 0.026 KB total ukey len = 33.016060 GB avg = 0.014 KB total ukey num = 2.332110504 Billion total entry num = 1.711612526 Billion write speed all = 71.815705001 MB/sec (with seq num) write speed all = 70.201103769 MB/sec (without seq num) 2024/11/20-20:25:03.068889 140008056243776 [compaction_job.cc:1948] [default] [JOB 10449] Generated table #66357: 925075 keys, 40749238 bytes, temperature: kWarm 2024/11/20-20:25:03.068960 140008056243776 EVENT_LOG_v1 {"time_micros": 1732105503068928, "cf_name": "default", "job": 10449, "event": "table_file_creation", "file_number": 66357, "file_size": 40749238, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 1077209210, "table_properties": {"data_size": 34871952, "index_size": 1748416, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25902100, "raw_average_key_size": 28, "raw_value_size": 108315710, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 925075, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732105499, "oldest_key_time": 0, "file_creation_time": 1732105499, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "6MZ3RU376XPAYLWHL32R", "orig_file_number": 66357, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-20:25:03.104407 140008056243776 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10449/att-00/066358.sst) /dev/shm/ToplingTemp/Topling-937398-K8IHPN 2024/11/20-20:25:04.249524 140008056243776 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10449/att-00/066358.sst): first pass time = 1.15's, 117.214'MB/sec 2024/11/20-20:25:05.558345 140008056243776 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10449/att-00/066358.sst): old prealloc_size = 147639500, real_size = 34367616 2024/11/20-20:25:05.558915 140008056243776 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10449/att-00/066358.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 922304 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1084 GB zip-val = 0.0324 GB avg-val = 117.52 avg-zval = 35.10 2024/11/20-20:25:05.559721 140008056243776 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10449/att-00/066358.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-20:25:06.414795 140008056243776 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10449/att-00/066358.sst): second pass time = 1.31's, 82.873'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.86's, 44.765'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3324.571'MB/sec (index lex order gen) rebuild zvType time = 0.73's, 0.318'MB/sec write SST data time = 0.13's, 292.939'MB/sec dict compress time = 0.00's, 1083254.000'MB/sec z-dict build time = 0.00's, sample length = 1.083'MB, throughput = 34023.934'MB/sec zip my value time = 1.31's, unzip length = 0.108'GB zip my value throughput = 82.873'MB/sec zip pipeline throughput = 82.873'MB/sec entries = 922304 avg-key = 28.00 avg-zkey = 1.91 avg-val = 117.52 avg-zval = 35.10 usrkeys = 922304 avg-key = 20.00 avg-zkey = 1.91 avg-val = 124.52 avg-zval = 35.10 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 922304 bytes = 3112784 } seq expand size = 6456128 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0184 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0324 GB dict = 1.08 MB all = 0.0383 GB } UnZip/Zip{ index = 10.4439 value = 3.3485 dict = 1.00 all = 3.5008 } Zip/UnZip{ index = 0.0957 value = 0.2986 dict = 1.00 all = 0.2856 } ---------------------------- total value len = 564.535051 GB avg = 0.330 KB (by entry num) total key len = 44.650917 GB avg = 0.026 KB total ukey len = 33.034506 GB avg = 0.014 KB total ukey num = 2.333032808 Billion total entry num = 1.712534830 Billion write speed all = 71.803537414 MB/sec (with seq num) write speed all = 70.188712843 MB/sec (without seq num) 2024/11/20-20:25:06.466598 140008056243776 [compaction_job.cc:1948] [default] [JOB 10449] Generated table #66358: 922304 keys, 38338950 bytes, temperature: kWarm 2024/11/20-20:25:06.466670 140008056243776 EVENT_LOG_v1 {"time_micros": 1732105506466637, "cf_name": "default", "job": 10449, "event": "table_file_creation", "file_number": 66358, "file_size": 38338950, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 980002250, "largest_seqno": 1077208719, "table_properties": {"data_size": 32370672, "index_size": 1766208, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25824512, "raw_average_key_size": 28, "raw_value_size": 108393304, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 922304, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732105503, "oldest_key_time": 0, "file_creation_time": 1732105503, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "6MZ3RU376XPAYLWHL32R", "orig_file_number": 66358, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-20:25:06.506468 140008056243776 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10449/att-00/066359.sst) /dev/shm/ToplingTemp/Topling-937398-SKR3sQ 2024/11/20-20:25:06.734186 140008056243776 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10449/att-00/066359.sst): first pass time = 0.23's, 174.813'MB/sec 2024/11/20-20:25:07.733672 140008056243776 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10449/att-00/066359.sst): old prealloc_size = 147639500, real_size = 10900208 2024/11/20-20:25:07.733865 140008056243776 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10449/att-00/066359.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 272594 prefix = 4 raw-key = 0.0044 GB zip-key = 0.0005 GB avg-key = 16.00 avg-zkey = 1.93 raw-val = 0.0322 GB zip-val = 0.0103 GB avg-val = 118.00 avg-zval = 37.81 2024/11/20-20:25:07.734140 140008056243776 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10449/att-00/066359.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.040 GB 2024/11/20-20:25:08.039971 140008056243776 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10449/att-00/066359.sst): second pass time = 1.00's, 32.208'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.31's, 39.340'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3069.925'MB/sec (index lex order gen) rebuild zvType time = 0.24's, 0.289'MB/sec write SST data time = 0.07's, 172.263'MB/sec dict compress time = 0.00's, 328040.000'MB/sec z-dict build time = 0.00's, sample length = 0.328'MB, throughput = 8900.103'MB/sec zip my value time = 1.00's, unzip length = 0.032'GB zip my value throughput = 32.208'MB/sec zip pipeline throughput = 190.442'MB/sec entries = 272594 avg-key = 28.00 avg-zkey = 1.93 avg-val = 118.00 avg-zval = 37.81 usrkeys = 272594 avg-key = 20.00 avg-zkey = 1.93 avg-val = 125.00 avg-zval = 37.81 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 272594 bytes = 885952 } seq expand size = 1908158 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0055 GB value = 0.0322 GB dict = 0.33 MB all = 0.0398 GB } __ZipSize{ index = 0.0005 GB value = 0.0103 GB dict = 0.33 MB all = 0.0120 GB } UnZip/Zip{ index = 10.3569 value = 3.1213 dict = 1.00 all = 3.3034 } Zip/UnZip{ index = 0.0966 value = 0.3204 dict = 1.00 all = 0.3027 } ---------------------------- total value len = 564.569126 GB avg = 0.330 KB (by entry num) total key len = 44.658549 GB avg = 0.026 KB total ukey len = 33.039958 GB avg = 0.014 KB total ukey num = 2.333305402 Billion total entry num = 1.712807424 Billion write speed all = 71.794700838 MB/sec (with seq num) write speed all = 70.179928540 MB/sec (without seq num) 2024/11/20-20:25:08.061514 140008056243776 [compaction_job.cc:1948] [default] [JOB 10449] Generated table #66359: 272594 keys, 12047879 bytes, temperature: kWarm 2024/11/20-20:25:08.061601 140008056243776 EVENT_LOG_v1 {"time_micros": 1732105508061557, "cf_name": "default", "job": 10449, "event": "table_file_creation", "file_number": 66359, "file_size": 12047879, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 989801258, "largest_seqno": 1044047413, "table_properties": {"data_size": 10305504, "index_size": 526400, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 7632632, "raw_average_key_size": 28, "raw_value_size": 32166092, "raw_average_value_size": 118, "num_data_blocks": 1, "num_entries": 272594, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 118, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732105506, "oldest_key_time": 0, "file_creation_time": 1732105506, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "6MZ3RU376XPAYLWHL32R", "orig_file_number": 66359, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-20:25:08.080521 140008056243776 [compaction_job.cc:703] job-10449: subcompact[0], size: 0.523163 G, files: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10449/att-00 [066346,066347,066348,066349,066350,066351,066352,066353,066354,066355,066356,066357,066358,066359] 2024/11/20-20:25:08.182119 140008056243776 (Original Log Time 2024/11/20-20:24:23.749966) EVENT_LOG_v1 {"time_micros": 1732105463749927, "job": 10449, "event": "compaction_started", "compaction_reason": "FilesMarkedForCompaction", "files_L2": [66343], "files_L3": [66315, 66316, 66260, 66261, 66262, 66263, 66264, 66329, 66330, 66331, 66332, 66333, 66334, 66335], "score": 0.856417, "input_data_size": 541638963, "oldest_snapshot_seqno": 1078760968} 2024/11/20-20:25:08.182123 140008056243776 (Original Log Time 2024/11/20-20:25:08.180870) [compaction_job.cc:2022] [default] [JOB 10449] Compacted 1@2 + 14@3 files to L3 => 523162931 bytes 2024/11/20-20:25:08.182125 140008056243776 (Original Log Time 2024/11/20-20:25:08.182036) [compaction_job.cc:1224] [default] compacted to: files[0 0 0 14 0 0 0] max score 0.02, MB/sec: 12.2 rd, 11.8 wr, level 3, files in(1, 14) out(14 +0 blob) MB in(27.2, 489.4 +0.0 blob) out(498.9 +0.0 blob), read-write-amplify(37.4) write-amplify(18.4) OK, records in: 12402368, records dropped: 111542 output_compression: Snappy 2024/11/20-20:25:08.182128 140008056243776 (Original Log Time 2024/11/20-20:25:08.182097) EVENT_LOG_v1 {"time_micros": 1732105508182071, "cf": "default", "job": 10449, "event": "compaction_finished", "compaction_time_micros": 44330574, "compaction_time_cpu_micros": 19591061, "output_level": 3, "num_output_files": 14, "total_output_size": 523162931, "num_input_records": 12402368, "num_output_records": 12290826, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "file_write_nanos": 393090456, "file_range_sync_nanos": 0, "file_fsync_nanos": 17270, "file_prepare_write_nanos": 47658, "lsm_state": [0, 0, 0, 14, 0, 0, 0]} 2024/11/20-20:25:08.327575 140008056243776 DEBG dcompact_worker.cpp:240: HttpPost: 200 OK: url = http://nlb-7zny4kaa1poal01o64.cn-shenzhen.nlb.aliyuncs.com:8443, body = {"instanceId":"nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137","labourId":"","dbId":"d89b4006-2803-486e-b7a2-759bcf348921","dbStarts":1732096383,"starts":1732105463,"executesMs":44596,"compactionJobId":10449,"attempt":0,"compactionInputRawBytes":1800468840,"compactionInputZipBytes":541638963,"compactionOutputRawBytes":0,"compactionOutputZipBytes":523162931,"headers":{"Accept":"*/*","Connection":"close","Host":"aliyun-topling-saas.topling.cn:18443","RemoteIp":"120.24.192.169","X-Forwarded-For":"120.24.192.169","region":"cn-shenzhen","token":"e6474c481bd4415abc537135cc03626b","instance-token":"e6474c481bd4415abc537135cc03626b","provider":"aliyun","CloudMarketInstanceId":"si-59c0ae5c955845588903","MeteringAssit":"","Transfer-Encoding":"chunked","traceparent":"00-06ac105dd47b57039cb904490f78c1ba-1475a7908f66d8ee-00"}}, response = 2024/11/20-20:25:08.327675 140008056243776 INFO dcompact_worker.cpp:1464: finish /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-20T17.53.03/.rocksdb/job-10449/att-00: olev 3, work 44.596 s, result 7.718 ms, install 1.275 ms, input{raw 1.677 GiB zip 516.547 MiB}