2024/11/20-23:57:48.685518 140008677303872 DEBG dcompact_worker.cpp:2219: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22042/att-00: fork to child time = 0.008630 sec 2024/11/20-23:57:48.685986 140008677303872 DEBG dcompact_worker.cpp:1013: Beg SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22042/att-00 2024/11/20-23:57:48.693752 140008677303872 DEBG dcompact_worker.cpp:1033: End SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22042/att-00 2024/11/20-23:57:48.695437 140008677303872 TRAC dcompact_worker.cpp:1083: INFO_LOG_LEVEL: rpc = INFO_LEVEL, env_var = undefined 2024/11/20-23:57:48.695624 140008677303872 [WARN] [column_family.cc:386] multiple cf_paths/db_paths and level_compaction_dynamic_level_bytes can't be used together 2024/11/20-23:57:48.743875 140008677303872 [version_set.cc:6211] Recovering from manifest file: /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-20T17.53.03/.rocksdb/job-22042/att-00/MANIFEST-049091 2024/11/20-23:57:48.776742 140008677303872 [version_set.cc:6254] Recovered from manifest file:/worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-20T17.53.03/.rocksdb/job-22042/att-00/MANIFEST-049091 succeeded,manifest_file_number is 49091, next_file_number is 87671, last_sequence is 1339024427, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 87534 2024/11/20-23:57:48.776749 140008677303872 [version_set.cc:6269] Column family [default] (ID 0), log number is 0 2024/11/20-23:57:48.776823 140008677303872 [version_set.cc:5724] Creating manifest 87671 2024/11/20-23:57:48.808821 140008677303872 DEBG dcompact_worker.cpp:1225: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22042/att-00: bottommost_level: fake = 1, rpc = 0 2024/11/20-23:57:48.828060 140008677303872 [compaction_job.cc:2437] [default] [JOB 22042] Compacting 1@2 + 13@3 files to L3, score 0.99, subcompactions 1 : 1 2024/11/20-23:57:48.828072 140008677303872 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 16470 Base level 2, inputs: [87662(27MB)], [87605(37MB) 87606(36MB) 87607(36MB) 87608(38MB) 87609(36MB) 87610(37MB) 87611(39MB) 87612(37MB) 87613(37MB) 87614(38MB) 87615(38MB) 87616(36MB) 87623(36MB)] 2024/11/20-23:57:48.835176 140008677303872 [top_zip_table.cc:59] core git_version_hash_info_is:commit 81964c21ebbcc178d8e99dae0fbf61bded2729cc Author: rockeet Date: Mon Nov 11 21:28:46 2024 +0800 Makefile: fix gen git-version-*.cpp GIT_PATH_ARG = :!src/terark/fsa :!tools/fsa :!src/terark/zbs :!tools/zbs g++ (GCC) 12.2.1 20221121 (Red Hat 12.2.1-7) Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/zstd -Iboost-include DEFS = -DTOPLING_IO_WITH_URING=1 -DDIVSUFSORT_API= CXXFLAGS = -fPIC -time -fdiagnostics-color -mcx16 -fno-stack-protector WARNINGS = -Wno-class-memaccess -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -Wno-deprecated-declarations -Wstrict-aliasing=3 RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 LDFLAGS = -fPIC -rdynamic 2024/11/20-23:57:48.835201 140008677303872 [top_zip_table.cc:60] fsa git_version_hash_info_is:commit 5dfecb7d107196f044ff5bf78dc39d2e725b9d9b Author: leipeng Date: Thu Nov 7 15:22:45 2024 +0800 Makefile: fix for x86_64 CPU older than haswell GIT_PATH_ARG = src/terark/fsa tools/fsa g++ (GCC) 12.2.1 20221121 (Red Hat 12.2.1-7) Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/zstd -Iboost-include DEFS = -DTOPLING_IO_WITH_URING=1 -DDIVSUFSORT_API= CXXFLAGS = -fPIC -time -fdiagnostics-color -mcx16 -fno-stack-protector WARNINGS = -Wno-class-memaccess -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -Wno-deprecated-declarations -Wstrict-aliasing=3 RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 LDFLAGS = -fPIC -rdynamic 2024/11/20-23:57:48.835215 140008677303872 [top_zip_table.cc:61] zbs git_version_hash_info_is:commit d44dd5ff72707128fe3c916077b43d2093c01f7c Author: leipeng Date: Sun Oct 27 23:38:26 2024 +0800 Fix for msvc, when toplingdb on msvc GIT_PATH_ARG = src/terark/zbs tools/zbs g++ (GCC) 12.2.1 20221121 (Red Hat 12.2.1-7) Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/zstd -Iboost-include DEFS = -DTOPLING_IO_WITH_URING=1 -DDIVSUFSORT_API= CXXFLAGS = -fPIC -time -fdiagnostics-color -mcx16 -fno-stack-protector WARNINGS = -Wno-class-memaccess -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -Wno-deprecated-declarations -Wstrict-aliasing=3 RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 LDFLAGS = -fPIC -rdynamic 2024/11/20-23:57:48.835222 140008677303872 [top_zip_table.cc:62] topling-zip_table_reader: git_version_hash_info_is: commit 79614a7e7dc27362fc5151b0797eb7d83c674c7b Author: rockeet Date: Sun Nov 10 15:02:21 2024 +0800 cpu_has_bmi2.sh: detect by compile c++ code check __BMI2__ g++ (GCC) 12.2.1 20221121 (Red Hat 12.2.1-7) Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/20-23:57:48.835231 140008677303872 [top_zip_table.cc:64] topling-rocks git_version_hash_info_is: commit c46b65a52d9c74aa8b87aeb8438620ff2dbc669c Author: rockeet Date: Sun Nov 10 15:02:42 2024 +0800 cpu_has_bmi2.sh: detect by compile c++ code check __BMI2__ g++ (GCC) 12.2.1 20221121 (Red Hat 12.2.1-7) Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/20-23:57:49.398813 140008677303872 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22042/att-00/087672.sst) /dev/shm/ToplingTemp/Topling-1172036-XxabL3 2024/11/20-23:57:50.124239 140008677303872 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22042/att-00/087672.sst): first pass time = 0.73's, 185.033'MB/sec 2024/11/20-23:57:51.439866 140008677303872 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22042/att-00/087672.sst): old prealloc_size = 147639500, real_size = 35084304 2024/11/20-23:57:51.440617 140008677303872 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22042/att-00/087672.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927954 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0331 GB avg-val = 116.64 avg-zval = 35.66 2024/11/20-23:57:51.442374 140008677303872 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22042/att-00/087672.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-23:57:52.401329 140008677303872 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22042/att-00/087672.sst): second pass time = 1.31's, 82.332'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.96's, 40.877'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2419.774'MB/sec (index lex order gen) rebuild zvType time = 0.80's, 0.291'MB/sec write SST data time = 0.16's, 242.261'MB/sec dict compress time = 3544385890.27's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 33860.964'MB/sec zip my value time = 1.31's, unzip length = 0.108'GB zip my value throughput = 82.332'MB/sec zip pipeline throughput = 82.332'MB/sec entries = 927954 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.64 avg-zval = 35.66 usrkeys = 927954 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.64 avg-zval = 35.66 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 927954 bytes = 3363856 } seq expand size = 6495678 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0331 GB dict = 1.08 MB all = 0.0393 GB } UnZip/Zip{ index = 10.5140 value = 3.2712 dict = 1.00 all = 3.4150 } Zip/UnZip{ index = 0.0951 value = 0.3057 dict = 1.00 all = 0.2928 } ---------------------------- total value len = 563.180463 GB avg = 0.331 KB (by entry num) total key len = 44.340389 GB avg = 0.026 KB total ukey len = 32.812701 GB avg = 0.014 KB total ukey num = 2.321942530 Billion total entry num = 1.701444552 Billion write speed all = 28.589145552 MB/sec (with seq num) write speed all = 27.948603311 MB/sec (without seq num) 2024/11/20-23:57:52.451327 140008677303872 [compaction_job.cc:1948] [default] [JOB 22042] Generated table #87672: 927954 keys, 39301892 bytes, temperature: kWarm 2024/11/20-23:57:52.451417 140008677303872 EVENT_LOG_v1 {"time_micros": 1732118272451374, "cf_name": "default", "job": 22042, "event": "table_file_creation", "file_number": 87672, "file_size": 39301892, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1069697601, "largest_seqno": 1338995975, "table_properties": {"data_size": 33086976, "index_size": 1765184, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25982712, "raw_average_key_size": 28, "raw_value_size": 108235148, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927954, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732118269, "oldest_key_time": 0, "file_creation_time": 1732118269, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "6MZ3RU376XPAYLWHL32R", "orig_file_number": 87672, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-23:57:52.493130 140008677303872 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22042/att-00/087673.sst) /dev/shm/ToplingTemp/Topling-1172036-0BqOl5 2024/11/20-23:57:53.523423 140008677303872 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22042/att-00/087673.sst): first pass time = 1.03's, 130.277'MB/sec 2024/11/20-23:57:55.285829 140008677303872 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22042/att-00/087673.sst): old prealloc_size = 147639500, real_size = 34038624 2024/11/20-23:57:55.286411 140008677303872 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22042/att-00/087673.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 928207 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0320 GB avg-val = 116.60 avg-zval = 34.52 2024/11/20-23:57:55.287275 140008677303872 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22042/att-00/087673.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-23:57:56.345838 140008677303872 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22042/att-00/087673.sst): second pass time = 1.76's, 61.439'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.06's, 36.091'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3198.928'MB/sec (index lex order gen) rebuild zvType time = 0.90's, 0.257'MB/sec write SST data time = 0.16's, 243.896'MB/sec dict compress time = 140029.08's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 29465.284'MB/sec zip my value time = 1.76's, unzip length = 0.108'GB zip my value throughput = 61.439'MB/sec zip pipeline throughput = 230.077'MB/sec entries = 928207 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.60 avg-zval = 34.52 usrkeys = 928207 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.60 avg-zval = 34.52 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 928207 bytes = 3364768 } seq expand size = 6497449 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0320 GB dict = 1.08 MB all = 0.0383 GB } UnZip/Zip{ index = 10.5134 value = 3.3778 dict = 1.00 all = 3.5083 } Zip/UnZip{ index = 0.0951 value = 0.2960 dict = 1.00 all = 0.2850 } ---------------------------- total value len = 563.295188 GB avg = 0.331 KB (by entry num) total key len = 44.366379 GB avg = 0.026 KB total ukey len = 32.831265 GB avg = 0.014 KB total ukey num = 2.322870737 Billion total entry num = 1.702372759 Billion write speed all = 28.590460365 MB/sec (with seq num) write speed all = 27.949687625 MB/sec (without seq num) 2024/11/20-23:57:56.404064 140008677303872 [compaction_job.cc:1948] [default] [JOB 22042] Generated table #87673: 928207 keys, 38256776 bytes, temperature: kWarm 2024/11/20-23:57:56.404130 140008677303872 EVENT_LOG_v1 {"time_micros": 1732118276404100, "cf_name": "default", "job": 22042, "event": "table_file_creation", "file_number": 87673, "file_size": 38256776, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1069697639, "largest_seqno": 1338995687, "table_properties": {"data_size": 32040656, "index_size": 1765760, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25989796, "raw_average_key_size": 28, "raw_value_size": 108227946, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 928207, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732118272, "oldest_key_time": 0, "file_creation_time": 1732118272, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "6MZ3RU376XPAYLWHL32R", "orig_file_number": 87673, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-23:57:56.442372 140008677303872 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22042/att-00/087674.sst) /dev/shm/ToplingTemp/Topling-1172036-kxFxD4 2024/11/20-23:57:57.351801 140008677303872 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22042/att-00/087674.sst): first pass time = 0.91's, 147.591'MB/sec 2024/11/20-23:57:58.677472 140008677303872 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22042/att-00/087674.sst): old prealloc_size = 147639500, real_size = 33685328 2024/11/20-23:57:58.678064 140008677303872 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22042/att-00/087674.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 926993 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1083 GB zip-val = 0.0317 GB avg-val = 116.79 avg-zval = 34.17 2024/11/20-23:57:58.678900 140008677303872 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22042/att-00/087674.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-23:57:59.556769 140008677303872 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22042/att-00/087674.sst): second pass time = 1.32's, 81.713'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.88's, 42.972'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3116.655'MB/sec (index lex order gen) rebuild zvType time = 0.74's, 0.313'MB/sec write SST data time = 0.14's, 274.329'MB/sec dict compress time = 140029.08's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 39689.826'MB/sec zip my value time = 1.32's, unzip length = 0.108'GB zip my value throughput = 81.713'MB/sec zip pipeline throughput = 103.896'MB/sec entries = 926993 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.79 avg-zval = 34.17 usrkeys = 926993 avg-key = 20.00 avg-zkey = 1.91 avg-val = 123.79 avg-zval = 34.17 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 926993 bytes = 3244496 } seq expand size = 6488951 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0317 GB dict = 1.08 MB all = 0.0378 GB } UnZip/Zip{ index = 10.4459 value = 3.4175 dict = 1.00 all = 3.5522 } Zip/UnZip{ index = 0.0957 value = 0.2926 dict = 1.00 all = 0.2815 } ---------------------------- total value len = 563.409939 GB avg = 0.331 KB (by entry num) total key len = 44.392335 GB avg = 0.026 KB total ukey len = 32.849805 GB avg = 0.014 KB total ukey num = 2.323797730 Billion total entry num = 1.703299752 Billion write speed all = 28.592761001 MB/sec (with seq num) write speed all = 27.951736183 MB/sec (without seq num) 2024/11/20-23:57:59.638998 140008677303872 [compaction_job.cc:1948] [default] [JOB 22042] Generated table #87674: 926993 keys, 37784126 bytes, temperature: kWarm 2024/11/20-23:57:59.639073 140008677303872 EVENT_LOG_v1 {"time_micros": 1732118279639031, "cf_name": "default", "job": 22042, "event": "table_file_creation", "file_number": 87674, "file_size": 37784126, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1156808633, "largest_seqno": 1338996359, "table_properties": {"data_size": 31678528, "index_size": 1774848, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25955804, "raw_average_key_size": 28, "raw_value_size": 108262010, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 926993, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732118276, "oldest_key_time": 0, "file_creation_time": 1732118276, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "6MZ3RU376XPAYLWHL32R", "orig_file_number": 87674, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-23:57:59.680823 140008677303872 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22042/att-00/087675.sst) /dev/shm/ToplingTemp/Topling-1172036-srv584 2024/11/20-23:58:00.529718 140008677303872 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22042/att-00/087675.sst): first pass time = 0.85's, 158.115'MB/sec 2024/11/20-23:58:01.823468 140008677303872 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22042/att-00/087675.sst): old prealloc_size = 147639500, real_size = 35549984 2024/11/20-23:58:01.824289 140008677303872 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22042/att-00/087675.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 929188 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.97 raw-val = 0.1082 GB zip-val = 0.0335 GB avg-val = 116.45 avg-zval = 36.04 2024/11/20-23:58:01.825158 140008677303872 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22042/att-00/087675.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-23:58:03.068282 140008677303872 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22042/att-00/087675.sst): second pass time = 1.29's, 83.700'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.24's, 31.835'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2296.954'MB/sec (index lex order gen) rebuild zvType time = 1.04's, 0.224'MB/sec write SST data time = 0.21's, 193.143'MB/sec dict compress time = 140029.08's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 27688.874'MB/sec zip my value time = 1.29's, unzip length = 0.108'GB zip my value throughput = 83.700'MB/sec zip pipeline throughput = 113.026'MB/sec entries = 929188 avg-key = 28.00 avg-zkey = 1.97 avg-val = 116.45 avg-zval = 36.04 usrkeys = 929188 avg-key = 20.00 avg-zkey = 1.97 avg-val = 122.84 avg-zval = 36.04 TagRS{ kinds = RS_Key0_TagN bytes = 145280 } TagArray{ size = 848696 bytes = 3076544 } seq expand size = 5940872 multi value expand size = 0 cnt WriteAppend = 86 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0335 GB dict = 1.08 MB all = 0.0396 GB } UnZip/Zip{ index = 10.1753 value = 3.2307 dict = 1.00 all = 3.3869 } Zip/UnZip{ index = 0.0983 value = 0.3095 dict = 1.00 all = 0.2953 } ---------------------------- total value len = 563.524081 GB avg = 0.331 KB (by entry num) total key len = 44.418352 GB avg = 0.026 KB total ukey len = 32.868389 GB avg = 0.014 KB total ukey num = 2.324726918 Billion total entry num = 1.704228940 Billion write speed all = 28.594630867 MB/sec (with seq num) write speed all = 27.953362289 MB/sec (without seq num) 2024/11/20-23:58:03.120947 140008677303872 [compaction_job.cc:1948] [default] [JOB 22042] Generated table #87675: 929188 keys, 39628284 bytes, temperature: kWarm 2024/11/20-23:58:03.121005 140008677303872 EVENT_LOG_v1 {"time_micros": 1732118283120975, "cf_name": "default", "job": 22042, "event": "table_file_creation", "file_number": 87675, "file_size": 39628284, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 1338996341, "table_properties": {"data_size": 33491152, "index_size": 1826368, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26017264, "raw_average_key_size": 28, "raw_value_size": 108200608, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 929188, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732118279, "oldest_key_time": 0, "file_creation_time": 1732118279, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "6MZ3RU376XPAYLWHL32R", "orig_file_number": 87675, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-23:58:03.156802 140008677303872 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22042/att-00/087676.sst) /dev/shm/ToplingTemp/Topling-1172036-1nuir2 2024/11/20-23:58:03.952855 140008677303872 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22042/att-00/087676.sst): first pass time = 0.80's, 168.611'MB/sec 2024/11/20-23:58:05.623761 140008677303872 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22042/att-00/087676.sst): old prealloc_size = 147639500, real_size = 36465488 2024/11/20-23:58:05.624582 140008677303872 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22042/att-00/087676.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 926586 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.97 raw-val = 0.1083 GB zip-val = 0.0344 GB avg-val = 116.85 avg-zval = 37.14 2024/11/20-23:58:05.625000 140008677303872 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22042/att-00/087676.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-23:58:06.388395 140008677303872 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22042/att-00/087676.sst): second pass time = 1.67's, 64.837'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.76's, 50.516'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2294.500'MB/sec (index lex order gen) rebuild zvType time = 0.58's, 0.401'MB/sec write SST data time = 0.19's, 207.425'MB/sec dict compress time = 140029.08's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 14598.506'MB/sec zip my value time = 1.67's, unzip length = 0.108'GB zip my value throughput = 64.837'MB/sec zip pipeline throughput = 104.418'MB/sec entries = 926586 avg-key = 28.00 avg-zkey = 1.97 avg-val = 116.85 avg-zval = 37.14 usrkeys = 926586 avg-key = 20.00 avg-zkey = 1.97 avg-val = 119.44 avg-zval = 37.14 TagRS{ kinds = RS_Key0_TagN bytes = 144880 } TagArray{ size = 342730 bytes = 1156736 } seq expand size = 2399110 multi value expand size = 0 cnt WriteAppend = 57 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0344 GB dict = 1.08 MB all = 0.0386 GB } UnZip/Zip{ index = 10.1753 value = 3.1463 dict = 1.00 all = 3.4748 } Zip/UnZip{ index = 0.0983 value = 0.3178 dict = 1.00 all = 0.2878 } ---------------------------- total value len = 563.634753 GB avg = 0.331 KB (by entry num) total key len = 44.444296 GB avg = 0.026 KB total ukey len = 32.886920 GB avg = 0.014 KB total ukey num = 2.325653504 Billion total entry num = 1.705155526 Billion write speed all = 28.596590958 MB/sec (with seq num) write speed all = 27.955073903 MB/sec (without seq num) 2024/11/20-23:58:06.461686 140008677303872 [compaction_job.cc:1948] [default] [JOB 22042] Generated table #87676: 926586 keys, 38625635 bytes, temperature: kWarm 2024/11/20-23:58:06.461748 140008677303872 EVENT_LOG_v1 {"time_micros": 1732118286461718, "cf_name": "default", "job": 22042, "event": "table_file_creation", "file_number": 87676, "file_size": 38625635, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 978567417, "table_properties": {"data_size": 34412416, "index_size": 1821248, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25944408, "raw_average_key_size": 28, "raw_value_size": 108273368, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 926586, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732118283, "oldest_key_time": 0, "file_creation_time": 1732118283, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "6MZ3RU376XPAYLWHL32R", "orig_file_number": 87676, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-23:58:06.498772 140008677303872 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22042/att-00/087677.sst) /dev/shm/ToplingTemp/Topling-1172036-H5yN94 2024/11/20-23:58:07.360098 140008677303872 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22042/att-00/087677.sst): first pass time = 0.86's, 155.834'MB/sec 2024/11/20-23:58:08.772174 140008677303872 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22042/att-00/087677.sst): old prealloc_size = 147639500, real_size = 36877104 2024/11/20-23:58:08.772755 140008677303872 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22042/att-00/087677.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 926797 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.97 raw-val = 0.1083 GB zip-val = 0.0348 GB avg-val = 116.82 avg-zval = 37.57 2024/11/20-23:58:08.773151 140008677303872 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22042/att-00/087677.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-23:58:09.630133 140008677303872 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22042/att-00/087677.sst): second pass time = 1.41's, 76.714'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.86's, 45.485'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3275.182'MB/sec (index lex order gen) rebuild zvType time = 0.59's, 0.394'MB/sec write SST data time = 0.27's, 145.174'MB/sec dict compress time = 140029.08's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 14132.009'MB/sec zip my value time = 1.41's, unzip length = 0.108'GB zip my value throughput = 76.714'MB/sec zip pipeline throughput = 115.150'MB/sec entries = 926797 avg-key = 28.00 avg-zkey = 1.97 avg-val = 116.82 avg-zval = 37.57 usrkeys = 926797 avg-key = 20.00 avg-zkey = 1.97 avg-val = 119.20 avg-zval = 37.57 TagRS{ kinds = RS_Key0_TagN bytes = 144920 } TagArray{ size = 315062 bytes = 1142112 } seq expand size = 2205434 multi value expand size = 0 cnt WriteAppend = 36 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0348 GB dict = 1.08 MB all = 0.0390 GB } UnZip/Zip{ index = 10.1765 value = 3.1090 dict = 1.00 all = 3.4395 } Zip/UnZip{ index = 0.0983 value = 0.3216 dict = 1.00 all = 0.2907 } ---------------------------- total value len = 563.745226 GB avg = 0.330 KB (by entry num) total key len = 44.470247 GB avg = 0.026 KB total ukey len = 32.905456 GB avg = 0.014 KB total ukey num = 2.326580301 Billion total entry num = 1.706082323 Billion write speed all = 28.598646769 MB/sec (with seq num) write speed all = 27.956878870 MB/sec (without seq num) 2024/11/20-23:58:09.683183 140008677303872 [compaction_job.cc:1948] [default] [JOB 22042] Generated table #87677: 926797 keys, 39022133 bytes, temperature: kWarm 2024/11/20-23:58:09.683284 140008677303872 EVENT_LOG_v1 {"time_micros": 1732118289683238, "cf_name": "default", "job": 22042, "event": "table_file_creation", "file_number": 87677, "file_size": 39022133, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 1323159662, "table_properties": {"data_size": 34823776, "index_size": 1821440, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25950316, "raw_average_key_size": 28, "raw_value_size": 108267478, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 926797, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732118286, "oldest_key_time": 0, "file_creation_time": 1732118286, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "6MZ3RU376XPAYLWHL32R", "orig_file_number": 87677, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-23:58:09.776821 140008677303872 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22042/att-00/087678.sst) /dev/shm/ToplingTemp/Topling-1172036-1EHyy2 2024/11/20-23:58:10.801829 140008677303872 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22042/att-00/087678.sst): first pass time = 1.02's, 130.949'MB/sec 2024/11/20-23:58:12.325642 140008677303872 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22042/att-00/087678.sst): old prealloc_size = 147639500, real_size = 38127392 2024/11/20-23:58:12.326283 140008677303872 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22042/att-00/087678.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 926373 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.89 raw-val = 0.1083 GB zip-val = 0.0361 GB avg-val = 116.89 avg-zval = 39.02 2024/11/20-23:58:12.327158 140008677303872 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22042/att-00/087678.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-23:58:13.240806 140008677303872 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22042/att-00/087678.sst): second pass time = 1.52's, 71.100'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.92's, 46.269'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2903.330'MB/sec (index lex order gen) rebuild zvType time = 0.78's, 0.297'MB/sec write SST data time = 0.13's, 313.973'MB/sec dict compress time = 140029.08's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 32621.456'MB/sec zip my value time = 1.52's, unzip length = 0.108'GB zip my value throughput = 71.100'MB/sec zip pipeline throughput = 134.463'MB/sec entries = 926373 avg-key = 28.00 avg-zkey = 1.89 avg-val = 116.89 avg-zval = 39.02 usrkeys = 926373 avg-key = 20.00 avg-zkey = 1.89 avg-val = 123.89 avg-zval = 39.02 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 926373 bytes = 3358112 } seq expand size = 6484611 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0361 GB dict = 1.08 MB all = 0.0423 GB } UnZip/Zip{ index = 10.5835 value = 2.9957 dict = 1.00 all = 3.1697 } Zip/UnZip{ index = 0.0945 value = 0.3338 dict = 1.00 all = 0.3155 } ---------------------------- total value len = 563.859990 GB avg = 0.330 KB (by entry num) total key len = 44.496185 GB avg = 0.026 KB total ukey len = 32.923984 GB avg = 0.014 KB total ukey num = 2.327506674 Billion total entry num = 1.707008696 Billion write speed all = 28.600406981 MB/sec (with seq num) write speed all = 27.958399612 MB/sec (without seq num) 2024/11/20-23:58:13.298088 140008677303872 [compaction_job.cc:1948] [default] [JOB 22042] Generated table #87678: 926373 keys, 42343830 bytes, temperature: kWarm 2024/11/20-23:58:13.298164 140008677303872 EVENT_LOG_v1 {"time_micros": 1732118293298130, "cf_name": "default", "job": 22042, "event": "table_file_creation", "file_number": 87678, "file_size": 42343830, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1052137445, "largest_seqno": 1331715475, "table_properties": {"data_size": 36145040, "index_size": 1750592, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25938444, "raw_average_key_size": 28, "raw_value_size": 108279302, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 926373, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732118289, "oldest_key_time": 0, "file_creation_time": 1732118289, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "6MZ3RU376XPAYLWHL32R", "orig_file_number": 87678, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-23:58:13.336438 140008677303872 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22042/att-00/087679.sst) /dev/shm/ToplingTemp/Topling-1172036-Wf3E84 2024/11/20-23:58:14.188167 140008677303872 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22042/att-00/087679.sst): first pass time = 0.85's, 157.592'MB/sec 2024/11/20-23:58:15.459280 140008677303872 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22042/att-00/087679.sst): old prealloc_size = 147639500, real_size = 34915536 2024/11/20-23:58:15.459833 140008677303872 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22042/att-00/087679.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 926129 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1083 GB zip-val = 0.0329 GB avg-val = 116.92 avg-zval = 35.54 2024/11/20-23:58:15.460686 140008677303872 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22042/att-00/087679.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-23:58:16.305187 140008677303872 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22042/att-00/087679.sst): second pass time = 1.27's, 85.237'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.85's, 46.120'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3309.087'MB/sec (index lex order gen) rebuild zvType time = 0.71's, 0.325'MB/sec write SST data time = 0.13's, 295.025'MB/sec dict compress time = 140029.08's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 34115.460'MB/sec zip my value time = 1.27's, unzip length = 0.108'GB zip my value throughput = 85.237'MB/sec zip pipeline throughput = 158.691'MB/sec entries = 926129 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.92 avg-zval = 35.54 usrkeys = 926129 avg-key = 20.00 avg-zkey = 1.91 avg-val = 123.92 avg-zval = 35.54 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 926129 bytes = 3241472 } seq expand size = 6482903 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0329 GB dict = 1.08 MB all = 0.0390 GB } UnZip/Zip{ index = 10.4448 value = 3.2903 dict = 1.00 all = 3.4404 } Zip/UnZip{ index = 0.0957 value = 0.3039 dict = 1.00 all = 0.2907 } ---------------------------- total value len = 563.974759 GB avg = 0.330 KB (by entry num) total key len = 44.522117 GB avg = 0.026 KB total ukey len = 32.942506 GB avg = 0.014 KB total ukey num = 2.328432803 Billion total entry num = 1.707934825 Billion write speed all = 28.602901023 MB/sec (with seq num) write speed all = 27.960637863 MB/sec (without seq num) 2024/11/20-23:58:16.369972 140008677303872 [compaction_job.cc:1948] [default] [JOB 22042] Generated table #87679: 926129 keys, 39012254 bytes, temperature: kWarm 2024/11/20-23:58:16.370040 140008677303872 EVENT_LOG_v1 {"time_micros": 1732118296370009, "cf_name": "default", "job": 22042, "event": "table_file_creation", "file_number": 87679, "file_size": 39012254, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1187855341, "largest_seqno": 1331717282, "table_properties": {"data_size": 32910464, "index_size": 1773376, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25931612, "raw_average_key_size": 28, "raw_value_size": 108286166, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 926129, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732118293, "oldest_key_time": 0, "file_creation_time": 1732118293, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "6MZ3RU376XPAYLWHL32R", "orig_file_number": 87679, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-23:58:16.409273 140008677303872 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22042/att-00/087680.sst) /dev/shm/ToplingTemp/Topling-1172036-paEHV4 2024/11/20-23:58:17.252513 140008677303872 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22042/att-00/087680.sst): first pass time = 0.84's, 159.177'MB/sec 2024/11/20-23:58:18.516985 140008677303872 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22042/att-00/087680.sst): old prealloc_size = 147639500, real_size = 35692688 2024/11/20-23:58:18.517629 140008677303872 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22042/att-00/087680.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 928431 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0337 GB avg-val = 116.56 avg-zval = 36.29 2024/11/20-23:58:18.518481 140008677303872 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22042/att-00/087680.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-23:58:19.349969 140008677303872 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22042/att-00/087680.sst): second pass time = 1.26's, 85.635'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.83's, 47.775'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2924.792'MB/sec (index lex order gen) rebuild zvType time = 0.70's, 0.331'MB/sec write SST data time = 0.13's, 302.578'MB/sec dict compress time = 140029.08's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 31462.475'MB/sec zip my value time = 1.26's, unzip length = 0.108'GB zip my value throughput = 85.635'MB/sec zip pipeline throughput = 157.468'MB/sec entries = 928431 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.56 avg-zval = 36.29 usrkeys = 928431 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.56 avg-zval = 36.29 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 928431 bytes = 3249520 } seq expand size = 6499017 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0337 GB dict = 1.08 MB all = 0.0398 GB } UnZip/Zip{ index = 10.5140 value = 3.2119 dict = 1.00 all = 3.3727 } Zip/UnZip{ index = 0.0951 value = 0.3113 dict = 1.00 all = 0.2965 } ---------------------------- total value len = 564.089480 GB avg = 0.330 KB (by entry num) total key len = 44.548113 GB avg = 0.026 KB total ukey len = 32.961075 GB avg = 0.014 KB total ukey num = 2.329361234 Billion total entry num = 1.708863256 Billion write speed all = 28.605421453 MB/sec (with seq num) write speed all = 27.962901120 MB/sec (without seq num) 2024/11/20-23:58:19.413747 140008677303872 [compaction_job.cc:1948] [default] [JOB 22042] Generated table #87680: 928431 keys, 39795838 bytes, temperature: kWarm 2024/11/20-23:58:19.413820 140008677303872 EVENT_LOG_v1 {"time_micros": 1732118299413785, "cf_name": "default", "job": 22042, "event": "table_file_creation", "file_number": 87680, "file_size": 39795838, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1187855426, "largest_seqno": 1331716806, "table_properties": {"data_size": 33694336, "index_size": 1766080, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25996068, "raw_average_key_size": 28, "raw_value_size": 108221698, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 928431, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732118296, "oldest_key_time": 0, "file_creation_time": 1732118296, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "6MZ3RU376XPAYLWHL32R", "orig_file_number": 87680, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-23:58:19.450985 140008677303872 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22042/att-00/087681.sst) /dev/shm/ToplingTemp/Topling-1172036-3XCa03 2024/11/20-23:58:20.312587 140008677303872 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22042/att-00/087681.sst): first pass time = 0.86's, 155.785'MB/sec 2024/11/20-23:58:21.624848 140008677303872 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22042/att-00/087681.sst): old prealloc_size = 147639500, real_size = 36625312 2024/11/20-23:58:21.625456 140008677303872 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22042/att-00/087681.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 929022 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1082 GB zip-val = 0.0346 GB avg-val = 116.47 avg-zval = 37.26 2024/11/20-23:58:21.626324 140008677303872 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22042/att-00/087681.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-23:58:22.437871 140008677303872 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22042/att-00/087681.sst): second pass time = 1.31's, 82.498'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.81's, 50.103'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3042.496'MB/sec (index lex order gen) rebuild zvType time = 0.68's, 0.339'MB/sec write SST data time = 0.13's, 317.918'MB/sec dict compress time = 140029.08's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 28232.121'MB/sec zip my value time = 1.31's, unzip length = 0.108'GB zip my value throughput = 82.498'MB/sec zip pipeline throughput = 163.596'MB/sec entries = 929022 avg-key = 28.00 avg-zkey = 1.92 avg-val = 116.47 avg-zval = 37.26 usrkeys = 929022 avg-key = 20.00 avg-zkey = 1.92 avg-val = 123.47 avg-zval = 37.26 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 929022 bytes = 3251584 } seq expand size = 6503154 multi value expand size = 0 cnt WriteAppend = 18 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0346 GB dict = 1.08 MB all = 0.0407 GB } UnZip/Zip{ index = 10.4431 value = 3.1261 dict = 1.00 all = 3.2950 } Zip/UnZip{ index = 0.0958 value = 0.3199 dict = 1.00 all = 0.3035 } ---------------------------- total value len = 564.204188 GB avg = 0.330 KB (by entry num) total key len = 44.574125 GB avg = 0.026 KB total ukey len = 32.979655 GB avg = 0.014 KB total ukey num = 2.330290256 Billion total entry num = 1.709792278 Billion write speed all = 28.607883392 MB/sec (with seq num) write speed all = 27.965107038 MB/sec (without seq num) 2024/11/20-23:58:22.505734 140008677303872 [compaction_job.cc:1948] [default] [JOB 22042] Generated table #87681: 929022 keys, 40733474 bytes, temperature: kWarm 2024/11/20-23:58:22.505803 140008677303872 EVENT_LOG_v1 {"time_micros": 1732118302505771, "cf_name": "default", "job": 22042, "event": "table_file_creation", "file_number": 87681, "file_size": 40733474, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1187851486, "largest_seqno": 1331717093, "table_properties": {"data_size": 34613648, "index_size": 1779200, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26012616, "raw_average_key_size": 28, "raw_value_size": 108205220, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 929022, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732118299, "oldest_key_time": 0, "file_creation_time": 1732118299, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "6MZ3RU376XPAYLWHL32R", "orig_file_number": 87681, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-23:58:22.541082 140008677303872 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22042/att-00/087682.sst) /dev/shm/ToplingTemp/Topling-1172036-0cS8U3 2024/11/20-23:58:23.461814 140008677303872 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22042/att-00/087682.sst): first pass time = 0.92's, 145.778'MB/sec 2024/11/20-23:58:24.698535 140008677303872 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22042/att-00/087682.sst): old prealloc_size = 147639500, real_size = 35998032 2024/11/20-23:58:24.699105 140008677303872 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22042/att-00/087682.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 930984 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0340 GB avg-val = 116.17 avg-zval = 36.51 2024/11/20-23:58:24.699916 140008677303872 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22042/att-00/087682.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-23:58:25.516983 140008677303872 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22042/att-00/087682.sst): second pass time = 1.24's, 87.507'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.82's, 49.011'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3252.480'MB/sec (index lex order gen) rebuild zvType time = 0.69's, 0.337'MB/sec write SST data time = 0.13's, 316.536'MB/sec dict compress time = 140029.08's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 18747.948'MB/sec zip my value time = 1.24's, unzip length = 0.108'GB zip my value throughput = 87.507'MB/sec zip pipeline throughput = 87.507'MB/sec entries = 930984 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.17 avg-zval = 36.51 usrkeys = 930984 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.17 avg-zval = 36.51 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 930984 bytes = 3258464 } seq expand size = 6516888 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0340 GB dict = 1.08 MB all = 0.0401 GB } UnZip/Zip{ index = 10.5136 value = 3.1814 dict = 1.00 all = 3.3461 } Zip/UnZip{ index = 0.0951 value = 0.3143 dict = 1.00 all = 0.2989 } ---------------------------- total value len = 564.318856 GB avg = 0.330 KB (by entry num) total key len = 44.600193 GB avg = 0.026 KB total ukey len = 32.998275 GB avg = 0.014 KB total ukey num = 2.331221240 Billion total entry num = 1.710723262 Billion write speed all = 28.610357074 MB/sec (with seq num) write speed all = 27.967323771 MB/sec (without seq num) 2024/11/20-23:58:25.566262 140008677303872 [compaction_job.cc:1948] [default] [JOB 22042] Generated table #87682: 930984 keys, 40111720 bytes, temperature: kWarm 2024/11/20-23:58:25.566328 140008677303872 EVENT_LOG_v1 {"time_micros": 1732118305566297, "cf_name": "default", "job": 22042, "event": "table_file_creation", "file_number": 87682, "file_size": 40111720, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1105231892, "largest_seqno": 1331716260, "table_properties": {"data_size": 33994112, "index_size": 1771008, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26067552, "raw_average_key_size": 28, "raw_value_size": 108150312, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 930984, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732118302, "oldest_key_time": 0, "file_creation_time": 1732118302, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "6MZ3RU376XPAYLWHL32R", "orig_file_number": 87682, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-23:58:25.603366 140008677303872 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22042/att-00/087683.sst) /dev/shm/ToplingTemp/Topling-1172036-74GBN5 2024/11/20-23:58:26.593613 140008677303872 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22042/att-00/087683.sst): first pass time = 0.99's, 135.544'MB/sec 2024/11/20-23:58:27.723796 140008677303872 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22042/att-00/087683.sst): old prealloc_size = 147639500, real_size = 33697760 2024/11/20-23:58:27.724418 140008677303872 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22042/att-00/087683.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 923439 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1084 GB zip-val = 0.0317 GB avg-val = 117.35 avg-zval = 34.34 2024/11/20-23:58:27.725300 140008677303872 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22042/att-00/087683.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-23:58:28.571683 140008677303872 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22042/att-00/087683.sst): second pass time = 1.13's, 95.956'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.85's, 44.805'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2975.655'MB/sec (index lex order gen) rebuild zvType time = 0.72's, 0.322'MB/sec write SST data time = 0.13's, 293.002'MB/sec dict compress time = 140029.08's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.083'MB, throughput = 32398.337'MB/sec zip my value time = 1.13's, unzip length = 0.108'GB zip my value throughput = 95.956'MB/sec zip pipeline throughput = 95.956'MB/sec entries = 923439 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.35 avg-zval = 34.34 usrkeys = 923439 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.22 avg-zval = 34.34 TagRS{ kinds = RS_Key0_TagN bytes = 144400 } TagArray{ size = 907408 bytes = 3289376 } seq expand size = 6351856 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0185 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0317 GB dict = 1.08 MB all = 0.0380 GB } UnZip/Zip{ index = 10.5150 value = 3.4172 dict = 1.00 all = 3.5330 } Zip/UnZip{ index = 0.0951 value = 0.2926 dict = 1.00 all = 0.2830 } ---------------------------- total value len = 564.433569 GB avg = 0.330 KB (by entry num) total key len = 44.626049 GB avg = 0.026 KB total ukey len = 33.016744 GB avg = 0.014 KB total ukey num = 2.332144679 Billion total entry num = 1.711646701 Billion write speed all = 28.612855107 MB/sec (with seq num) write speed all = 27.969567027 MB/sec (without seq num) 2024/11/20-23:58:28.619518 140008677303872 [compaction_job.cc:1948] [default] [JOB 22042] Generated table #87683: 923439 keys, 37989330 bytes, temperature: kWarm 2024/11/20-23:58:28.619583 140008677303872 EVENT_LOG_v1 {"time_micros": 1732118308619552, "cf_name": "default", "job": 22042, "event": "table_file_creation", "file_number": 87683, "file_size": 37989330, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 1338995653, "table_properties": {"data_size": 31710288, "index_size": 1756416, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25856292, "raw_average_key_size": 28, "raw_value_size": 108361546, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 923439, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732118305, "oldest_key_time": 0, "file_creation_time": 1732118305, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "6MZ3RU376XPAYLWHL32R", "orig_file_number": 87683, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-23:58:28.653387 140008677303872 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22042/att-00/087684.sst) /dev/shm/ToplingTemp/Topling-1172036-mxbPY4 2024/11/20-23:58:29.473778 140008677303872 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22042/att-00/087684.sst): first pass time = 0.82's, 163.608'MB/sec 2024/11/20-23:58:30.622976 140008677303872 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22042/att-00/087684.sst): old prealloc_size = 147639500, real_size = 35074416 2024/11/20-23:58:30.623620 140008677303872 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22042/att-00/087684.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 929334 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0331 GB avg-val = 116.42 avg-zval = 35.59 2024/11/20-23:58:30.624512 140008677303872 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22042/att-00/087684.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-23:58:31.457474 140008677303872 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22042/att-00/087684.sst): second pass time = 1.15's, 94.221'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.83's, 47.089'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2918.070'MB/sec (index lex order gen) rebuild zvType time = 0.71's, 0.329'MB/sec write SST data time = 0.13's, 308.265'MB/sec dict compress time = 140029.08's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 21753.236'MB/sec zip my value time = 1.15's, unzip length = 0.108'GB zip my value throughput = 94.221'MB/sec zip pipeline throughput = 94.221'MB/sec entries = 929334 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.42 avg-zval = 35.59 usrkeys = 929334 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.42 avg-zval = 35.59 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 929334 bytes = 3368848 } seq expand size = 6505338 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0331 GB dict = 1.08 MB all = 0.0393 GB } UnZip/Zip{ index = 10.5132 value = 3.2713 dict = 1.00 all = 3.4156 } Zip/UnZip{ index = 0.0951 value = 0.3057 dict = 1.00 all = 0.2928 } ---------------------------- total value len = 564.548271 GB avg = 0.330 KB (by entry num) total key len = 44.652071 GB avg = 0.026 KB total ukey len = 33.035331 GB avg = 0.014 KB total ukey num = 2.333074013 Billion total entry num = 1.712576035 Billion write speed all = 28.615586659 MB/sec (with seq num) write speed all = 27.972036554 MB/sec (without seq num) 2024/11/20-23:58:31.506801 140008677303872 [compaction_job.cc:1948] [default] [JOB 22042] Generated table #87684: 929334 keys, 39295788 bytes, temperature: kWarm 2024/11/20-23:58:31.506869 140008677303872 EVENT_LOG_v1 {"time_micros": 1732118311506836, "cf_name": "default", "job": 22042, "event": "table_file_creation", "file_number": 87684, "file_size": 39295788, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1053131113, "largest_seqno": 1338995201, "table_properties": {"data_size": 33073952, "index_size": 1767936, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26021352, "raw_average_key_size": 28, "raw_value_size": 108196424, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 929334, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732118308, "oldest_key_time": 0, "file_creation_time": 1732118308, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "6MZ3RU376XPAYLWHL32R", "orig_file_number": 87684, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-23:58:31.541300 140008677303872 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22042/att-00/087685.sst) /dev/shm/ToplingTemp/Topling-1172036-Ht3Xg2 2024/11/20-23:58:31.627507 140008677303872 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22042/att-00/087685.sst): first pass time = 0.09's, 232.586'MB/sec 2024/11/20-23:58:31.794526 140008677303872 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22042/att-00/087685.sst): old prealloc_size = 147639500, real_size = 5682528 2024/11/20-23:58:31.794674 140008677303872 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22042/att-00/087685.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 139650 prefix = 4 raw-key = 0.0022 GB zip-key = 0.0003 GB avg-key = 16.00 avg-zkey = 1.94 raw-val = 0.0161 GB zip-val = 0.0054 GB avg-val = 115.50 avg-zval = 38.50 2024/11/20-23:58:31.794829 140008677303872 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22042/att-00/087685.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.020 GB 2024/11/20-23:58:31.918299 140008677303872 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22042/att-00/087685.sst): second pass time = 0.17's, 97.027'MB/sec, value only(80.5% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.12's, 50.676'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2330.149'MB/sec (index lex order gen) rebuild zvType time = 0.10's, 0.336'MB/sec write SST data time = 0.02's, 319.811'MB/sec dict compress time = 140029.08's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.169'MB, throughput = 5640.016'MB/sec zip my value time = 0.17's, unzip length = 0.016'GB zip my value throughput = 97.027'MB/sec zip pipeline throughput = 97.027'MB/sec entries = 139650 avg-key = 28.00 avg-zkey = 1.94 avg-val = 115.50 avg-zval = 38.50 usrkeys = 139650 avg-key = 20.00 avg-zkey = 1.94 avg-val = 122.50 avg-zval = 38.50 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 139650 bytes = 453872 } seq expand size = 977550 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0028 GB value = 0.0161 GB dict = 0.17 MB all = 0.0200 GB } __ZipSize{ index = 0.0003 GB value = 0.0054 GB dict = 0.17 MB all = 0.0063 GB } UnZip/Zip{ index = 10.3243 value = 2.9998 dict = 1.00 all = 3.1951 } Zip/UnZip{ index = 0.0969 value = 0.3334 dict = 1.00 all = 0.3130 } ---------------------------- total value len = 564.565378 GB avg = 0.330 KB (by entry num) total key len = 44.655981 GB avg = 0.026 KB total ukey len = 33.038124 GB avg = 0.014 KB total ukey num = 2.333213663 Billion total entry num = 1.712715685 Billion write speed all = 28.615954467 MB/sec (with seq num) write speed all = 27.972365816 MB/sec (without seq num) 2024/11/20-23:58:31.932139 140008677303872 [compaction_job.cc:1948] [default] [JOB 22042] Generated table #87685: 139650 keys, 6271947 bytes, temperature: kWarm 2024/11/20-23:58:31.932204 140008677303872 EVENT_LOG_v1 {"time_micros": 1732118311932168, "cf_name": "default", "job": 22042, "event": "table_file_creation", "file_number": 87685, "file_size": 6271947, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1296927567, "largest_seqno": 1338560355, "table_properties": {"data_size": 5376912, "index_size": 270528, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 3910200, "raw_average_key_size": 28, "raw_value_size": 16129416, "raw_average_value_size": 115, "num_data_blocks": 1, "num_entries": 139650, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732118311, "oldest_key_time": 0, "file_creation_time": 1732118311, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "6MZ3RU376XPAYLWHL32R", "orig_file_number": 87685, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-23:58:31.942585 140008677303872 [compaction_job.cc:703] job-22042: subcompact[0], size: 0.518173 G, files: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22042/att-00 [087672,087673,087674,087675,087676,087677,087678,087679,087680,087681,087682,087683,087684,087685] 2024/11/20-23:58:32.032702 140008677303872 (Original Log Time 2024/11/20-23:57:48.828115) EVENT_LOG_v1 {"time_micros": 1732118268828080, "job": 22042, "event": "compaction_started", "compaction_reason": "FilesMarkedForCompaction", "files_L2": [87662], "files_L3": [87605, 87606, 87607, 87608, 87609, 87610, 87611, 87612, 87613, 87614, 87615, 87616, 87623], "score": 0.993559, "input_data_size": 540406372, "oldest_snapshot_seqno": 1339024397} 2024/11/20-23:58:32.032705 140008677303872 (Original Log Time 2024/11/20-23:58:32.031411) [compaction_job.cc:2022] [default] [JOB 22042] Compacted 1@2 + 13@3 files to L3 => 518173027 bytes 2024/11/20-23:58:32.032707 140008677303872 (Original Log Time 2024/11/20-23:58:32.032631) [compaction_job.cc:1224] [default] compacted to: files[0 0 0 14 0 0 0] max score 0.02, MB/sec: 12.5 rd, 12.0 wr, level 3, files in(1, 13) out(14 +0 blob) MB in(27.1, 488.3 +0.0 blob) out(494.2 +0.0 blob), read-write-amplify(37.3) write-amplify(18.2) OK, records in: 12293883, records dropped: 94796 output_compression: Snappy 2024/11/20-23:58:32.032711 140008677303872 (Original Log Time 2024/11/20-23:58:32.032678) EVENT_LOG_v1 {"time_micros": 1732118312032653, "cf": "default", "job": 22042, "event": "compaction_finished", "compaction_time_micros": 43114478, "compaction_time_cpu_micros": 18717470, "output_level": 3, "num_output_files": 14, "total_output_size": 518173027, "num_input_records": 12293883, "num_output_records": 12199087, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "file_write_nanos": 390659525, "file_range_sync_nanos": 0, "file_fsync_nanos": 12322, "file_prepare_write_nanos": 38888, "lsm_state": [0, 0, 0, 14, 0, 0, 0]} 2024/11/20-23:58:32.155362 140008677303872 DEBG dcompact_worker.cpp:240: HttpPost: 200 OK: url = http://nlb-7zny4kaa1poal01o64.cn-shenzhen.nlb.aliyuncs.com:8443, body = {"instanceId":"nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137","labourId":"","dbId":"d89b4006-2803-486e-b7a2-759bcf348921","dbStarts":1732096383,"starts":1732118268,"executesMs":43338,"compactionJobId":22042,"attempt":0,"compactionInputRawBytes":1778332110,"compactionInputZipBytes":540406372,"compactionOutputRawBytes":0,"compactionOutputZipBytes":518173027,"headers":{"Accept":"*/*","Connection":"close","Host":"aliyun-topling-saas.topling.cn:18443","RemoteIp":"120.24.192.169","X-Forwarded-For":"120.24.192.169","region":"cn-shenzhen","token":"e6474c481bd4415abc537135cc03626b","instance-token":"e6474c481bd4415abc537135cc03626b","provider":"aliyun","CloudMarketInstanceId":"si-59c0ae5c955845588903","MeteringAssit":"","Transfer-Encoding":"chunked","traceparent":"00-3f6f6bf8f0806c138211a6f9cb9e2b68-e9f21996caecd6f0-00"}}, response = 2024/11/20-23:58:32.155457 140008677303872 INFO dcompact_worker.cpp:1464: finish /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-20T17.53.03/.rocksdb/job-22042/att-00: olev 3, work 43.338 s, result 7.660 ms, install 1.315 ms, input{raw 1.656 GiB zip 515.372 MiB}