2024/11/20-21:15:31.406948 140008291239488 DEBG dcompact_worker.cpp:2219: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-13575/att-00: fork to child time = 0.009732 sec 2024/11/20-21:15:31.407500 140008291239488 DEBG dcompact_worker.cpp:1013: Beg SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-13575/att-00 2024/11/20-21:15:31.414314 140008291239488 DEBG dcompact_worker.cpp:1033: End SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-13575/att-00 2024/11/20-21:15:31.415975 140008291239488 TRAC dcompact_worker.cpp:1083: INFO_LOG_LEVEL: rpc = INFO_LEVEL, env_var = undefined 2024/11/20-21:15:31.416213 140008291239488 [WARN] [column_family.cc:386] multiple cf_paths/db_paths and level_compaction_dynamic_level_bytes can't be used together 2024/11/20-21:15:31.464134 140008291239488 [version_set.cc:6211] Recovering from manifest file: /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-20T17.53.03/.rocksdb/job-13575/att-00/MANIFEST-049091 2024/11/20-21:15:31.482760 140008291239488 [version_set.cc:6254] Recovered from manifest file:/worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-20T17.53.03/.rocksdb/job-13575/att-00/MANIFEST-049091 succeeded,manifest_file_number is 49091, next_file_number is 71983, last_sequence is 1148068493, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 71811 2024/11/20-21:15:31.482767 140008291239488 [version_set.cc:6269] Column family [default] (ID 0), log number is 0 2024/11/20-21:15:31.482856 140008291239488 [version_set.cc:5724] Creating manifest 71983 2024/11/20-21:15:31.512693 140008291239488 DEBG dcompact_worker.cpp:1225: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-13575/att-00: bottommost_level: fake = 1, rpc = 0 2024/11/20-21:15:31.531941 140008291239488 [compaction_job.cc:2437] [default] [JOB 13575] Compacting 1@2 + 14@3 files to L3, score 0.96, subcompactions 1 : 1 2024/11/20-21:15:31.531954 140008291239488 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 10913 Base level 2, inputs: [71980(54MB)], [71976(38MB) 71977(16MB) 71765(40MB) 71766(36MB) 71912(39MB) 71913(38MB) 71914(36MB) 71915(36MB) 71916(38MB) 71917(37MB) 71918(37MB) 71919(37MB) 71920(38MB) 71921(39MB)] 2024/11/20-21:15:31.546689 140008291239488 [top_zip_table.cc:59] core git_version_hash_info_is:commit 81964c21ebbcc178d8e99dae0fbf61bded2729cc Author: rockeet Date: Mon Nov 11 21:28:46 2024 +0800 Makefile: fix gen git-version-*.cpp GIT_PATH_ARG = :!src/terark/fsa :!tools/fsa :!src/terark/zbs :!tools/zbs g++ (GCC) 12.2.1 20221121 (Red Hat 12.2.1-7) Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/zstd -Iboost-include DEFS = -DTOPLING_IO_WITH_URING=1 -DDIVSUFSORT_API= CXXFLAGS = -fPIC -time -fdiagnostics-color -mcx16 -fno-stack-protector WARNINGS = -Wno-class-memaccess -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -Wno-deprecated-declarations -Wstrict-aliasing=3 RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 LDFLAGS = -fPIC -rdynamic 2024/11/20-21:15:31.546720 140008291239488 [top_zip_table.cc:60] fsa git_version_hash_info_is:commit 5dfecb7d107196f044ff5bf78dc39d2e725b9d9b Author: leipeng Date: Thu Nov 7 15:22:45 2024 +0800 Makefile: fix for x86_64 CPU older than haswell GIT_PATH_ARG = src/terark/fsa tools/fsa g++ (GCC) 12.2.1 20221121 (Red Hat 12.2.1-7) Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/zstd -Iboost-include DEFS = -DTOPLING_IO_WITH_URING=1 -DDIVSUFSORT_API= CXXFLAGS = -fPIC -time -fdiagnostics-color -mcx16 -fno-stack-protector WARNINGS = -Wno-class-memaccess -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -Wno-deprecated-declarations -Wstrict-aliasing=3 RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 LDFLAGS = -fPIC -rdynamic 2024/11/20-21:15:31.546739 140008291239488 [top_zip_table.cc:61] zbs git_version_hash_info_is:commit d44dd5ff72707128fe3c916077b43d2093c01f7c Author: leipeng Date: Sun Oct 27 23:38:26 2024 +0800 Fix for msvc, when toplingdb on msvc GIT_PATH_ARG = src/terark/zbs tools/zbs g++ (GCC) 12.2.1 20221121 (Red Hat 12.2.1-7) Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/zstd -Iboost-include DEFS = -DTOPLING_IO_WITH_URING=1 -DDIVSUFSORT_API= CXXFLAGS = -fPIC -time -fdiagnostics-color -mcx16 -fno-stack-protector WARNINGS = -Wno-class-memaccess -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -Wno-deprecated-declarations -Wstrict-aliasing=3 RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 LDFLAGS = -fPIC -rdynamic 2024/11/20-21:15:31.546748 140008291239488 [top_zip_table.cc:62] topling-zip_table_reader: git_version_hash_info_is: commit 79614a7e7dc27362fc5151b0797eb7d83c674c7b Author: rockeet Date: Sun Nov 10 15:02:21 2024 +0800 cpu_has_bmi2.sh: detect by compile c++ code check __BMI2__ g++ (GCC) 12.2.1 20221121 (Red Hat 12.2.1-7) Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/20-21:15:31.546758 140008291239488 [top_zip_table.cc:64] topling-rocks git_version_hash_info_is: commit c46b65a52d9c74aa8b87aeb8438620ff2dbc669c Author: rockeet Date: Sun Nov 10 15:02:42 2024 +0800 cpu_has_bmi2.sh: detect by compile c++ code check __BMI2__ g++ (GCC) 12.2.1 20221121 (Red Hat 12.2.1-7) Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/20-21:15:32.344678 140008291239488 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-13575/att-00/071984.sst) /dev/shm/ToplingTemp/Topling-999838-TtlyPd 2024/11/20-21:15:32.879935 140008291239488 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-13575/att-00/071984.sst): first pass time = 0.54's, 250.785'MB/sec 2024/11/20-21:15:34.078420 140008291239488 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-13575/att-00/071984.sst): old prealloc_size = 147639500, real_size = 36544256 2024/11/20-21:15:34.079076 140008291239488 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-13575/att-00/071984.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 924214 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0346 GB avg-val = 117.22 avg-zval = 37.39 2024/11/20-21:15:34.080391 140008291239488 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-13575/att-00/071984.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-21:15:34.914985 140008291239488 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-13575/att-00/071984.sst): second pass time = 1.20's, 90.451'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.84's, 48.298'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2757.779'MB/sec (index lex order gen) rebuild zvType time = 0.70's, 0.328'MB/sec write SST data time = 0.13's, 305.508'MB/sec dict compress time = 2316861426.46's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.082'MB, throughput = 38080.414'MB/sec zip my value time = 1.20's, unzip length = 0.108'GB zip my value throughput = 90.451'MB/sec zip pipeline throughput = 90.451'MB/sec entries = 924214 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.22 avg-zval = 37.39 usrkeys = 924214 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.22 avg-zval = 37.39 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 924214 bytes = 3003712 } seq expand size = 6469498 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0346 GB dict = 1.08 MB all = 0.0404 GB } UnZip/Zip{ index = 10.5112 value = 3.1353 dict = 1.00 all = 3.3219 } Zip/UnZip{ index = 0.0951 value = 0.3189 dict = 1.00 all = 0.3010 } ---------------------------- total value len = 563.180541 GB avg = 0.331 KB (by entry num) total key len = 44.340284 GB avg = 0.026 KB total ukey len = 32.812626 GB avg = 0.014 KB total ukey num = 2.321938790 Billion total entry num = 1.701440812 Billion write speed all = 52.770234070 MB/sec (with seq num) write speed all = 51.587915031 MB/sec (without seq num) 2024/11/20-21:15:34.965634 140008291239488 [compaction_job.cc:1948] [default] [JOB 13575] Generated table #71984: 924214 keys, 40404366 bytes, temperature: kWarm 2024/11/20-21:15:34.965718 140008291239488 EVENT_LOG_v1 {"time_micros": 1732108534965677, "cf_name": "default", "job": 13575, "event": "table_file_creation", "file_number": 71984, "file_size": 40404366, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1080218058, "largest_seqno": 1146447319, "table_properties": {"data_size": 34554480, "index_size": 1758528, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25877992, "raw_average_key_size": 28, "raw_value_size": 108339748, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 924214, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732108532, "oldest_key_time": 0, "file_creation_time": 1732108532, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "6MZ3RU376XPAYLWHL32R", "orig_file_number": 71984, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-21:15:35.001736 140008291239488 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-13575/att-00/071985.sst) /dev/shm/ToplingTemp/Topling-999838-sr3pjg 2024/11/20-21:15:36.228889 140008291239488 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-13575/att-00/071985.sst): first pass time = 1.23's, 109.377'MB/sec 2024/11/20-21:15:37.445947 140008291239488 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-13575/att-00/071985.sst): old prealloc_size = 147639500, real_size = 36429488 2024/11/20-21:15:37.446558 140008291239488 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-13575/att-00/071985.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 923340 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1084 GB zip-val = 0.0344 GB avg-val = 117.36 avg-zval = 37.30 2024/11/20-21:15:37.447368 140008291239488 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-13575/att-00/071985.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-21:15:38.337029 140008291239488 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-13575/att-00/071985.sst): second pass time = 1.22's, 89.099'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.89's, 45.343'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2987.008'MB/sec (index lex order gen) rebuild zvType time = 0.76's, 0.302'MB/sec write SST data time = 0.13's, 321.270'MB/sec dict compress time = 140029.08's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.083'MB, throughput = 18652.473'MB/sec zip my value time = 1.22's, unzip length = 0.108'GB zip my value throughput = 89.099'MB/sec zip pipeline throughput = 89.099'MB/sec entries = 923340 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.36 avg-zval = 37.30 usrkeys = 923340 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.36 avg-zval = 37.30 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 923340 bytes = 3116288 } seq expand size = 6463380 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0344 GB dict = 1.08 MB all = 0.0404 GB } UnZip/Zip{ index = 10.5116 value = 3.1463 dict = 1.00 all = 3.3219 } Zip/UnZip{ index = 0.0951 value = 0.3178 dict = 1.00 all = 0.3010 } ---------------------------- total value len = 563.295369 GB avg = 0.331 KB (by entry num) total key len = 44.366138 GB avg = 0.026 KB total ukey len = 32.831093 GB avg = 0.014 KB total ukey num = 2.322862130 Billion total entry num = 1.702364152 Billion write speed all = 52.766769285 MB/sec (with seq num) write speed all = 51.584160146 MB/sec (without seq num) 2024/11/20-21:15:38.385303 140008291239488 [compaction_job.cc:1948] [default] [JOB 13575] Generated table #71985: 923340 keys, 40403680 bytes, temperature: kWarm 2024/11/20-21:15:38.385371 140008291239488 EVENT_LOG_v1 {"time_micros": 1732108538385340, "cf_name": "default", "job": 13575, "event": "table_file_creation", "file_number": 71985, "file_size": 40403680, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1079409551, "largest_seqno": 1147943666, "table_properties": {"data_size": 34441696, "index_size": 1756800, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25853520, "raw_average_key_size": 28, "raw_value_size": 108364244, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 923340, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732108534, "oldest_key_time": 0, "file_creation_time": 1732108534, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "6MZ3RU376XPAYLWHL32R", "orig_file_number": 71985, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-21:15:38.420397 140008291239488 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-13575/att-00/071986.sst) /dev/shm/ToplingTemp/Topling-999838-Iz9b9f 2024/11/20-21:15:39.527797 140008291239488 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-13575/att-00/071986.sst): first pass time = 1.11's, 121.205'MB/sec 2024/11/20-21:15:40.802616 140008291239488 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-13575/att-00/071986.sst): old prealloc_size = 147639500, real_size = 38273744 2024/11/20-21:15:40.803370 140008291239488 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-13575/att-00/071986.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 924968 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1083 GB zip-val = 0.0363 GB avg-val = 117.11 avg-zval = 39.21 2024/11/20-21:15:40.804278 140008291239488 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-13575/att-00/071986.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-21:15:41.710413 140008291239488 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-13575/att-00/071986.sst): second pass time = 1.27's, 85.033'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.91's, 46.530'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2496.779'MB/sec (index lex order gen) rebuild zvType time = 0.74's, 0.312'MB/sec write SST data time = 0.16's, 256.401'MB/sec dict compress time = 140029.08's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 31670.084'MB/sec zip my value time = 1.27's, unzip length = 0.108'GB zip my value throughput = 85.033'MB/sec zip pipeline throughput = 85.033'MB/sec entries = 924968 avg-key = 28.00 avg-zkey = 1.92 avg-val = 117.11 avg-zval = 39.21 usrkeys = 924968 avg-key = 20.00 avg-zkey = 1.92 avg-val = 123.51 avg-zval = 39.21 TagRS{ kinds = RS_Key0_TagN bytes = 144640 } TagArray{ size = 846036 bytes = 2961136 } seq expand size = 5922252 multi value expand size = 0 cnt WriteAppend = 15 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0363 GB dict = 1.08 MB all = 0.0422 GB } UnZip/Zip{ index = 10.4434 value = 2.9864 dict = 1.00 all = 3.1776 } Zip/UnZip{ index = 0.0958 value = 0.3349 dict = 1.00 all = 0.3147 } ---------------------------- total value len = 563.409610 GB avg = 0.331 KB (by entry num) total key len = 44.392037 GB avg = 0.026 KB total ukey len = 32.849592 GB avg = 0.014 KB total ukey num = 2.323787098 Billion total entry num = 1.703289120 Billion write speed all = 52.763482431 MB/sec (with seq num) write speed all = 51.580577239 MB/sec (without seq num) 2024/11/20-21:15:41.761558 140008291239488 [compaction_job.cc:1948] [default] [JOB 13575] Generated table #71986: 924968 keys, 42238994 bytes, temperature: kWarm 2024/11/20-21:15:41.761637 140008291239488 EVENT_LOG_v1 {"time_micros": 1732108541761597, "cf_name": "default", "job": 13575, "event": "table_file_creation", "file_number": 71986, "file_size": 42238994, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 1147943440, "table_properties": {"data_size": 36270912, "index_size": 1771392, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25899104, "raw_average_key_size": 28, "raw_value_size": 108318744, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 924968, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732108538, "oldest_key_time": 0, "file_creation_time": 1732108538, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "6MZ3RU376XPAYLWHL32R", "orig_file_number": 71986, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-21:15:41.836553 140008291239488 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-13575/att-00/071987.sst) /dev/shm/ToplingTemp/Topling-999838-yI29We 2024/11/20-21:15:42.929024 140008291239488 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-13575/att-00/071987.sst): first pass time = 1.09's, 122.864'MB/sec 2024/11/20-21:15:44.154010 140008291239488 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-13575/att-00/071987.sst): old prealloc_size = 147639500, real_size = 35869344 2024/11/20-21:15:44.154603 140008291239488 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-13575/att-00/071987.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 928878 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1082 GB zip-val = 0.0339 GB avg-val = 116.49 avg-zval = 36.45 2024/11/20-21:15:44.155465 140008291239488 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-13575/att-00/071987.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-21:15:45.124067 140008291239488 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-13575/att-00/071987.sst): second pass time = 1.22's, 88.396'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.97's, 41.210'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3259.891'MB/sec (index lex order gen) rebuild zvType time = 0.70's, 0.330'MB/sec write SST data time = 0.27's, 150.773'MB/sec dict compress time = 140029.08's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 32539.667'MB/sec zip my value time = 1.22's, unzip length = 0.108'GB zip my value throughput = 88.396'MB/sec zip pipeline throughput = 88.396'MB/sec entries = 928878 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.49 avg-zval = 36.45 usrkeys = 928878 avg-key = 20.00 avg-zkey = 1.91 avg-val = 123.49 avg-zval = 36.45 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 928878 bytes = 3251088 } seq expand size = 6502146 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0339 GB dict = 1.08 MB all = 0.0400 GB } UnZip/Zip{ index = 10.4445 value = 3.1959 dict = 1.00 all = 3.3577 } Zip/UnZip{ index = 0.0957 value = 0.3129 dict = 1.00 all = 0.2978 } ---------------------------- total value len = 563.524322 GB avg = 0.331 KB (by entry num) total key len = 44.418046 GB avg = 0.026 KB total ukey len = 32.868170 GB avg = 0.014 KB total ukey num = 2.324715976 Billion total entry num = 1.704217998 Billion write speed all = 52.760063608 MB/sec (with seq num) write speed all = 51.576863952 MB/sec (without seq num) 2024/11/20-21:15:45.177501 140008291239488 [compaction_job.cc:1948] [default] [JOB 13575] Generated table #71987: 928878 keys, 39973696 bytes, temperature: kWarm 2024/11/20-21:15:45.177598 140008291239488 EVENT_LOG_v1 {"time_micros": 1732108545177547, "cf_name": "default", "job": 13575, "event": "table_file_creation", "file_number": 71987, "file_size": 39973696, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 979921749, "largest_seqno": 1147944197, "table_properties": {"data_size": 33858256, "index_size": 1778688, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26008584, "raw_average_key_size": 28, "raw_value_size": 108209264, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 928878, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732108541, "oldest_key_time": 0, "file_creation_time": 1732108541, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "6MZ3RU376XPAYLWHL32R", "orig_file_number": 71987, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-21:15:45.240176 140008291239488 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-13575/att-00/071988.sst) /dev/shm/ToplingTemp/Topling-999838-SecjWg 2024/11/20-21:15:46.394609 140008291239488 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-13575/att-00/071988.sst): first pass time = 1.15's, 116.269'MB/sec 2024/11/20-21:15:47.781998 140008291239488 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-13575/att-00/071988.sst): old prealloc_size = 147639500, real_size = 35572960 2024/11/20-21:15:47.782546 140008291239488 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-13575/att-00/071988.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927933 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1082 GB zip-val = 0.0336 GB avg-val = 116.64 avg-zval = 36.17 2024/11/20-21:15:47.783340 140008291239488 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-13575/att-00/071988.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-21:15:48.843519 140008291239488 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-13575/att-00/071988.sst): second pass time = 1.39's, 78.061'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.06's, 37.266'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3430.902'MB/sec (index lex order gen) rebuild zvType time = 0.90's, 0.256'MB/sec write SST data time = 0.16's, 253.075'MB/sec dict compress time = 140029.08's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 18730.993'MB/sec zip my value time = 1.39's, unzip length = 0.108'GB zip my value throughput = 78.061'MB/sec zip pipeline throughput = 172.995'MB/sec entries = 927933 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.64 avg-zval = 36.17 usrkeys = 927933 avg-key = 20.00 avg-zkey = 1.91 avg-val = 123.64 avg-zval = 36.17 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 927933 bytes = 3131792 } seq expand size = 6495531 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0336 GB dict = 1.08 MB all = 0.0396 GB } UnZip/Zip{ index = 10.4441 value = 3.2248 dict = 1.00 all = 3.3929 } Zip/UnZip{ index = 0.0957 value = 0.3101 dict = 1.00 all = 0.2947 } ---------------------------- total value len = 563.639053 GB avg = 0.331 KB (by entry num) total key len = 44.444028 GB avg = 0.026 KB total ukey len = 32.886728 GB avg = 0.014 KB total ukey num = 2.325643909 Billion total entry num = 1.705145931 Billion write speed all = 52.755246248 MB/sec (with seq num) write speed all = 51.571784364 MB/sec (without seq num) 2024/11/20-21:15:48.893764 140008291239488 [compaction_job.cc:1948] [default] [JOB 13575] Generated table #71988: 927933 keys, 39558648 bytes, temperature: kWarm 2024/11/20-21:15:48.893824 140008291239488 EVENT_LOG_v1 {"time_micros": 1732108548893794, "cf_name": "default", "job": 13575, "event": "table_file_creation", "file_number": 71988, "file_size": 39558648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1019284544, "largest_seqno": 1147944387, "table_properties": {"data_size": 33563856, "index_size": 1776960, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25982124, "raw_average_key_size": 28, "raw_value_size": 108235658, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927933, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732108545, "oldest_key_time": 0, "file_creation_time": 1732108545, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "6MZ3RU376XPAYLWHL32R", "orig_file_number": 71988, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-21:15:48.929202 140008291239488 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-13575/att-00/071989.sst) /dev/shm/ToplingTemp/Topling-999838-3yDPlh 2024/11/20-21:15:49.783246 140008291239488 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-13575/att-00/071989.sst): first pass time = 0.85's, 157.163'MB/sec 2024/11/20-21:15:51.071524 140008291239488 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-13575/att-00/071989.sst): old prealloc_size = 147639500, real_size = 36535520 2024/11/20-21:15:51.072176 140008291239488 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-13575/att-00/071989.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927074 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.95 raw-val = 0.1083 GB zip-val = 0.0345 GB avg-val = 116.78 avg-zval = 37.21 2024/11/20-21:15:51.072861 140008291239488 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-13575/att-00/071989.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-21:15:51.955526 140008291239488 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-13575/att-00/071989.sst): second pass time = 1.29's, 84.086'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.88's, 45.307'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2882.642'MB/sec (index lex order gen) rebuild zvType time = 0.75's, 0.309'MB/sec write SST data time = 0.13's, 302.475'MB/sec dict compress time = 140029.08's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 34710.646'MB/sec zip my value time = 1.29's, unzip length = 0.108'GB zip my value throughput = 84.086'MB/sec zip pipeline throughput = 84.086'MB/sec entries = 927074 avg-key = 28.00 avg-zkey = 1.95 avg-val = 116.78 avg-zval = 37.21 usrkeys = 927074 avg-key = 20.00 avg-zkey = 1.95 avg-val = 122.19 avg-zval = 37.21 TagRS{ kinds = RS_Key0_TagN bytes = 144960 } TagArray{ size = 717608 bytes = 2511648 } seq expand size = 5023256 multi value expand size = 0 cnt WriteAppend = 46 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0345 GB dict = 1.08 MB all = 0.0401 GB } UnZip/Zip{ index = 10.2415 value = 3.1386 dict = 1.00 all = 3.3512 } Zip/UnZip{ index = 0.0976 value = 0.3186 dict = 1.00 all = 0.2984 } ---------------------------- total value len = 563.752336 GB avg = 0.330 KB (by entry num) total key len = 44.469986 GB avg = 0.026 KB total ukey len = 32.905270 GB avg = 0.014 KB total ukey num = 2.326570983 Billion total entry num = 1.706073005 Billion write speed all = 52.753083671 MB/sec (with seq num) write speed all = 51.569297956 MB/sec (without seq num) 2024/11/20-21:15:52.003647 140008291239488 [compaction_job.cc:1948] [default] [JOB 13575] Generated table #71989: 927074 keys, 40050166 bytes, temperature: kWarm 2024/11/20-21:15:52.003716 140008291239488 EVENT_LOG_v1 {"time_micros": 1732108552003683, "cf_name": "default", "job": 13575, "event": "table_file_creation", "file_number": 71989, "file_size": 40050166, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 1147944109, "table_properties": {"data_size": 34493136, "index_size": 1810432, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25958072, "raw_average_key_size": 28, "raw_value_size": 108259756, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927074, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732108548, "oldest_key_time": 0, "file_creation_time": 1732108548, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "6MZ3RU376XPAYLWHL32R", "orig_file_number": 71989, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-21:15:52.040004 140008291239488 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-13575/att-00/071990.sst) /dev/shm/ToplingTemp/Topling-999838-EKOSYe 2024/11/20-21:15:52.860715 140008291239488 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-13575/att-00/071990.sst): first pass time = 0.82's, 163.545'MB/sec 2024/11/20-21:15:54.235075 140008291239488 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-13575/att-00/071990.sst): old prealloc_size = 147639500, real_size = 36490240 2024/11/20-21:15:54.235876 140008291239488 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-13575/att-00/071990.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 926915 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.94 raw-val = 0.1083 GB zip-val = 0.0345 GB avg-val = 116.80 avg-zval = 37.18 2024/11/20-21:15:54.236236 140008291239488 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-13575/att-00/071990.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-21:15:55.250254 140008291239488 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-13575/att-00/071990.sst): second pass time = 1.37's, 78.835'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.02's, 37.679'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2316.917'MB/sec (index lex order gen) rebuild zvType time = 0.86's, 0.270'MB/sec write SST data time = 0.16's, 242.618'MB/sec dict compress time = 140029.08's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 18256.795'MB/sec zip my value time = 1.37's, unzip length = 0.108'GB zip my value throughput = 78.835'MB/sec zip pipeline throughput = 78.835'MB/sec entries = 926915 avg-key = 28.00 avg-zkey = 1.94 avg-val = 116.80 avg-zval = 37.18 usrkeys = 926915 avg-key = 20.00 avg-zkey = 1.94 avg-val = 118.56 avg-zval = 37.18 TagRS{ kinds = RS_Key0_TagN bytes = 144920 } TagArray{ size = 233373 bytes = 758480 } seq expand size = 1633611 multi value expand size = 0 cnt WriteAppend = 39 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0345 GB dict = 1.08 MB all = 0.0383 GB } UnZip/Zip{ index = 10.3075 value = 3.1418 dict = 1.00 all = 3.5088 } Zip/UnZip{ index = 0.0970 value = 0.3183 dict = 1.00 all = 0.2850 } ---------------------------- total value len = 563.862234 GB avg = 0.330 KB (by entry num) total key len = 44.495939 GB avg = 0.026 KB total ukey len = 32.923808 GB avg = 0.014 KB total ukey num = 2.327497898 Billion total entry num = 1.706999920 Billion write speed all = 52.749792610 MB/sec (with seq num) write speed all = 51.565702109 MB/sec (without seq num) 2024/11/20-21:15:55.298533 140008291239488 [compaction_job.cc:1948] [default] [JOB 13575] Generated table #71990: 926915 keys, 38251543 bytes, temperature: kWarm 2024/11/20-21:15:55.298605 140008291239488 EVENT_LOG_v1 {"time_micros": 1732108555298573, "cf_name": "default", "job": 13575, "event": "table_file_creation", "file_number": 71990, "file_size": 38251543, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 973933812, "table_properties": {"data_size": 34459824, "index_size": 1798528, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25953620, "raw_average_key_size": 28, "raw_value_size": 108264214, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 926915, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732108552, "oldest_key_time": 0, "file_creation_time": 1732108552, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "6MZ3RU376XPAYLWHL32R", "orig_file_number": 71990, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-21:15:55.338383 140008291239488 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-13575/att-00/071991.sst) /dev/shm/ToplingTemp/Topling-999838-ePAtAe 2024/11/20-21:15:56.129318 140008291239488 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-13575/att-00/071991.sst): first pass time = 0.79's, 169.704'MB/sec 2024/11/20-21:15:57.640671 140008291239488 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-13575/att-00/071991.sst): old prealloc_size = 147639500, real_size = 36510064 2024/11/20-21:15:57.641421 140008291239488 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-13575/att-00/071991.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 926884 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.96 raw-val = 0.1083 GB zip-val = 0.0345 GB avg-val = 116.81 avg-zval = 37.18 2024/11/20-21:15:57.641584 140008291239488 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-13575/att-00/071991.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-21:15:58.512232 140008291239488 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-13575/att-00/071991.sst): second pass time = 1.51's, 71.682'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.87's, 43.042'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2554.417'MB/sec (index lex order gen) rebuild zvType time = 0.72's, 0.321'MB/sec write SST data time = 0.15's, 251.100'MB/sec dict compress time = 140029.08's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 31868.779'MB/sec zip my value time = 1.51's, unzip length = 0.108'GB zip my value throughput = 71.682'MB/sec zip pipeline throughput = 71.682'MB/sec entries = 926884 avg-key = 28.00 avg-zkey = 1.96 avg-val = 116.81 avg-zval = 37.18 usrkeys = 926884 avg-key = 20.00 avg-zkey = 1.96 avg-val = 116.81 avg-zval = 37.18 TagRS{ kinds = RS_Key0_TagN bytes = 144920 } TagArray{ size = 255 bytes = 784 } seq expand size = 1785 multi value expand size = 0 cnt WriteAppend = 25 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0345 GB dict = 1.08 MB all = 0.0375 GB } UnZip/Zip{ index = 10.1786 value = 3.1420 dict = 1.00 all = 3.5778 } Zip/UnZip{ index = 0.0982 value = 0.3183 dict = 1.00 all = 0.2795 } ---------------------------- total value len = 563.970500 GB avg = 0.330 KB (by entry num) total key len = 44.521892 GB avg = 0.026 KB total ukey len = 32.942346 GB avg = 0.014 KB total ukey num = 2.328424782 Billion total entry num = 1.707926804 Billion write speed all = 52.746511697 MB/sec (with seq num) write speed all = 51.562113242 MB/sec (without seq num) 2024/11/20-21:15:58.557596 140008291239488 [compaction_job.cc:1948] [default] [JOB 13575] Generated table #71991: 926884 keys, 37513807 bytes, temperature: kWarm 2024/11/20-21:15:58.557670 140008291239488 EVENT_LOG_v1 {"time_micros": 1732108558557637, "cf_name": "default", "job": 13575, "event": "table_file_creation", "file_number": 71991, "file_size": 37513807, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 965663958, "table_properties": {"data_size": 34456928, "index_size": 1821248, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25952752, "raw_average_key_size": 28, "raw_value_size": 108265036, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 926884, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732108555, "oldest_key_time": 0, "file_creation_time": 1732108555, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "6MZ3RU376XPAYLWHL32R", "orig_file_number": 71991, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-21:15:58.598370 140008291239488 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-13575/att-00/071992.sst) /dev/shm/ToplingTemp/Topling-999838-84evXd 2024/11/20-21:15:59.413635 140008291239488 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-13575/att-00/071992.sst): first pass time = 0.82's, 164.639'MB/sec 2024/11/20-21:16:00.715312 140008291239488 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-13575/att-00/071992.sst): old prealloc_size = 147639500, real_size = 38767968 2024/11/20-21:16:00.716084 140008291239488 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-13575/att-00/071992.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 924952 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.94 raw-val = 0.1083 GB zip-val = 0.0367 GB avg-val = 117.11 avg-zval = 39.72 2024/11/20-21:16:00.716801 140008291239488 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-13575/att-00/071992.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-21:16:01.630446 140008291239488 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-13575/att-00/071992.sst): second pass time = 1.30's, 83.278'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.92's, 46.215'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2417.015'MB/sec (index lex order gen) rebuild zvType time = 0.75's, 0.310'MB/sec write SST data time = 0.17's, 250.639'MB/sec dict compress time = 140029.08's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 18153.678'MB/sec zip my value time = 1.30's, unzip length = 0.108'GB zip my value throughput = 83.278'MB/sec zip pipeline throughput = 83.278'MB/sec entries = 924952 avg-key = 28.00 avg-zkey = 1.94 avg-val = 117.11 avg-zval = 39.72 usrkeys = 924952 avg-key = 20.00 avg-zkey = 1.94 avg-val = 122.56 avg-zval = 39.72 TagRS{ kinds = RS_Key0_TagN bytes = 144640 } TagArray{ size = 720147 bytes = 2520528 } seq expand size = 5041029 multi value expand size = 0 cnt WriteAppend = 20 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0367 GB dict = 1.08 MB all = 0.0423 GB } UnZip/Zip{ index = 10.3088 value = 2.9481 dict = 1.00 all = 3.1736 } Zip/UnZip{ index = 0.0970 value = 0.3392 dict = 1.00 all = 0.3151 } ---------------------------- total value len = 564.083861 GB avg = 0.330 KB (by entry num) total key len = 44.547791 GB avg = 0.026 KB total ukey len = 32.960845 GB avg = 0.014 KB total ukey num = 2.329349734 Billion total entry num = 1.708851756 Billion write speed all = 52.744326467 MB/sec (with seq num) write speed all = 51.559606814 MB/sec (without seq num) 2024/11/20-21:16:01.680929 140008291239488 [compaction_job.cc:1948] [default] [JOB 13575] Generated table #71992: 924952 keys, 42292342 bytes, temperature: kWarm 2024/11/20-21:16:01.680995 140008291239488 EVENT_LOG_v1 {"time_micros": 1732108561680964, "cf_name": "default", "job": 13575, "event": "table_file_creation", "file_number": 71992, "file_size": 42292342, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 1147944301, "table_properties": {"data_size": 36742032, "index_size": 1794496, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25898656, "raw_average_key_size": 28, "raw_value_size": 108319212, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 924952, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732108558, "oldest_key_time": 0, "file_creation_time": 1732108558, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "6MZ3RU376XPAYLWHL32R", "orig_file_number": 71992, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-21:16:01.719559 140008291239488 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-13575/att-00/071993.sst) /dev/shm/ToplingTemp/Topling-999838-YK0Vdh 2024/11/20-21:16:02.599976 140008291239488 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-13575/att-00/071993.sst): first pass time = 0.88's, 152.455'MB/sec 2024/11/20-21:16:03.841548 140008291239488 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-13575/att-00/071993.sst): old prealloc_size = 147639500, real_size = 35368128 2024/11/20-21:16:03.842108 140008291239488 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-13575/att-00/071993.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 925101 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0334 GB avg-val = 117.08 avg-zval = 36.08 2024/11/20-21:16:03.842852 140008291239488 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-13575/att-00/071993.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-21:16:04.678172 140008291239488 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-13575/att-00/071993.sst): second pass time = 1.24's, 87.290'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.84's, 47.030'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3254.570'MB/sec (index lex order gen) rebuild zvType time = 0.71's, 0.328'MB/sec write SST data time = 0.13's, 301.007'MB/sec dict compress time = 140029.08's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 31900.481'MB/sec zip my value time = 1.24's, unzip length = 0.108'GB zip my value throughput = 87.290'MB/sec zip pipeline throughput = 87.290'MB/sec entries = 925101 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.08 avg-zval = 36.08 usrkeys = 925101 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.08 avg-zval = 36.08 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 925101 bytes = 3122224 } seq expand size = 6475707 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0334 GB dict = 1.08 MB all = 0.0393 GB } UnZip/Zip{ index = 10.5137 value = 3.2452 dict = 1.00 all = 3.4112 } Zip/UnZip{ index = 0.0951 value = 0.3081 dict = 1.00 all = 0.2931 } ---------------------------- total value len = 564.198651 GB avg = 0.330 KB (by entry num) total key len = 44.573694 GB avg = 0.026 KB total ukey len = 32.979347 GB avg = 0.014 KB total ukey num = 2.330274835 Billion total entry num = 1.709776857 Billion write speed all = 52.742588791 MB/sec (with seq num) write speed all = 51.557540772 MB/sec (without seq num) 2024/11/20-21:16:04.726117 140008291239488 [compaction_job.cc:1948] [default] [JOB 13575] Generated table #71993: 925101 keys, 39345796 bytes, temperature: kWarm 2024/11/20-21:16:04.726179 140008291239488 EVENT_LOG_v1 {"time_micros": 1732108564726149, "cf_name": "default", "job": 13575, "event": "table_file_creation", "file_number": 71993, "file_size": 39345796, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1015608320, "largest_seqno": 1147944131, "table_properties": {"data_size": 33376880, "index_size": 1759808, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25902828, "raw_average_key_size": 28, "raw_value_size": 108314982, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 925101, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732108561, "oldest_key_time": 0, "file_creation_time": 1732108561, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "6MZ3RU376XPAYLWHL32R", "orig_file_number": 71993, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-21:16:04.762940 140008291239488 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-13575/att-00/071994.sst) /dev/shm/ToplingTemp/Topling-999838-PGIiKh 2024/11/20-21:16:05.581026 140008291239488 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-13575/att-00/071994.sst): first pass time = 0.82's, 164.069'MB/sec 2024/11/20-21:16:06.776398 140008291239488 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-13575/att-00/071994.sst): old prealloc_size = 147639500, real_size = 35893472 2024/11/20-21:16:06.777063 140008291239488 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-13575/att-00/071994.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 928616 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1082 GB zip-val = 0.0339 GB avg-val = 116.54 avg-zval = 36.49 2024/11/20-21:16:06.777807 140008291239488 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-13575/att-00/071994.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-21:16:07.602502 140008291239488 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-13575/att-00/071994.sst): second pass time = 1.19's, 90.604'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.83's, 48.277'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2778.661'MB/sec (index lex order gen) rebuild zvType time = 0.70's, 0.334'MB/sec write SST data time = 0.13's, 306.598'MB/sec dict compress time = 140029.08's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 33430.270'MB/sec zip my value time = 1.19's, unzip length = 0.108'GB zip my value throughput = 90.604'MB/sec zip pipeline throughput = 90.604'MB/sec entries = 928616 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.54 avg-zval = 36.49 usrkeys = 928616 avg-key = 20.00 avg-zkey = 1.91 avg-val = 123.54 avg-zval = 36.49 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 928616 bytes = 3134096 } seq expand size = 6500312 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0339 GB dict = 1.08 MB all = 0.0399 GB } UnZip/Zip{ index = 10.4442 value = 3.1938 dict = 1.00 all = 3.3655 } Zip/UnZip{ index = 0.0957 value = 0.3131 dict = 1.00 all = 0.2971 } ---------------------------- total value len = 564.313368 GB avg = 0.330 KB (by entry num) total key len = 44.599695 GB avg = 0.026 KB total ukey len = 32.997919 GB avg = 0.014 KB total ukey num = 2.331203451 Billion total entry num = 1.710705473 Billion write speed all = 52.741417870 MB/sec (with seq num) write speed all = 51.556026554 MB/sec (without seq num) 2024/11/20-21:16:07.650884 140008291239488 [compaction_job.cc:1948] [default] [JOB 13575] Generated table #71994: 928616 keys, 39880896 bytes, temperature: kWarm 2024/11/20-21:16:07.650949 140008291239488 EVENT_LOG_v1 {"time_micros": 1732108567650918, "cf_name": "default", "job": 13575, "event": "table_file_creation", "file_number": 71994, "file_size": 39880896, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1020299496, "largest_seqno": 1147944333, "table_properties": {"data_size": 33882896, "index_size": 1778240, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26001248, "raw_average_key_size": 28, "raw_value_size": 108216568, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 928616, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732108564, "oldest_key_time": 0, "file_creation_time": 1732108564, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "6MZ3RU376XPAYLWHL32R", "orig_file_number": 71994, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-21:16:07.690767 140008291239488 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-13575/att-00/071995.sst) /dev/shm/ToplingTemp/Topling-999838-hovWRf 2024/11/20-21:16:08.506852 140008291239488 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-13575/att-00/071995.sst): first pass time = 0.82's, 164.472'MB/sec 2024/11/20-21:16:09.631565 140008291239488 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-13575/att-00/071995.sst): old prealloc_size = 147639500, real_size = 33921472 2024/11/20-21:16:09.632130 140008291239488 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-13575/att-00/071995.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 921281 prefix = 4 raw-key = 0.0147 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1084 GB zip-val = 0.0319 GB avg-val = 117.69 avg-zval = 34.67 2024/11/20-21:16:09.632884 140008291239488 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-13575/att-00/071995.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-21:16:10.479197 140008291239488 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-13575/att-00/071995.sst): second pass time = 1.12's, 96.462'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.85's, 44.838'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3216.446'MB/sec (index lex order gen) rebuild zvType time = 0.72's, 0.320'MB/sec write SST data time = 0.13's, 297.666'MB/sec dict compress time = 140029.08's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.084'MB, throughput = 33410.858'MB/sec zip my value time = 1.12's, unzip length = 0.108'GB zip my value throughput = 96.462'MB/sec zip pipeline throughput = 96.462'MB/sec entries = 921281 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.69 avg-zval = 34.67 usrkeys = 921281 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.69 avg-zval = 34.67 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 921281 bytes = 3224496 } seq expand size = 6448967 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0184 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0319 GB dict = 1.08 MB all = 0.0380 GB } UnZip/Zip{ index = 10.5150 value = 3.3947 dict = 1.00 all = 3.5316 } Zip/UnZip{ index = 0.0951 value = 0.2946 dict = 1.00 all = 0.2832 } ---------------------------- total value len = 564.428239 GB avg = 0.330 KB (by entry num) total key len = 44.625491 GB avg = 0.026 KB total ukey len = 33.016345 GB avg = 0.014 KB total ukey num = 2.332124732 Billion total entry num = 1.711626754 Billion write speed all = 52.740460640 MB/sec (with seq num) write speed all = 51.554726390 MB/sec (without seq num) 2024/11/20-21:16:10.525541 140008291239488 [compaction_job.cc:1948] [default] [JOB 13575] Generated table #71995: 921281 keys, 38005236 bytes, temperature: kWarm 2024/11/20-21:16:10.525603 140008291239488 EVENT_LOG_v1 {"time_micros": 1732108570525573, "cf_name": "default", "job": 13575, "event": "table_file_creation", "file_number": 71995, "file_size": 38005236, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 980002347, "largest_seqno": 1147943074, "table_properties": {"data_size": 31938672, "index_size": 1752320, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25795868, "raw_average_key_size": 28, "raw_value_size": 108421898, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 921281, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732108567, "oldest_key_time": 0, "file_creation_time": 1732108567, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "6MZ3RU376XPAYLWHL32R", "orig_file_number": 71995, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-21:16:10.560929 140008291239488 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-13575/att-00/071996.sst) /dev/shm/ToplingTemp/Topling-999838-EZQzfg 2024/11/20-21:16:11.372122 140008291239488 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-13575/att-00/071996.sst): first pass time = 0.81's, 165.464'MB/sec 2024/11/20-21:16:12.634180 140008291239488 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-13575/att-00/071996.sst): old prealloc_size = 147639500, real_size = 37057344 2024/11/20-21:16:12.634818 140008291239488 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-13575/att-00/071996.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 925796 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.95 raw-val = 0.1083 GB zip-val = 0.0350 GB avg-val = 116.98 avg-zval = 37.82 2024/11/20-21:16:12.635608 140008291239488 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-13575/att-00/071996.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-21:16:13.372857 140008291239488 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-13575/att-00/071996.sst): second pass time = 1.26's, 85.870'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.74's, 55.719'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2908.272'MB/sec (index lex order gen) rebuild zvType time = 0.61's, 0.380'MB/sec write SST data time = 0.13's, 318.050'MB/sec dict compress time = 140029.08's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 19770.006'MB/sec zip my value time = 1.26's, unzip length = 0.108'GB zip my value throughput = 85.870'MB/sec zip pipeline throughput = 85.870'MB/sec entries = 925796 avg-key = 28.00 avg-zkey = 1.95 avg-val = 116.98 avg-zval = 37.82 usrkeys = 925796 avg-key = 20.00 avg-zkey = 1.95 avg-val = 123.98 avg-zval = 37.82 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 925796 bytes = 3240304 } seq expand size = 6480572 multi value expand size = 0 cnt WriteAppend = 28 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0350 GB dict = 1.08 MB all = 0.0412 GB } UnZip/Zip{ index = 10.2411 value = 3.0926 dict = 1.00 all = 3.2611 } Zip/UnZip{ index = 0.0976 value = 0.3234 dict = 1.00 all = 0.3066 } ---------------------------- total value len = 564.543015 GB avg = 0.330 KB (by entry num) total key len = 44.651413 GB avg = 0.026 KB total ukey len = 33.034861 GB avg = 0.014 KB total ukey num = 2.333050528 Billion total entry num = 1.712552550 Billion write speed all = 52.739429167 MB/sec (with seq num) write speed all = 51.553350770 MB/sec (without seq num) 2024/11/20-21:16:13.421887 140008291239488 [compaction_job.cc:1948] [default] [JOB 13575] Generated table #71996: 925796 keys, 41156956 bytes, temperature: kWarm 2024/11/20-21:16:13.421950 140008291239488 EVENT_LOG_v1 {"time_micros": 1732108573421920, "cf_name": "default", "job": 13575, "event": "table_file_creation", "file_number": 71996, "file_size": 41156956, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 958816147, "largest_seqno": 1147943090, "table_properties": {"data_size": 35017712, "index_size": 1808000, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25922288, "raw_average_key_size": 28, "raw_value_size": 108295520, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 925796, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732108570, "oldest_key_time": 0, "file_creation_time": 1732108570, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "6MZ3RU376XPAYLWHL32R", "orig_file_number": 71996, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-21:16:13.457294 140008291239488 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-13575/att-00/071997.sst) /dev/shm/ToplingTemp/Topling-999838-2kjOjg 2024/11/20-21:16:13.841671 140008291239488 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-13575/att-00/071997.sst): first pass time = 0.38's, 261.514'MB/sec 2024/11/20-21:16:14.727251 140008291239488 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-13575/att-00/071997.sst): old prealloc_size = 147639500, real_size = 28303760 2024/11/20-21:16:14.727679 140008291239488 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-13575/att-00/071997.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 694698 prefix = 4 raw-key = 0.0111 GB zip-key = 0.0013 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.0811 GB zip-val = 0.0268 GB avg-val = 116.69 avg-zval = 38.58 2024/11/20-21:16:14.728322 140008291239488 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-13575/att-00/071997.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0017 GB, waited 0.000 sec, Key+Value = 0.101 GB 2024/11/20-21:16:15.332199 140008291239488 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-13575/att-00/071997.sst): second pass time = 0.88's, 91.614'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.60's, 51.729'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3300.322'MB/sec (index lex order gen) rebuild zvType time = 0.50's, 0.344'MB/sec write SST data time = 0.10's, 312.929'MB/sec dict compress time = 140029.08's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.813'MB, throughput = 12418.077'MB/sec zip my value time = 0.88's, unzip length = 0.081'GB zip my value throughput = 91.614'MB/sec zip pipeline throughput = 91.614'MB/sec entries = 694698 avg-key = 28.00 avg-zkey = 1.92 avg-val = 116.69 avg-zval = 38.58 usrkeys = 694698 avg-key = 20.00 avg-zkey = 1.92 avg-val = 123.69 avg-zval = 38.58 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 694698 bytes = 2344624 } seq expand size = 4862886 multi value expand size = 0 cnt WriteAppend = 15 UnZipSize{ index = 0.0139 GB value = 0.0811 GB dict = 0.81 MB all = 0.1005 GB } __ZipSize{ index = 0.0013 GB value = 0.0268 GB dict = 0.81 MB all = 0.0313 GB } UnZip/Zip{ index = 10.4392 value = 3.0248 dict = 1.00 all = 3.2120 } Zip/UnZip{ index = 0.0958 value = 0.3306 dict = 1.00 all = 0.3113 } ---------------------------- total value len = 564.628939 GB avg = 0.330 KB (by entry num) total key len = 44.670865 GB avg = 0.026 KB total ukey len = 33.048755 GB avg = 0.014 KB total ukey num = 2.333745226 Billion total entry num = 1.713247248 Billion write speed all = 52.739605818 MB/sec (with seq num) write speed all = 51.553247523 MB/sec (without seq num) 2024/11/20-21:16:15.371761 140008291239488 [compaction_job.cc:1948] [default] [JOB 13575] Generated table #71997: 694698 keys, 31292462 bytes, temperature: kWarm 2024/11/20-21:16:15.371830 140008291239488 EVENT_LOG_v1 {"time_micros": 1732108575371799, "cf_name": "default", "job": 13575, "event": "table_file_creation", "file_number": 71997, "file_size": 31292462, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1046399328, "largest_seqno": 1147944043, "table_properties": {"data_size": 26798976, "index_size": 1330944, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 19451544, "raw_average_key_size": 28, "raw_value_size": 81060976, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 694698, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732108573, "oldest_key_time": 0, "file_creation_time": 1732108573, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "6MZ3RU376XPAYLWHL32R", "orig_file_number": 71997, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-21:16:15.394859 140008291239488 [compaction_job.cc:703] job-13575: subcompact[0], size: 0.550369 G, files: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-13575/att-00 [071984,071985,071986,071987,071988,071989,071990,071991,071992,071993,071994,071995,071996,071997] 2024/11/20-21:16:15.775131 140008291239488 (Original Log Time 2024/11/20-21:15:31.532013) EVENT_LOG_v1 {"time_micros": 1732108531531972, "job": 13575, "event": "compaction_started", "compaction_reason": "FilesMarkedForCompaction", "files_L2": [71980], "files_L3": [71976, 71977, 71765, 71766, 71912, 71913, 71914, 71915, 71916, 71917, 71918, 71919, 71920, 71921], "score": 0.964766, "input_data_size": 592709376, "oldest_snapshot_seqno": 1148067719} 2024/11/20-21:16:15.775134 140008291239488 (Original Log Time 2024/11/20-21:16:15.772237) [compaction_job.cc:2022] [default] [JOB 13575] Compacted 1@2 + 14@3 files to L3 => 550368588 bytes 2024/11/20-21:16:15.775135 140008291239488 (Original Log Time 2024/11/20-21:16:15.775061) [compaction_job.cc:1224] [default] compacted to: files[0 0 0 14 0 0 0] max score 0.02, MB/sec: 13.5 rd, 12.5 wr, level 3, files in(1, 14) out(14 +0 blob) MB in(54.2, 511.0 +0.0 blob) out(524.9 +0.0 blob), read-write-amplify(20.1) write-amplify(9.7) OK, records in: 12874868, records dropped: 144218 output_compression: Snappy 2024/11/20-21:16:15.775139 140008291239488 (Original Log Time 2024/11/20-21:16:15.775109) EVENT_LOG_v1 {"time_micros": 1732108575775083, "cf": "default", "job": 13575, "event": "compaction_finished", "compaction_time_micros": 43862854, "compaction_time_cpu_micros": 19773055, "output_level": 3, "num_output_files": 14, "total_output_size": 550368588, "num_input_records": 12874868, "num_output_records": 12730650, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "file_write_nanos": 391786866, "file_range_sync_nanos": 0, "file_fsync_nanos": 12414, "file_prepare_write_nanos": 52060, "lsm_state": [0, 0, 0, 14, 0, 0, 0]} 2024/11/20-21:16:15.904685 140008291239488 DEBG dcompact_worker.cpp:240: HttpPost: 200 OK: url = http://nlb-7zny4kaa1poal01o64.cn-shenzhen.nlb.aliyuncs.com:8443, body = {"instanceId":"nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137","labourId":"","dbId":"d89b4006-2803-486e-b7a2-759bcf348921","dbStarts":1732096383,"starts":1732108531,"executesMs":44357,"compactionJobId":13575,"attempt":0,"compactionInputRawBytes":1865822976,"compactionInputZipBytes":592709376,"compactionOutputRawBytes":0,"compactionOutputZipBytes":550368588,"headers":{"Accept":"*/*","Connection":"close","Host":"aliyun-topling-saas.topling.cn:18443","RemoteIp":"120.24.192.169","X-Forwarded-For":"120.24.192.169","region":"cn-shenzhen","token":"e6474c481bd4415abc537135cc03626b","instance-token":"e6474c481bd4415abc537135cc03626b","provider":"aliyun","CloudMarketInstanceId":"si-59c0ae5c955845588903","MeteringAssit":"","Transfer-Encoding":"chunked","traceparent":"00-8a727cfb3f59b2562bcf742c7d0016c1-f40725523ea05d67-00"}}, response = 2024/11/20-21:16:15.904739 140008291239488 INFO dcompact_worker.cpp:1464: finish /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-20T17.53.03/.rocksdb/job-13575/att-00: olev 3, work 44.357 s, result 7.697 ms, install 2.917 ms, input{raw 1.738 GiB zip 565.252 MiB}