2024/11/20-14:03:14.882575 140257592440384 DEBG dcompact_worker.cpp:2219: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08804/att-00: fork to child time = 0.008327 sec 2024/11/20-14:03:14.883073 140257592440384 DEBG dcompact_worker.cpp:1013: Beg SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08804/att-00 2024/11/20-14:03:14.888586 140257592440384 DEBG dcompact_worker.cpp:1033: End SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08804/att-00 2024/11/20-14:03:14.890263 140257592440384 TRAC dcompact_worker.cpp:1083: INFO_LOG_LEVEL: rpc = INFO_LEVEL, env_var = undefined 2024/11/20-14:03:14.890483 140257592440384 [WARN] [column_family.cc:386] multiple cf_paths/db_paths and level_compaction_dynamic_level_bytes can't be used together 2024/11/20-14:03:14.935990 140257592440384 [version_set.cc:6211] Recovering from manifest file: /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-20T12.20.00/.rocksdb/job-08804/att-00/MANIFEST-019309 2024/11/20-14:03:14.951131 140257592440384 [version_set.cc:6254] Recovered from manifest file:/worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-20T12.20.00/.rocksdb/job-08804/att-00/MANIFEST-019309 succeeded,manifest_file_number is 19309, next_file_number is 33009, last_sequence is 604862982, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 32803 2024/11/20-14:03:14.951136 140257592440384 [version_set.cc:6269] Column family [default] (ID 0), log number is 0 2024/11/20-14:03:14.951195 140257592440384 [version_set.cc:5724] Creating manifest 33009 2024/11/20-14:03:14.984060 140257592440384 DEBG dcompact_worker.cpp:1225: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08804/att-00: bottommost_level: fake = 1, rpc = 0 2024/11/20-14:03:15.005072 140257592440384 [compaction_job.cc:2437] [default] [JOB 8804] Compacting 1@2 + 9@3 files to L3, score 0.82, subcompactions 1 : 1 2024/11/20-14:03:15.005087 140257592440384 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 7839 Base level 2, inputs: [32987(14MB)], [32972(37MB) 32973(39MB) 32974(37MB) 32975(37MB) 32976(37MB) 32977(37MB) 32978(36MB) 32979(36MB) 32999(37MB)] 2024/11/20-14:03:15.010250 140257592440384 [top_zip_table.cc:59] core git_version_hash_info_is:commit 81964c21ebbcc178d8e99dae0fbf61bded2729cc Author: rockeet Date: Mon Nov 11 21:28:46 2024 +0800 Makefile: fix gen git-version-*.cpp GIT_PATH_ARG = :!src/terark/fsa :!tools/fsa :!src/terark/zbs :!tools/zbs g++ (GCC) 12.2.1 20221121 (Red Hat 12.2.1-7) Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/zstd -Iboost-include DEFS = -DTOPLING_IO_WITH_URING=1 -DDIVSUFSORT_API= CXXFLAGS = -fPIC -time -fdiagnostics-color -mcx16 -fno-stack-protector WARNINGS = -Wno-class-memaccess -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -Wno-deprecated-declarations -Wstrict-aliasing=3 RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 LDFLAGS = -fPIC -rdynamic 2024/11/20-14:03:15.010269 140257592440384 [top_zip_table.cc:60] fsa git_version_hash_info_is:commit 5dfecb7d107196f044ff5bf78dc39d2e725b9d9b Author: leipeng Date: Thu Nov 7 15:22:45 2024 +0800 Makefile: fix for x86_64 CPU older than haswell GIT_PATH_ARG = src/terark/fsa tools/fsa g++ (GCC) 12.2.1 20221121 (Red Hat 12.2.1-7) Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/zstd -Iboost-include DEFS = -DTOPLING_IO_WITH_URING=1 -DDIVSUFSORT_API= CXXFLAGS = -fPIC -time -fdiagnostics-color -mcx16 -fno-stack-protector WARNINGS = -Wno-class-memaccess -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -Wno-deprecated-declarations -Wstrict-aliasing=3 RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 LDFLAGS = -fPIC -rdynamic 2024/11/20-14:03:15.010285 140257592440384 [top_zip_table.cc:61] zbs git_version_hash_info_is:commit d44dd5ff72707128fe3c916077b43d2093c01f7c Author: leipeng Date: Sun Oct 27 23:38:26 2024 +0800 Fix for msvc, when toplingdb on msvc GIT_PATH_ARG = src/terark/zbs tools/zbs g++ (GCC) 12.2.1 20221121 (Red Hat 12.2.1-7) Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/zstd -Iboost-include DEFS = -DTOPLING_IO_WITH_URING=1 -DDIVSUFSORT_API= CXXFLAGS = -fPIC -time -fdiagnostics-color -mcx16 -fno-stack-protector WARNINGS = -Wno-class-memaccess -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -Wno-deprecated-declarations -Wstrict-aliasing=3 RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 LDFLAGS = -fPIC -rdynamic 2024/11/20-14:03:15.010291 140257592440384 [top_zip_table.cc:62] topling-zip_table_reader: git_version_hash_info_is: commit 79614a7e7dc27362fc5151b0797eb7d83c674c7b Author: rockeet Date: Sun Nov 10 15:02:21 2024 +0800 cpu_has_bmi2.sh: detect by compile c++ code check __BMI2__ g++ (GCC) 12.2.1 20221121 (Red Hat 12.2.1-7) Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/20-14:03:15.010299 140257592440384 [top_zip_table.cc:64] topling-rocks git_version_hash_info_is: commit c46b65a52d9c74aa8b87aeb8438620ff2dbc669c Author: rockeet Date: Sun Nov 10 15:02:42 2024 +0800 cpu_has_bmi2.sh: detect by compile c++ code check __BMI2__ g++ (GCC) 12.2.1 20221121 (Red Hat 12.2.1-7) Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/20-14:03:15.443625 140257592440384 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08804/att-00/033010.sst) /dev/shm/ToplingTemp/Topling-270706-eYiG7H 2024/11/20-14:03:16.255873 140257592440384 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08804/att-00/033010.sst): first pass time = 0.81's, 165.251'MB/sec 2024/11/20-14:03:17.543590 140257592440384 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08804/att-00/033010.sst): old prealloc_size = 147639500, real_size = 35945120 2024/11/20-14:03:17.544138 140257592440384 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08804/att-00/033010.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 922596 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1084 GB zip-val = 0.0339 GB avg-val = 117.48 avg-zval = 36.80 2024/11/20-14:03:17.544926 140257592440384 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08804/att-00/033010.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-14:03:18.528751 140257592440384 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08804/att-00/033010.sst): second pass time = 1.29's, 84.229'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.99's, 40.401'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3375.293'MB/sec (index lex order gen) rebuild zvType time = 0.86's, 0.269'MB/sec write SST data time = 0.13's, 311.992'MB/sec dict compress time = 737314284.45's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.083'MB, throughput = 18112.791'MB/sec zip my value time = 1.29's, unzip length = 0.108'GB zip my value throughput = 84.229'MB/sec zip pipeline throughput = 84.229'MB/sec entries = 922596 avg-key = 28.00 avg-zkey = 1.92 avg-val = 117.48 avg-zval = 36.80 usrkeys = 922596 avg-key = 20.00 avg-zkey = 1.92 avg-val = 124.48 avg-zval = 36.80 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 922596 bytes = 2998448 } seq expand size = 6458172 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0339 GB dict = 1.08 MB all = 0.0398 GB } UnZip/Zip{ index = 10.4430 value = 3.1927 dict = 1.00 all = 3.3722 } Zip/UnZip{ index = 0.0958 value = 0.3132 dict = 1.00 all = 0.2965 } ---------------------------- total value len = 0.114843 GB avg = 0.124 KB (by entry num) total key len = 0.025833 GB avg = 0.028 KB total ukey len = 0.018452 GB avg = 0.020 KB total ukey num = 0.000922596 Billion total entry num = 0.000922596 Billion write speed all = 0.007428748 MB/sec (with seq num) write speed all = 0.007038988 MB/sec (without seq num) 2024/11/20-14:03:18.611377 140257592440384 [compaction_job.cc:1948] [default] [JOB 8804] Generated table #33010: 922596 keys, 39801608 bytes, temperature: kWarm 2024/11/20-14:03:18.611448 140257592440384 EVENT_LOG_v1 {"time_micros": 1732082598611414, "cf_name": "default", "job": 8804, "event": "table_file_creation", "file_number": 33010, "file_size": 39801608, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 542625228, "largest_seqno": 604161732, "table_properties": {"data_size": 33947344, "index_size": 1766912, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25832688, "raw_average_key_size": 28, "raw_value_size": 108385040, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 922596, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732082595, "oldest_key_time": 0, "file_creation_time": 1732082595, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "92E45FH6K6HCJOD41QCQ", "orig_file_number": 33010, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-14:03:18.653783 140257592440384 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08804/att-00/033011.sst) /dev/shm/ToplingTemp/Topling-270706-LZqckH 2024/11/20-14:03:20.080130 140257592440384 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08804/att-00/033011.sst): first pass time = 1.43's, 94.102'MB/sec 2024/11/20-14:03:21.456883 140257592440384 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08804/att-00/033011.sst): old prealloc_size = 147639500, real_size = 37127936 2024/11/20-14:03:21.457653 140257592440384 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08804/att-00/033011.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 925834 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.97 raw-val = 0.1083 GB zip-val = 0.0351 GB avg-val = 116.97 avg-zval = 37.89 2024/11/20-14:03:21.458486 140257592440384 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08804/att-00/033011.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-14:03:22.295330 140257592440384 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08804/att-00/033011.sst): second pass time = 1.38's, 78.707'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.84's, 48.898'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2460.560'MB/sec (index lex order gen) rebuild zvType time = 0.68's, 0.341'MB/sec write SST data time = 0.16's, 256.877'MB/sec dict compress time = 737314284.45's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 29786.084'MB/sec zip my value time = 1.38's, unzip length = 0.108'GB zip my value throughput = 78.707'MB/sec zip pipeline throughput = 78.707'MB/sec entries = 925834 avg-key = 28.00 avg-zkey = 1.97 avg-val = 116.97 avg-zval = 37.89 usrkeys = 925834 avg-key = 20.00 avg-zkey = 1.97 avg-val = 123.39 avg-zval = 37.89 TagRS{ kinds = RS_Key0_TagN bytes = 144760 } TagArray{ size = 849261 bytes = 2866272 } seq expand size = 5944827 multi value expand size = 0 cnt WriteAppend = 43 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0351 GB dict = 1.08 MB all = 0.0410 GB } UnZip/Zip{ index = 10.1753 value = 3.0874 dict = 1.00 all = 3.2738 } Zip/UnZip{ index = 0.0983 value = 0.3239 dict = 1.00 all = 0.3055 } ---------------------------- total value len = 0.229082 GB avg = 0.124 KB (by entry num) total key len = 0.051756 GB avg = 0.028 KB total ukey len = 0.036969 GB avg = 0.020 KB total ukey num = 0.001848430 Billion total entry num = 0.001848430 Billion write speed all = 0.014827440 MB/sec (with seq num) write speed all = 0.014046707 MB/sec (without seq num) 2024/11/20-14:03:22.344443 140257592440384 [compaction_job.cc:1948] [default] [JOB 8804] Generated table #33011: 925834 keys, 40997784 bytes, temperature: kWarm 2024/11/20-14:03:22.344507 140257592440384 EVENT_LOG_v1 {"time_micros": 1732082602344477, "cf_name": "default", "job": 8804, "event": "table_file_creation", "file_number": 33011, "file_size": 40997784, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 604161313, "table_properties": {"data_size": 35076528, "index_size": 1819776, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25923352, "raw_average_key_size": 28, "raw_value_size": 108294400, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 925834, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732082598, "oldest_key_time": 0, "file_creation_time": 1732082598, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "92E45FH6K6HCJOD41QCQ", "orig_file_number": 33011, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-14:03:22.377879 140257592440384 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08804/att-00/033012.sst) /dev/shm/ToplingTemp/Topling-270706-sl8wAG 2024/11/20-14:03:23.263305 140257592440384 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08804/att-00/033012.sst): first pass time = 0.89's, 151.592'MB/sec 2024/11/20-14:03:24.419185 140257592440384 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08804/att-00/033012.sst): old prealloc_size = 147639500, real_size = 35420800 2024/11/20-14:03:24.419700 140257592440384 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08804/att-00/033012.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 922999 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1084 GB zip-val = 0.0334 GB avg-val = 117.41 avg-zval = 36.21 2024/11/20-14:03:24.420432 140257592440384 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08804/att-00/033012.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-14:03:25.245789 140257592440384 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08804/att-00/033012.sst): second pass time = 1.16's, 93.825'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.83's, 47.519'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3599.501'MB/sec (index lex order gen) rebuild zvType time = 0.71's, 0.327'MB/sec write SST data time = 0.12's, 325.164'MB/sec dict compress time = 737314284.45's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.083'MB, throughput = 35587.340'MB/sec zip my value time = 1.16's, unzip length = 0.108'GB zip my value throughput = 93.825'MB/sec zip pipeline throughput = 93.825'MB/sec entries = 922999 avg-key = 28.00 avg-zkey = 1.91 avg-val = 117.41 avg-zval = 36.21 usrkeys = 922999 avg-key = 20.00 avg-zkey = 1.91 avg-val = 124.41 avg-zval = 36.21 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 922999 bytes = 2999760 } seq expand size = 6460993 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0334 GB dict = 1.08 MB all = 0.0393 GB } UnZip/Zip{ index = 10.4442 value = 3.2426 dict = 1.00 all = 3.4171 } Zip/UnZip{ index = 0.0957 value = 0.3084 dict = 1.00 all = 0.2926 } ---------------------------- total value len = 0.343917 GB avg = 0.124 KB (by entry num) total key len = 0.077600 GB avg = 0.028 KB total ukey len = 0.055429 GB avg = 0.020 KB total ukey num = 0.002771429 Billion total entry num = 0.002771429 Billion write speed all = 0.022251397 MB/sec (with seq num) write speed all = 0.021080994 MB/sec (without seq num) 2024/11/20-14:03:25.292335 140257592440384 [compaction_job.cc:1948] [default] [JOB 8804] Generated table #33012: 922999 keys, 39278480 bytes, temperature: kWarm 2024/11/20-14:03:25.292397 140257592440384 EVENT_LOG_v1 {"time_micros": 1732082605292368, "cf_name": "default", "job": 8804, "event": "table_file_creation", "file_number": 33012, "file_size": 39278480, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 542625312, "largest_seqno": 604161764, "table_properties": {"data_size": 33422384, "index_size": 1767488, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25843972, "raw_average_key_size": 28, "raw_value_size": 108373838, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 922999, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732082602, "oldest_key_time": 0, "file_creation_time": 1732082602, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "92E45FH6K6HCJOD41QCQ", "orig_file_number": 33012, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-14:03:25.327141 140257592440384 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08804/att-00/033013.sst) /dev/shm/ToplingTemp/Topling-270706-UAFsRG 2024/11/20-14:03:26.121536 140257592440384 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08804/att-00/033013.sst): first pass time = 0.79's, 168.963'MB/sec 2024/11/20-14:03:27.237498 140257592440384 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08804/att-00/033013.sst): old prealloc_size = 147639500, real_size = 35204224 2024/11/20-14:03:27.238042 140257592440384 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08804/att-00/033013.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 921966 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1084 GB zip-val = 0.0332 GB avg-val = 117.58 avg-zval = 36.03 2024/11/20-14:03:27.238771 140257592440384 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08804/att-00/033013.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-14:03:28.063208 140257592440384 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08804/att-00/033013.sst): second pass time = 1.12's, 97.207'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.83's, 47.305'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3239.379'MB/sec (index lex order gen) rebuild zvType time = 0.71's, 0.327'MB/sec write SST data time = 0.12's, 326.605'MB/sec dict compress time = 737314284.45's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.083'MB, throughput = 35902.306'MB/sec zip my value time = 1.12's, unzip length = 0.108'GB zip my value throughput = 97.207'MB/sec zip pipeline throughput = 97.207'MB/sec entries = 921966 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.58 avg-zval = 36.03 usrkeys = 921966 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.58 avg-zval = 36.03 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 921966 bytes = 2996400 } seq expand size = 6453762 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0184 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0332 GB dict = 1.08 MB all = 0.0391 GB } UnZip/Zip{ index = 10.5147 value = 3.2632 dict = 1.00 all = 3.4363 } Zip/UnZip{ index = 0.0951 value = 0.3064 dict = 1.00 all = 0.2910 } ---------------------------- total value len = 0.458774 GB avg = 0.124 KB (by entry num) total key len = 0.103415 GB avg = 0.028 KB total ukey len = 0.073868 GB avg = 0.020 KB total ukey num = 0.003693395 Billion total entry num = 0.003693395 Billion write speed all = 0.029672872 MB/sec (with seq num) write speed all = 0.028113344 MB/sec (without seq num) 2024/11/20-14:03:28.110678 140257592440384 [compaction_job.cc:1948] [default] [JOB 8804] Generated table #33013: 921966 keys, 39059340 bytes, temperature: kWarm 2024/11/20-14:03:28.110736 140257592440384 EVENT_LOG_v1 {"time_micros": 1732082608110708, "cf_name": "default", "job": 8804, "event": "table_file_creation", "file_number": 33013, "file_size": 39059340, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 542625359, "largest_seqno": 604160855, "table_properties": {"data_size": 33219888, "index_size": 1753664, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25815048, "raw_average_key_size": 28, "raw_value_size": 108402800, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 921966, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732082605, "oldest_key_time": 0, "file_creation_time": 1732082605, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "92E45FH6K6HCJOD41QCQ", "orig_file_number": 33013, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-14:03:28.144647 140257592440384 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08804/att-00/033014.sst) /dev/shm/ToplingTemp/Topling-270706-vctp0I 2024/11/20-14:03:28.937197 140257592440384 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08804/att-00/033014.sst): first pass time = 0.79's, 169.355'MB/sec 2024/11/20-14:03:30.047010 140257592440384 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08804/att-00/033014.sst): old prealloc_size = 147639500, real_size = 35555312 2024/11/20-14:03:30.047551 140257592440384 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08804/att-00/033014.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 922641 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1084 GB zip-val = 0.0336 GB avg-val = 117.47 avg-zval = 36.37 2024/11/20-14:03:30.048293 140257592440384 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08804/att-00/033014.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-14:03:30.870749 140257592440384 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08804/att-00/033014.sst): second pass time = 1.11's, 97.727'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.82's, 47.847'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3375.914'MB/sec (index lex order gen) rebuild zvType time = 0.70's, 0.328'MB/sec write SST data time = 0.12's, 326.142'MB/sec dict compress time = 737314284.45's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.083'MB, throughput = 34922.561'MB/sec zip my value time = 1.11's, unzip length = 0.108'GB zip my value throughput = 97.727'MB/sec zip pipeline throughput = 97.727'MB/sec entries = 922641 avg-key = 28.00 avg-zkey = 1.91 avg-val = 117.47 avg-zval = 36.37 usrkeys = 922641 avg-key = 20.00 avg-zkey = 1.91 avg-val = 124.47 avg-zval = 36.37 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 922641 bytes = 2998592 } seq expand size = 6458487 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0185 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0336 GB dict = 1.08 MB all = 0.0394 GB } UnZip/Zip{ index = 10.4454 value = 3.2298 dict = 1.00 all = 3.4055 } Zip/UnZip{ index = 0.0957 value = 0.3096 dict = 1.00 all = 0.2936 } ---------------------------- total value len = 0.573616 GB avg = 0.124 KB (by entry num) total key len = 0.129249 GB avg = 0.028 KB total ukey len = 0.092321 GB avg = 0.020 KB total ukey num = 0.004616036 Billion total entry num = 0.004616036 Billion write speed all = 0.037092405 MB/sec (with seq num) write speed all = 0.035143583 MB/sec (without seq num) 2024/11/20-14:03:30.918554 140257592440384 [compaction_job.cc:1948] [default] [JOB 8804] Generated table #33014: 922641 keys, 39412204 bytes, temperature: kWarm 2024/11/20-14:03:30.918612 140257592440384 EVENT_LOG_v1 {"time_micros": 1732082610918584, "cf_name": "default", "job": 8804, "event": "table_file_creation", "file_number": 33014, "file_size": 39412204, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 542625392, "largest_seqno": 604161335, "table_properties": {"data_size": 33557856, "index_size": 1766592, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25833948, "raw_average_key_size": 28, "raw_value_size": 108383850, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 922641, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732082608, "oldest_key_time": 0, "file_creation_time": 1732082608, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "92E45FH6K6HCJOD41QCQ", "orig_file_number": 33014, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-14:03:30.952209 140257592440384 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08804/att-00/033015.sst) /dev/shm/ToplingTemp/Topling-270706-LoxeDI 2024/11/20-14:03:31.742638 140257592440384 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08804/att-00/033015.sst): first pass time = 0.79's, 169.811'MB/sec 2024/11/20-14:03:32.977647 140257592440384 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08804/att-00/033015.sst): old prealloc_size = 147639500, real_size = 36456880 2024/11/20-14:03:32.978207 140257592440384 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08804/att-00/033015.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 925706 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1083 GB zip-val = 0.0345 GB avg-val = 116.99 avg-zval = 37.22 2024/11/20-14:03:32.978806 140257592440384 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08804/att-00/033015.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-14:03:33.727013 140257592440384 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08804/att-00/033015.sst): second pass time = 1.23's, 87.756'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.75's, 52.914'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3360.887'MB/sec (index lex order gen) rebuild zvType time = 0.63's, 0.369'MB/sec write SST data time = 0.12's, 325.018'MB/sec dict compress time = 737314284.45's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 19007.760'MB/sec zip my value time = 1.23's, unzip length = 0.108'GB zip my value throughput = 87.756'MB/sec zip pipeline throughput = 87.756'MB/sec entries = 925706 avg-key = 28.00 avg-zkey = 1.92 avg-val = 116.99 avg-zval = 37.22 usrkeys = 925706 avg-key = 20.00 avg-zkey = 1.92 avg-val = 121.90 avg-zval = 37.22 TagRS{ kinds = RS_Key0_TagN bytes = 144760 } TagArray{ size = 649291 bytes = 2191376 } seq expand size = 4545037 multi value expand size = 0 cnt WriteAppend = 16 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0345 GB dict = 1.08 MB all = 0.0397 GB } UnZip/Zip{ index = 10.4412 value = 3.1434 dict = 1.00 all = 3.3849 } Zip/UnZip{ index = 0.0958 value = 0.3181 dict = 1.00 all = 0.2954 } ---------------------------- total value len = 0.686459 GB avg = 0.124 KB (by entry num) total key len = 0.155169 GB avg = 0.028 KB total ukey len = 0.110835 GB avg = 0.020 KB total ukey num = 0.005541742 Billion total entry num = 0.005541742 Billion write speed all = 0.044408661 MB/sec (with seq num) write speed all = 0.042069372 MB/sec (without seq num) 2024/11/20-14:03:33.774241 140257592440384 [compaction_job.cc:1948] [default] [JOB 8804] Generated table #33015: 925706 keys, 39651382 bytes, temperature: kWarm 2024/11/20-14:03:33.774302 140257592440384 EVENT_LOG_v1 {"time_micros": 1732082613774272, "cf_name": "default", "job": 8804, "event": "table_file_creation", "file_number": 33015, "file_size": 39651382, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 604160908, "table_properties": {"data_size": 34452064, "index_size": 1773184, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25919768, "raw_average_key_size": 28, "raw_value_size": 108298004, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 925706, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732082610, "oldest_key_time": 0, "file_creation_time": 1732082610, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "92E45FH6K6HCJOD41QCQ", "orig_file_number": 33015, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-14:03:33.807516 140257592440384 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08804/att-00/033016.sst) /dev/shm/ToplingTemp/Topling-270706-eS2EsK 2024/11/20-14:03:34.557524 140257592440384 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08804/att-00/033016.sst): first pass time = 0.75's, 178.962'MB/sec 2024/11/20-14:03:35.822159 140257592440384 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08804/att-00/033016.sst): old prealloc_size = 147639500, real_size = 36323728 2024/11/20-14:03:35.822668 140257592440384 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08804/att-00/033016.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 926964 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0343 GB avg-val = 116.79 avg-zval = 37.03 2024/11/20-14:03:35.822863 140257592440384 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08804/att-00/033016.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-14:03:36.508278 140257592440384 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08804/att-00/033016.sst): second pass time = 1.26's, 85.664'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.69's, 54.753'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3632.785'MB/sec (index lex order gen) rebuild zvType time = 0.57's, 0.408'MB/sec write SST data time = 0.12's, 319.372'MB/sec dict compress time = 737314284.45's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 34813.042'MB/sec zip my value time = 1.26's, unzip length = 0.108'GB zip my value throughput = 85.664'MB/sec zip pipeline throughput = 85.664'MB/sec entries = 926964 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.79 avg-zval = 37.03 usrkeys = 926964 avg-key = 20.00 avg-zkey = 1.90 avg-val = 117.59 avg-zval = 37.03 TagRS{ kinds = RS_Key0_TagN bytes = 144920 } TagArray{ size = 105735 bytes = 237920 } seq expand size = 740145 multi value expand size = 0 cnt WriteAppend = 15 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0343 GB dict = 1.08 MB all = 0.0376 GB } UnZip/Zip{ index = 10.5100 value = 3.1538 dict = 1.00 all = 3.5729 } Zip/UnZip{ index = 0.0951 value = 0.3171 dict = 1.00 all = 0.2799 } ---------------------------- total value len = 0.795462 GB avg = 0.123 KB (by entry num) total key len = 0.181124 GB avg = 0.028 KB total ukey len = 0.129374 GB avg = 0.020 KB total ukey num = 0.006468706 Billion total entry num = 0.006468706 Billion write speed all = 0.051522181 MB/sec (with seq num) write speed all = 0.048792001 MB/sec (without seq num) 2024/11/20-14:03:36.553121 140257592440384 [compaction_job.cc:1948] [default] [JOB 8804] Generated table #33016: 926964 keys, 37565825 bytes, temperature: kWarm 2024/11/20-14:03:36.553178 140257592440384 EVENT_LOG_v1 {"time_micros": 1732082616553150, "cf_name": "default", "job": 8804, "event": "table_file_creation", "file_number": 33016, "file_size": 37565825, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 521746379, "table_properties": {"data_size": 34327808, "index_size": 1763968, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25954992, "raw_average_key_size": 28, "raw_value_size": 108262796, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 926964, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732082613, "oldest_key_time": 0, "file_creation_time": 1732082613, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "92E45FH6K6HCJOD41QCQ", "orig_file_number": 33016, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-14:03:36.615076 140257592440384 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08804/att-00/033017.sst) /dev/shm/ToplingTemp/Topling-270706-j623SJ 2024/11/20-14:03:37.381208 140257592440384 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08804/att-00/033017.sst): first pass time = 0.77's, 175.197'MB/sec 2024/11/20-14:03:38.680747 140257592440384 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08804/att-00/033017.sst): old prealloc_size = 147639500, real_size = 36391120 2024/11/20-14:03:38.681290 140257592440384 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08804/att-00/033017.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 926466 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.89 raw-val = 0.1083 GB zip-val = 0.0344 GB avg-val = 116.87 avg-zval = 37.14 2024/11/20-14:03:38.681703 140257592440384 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08804/att-00/033017.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-14:03:39.370618 140257592440384 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08804/att-00/033017.sst): second pass time = 1.30's, 83.370'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.69's, 56.179'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3457.069'MB/sec (index lex order gen) rebuild zvType time = 0.57's, 0.407'MB/sec write SST data time = 0.12's, 321.291'MB/sec dict compress time = 737314284.45's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 32874.715'MB/sec zip my value time = 1.30's, unzip length = 0.108'GB zip my value throughput = 83.370'MB/sec zip pipeline throughput = 83.370'MB/sec entries = 926466 avg-key = 28.00 avg-zkey = 1.89 avg-val = 116.87 avg-zval = 37.14 usrkeys = 926466 avg-key = 20.00 avg-zkey = 1.89 avg-val = 120.30 avg-zval = 37.14 TagRS{ kinds = RS_Key0_TagN bytes = 144880 } TagArray{ size = 453684 bytes = 1361072 } seq expand size = 3175788 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0344 GB dict = 1.08 MB all = 0.0388 GB } UnZip/Zip{ index = 10.5819 value = 3.1468 dict = 1.00 all = 3.4632 } Zip/UnZip{ index = 0.0945 value = 0.3178 dict = 1.00 all = 0.2887 } ---------------------------- total value len = 0.906915 GB avg = 0.123 KB (by entry num) total key len = 0.207065 GB avg = 0.028 KB total ukey len = 0.147903 GB avg = 0.020 KB total ukey num = 0.007395172 Billion total entry num = 0.007395172 Billion write speed all = 0.058761845 MB/sec (with seq num) write speed all = 0.055641113 MB/sec (without seq num) 2024/11/20-14:03:39.416529 140257592440384 [compaction_job.cc:1948] [default] [JOB 8804] Generated table #33017: 926466 keys, 38755255 bytes, temperature: kWarm 2024/11/20-14:03:39.416593 140257592440384 EVENT_LOG_v1 {"time_micros": 1732082619416562, "cf_name": "default", "job": 8804, "event": "table_file_creation", "file_number": 33017, "file_size": 38755255, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 531166771, "table_properties": {"data_size": 34408256, "index_size": 1751040, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25941048, "raw_average_key_size": 28, "raw_value_size": 108276804, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 926466, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732082616, "oldest_key_time": 0, "file_creation_time": 1732082616, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "92E45FH6K6HCJOD41QCQ", "orig_file_number": 33017, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-14:03:39.449819 140257592440384 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08804/att-00/033018.sst) /dev/shm/ToplingTemp/Topling-270706-OmRuKH 2024/11/20-14:03:40.223881 140257592440384 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08804/att-00/033018.sst): first pass time = 0.77's, 173.401'MB/sec 2024/11/20-14:03:41.481211 140257592440384 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08804/att-00/033018.sst): old prealloc_size = 147639500, real_size = 37493312 2024/11/20-14:03:41.481709 140257592440384 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08804/att-00/033018.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 925411 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0017 GB avg-key = 16.00 avg-zkey = 1.89 raw-val = 0.1083 GB zip-val = 0.0355 GB avg-val = 117.04 avg-zval = 38.37 2024/11/20-14:03:41.482029 140257592440384 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08804/att-00/033018.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-14:03:42.185970 140257592440384 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08804/att-00/033018.sst): second pass time = 1.26's, 86.194'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.70's, 55.717'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3685.938'MB/sec (index lex order gen) rebuild zvType time = 0.59's, 0.395'MB/sec write SST data time = 0.12's, 331.079'MB/sec dict compress time = 737314284.45's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 32208.728'MB/sec zip my value time = 1.26's, unzip length = 0.108'GB zip my value throughput = 86.194'MB/sec zip pipeline throughput = 86.194'MB/sec entries = 925411 avg-key = 28.00 avg-zkey = 1.89 avg-val = 117.04 avg-zval = 38.37 usrkeys = 925411 avg-key = 20.00 avg-zkey = 1.89 avg-val = 118.98 avg-zval = 38.37 TagRS{ kinds = RS_Key0_TagN bytes = 144680 } TagArray{ size = 256530 bytes = 769600 } seq expand size = 1795710 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0017 GB value = 0.0355 GB dict = 1.08 MB all = 0.0393 GB } UnZip/Zip{ index = 10.5811 value = 3.0498 dict = 1.00 all = 3.4181 } Zip/UnZip{ index = 0.0945 value = 0.3279 dict = 1.00 all = 0.2926 } ---------------------------- total value len = 1.017017 GB avg = 0.122 KB (by entry num) total key len = 0.232976 GB avg = 0.028 KB total ukey len = 0.166412 GB avg = 0.020 KB total ukey num = 0.008320583 Billion total entry num = 0.008320583 Billion write speed all = 0.065926697 MB/sec (with seq num) write speed all = 0.062415967 MB/sec (without seq num) 2024/11/20-14:03:42.232183 140257592440384 [compaction_job.cc:1948] [default] [JOB 8804] Generated table #33018: 925411 keys, 39266217 bytes, temperature: kWarm 2024/11/20-14:03:42.232247 140257592440384 EVENT_LOG_v1 {"time_micros": 1732082622232217, "cf_name": "default", "job": 8804, "event": "table_file_creation", "file_number": 33018, "file_size": 39266217, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 604161799, "table_properties": {"data_size": 35512560, "index_size": 1749184, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25911508, "raw_average_key_size": 28, "raw_value_size": 108306306, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 925411, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732082619, "oldest_key_time": 0, "file_creation_time": 1732082619, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "92E45FH6K6HCJOD41QCQ", "orig_file_number": 33018, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-14:03:42.264724 140257592440384 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08804/att-00/033019.sst) /dev/shm/ToplingTemp/Topling-270706-wCbHQG 2024/11/20-14:03:42.302315 140257592440384 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08804/att-00/033019.sst): first pass time = 0.04's, 252.112'MB/sec 2024/11/20-14:03:42.377801 140257592440384 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08804/att-00/033019.sst): old prealloc_size = 147639500, real_size = 2869168 2024/11/20-14:03:42.377885 140257592440384 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08804/att-00/033019.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 65206 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0001 GB avg-key = 16.00 avg-zkey = 1.93 raw-val = 0.0076 GB zip-val = 0.0027 GB avg-val = 117.19 avg-zval = 41.82 2024/11/20-14:03:42.377951 140257592440384 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08804/att-00/033019.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0001 GB, waited 0.000 sec, Key+Value = 0.009 GB 2024/11/20-14:03:42.430254 140257592440384 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08804/att-00/033019.sst): second pass time = 0.07's, 101.971'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.05's, 58.659'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1907.314'MB/sec (index lex order gen) rebuild zvType time = 0.04's, 0.375'MB/sec write SST data time = 0.01's, 345.605'MB/sec dict compress time = 737314284.45's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.078'MB, throughput = 2410.889'MB/sec zip my value time = 0.07's, unzip length = 0.008'GB zip my value throughput = 101.971'MB/sec zip pipeline throughput = 101.971'MB/sec entries = 65206 avg-key = 28.00 avg-zkey = 1.93 avg-val = 117.19 avg-zval = 41.82 usrkeys = 65206 avg-key = 20.00 avg-zkey = 1.93 avg-val = 121.96 avg-zval = 41.82 TagRS{ kinds = RS_Key0_TagN bytes = 10280 } TagArray{ size = 44399 bytes = 133216 } seq expand size = 310793 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0013 GB value = 0.0076 GB dict = 0.08 MB all = 0.0095 GB } __ZipSize{ index = 0.0001 GB value = 0.0027 GB dict = 0.08 MB all = 0.0031 GB } UnZip/Zip{ index = 10.3858 value = 2.8020 dict = 1.00 all = 3.0776 } Zip/UnZip{ index = 0.0963 value = 0.3569 dict = 1.00 all = 0.3249 } ---------------------------- total value len = 1.024969 GB avg = 0.122 KB (by entry num) total key len = 0.234802 GB avg = 0.028 KB total ukey len = 0.167716 GB avg = 0.020 KB total ukey num = 0.008385789 Billion total entry num = 0.008385789 Billion write speed all = 0.066441551 MB/sec (with seq num) write speed all = 0.062903354 MB/sec (without seq num) 2024/11/20-14:03:42.440335 140257592440384 [compaction_job.cc:1948] [default] [JOB 8804] Generated table #33019: 65206 keys, 3076168 bytes, temperature: kWarm 2024/11/20-14:03:42.440383 140257592440384 EVENT_LOG_v1 {"time_micros": 1732082622440358, "cf_name": "default", "job": 8804, "event": "table_file_creation", "file_number": 33019, "file_size": 3076168, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 604161641, "table_properties": {"data_size": 2727136, "index_size": 125568, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 1825768, "raw_average_key_size": 28, "raw_value_size": 7641472, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 65206, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732082622, "oldest_key_time": 0, "file_creation_time": 1732082622, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "92E45FH6K6HCJOD41QCQ", "orig_file_number": 33019, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-14:03:42.452078 140257592440384 [compaction_job.cc:703] job-08804: subcompact[0], size: 0.356864 G, files: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08804/att-00 [033010,033011,033012,033013,033014,033015,033016,033017,033018,033019] 2024/11/20-14:03:42.512967 140257592440384 (Original Log Time 2024/11/20-14:03:15.005126) EVENT_LOG_v1 {"time_micros": 1732082595005099, "job": 8804, "event": "compaction_started", "compaction_reason": "FilesMarkedForCompaction", "files_L2": [32987], "files_L3": [32972, 32973, 32974, 32975, 32976, 32977, 32978, 32979, 32999], "score": 0.822253, "input_data_size": 368860545, "oldest_snapshot_seqno": 604862867} 2024/11/20-14:03:42.512970 140257592440384 (Original Log Time 2024/11/20-14:03:42.512060) [compaction_job.cc:2022] [default] [JOB 8804] Compacted 1@2 + 9@3 files to L3 => 356864263 bytes 2024/11/20-14:03:42.512972 140257592440384 (Original Log Time 2024/11/20-14:03:42.512902) [compaction_job.cc:1224] [default] compacted to: files[0 0 0 10 0 0 0] max score 0.01, MB/sec: 13.4 rd, 13.0 wr, level 3, files in(1, 9) out(10 +0 blob) MB in(14.3, 337.4 +0.0 blob) out(340.3 +0.0 blob), read-write-amplify(48.3) write-amplify(23.7) OK, records in: 8443841, records dropped: 58052 output_compression: Snappy 2024/11/20-14:03:42.512975 140257592440384 (Original Log Time 2024/11/20-14:03:42.512946) EVENT_LOG_v1 {"time_micros": 1732082622512924, "cf": "default", "job": 8804, "event": "compaction_finished", "compaction_time_micros": 27446956, "compaction_time_cpu_micros": 12352886, "output_level": 3, "num_output_files": 10, "total_output_size": 356864263, "num_input_records": 8443841, "num_output_records": 8385789, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "file_write_nanos": 230286452, "file_range_sync_nanos": 0, "file_fsync_nanos": 8504, "file_prepare_write_nanos": 23128, "lsm_state": [0, 0, 0, 10, 0, 0, 0]} 2024/11/20-14:03:42.639812 140257592440384 DEBG dcompact_worker.cpp:240: HttpPost: 200 OK: url = http://nlb-7zny4kaa1poal01o64.cn-shenzhen.nlb.aliyuncs.com:8443, body = {"instanceId":"nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137","labourId":"","dbId":"d89b4006-2803-486e-b7a2-759bcf348921","dbStarts":1732076400,"starts":1732082594,"executesMs":27621,"compactionJobId":8804,"attempt":0,"compactionInputRawBytes":1225670786,"compactionInputZipBytes":368860545,"compactionOutputRawBytes":0,"compactionOutputZipBytes":356864263,"headers":{"Accept":"*/*","Connection":"close","Host":"aliyun-topling-saas.topling.cn:18443","RemoteIp":"120.24.192.169","X-Forwarded-For":"120.24.192.169","region":"cn-shenzhen","token":"e6474c481bd4415abc537135cc03626b","instance-token":"e6474c481bd4415abc537135cc03626b","provider":"aliyun","CloudMarketInstanceId":"si-59c0ae5c955845588903","MeteringAssit":"","Transfer-Encoding":"chunked","traceparent":"00-7270da623c5e64789801bbf16f02ad86-28611944e2731033-00"}}, response = 2024/11/20-14:03:42.639868 140257592440384 INFO dcompact_worker.cpp:1464: finish /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-20T12.20.00/.rocksdb/job-08804/att-00: olev 3, work 27.622 s, result 7.632 ms, install 0.942 ms, input{raw 1.141 GiB zip 351.773 MiB}