2024/11/23-01:18:44.276155 140024726648384 DEBG dcompact_worker.cpp:2214: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-16202/att-00: fork to child time = 0.008872 sec 2024/11/23-01:18:44.277068 140024726648384 DEBG dcompact_worker.cpp:1013: Beg SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-16202/att-00 2024/11/23-01:18:44.284331 140024726648384 DEBG dcompact_worker.cpp:1033: End SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-16202/att-00 2024/11/23-01:18:44.285458 140024726648384 TRAC dcompact_worker.cpp:1083: INFO_LOG_LEVEL: rpc = INFO_LEVEL, env_var = undefined 2024/11/23-01:18:44.285777 140024726648384 [WARN] [column_family.cc:386] multiple cf_paths/db_paths and level_compaction_dynamic_level_bytes can't be used together 2024/11/23-01:18:44.340124 140024726648384 [version_set.cc:6208] Recovering from manifest file: /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-16202/att-00/MANIFEST-206347 2024/11/23-01:18:44.368570 140024726648384 [version_set.cc:6251] Recovered from manifest file:/worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-16202/att-00/MANIFEST-206347 succeeded,manifest_file_number is 206347, next_file_number is 238322, last_sequence is 3701291715, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 238107 2024/11/23-01:18:44.368581 140024726648384 [version_set.cc:6266] Column family [default] (ID 0), log number is 0 2024/11/23-01:18:44.368716 140024726648384 [version_set.cc:5721] Creating manifest 238322 2024/11/23-01:18:44.399954 140024726648384 DEBG dcompact_worker.cpp:1218: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-16202/att-00: bottommost_level: fake = 1, rpc = 0 2024/11/23-01:18:44.426076 140024726648384 [compaction_job.cc:2437] [default] [JOB 16202] Compacting 1@2 + 15@3 files to L3, score 1.00, subcompactions 1 : 1 2024/11/23-01:18:44.426098 140024726648384 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 12135 Base level 2, inputs: [238248(27MB)], [238271(36MB) 238272(1758KB) 238204(36MB) 238206(35MB) 238207(38MB) 238208(35MB) 238209(36MB) 238210(35MB) 238211(35MB) 238212(35MB) 238213(35MB) 238214(6535KB) 238173(34MB) 238174(35MB) 238306(34MB)] 2024/11/23-01:18:44.431939 140024726648384 [top_zip_table.cc:59] core git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-01:18:44.431972 140024726648384 [top_zip_table.cc:60] fsa git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-01:18:44.431993 140024726648384 [top_zip_table.cc:61] zbs git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-01:18:44.431998 140024726648384 [top_zip_table.cc:62] topling-zip_table_reader: git_version_hash_info_is: commit a4a382006cb82713acf5b3425835f22711877681 Author: leipeng Date: 2024-04-11 19:44:14 +0800 fixed_len_hole_index.cc: Add env bool FixedLenHoleIndexUseAVX512 for ut & debug 1. FixedLenHoleIndexUseAVX512 is only in unit tests or debug 2. In release mode, use avx512 by compile options(-march=) g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/23-01:18:44.432009 140024726648384 [top_zip_table.cc:64] topling-rocks git_version_hash_info_is: commit feab587e468621ba0204d47b4ffacc52e7c4290d Author: leipeng Date: 2024-03-22 13:35:06 +0800 ToplingZipTableBuilder::Add: immediately return after error This function returns void, and caller does not check builder->status() after calling this function and graceful abandon. So immediately return after error, and return error status in Finish(). g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/23-01:18:44.935666 140024726648384 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-16202/att-00/238323.sst) /dev/shm/ToplingTemp/Topling-364648-BeyDQa 2024/11/23-01:18:45.489182 140024726648384 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-16202/att-00/238323.sst): first pass time = 0.55's, 242.508'MB/sec 2024/11/23-01:18:46.852979 140024726648384 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-16202/att-00/238323.sst): old prealloc_size = 147639500, real_size = 34194880 2024/11/23-01:18:46.853527 140024726648384 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-16202/att-00/238323.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 931932 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.93 raw-val = 0.1081 GB zip-val = 0.0322 GB avg-val = 116.02 avg-zval = 34.51 2024/11/23-01:18:46.854345 140024726648384 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-16202/att-00/238323.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-01:18:47.759623 140024726648384 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-16202/att-00/238323.sst): second pass time = 1.36's, 79.331'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.91's, 42.252'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3422.313'MB/sec (index lex order gen) rebuild zvType time = 0.78's, 0.300'MB/sec write SST data time = 0.13's, 297.384'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 31345.524'MB/sec zip my value time = 1.36's, unzip length = 0.108'GB zip my value throughput = 79.331'MB/sec zip pipeline throughput = 79.331'MB/sec entries = 931932 avg-key = 28.00 avg-zkey = 1.93 avg-val = 116.02 avg-zval = 34.51 usrkeys = 931932 avg-key = 20.00 avg-zkey = 1.93 avg-val = 123.02 avg-zval = 34.51 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 931932 bytes = 3261776 } seq expand size = 6523524 multi value expand size = 0 cnt WriteAppend = 16 UnZipSize{ index = 0.0186 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0322 GB dict = 1.08 MB all = 0.0383 GB } UnZip/Zip{ index = 10.3769 value = 3.3615 dict = 1.00 all = 3.5037 } Zip/UnZip{ index = 0.0964 value = 0.2975 dict = 1.00 all = 0.2854 } ---------------------------- total value len = 0.114647 GB avg = 0.123 KB (by entry num) total key len = 0.026094 GB avg = 0.028 KB total ukey len = 0.018639 GB avg = 0.020 KB total ukey num = 0.000931932 Billion total entry num = 0.000931932 Billion write speed all = 0.002378003 MB/sec (with seq num) write speed all = 0.002252034 MB/sec (without seq num) 2024/11/23-01:18:47.793741 140024726648384 [compaction_job.cc:1948] [default] [JOB 16202] Generated table #238323: 931932 keys, 38307712 bytes, temperature: kWarm 2024/11/23-01:18:47.793853 140024726648384 EVENT_LOG_v1 {"time_micros": 1732295927793790, "cf_name": "default", "job": 16202, "event": "table_file_creation", "file_number": 238323, "file_size": 38307712, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3434038075, "largest_seqno": 3700651034, "table_properties": {"data_size": 32165552, "index_size": 1796160, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26094096, "raw_average_key_size": 28, "raw_value_size": 108123696, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 931932, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732295924, "oldest_key_time": 0, "file_creation_time": 1732295924, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 238323, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-01:18:47.830929 140024726648384 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-16202/att-00/238324.sst) /dev/shm/ToplingTemp/Topling-364648-o8qOq9 2024/11/23-01:18:48.732489 140024726648384 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-16202/att-00/238324.sst): first pass time = 0.90's, 148.880'MB/sec 2024/11/23-01:18:50.080638 140024726648384 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-16202/att-00/238324.sst): old prealloc_size = 147639500, real_size = 33202544 2024/11/23-01:18:50.081229 140024726648384 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-16202/att-00/238324.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 932583 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1081 GB zip-val = 0.0312 GB avg-val = 115.92 avg-zval = 33.44 2024/11/23-01:18:50.082019 140024726648384 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-16202/att-00/238324.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-01:18:51.017709 140024726648384 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-16202/att-00/238324.sst): second pass time = 1.35's, 80.266'MB/sec, value only(80.5% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.94's, 39.823'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3159.795'MB/sec (index lex order gen) rebuild zvType time = 0.81's, 0.288'MB/sec write SST data time = 0.13's, 291.114'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 28058.675'MB/sec zip my value time = 1.35's, unzip length = 0.108'GB zip my value throughput = 80.266'MB/sec zip pipeline throughput = 80.266'MB/sec entries = 932583 avg-key = 28.00 avg-zkey = 1.91 avg-val = 115.92 avg-zval = 33.44 usrkeys = 932583 avg-key = 20.00 avg-zkey = 1.91 avg-val = 122.92 avg-zval = 33.44 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 932583 bytes = 3264048 } seq expand size = 6528081 multi value expand size = 0 cnt WriteAppend = 15 UnZipSize{ index = 0.0187 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0312 GB dict = 1.08 MB all = 0.0373 GB } UnZip/Zip{ index = 10.4456 value = 3.4667 dict = 1.00 all = 3.5967 } Zip/UnZip{ index = 0.0957 value = 0.2885 dict = 1.00 all = 0.2780 } ---------------------------- total value len = 0.229281 GB avg = 0.123 KB (by entry num) total key len = 0.052206 GB avg = 0.028 KB total ukey len = 0.037290 GB avg = 0.020 KB total ukey num = 0.001864515 Billion total entry num = 0.001864515 Billion write speed all = 0.004755822 MB/sec (with seq num) write speed all = 0.004503809 MB/sec (without seq num) 2024/11/23-01:18:51.051919 140024726648384 [compaction_job.cc:1948] [default] [JOB 16202] Generated table #238324: 932583 keys, 37317122 bytes, temperature: kWarm 2024/11/23-01:18:51.051987 140024726648384 EVENT_LOG_v1 {"time_micros": 1732295931051953, "cf_name": "default", "job": 16202, "event": "table_file_creation", "file_number": 238324, "file_size": 37317122, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3434038106, "largest_seqno": 3700651272, "table_properties": {"data_size": 31183584, "index_size": 1785600, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26112324, "raw_average_key_size": 28, "raw_value_size": 108105506, "raw_average_value_size": 115, "num_data_blocks": 1, "num_entries": 932583, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732295927, "oldest_key_time": 0, "file_creation_time": 1732295927, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 238324, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-01:18:51.091160 140024726648384 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-16202/att-00/238325.sst) /dev/shm/ToplingTemp/Topling-364648-liKbOa 2024/11/23-01:18:51.966887 140024726648384 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-16202/att-00/238325.sst): first pass time = 0.88's, 153.272'MB/sec 2024/11/23-01:18:53.313250 140024726648384 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-16202/att-00/238325.sst): old prealloc_size = 147639500, real_size = 34636736 2024/11/23-01:18:53.313829 140024726648384 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-16202/att-00/238325.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927033 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0326 GB avg-val = 116.78 avg-zval = 35.21 2024/11/23-01:18:53.314560 140024726648384 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-16202/att-00/238325.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-01:18:54.222663 140024726648384 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-16202/att-00/238325.sst): second pass time = 1.35's, 80.459'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.91's, 42.595'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3147.022'MB/sec (index lex order gen) rebuild zvType time = 0.78's, 0.296'MB/sec write SST data time = 0.13's, 306.732'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 34103.093'MB/sec zip my value time = 1.35's, unzip length = 0.108'GB zip my value throughput = 80.459'MB/sec zip pipeline throughput = 80.459'MB/sec entries = 927033 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.78 avg-zval = 35.21 usrkeys = 927033 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.78 avg-zval = 35.21 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 927033 bytes = 3244624 } seq expand size = 6489231 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0326 GB dict = 1.08 MB all = 0.0387 GB } UnZip/Zip{ index = 10.5127 value = 3.3167 dict = 1.00 all = 3.4650 } Zip/UnZip{ index = 0.0951 value = 0.3015 dict = 1.00 all = 0.2886 } ---------------------------- total value len = 0.344031 GB avg = 0.123 KB (by entry num) total key len = 0.078163 GB avg = 0.028 KB total ukey len = 0.055831 GB avg = 0.020 KB total ukey num = 0.002791548 Billion total entry num = 0.002791548 Billion write speed all = 0.007132728 MB/sec (with seq num) write speed all = 0.006755435 MB/sec (without seq num) 2024/11/23-01:18:54.257785 140024726648384 [compaction_job.cc:1948] [default] [JOB 16202] Generated table #238325: 927033 keys, 38735826 bytes, temperature: kWarm 2024/11/23-01:18:54.257853 140024726648384 EVENT_LOG_v1 {"time_micros": 1732295934257818, "cf_name": "default", "job": 16202, "event": "table_file_creation", "file_number": 238325, "file_size": 38735826, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3434038136, "largest_seqno": 3700649046, "table_properties": {"data_size": 32641136, "index_size": 1763648, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25956924, "raw_average_key_size": 28, "raw_value_size": 108260822, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927033, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732295931, "oldest_key_time": 0, "file_creation_time": 1732295931, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 238325, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-01:18:54.299266 140024726648384 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-16202/att-00/238326.sst) /dev/shm/ToplingTemp/Topling-364648-9SrbAc 2024/11/23-01:18:55.155403 140024726648384 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-16202/att-00/238326.sst): first pass time = 0.86's, 156.779'MB/sec 2024/11/23-01:18:56.554915 140024726648384 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-16202/att-00/238326.sst): old prealloc_size = 147639500, real_size = 36797344 2024/11/23-01:18:56.555437 140024726648384 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-16202/att-00/238326.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 928724 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1082 GB zip-val = 0.0348 GB avg-val = 116.52 avg-zval = 37.46 2024/11/23-01:18:56.556045 140024726648384 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-16202/att-00/238326.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-01:18:57.333458 140024726648384 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-16202/att-00/238326.sst): second pass time = 1.40's, 77.364'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.78's, 51.397'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3602.032'MB/sec (index lex order gen) rebuild zvType time = 0.65's, 0.358'MB/sec write SST data time = 0.13's, 309.985'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 30514.929'MB/sec zip my value time = 1.40's, unzip length = 0.108'GB zip my value throughput = 77.364'MB/sec zip pipeline throughput = 77.364'MB/sec entries = 928724 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.52 avg-zval = 37.46 usrkeys = 928724 avg-key = 20.00 avg-zkey = 1.91 avg-val = 121.12 avg-zval = 37.46 TagRS{ kinds = RS_Key0_TagN bytes = 145200 } TagArray{ size = 611030 bytes = 2214992 } seq expand size = 4277210 multi value expand size = 0 cnt WriteAppend = 17 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0348 GB dict = 1.08 MB all = 0.0400 GB } UnZip/Zip{ index = 10.4439 value = 3.1108 dict = 1.00 all = 3.3543 } Zip/UnZip{ index = 0.0957 value = 0.3215 dict = 1.00 all = 0.2981 } ---------------------------- total value len = 0.456522 GB avg = 0.123 KB (by entry num) total key len = 0.104168 GB avg = 0.028 KB total ukey len = 0.074405 GB avg = 0.020 KB total ukey num = 0.003720272 Billion total entry num = 0.003720272 Billion write speed all = 0.009472024 MB/sec (with seq num) write speed all = 0.008969236 MB/sec (without seq num) 2024/11/23-01:18:57.368192 140024726648384 [compaction_job.cc:1948] [default] [JOB 16202] Generated table #238326: 928724 keys, 40014116 bytes, temperature: kWarm 2024/11/23-01:18:57.368266 140024726648384 EVENT_LOG_v1 {"time_micros": 1732295937368226, "cf_name": "default", "job": 16202, "event": "table_file_creation", "file_number": 238326, "file_size": 40014116, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3700651120, "table_properties": {"data_size": 34786512, "index_size": 1778496, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26004272, "raw_average_key_size": 28, "raw_value_size": 108213580, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 928724, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732295934, "oldest_key_time": 0, "file_creation_time": 1732295934, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 238326, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-01:18:57.408929 140024726648384 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-16202/att-00/238327.sst) /dev/shm/ToplingTemp/Topling-364648-W5ZIi9 2024/11/23-01:18:58.268769 140024726648384 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-16202/att-00/238327.sst): first pass time = 0.86's, 156.104'MB/sec 2024/11/23-01:18:59.799628 140024726648384 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-16202/att-00/238327.sst): old prealloc_size = 147639500, real_size = 36483488 2024/11/23-01:18:59.800158 140024726648384 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-16202/att-00/238327.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927148 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.89 raw-val = 0.1083 GB zip-val = 0.0345 GB avg-val = 116.76 avg-zval = 37.21 2024/11/23-01:18:59.800206 140024726648384 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-16202/att-00/238327.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-01:19:00.441938 140024726648384 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-16202/att-00/238327.sst): second pass time = 1.53's, 70.751'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.64's, 58.138'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3452.303'MB/sec (index lex order gen) rebuild zvType time = 0.52's, 0.448'MB/sec write SST data time = 0.12's, 299.951'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 35221.799'MB/sec zip my value time = 1.53's, unzip length = 0.108'GB zip my value throughput = 70.751'MB/sec zip pipeline throughput = 70.751'MB/sec entries = 927148 avg-key = 28.00 avg-zkey = 1.89 avg-val = 116.76 avg-zval = 37.21 usrkeys = 927148 avg-key = 20.00 avg-zkey = 1.89 avg-val = 116.76 avg-zval = 37.21 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 8 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0345 GB dict = 1.08 MB all = 0.0373 GB } UnZip/Zip{ index = 10.5827 value = 3.1380 dict = 1.00 all = 3.5943 } Zip/UnZip{ index = 0.0945 value = 0.3187 dict = 1.00 all = 0.2782 } ---------------------------- total value len = 0.564779 GB avg = 0.122 KB (by entry num) total key len = 0.130128 GB avg = 0.028 KB total ukey len = 0.092948 GB avg = 0.020 KB total ukey num = 0.004647420 Billion total entry num = 0.004647420 Billion write speed all = 0.011738820 MB/sec (with seq num) write speed all = 0.011110762 MB/sec (without seq num) 2024/11/23-01:19:00.475536 140024726648384 [compaction_job.cc:1948] [default] [JOB 16202] Generated table #238327: 927148 keys, 37341826 bytes, temperature: kWarm 2024/11/23-01:19:00.475601 140024726648384 EVENT_LOG_v1 {"time_micros": 1732295940475568, "cf_name": "default", "job": 16202, "event": "table_file_creation", "file_number": 238327, "file_size": 37341826, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 34499344, "index_size": 1752192, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25960144, "raw_average_key_size": 28, "raw_value_size": 108257584, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927148, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732295937, "oldest_key_time": 0, "file_creation_time": 1732295937, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 238327, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-01:19:00.512115 140024726648384 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-16202/att-00/238328.sst) /dev/shm/ToplingTemp/Topling-364648-uFiBUc 2024/11/23-01:19:01.273603 140024726648384 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-16202/att-00/238328.sst): first pass time = 0.76's, 176.268'MB/sec 2024/11/23-01:19:02.836900 140024726648384 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-16202/att-00/238328.sst): old prealloc_size = 147639500, real_size = 36378864 2024/11/23-01:19:02.837482 140024726648384 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-16202/att-00/238328.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 926823 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0344 GB avg-val = 116.81 avg-zval = 37.10 2024/11/23-01:19:02.837529 140024726648384 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-16202/att-00/238328.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-01:19:03.477830 140024726648384 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-16202/att-00/238328.sst): second pass time = 1.56's, 69.289'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.64's, 58.100'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3160.756'MB/sec (index lex order gen) rebuild zvType time = 0.52's, 0.448'MB/sec write SST data time = 0.12's, 301.289'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 33809.026'MB/sec zip my value time = 1.56's, unzip length = 0.108'GB zip my value throughput = 69.289'MB/sec zip pipeline throughput = 69.289'MB/sec entries = 926823 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.81 avg-zval = 37.10 usrkeys = 926823 avg-key = 20.00 avg-zkey = 1.90 avg-val = 116.81 avg-zval = 37.10 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0344 GB dict = 1.08 MB all = 0.0372 GB } UnZip/Zip{ index = 10.5133 value = 3.1488 dict = 1.00 all = 3.6044 } Zip/UnZip{ index = 0.0951 value = 0.3176 dict = 1.00 all = 0.2774 } ---------------------------- total value len = 0.673046 GB avg = 0.121 KB (by entry num) total key len = 0.156079 GB avg = 0.028 KB total ukey len = 0.111485 GB avg = 0.020 KB total ukey num = 0.005574243 Billion total entry num = 0.005574243 Billion write speed all = 0.014005395 MB/sec (with seq num) write speed all = 0.013252124 MB/sec (without seq num) 2024/11/23-01:19:03.511708 140024726648384 [compaction_job.cc:1948] [default] [JOB 16202] Generated table #238328: 926823 keys, 37236940 bytes, temperature: kWarm 2024/11/23-01:19:03.511775 140024726648384 EVENT_LOG_v1 {"time_micros": 1732295943511740, "cf_name": "default", "job": 16202, "event": "table_file_creation", "file_number": 238328, "file_size": 37236940, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 34383840, "index_size": 1763136, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25951044, "raw_average_key_size": 28, "raw_value_size": 108266706, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 926823, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732295940, "oldest_key_time": 0, "file_creation_time": 1732295940, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 238328, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-01:19:03.545795 140024726648384 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-16202/att-00/238329.sst) /dev/shm/ToplingTemp/Topling-364648-kSmxra 2024/11/23-01:19:04.370271 140024726648384 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-16202/att-00/238329.sst): first pass time = 0.82's, 162.799'MB/sec 2024/11/23-01:19:05.719560 140024726648384 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-16202/att-00/238329.sst): old prealloc_size = 147639500, real_size = 33665056 2024/11/23-01:19:05.720151 140024726648384 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-16202/att-00/238329.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 926502 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1083 GB zip-val = 0.0317 GB avg-val = 116.87 avg-zval = 34.17 2024/11/23-01:19:05.720976 140024726648384 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-16202/att-00/238329.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-01:19:06.669270 140024726648384 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-16202/att-00/238329.sst): second pass time = 1.35's, 80.290'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.95's, 40.018'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3134.037'MB/sec (index lex order gen) rebuild zvType time = 0.82's, 0.284'MB/sec write SST data time = 0.13's, 287.059'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 32397.841'MB/sec zip my value time = 1.35's, unzip length = 0.108'GB zip my value throughput = 80.290'MB/sec zip pipeline throughput = 80.290'MB/sec entries = 926502 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.87 avg-zval = 34.17 usrkeys = 926502 avg-key = 20.00 avg-zkey = 1.91 avg-val = 123.82 avg-zval = 34.17 TagRS{ kinds = RS_Key0_TagN bytes = 144880 } TagArray{ size = 920396 bytes = 3336448 } seq expand size = 6442772 multi value expand size = 0 cnt WriteAppend = 15 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0317 GB dict = 1.08 MB all = 0.0380 GB } UnZip/Zip{ index = 10.4445 value = 3.4201 dict = 1.00 all = 3.5316 } Zip/UnZip{ index = 0.0957 value = 0.2924 dict = 1.00 all = 0.2832 } ---------------------------- total value len = 0.787764 GB avg = 0.121 KB (by entry num) total key len = 0.182021 GB avg = 0.028 KB total ukey len = 0.130015 GB avg = 0.020 KB total ukey num = 0.006500745 Billion total entry num = 0.006500745 Billion write speed all = 0.016380519 MB/sec (with seq num) write speed all = 0.015502093 MB/sec (without seq num) 2024/11/23-01:19:06.708795 140024726648384 [compaction_job.cc:1948] [default] [JOB 16202] Generated table #238329: 926502 keys, 38004870 bytes, temperature: kWarm 2024/11/23-01:19:06.708861 140024726648384 EVENT_LOG_v1 {"time_micros": 1732295946708828, "cf_name": "default", "job": 16202, "event": "table_file_creation", "file_number": 238329, "file_size": 38004870, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3700650462, "table_properties": {"data_size": 31659088, "index_size": 1774144, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25942056, "raw_average_key_size": 28, "raw_value_size": 108275676, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 926502, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732295943, "oldest_key_time": 0, "file_creation_time": 1732295943, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 238329, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-01:19:06.744103 140024726648384 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-16202/att-00/238330.sst) /dev/shm/ToplingTemp/Topling-364648-Mbhplc 2024/11/23-01:19:07.585274 140024726648384 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-16202/att-00/238330.sst): first pass time = 0.84's, 159.569'MB/sec 2024/11/23-01:19:08.922550 140024726648384 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-16202/att-00/238330.sst): old prealloc_size = 147639500, real_size = 32558992 2024/11/23-01:19:08.923137 140024726648384 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-16202/att-00/238330.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 932767 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1081 GB zip-val = 0.0306 GB avg-val = 115.89 avg-zval = 32.75 2024/11/23-01:19:08.923887 140024726648384 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-16202/att-00/238330.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-01:19:09.875813 140024726648384 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-16202/att-00/238330.sst): second pass time = 1.34's, 80.882'MB/sec, value only(80.5% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.95's, 38.351'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3161.707'MB/sec (index lex order gen) rebuild zvType time = 0.82's, 0.283'MB/sec write SST data time = 0.13's, 286.106'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 31274.510'MB/sec zip my value time = 1.34's, unzip length = 0.108'GB zip my value throughput = 80.882'MB/sec zip pipeline throughput = 80.882'MB/sec entries = 932767 avg-key = 28.00 avg-zkey = 1.90 avg-val = 115.89 avg-zval = 32.75 usrkeys = 932767 avg-key = 20.00 avg-zkey = 1.90 avg-val = 122.89 avg-zval = 32.75 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 932767 bytes = 3148096 } seq expand size = 6529369 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0187 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0306 GB dict = 1.08 MB all = 0.0366 GB } UnZip/Zip{ index = 10.5117 value = 3.5384 dict = 1.00 all = 3.6714 } Zip/UnZip{ index = 0.0951 value = 0.2826 dict = 1.00 all = 0.2724 } ---------------------------- total value len = 0.902394 GB avg = 0.121 KB (by entry num) total key len = 0.208138 GB avg = 0.028 KB total ukey len = 0.148670 GB avg = 0.020 KB total ukey num = 0.007433512 Billion total entry num = 0.007433512 Billion write speed all = 0.018756846 MB/sec (with seq num) write speed all = 0.017752433 MB/sec (without seq num) 2024/11/23-01:19:09.910906 140024726648384 [compaction_job.cc:1948] [default] [JOB 16202] Generated table #238330: 932767 keys, 36557636 bytes, temperature: kWarm 2024/11/23-01:19:09.910971 140024726648384 EVENT_LOG_v1 {"time_micros": 1732295949910939, "cf_name": "default", "job": 16202, "event": "table_file_creation", "file_number": 238330, "file_size": 36557636, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3631595348, "largest_seqno": 3700648773, "table_properties": {"data_size": 30550912, "index_size": 1774720, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26117476, "raw_average_key_size": 28, "raw_value_size": 108100366, "raw_average_value_size": 115, "num_data_blocks": 1, "num_entries": 932767, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732295946, "oldest_key_time": 0, "file_creation_time": 1732295946, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 238330, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-01:19:09.946341 140024726648384 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-16202/att-00/238331.sst) /dev/shm/ToplingTemp/Topling-364648-xRx9v8 2024/11/23-01:19:10.882422 140024726648384 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-16202/att-00/238331.sst): first pass time = 0.94's, 143.391'MB/sec 2024/11/23-01:19:12.232078 140024726648384 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-16202/att-00/238331.sst): old prealloc_size = 147639500, real_size = 32331408 2024/11/23-01:19:12.232663 140024726648384 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-16202/att-00/238331.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 926957 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1083 GB zip-val = 0.0303 GB avg-val = 116.79 avg-zval = 32.71 2024/11/23-01:19:12.234812 140024726648384 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-16202/att-00/238331.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-01:19:13.126636 140024726648384 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-16202/att-00/238331.sst): second pass time = 1.35's, 80.283'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.89's, 40.854'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3163.204'MB/sec (index lex order gen) rebuild zvType time = 0.76's, 0.303'MB/sec write SST data time = 0.13's, 282.619'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 31197.147'MB/sec zip my value time = 1.35's, unzip length = 0.108'GB zip my value throughput = 80.283'MB/sec zip pipeline throughput = 80.283'MB/sec entries = 926957 avg-key = 28.00 avg-zkey = 1.92 avg-val = 116.79 avg-zval = 32.71 usrkeys = 926957 avg-key = 20.00 avg-zkey = 1.92 avg-val = 123.79 avg-zval = 32.71 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 926957 bytes = 3360240 } seq expand size = 6488699 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0303 GB dict = 1.08 MB all = 0.0365 GB } UnZip/Zip{ index = 10.4421 value = 3.5702 dict = 1.00 all = 3.6726 } Zip/UnZip{ index = 0.0958 value = 0.2801 dict = 1.00 all = 0.2723 } ---------------------------- total value len = 1.017146 GB avg = 0.122 KB (by entry num) total key len = 0.234093 GB avg = 0.028 KB total ukey len = 0.167209 GB avg = 0.020 KB total ukey num = 0.008360469 Billion total entry num = 0.008360469 Billion write speed all = 0.021132212 MB/sec (with seq num) write speed all = 0.020002610 MB/sec (without seq num) 2024/11/23-01:19:13.159031 140024726648384 [compaction_job.cc:1948] [default] [JOB 16202] Generated table #238331: 926957 keys, 36545814 bytes, temperature: kWarm 2024/11/23-01:19:13.159100 140024726648384 EVENT_LOG_v1 {"time_micros": 1732295953159066, "cf_name": "default", "job": 16202, "event": "table_file_creation", "file_number": 238331, "file_size": 36545814, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3273701386, "largest_seqno": 3700650615, "table_properties": {"data_size": 30324032, "index_size": 1775424, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25954796, "raw_average_key_size": 28, "raw_value_size": 108262958, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 926957, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732295949, "oldest_key_time": 0, "file_creation_time": 1732295949, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 238331, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-01:19:13.195285 140024726648384 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-16202/att-00/238332.sst) /dev/shm/ToplingTemp/Topling-364648-gfQ9sb 2024/11/23-01:19:14.059070 140024726648384 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-16202/att-00/238332.sst): first pass time = 0.86's, 155.393'MB/sec 2024/11/23-01:19:15.391723 140024726648384 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-16202/att-00/238332.sst): old prealloc_size = 147639500, real_size = 32601968 2024/11/23-01:19:15.392308 140024726648384 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-16202/att-00/238332.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 926414 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1083 GB zip-val = 0.0306 GB avg-val = 116.88 avg-zval = 33.03 2024/11/23-01:19:15.393062 140024726648384 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-16202/att-00/238332.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-01:19:16.304149 140024726648384 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-16202/att-00/238332.sst): second pass time = 1.33's, 81.294'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.91's, 40.095'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3150.515'MB/sec (index lex order gen) rebuild zvType time = 0.78's, 0.295'MB/sec write SST data time = 0.13's, 286.655'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 31886.079'MB/sec zip my value time = 1.33's, unzip length = 0.108'GB zip my value throughput = 81.294'MB/sec zip pipeline throughput = 81.294'MB/sec entries = 926414 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.88 avg-zval = 33.03 usrkeys = 926414 avg-key = 20.00 avg-zkey = 1.91 avg-val = 123.88 avg-zval = 33.03 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 926414 bytes = 3126656 } seq expand size = 6484898 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0306 GB dict = 1.08 MB all = 0.0366 GB } UnZip/Zip{ index = 10.4461 value = 3.5389 dict = 1.00 all = 3.6688 } Zip/UnZip{ index = 0.0957 value = 0.2826 dict = 1.00 all = 0.2726 } ---------------------------- total value len = 1.131909 GB avg = 0.122 KB (by entry num) total key len = 0.260033 GB avg = 0.028 KB total ukey len = 0.185738 GB avg = 0.020 KB total ukey num = 0.009286883 Billion total entry num = 0.009286883 Billion write speed all = 0.023507284 MB/sec (with seq num) write speed all = 0.022252579 MB/sec (without seq num) 2024/11/23-01:19:16.335932 140024726648384 [compaction_job.cc:1948] [default] [JOB 16202] Generated table #238332: 926414 keys, 36583324 bytes, temperature: kWarm 2024/11/23-01:19:16.336005 140024726648384 EVENT_LOG_v1 {"time_micros": 1732295956335967, "cf_name": "default", "job": 16202, "event": "table_file_creation", "file_number": 238332, "file_size": 36583324, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3606008427, "largest_seqno": 3700650251, "table_properties": {"data_size": 30596512, "index_size": 1773696, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25939592, "raw_average_key_size": 28, "raw_value_size": 108278276, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 926414, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732295953, "oldest_key_time": 0, "file_creation_time": 1732295953, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 238332, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-01:19:16.376445 140024726648384 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-16202/att-00/238333.sst) /dev/shm/ToplingTemp/Topling-364648-NLK0Xa 2024/11/23-01:19:17.210851 140024726648384 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-16202/att-00/238333.sst): first pass time = 0.83's, 160.863'MB/sec 2024/11/23-01:19:18.564691 140024726648384 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-16202/att-00/238333.sst): old prealloc_size = 147639500, real_size = 33596448 2024/11/23-01:19:18.565289 140024726648384 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-16202/att-00/238333.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 926309 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0316 GB avg-val = 116.90 avg-zval = 34.12 2024/11/23-01:19:18.566078 140024726648384 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-16202/att-00/238333.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-01:19:19.510139 140024726648384 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-16202/att-00/238333.sst): second pass time = 1.35's, 80.018'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.95's, 39.991'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3053.778'MB/sec (index lex order gen) rebuild zvType time = 0.82's, 0.283'MB/sec write SST data time = 0.13's, 297.087'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 31563.950'MB/sec zip my value time = 1.35's, unzip length = 0.108'GB zip my value throughput = 80.018'MB/sec zip pipeline throughput = 80.018'MB/sec entries = 926309 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.90 avg-zval = 34.12 usrkeys = 926309 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.90 avg-zval = 34.12 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 926309 bytes = 3357888 } seq expand size = 6484163 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0316 GB dict = 1.08 MB all = 0.0378 GB } UnZip/Zip{ index = 10.5144 value = 3.4263 dict = 1.00 all = 3.5499 } Zip/UnZip{ index = 0.0951 value = 0.2919 dict = 1.00 all = 0.2817 } ---------------------------- total value len = 1.246674 GB avg = 0.122 KB (by entry num) total key len = 0.285969 GB avg = 0.028 KB total ukey len = 0.204264 GB avg = 0.020 KB total ukey num = 0.010213192 Billion total entry num = 0.010213192 Billion write speed all = 0.025882075 MB/sec (with seq num) write speed all = 0.024502296 MB/sec (without seq num) 2024/11/23-01:19:19.543820 140024726648384 [compaction_job.cc:1948] [default] [JOB 16202] Generated table #238333: 926309 keys, 37809026 bytes, temperature: kWarm 2024/11/23-01:19:19.543896 140024726648384 EVENT_LOG_v1 {"time_micros": 1732295959543851, "cf_name": "default", "job": 16202, "event": "table_file_creation", "file_number": 238333, "file_size": 37809026, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3376774746, "largest_seqno": 3700650512, "table_properties": {"data_size": 31602704, "index_size": 1761984, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25936652, "raw_average_key_size": 28, "raw_value_size": 108281170, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 926309, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732295956, "oldest_key_time": 0, "file_creation_time": 1732295956, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 238333, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-01:19:19.619860 140024726648384 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-16202/att-00/238334.sst) /dev/shm/ToplingTemp/Topling-364648-1SxTX8 2024/11/23-01:19:20.426193 140024726648384 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-16202/att-00/238334.sst): first pass time = 0.81's, 166.463'MB/sec 2024/11/23-01:19:21.763270 140024726648384 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-16202/att-00/238334.sst): old prealloc_size = 147639500, real_size = 33343728 2024/11/23-01:19:21.763856 140024726648384 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-16202/att-00/238334.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 926510 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0313 GB avg-val = 116.86 avg-zval = 33.84 2024/11/23-01:19:21.764632 140024726648384 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-16202/att-00/238334.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-01:19:22.707594 140024726648384 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-16202/att-00/238334.sst): second pass time = 1.34's, 81.024'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.94's, 39.649'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3134.565'MB/sec (index lex order gen) rebuild zvType time = 0.82's, 0.284'MB/sec write SST data time = 0.13's, 292.867'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 29426.121'MB/sec zip my value time = 1.34's, unzip length = 0.108'GB zip my value throughput = 81.024'MB/sec zip pipeline throughput = 81.024'MB/sec entries = 926510 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.86 avg-zval = 33.84 usrkeys = 926510 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.86 avg-zval = 33.84 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 926510 bytes = 3242800 } seq expand size = 6485570 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0313 GB dict = 1.08 MB all = 0.0374 GB } UnZip/Zip{ index = 10.5125 value = 3.4539 dict = 1.00 all = 3.5848 } Zip/UnZip{ index = 0.0951 value = 0.2895 dict = 1.00 all = 0.2790 } ---------------------------- total value len = 1.361435 GB avg = 0.122 KB (by entry num) total key len = 0.311912 GB avg = 0.028 KB total ukey len = 0.222794 GB avg = 0.020 KB total ukey num = 0.011139702 Billion total entry num = 0.011139702 Billion write speed all = 0.028256637 MB/sec (with seq num) write speed all = 0.026751770 MB/sec (without seq num) 2024/11/23-01:19:22.744868 140024726648384 [compaction_job.cc:1948] [default] [JOB 16202] Generated table #238334: 926510 keys, 37441306 bytes, temperature: kWarm 2024/11/23-01:19:22.744935 140024726648384 EVENT_LOG_v1 {"time_micros": 1732295962744902, "cf_name": "default", "job": 16202, "event": "table_file_creation", "file_number": 238334, "file_size": 37441306, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3563652023, "largest_seqno": 3700648478, "table_properties": {"data_size": 31349216, "index_size": 1762688, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25942280, "raw_average_key_size": 28, "raw_value_size": 108275536, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 926510, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732295959, "oldest_key_time": 0, "file_creation_time": 1732295959, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 238334, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-01:19:22.782371 140024726648384 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-16202/att-00/238335.sst) /dev/shm/ToplingTemp/Topling-364648-GLcoha 2024/11/23-01:19:23.619590 140024726648384 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-16202/att-00/238335.sst): first pass time = 0.84's, 160.322'MB/sec 2024/11/23-01:19:24.945350 140024726648384 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-16202/att-00/238335.sst): old prealloc_size = 147639500, real_size = 33448144 2024/11/23-01:19:24.945893 140024726648384 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-16202/att-00/238335.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 926476 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0315 GB avg-val = 116.87 avg-zval = 33.95 2024/11/23-01:19:24.946672 140024726648384 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-16202/att-00/238335.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-01:19:25.887299 140024726648384 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-16202/att-00/238335.sst): second pass time = 1.32's, 81.739'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.94's, 39.860'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3407.811'MB/sec (index lex order gen) rebuild zvType time = 0.81's, 0.285'MB/sec write SST data time = 0.13's, 294.405'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 34186.110'MB/sec zip my value time = 1.32's, unzip length = 0.108'GB zip my value throughput = 81.739'MB/sec zip pipeline throughput = 81.739'MB/sec entries = 926476 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.87 avg-zval = 33.95 usrkeys = 926476 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.87 avg-zval = 33.95 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 926476 bytes = 3242688 } seq expand size = 6485332 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0315 GB dict = 1.08 MB all = 0.0375 GB } UnZip/Zip{ index = 10.5167 value = 3.4423 dict = 1.00 all = 3.5748 } Zip/UnZip{ index = 0.0951 value = 0.2905 dict = 1.00 all = 0.2797 } ---------------------------- total value len = 1.476197 GB avg = 0.122 KB (by entry num) total key len = 0.337853 GB avg = 0.028 KB total ukey len = 0.241324 GB avg = 0.020 KB total ukey num = 0.012066178 Billion total entry num = 0.012066178 Billion write speed all = 0.030630947 MB/sec (with seq num) write speed all = 0.029001010 MB/sec (without seq num) 2024/11/23-01:19:25.920499 140024726648384 [compaction_job.cc:1948] [default] [JOB 16202] Generated table #238335: 926476 keys, 37545492 bytes, temperature: kWarm 2024/11/23-01:19:25.920583 140024726648384 EVENT_LOG_v1 {"time_micros": 1732295965920537, "cf_name": "default", "job": 16202, "event": "table_file_creation", "file_number": 238335, "file_size": 37545492, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3504428200, "largest_seqno": 3700649684, "table_properties": {"data_size": 31454400, "index_size": 1761920, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25941328, "raw_average_key_size": 28, "raw_value_size": 108276476, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 926476, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732295962, "oldest_key_time": 0, "file_creation_time": 1732295962, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 238335, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-01:19:25.956444 140024726648384 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-16202/att-00/238336.sst) /dev/shm/ToplingTemp/Topling-364648-caI7x9 2024/11/23-01:19:26.162454 140024726648384 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-16202/att-00/238336.sst): first pass time = 0.21's, 237.622'MB/sec 2024/11/23-01:19:26.621048 140024726648384 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-16202/att-00/238336.sst): old prealloc_size = 147639500, real_size = 12778400 2024/11/23-01:19:26.621303 140024726648384 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-16202/att-00/238336.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 338924 prefix = 4 raw-key = 0.0054 GB zip-key = 0.0006 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.0395 GB zip-val = 0.0120 GB avg-val = 116.41 avg-zval = 35.54 2024/11/23-01:19:26.621593 140024726648384 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-16202/att-00/238336.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0008 GB, waited 0.000 sec, Key+Value = 0.049 GB 2024/11/23-01:19:26.967862 140024726648384 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-16202/att-00/238336.sst): second pass time = 0.46's, 86.141'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.35's, 40.949'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2833.316'MB/sec (index lex order gen) rebuild zvType time = 0.30's, 0.283'MB/sec write SST data time = 0.05's, 298.714'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.404'MB, throughput = 14172.560'MB/sec zip my value time = 0.46's, unzip length = 0.039'GB zip my value throughput = 86.141'MB/sec zip pipeline throughput = 86.141'MB/sec entries = 338924 avg-key = 28.00 avg-zkey = 1.92 avg-val = 116.41 avg-zval = 35.54 usrkeys = 338924 avg-key = 20.00 avg-zkey = 1.92 avg-val = 123.41 avg-zval = 35.54 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 338924 bytes = 1101520 } seq expand size = 2372468 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0068 GB value = 0.0395 GB dict = 0.40 MB all = 0.0489 GB } __ZipSize{ index = 0.0006 GB value = 0.0120 GB dict = 0.40 MB all = 0.0142 GB } UnZip/Zip{ index = 10.4349 value = 3.2758 dict = 1.00 all = 3.4464 } Zip/UnZip{ index = 0.0958 value = 0.3053 dict = 1.00 all = 0.2902 } ---------------------------- total value len = 1.518023 GB avg = 0.122 KB (by entry num) total key len = 0.347343 GB avg = 0.028 KB total ukey len = 0.248102 GB avg = 0.020 KB total ukey num = 0.012405102 Billion total entry num = 0.012405102 Billion write speed all = 0.031496850 MB/sec (with seq num) write speed all = 0.029821160 MB/sec (without seq num) 2024/11/23-01:19:26.985885 140024726648384 [compaction_job.cc:1948] [default] [JOB 16202] Generated table #238336: 338924 keys, 14200919 bytes, temperature: kWarm 2024/11/23-01:19:26.985948 140024726648384 EVENT_LOG_v1 {"time_micros": 1732295966985915, "cf_name": "default", "job": 16202, "event": "table_file_creation", "file_number": 238336, "file_size": 14200919, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3653489032, "largest_seqno": 3700647642, "table_properties": {"data_size": 12043856, "index_size": 649600, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 9489872, "raw_average_key_size": 28, "raw_value_size": 39452852, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 338924, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732295965, "oldest_key_time": 0, "file_creation_time": 1732295965, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 238336, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-01:19:27.000508 140024726648384 [compaction_job.cc:703] job-16202: subcompact[0], size: 0.503642 G, files: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-16202/att-00 [238323,238324,238325,238326,238327,238328,238329,238330,238331,238332,238333,238334,238335,238336] 2024/11/23-01:19:27.094801 140024726648384 (Original Log Time 2024/11/23-01:18:44.426157) EVENT_LOG_v1 {"time_micros": 1732295924426115, "job": 16202, "event": "compaction_started", "compaction_reason": "FilesMarkedForCompaction", "files_L2": [238248], "files_L3": [238271, 238272, 238204, 238206, 238207, 238208, 238209, 238210, 238211, 238212, 238213, 238214, 238173, 238174, 238306], "score": 0.999734, "input_data_size": 525515824, "oldest_snapshot_seqno": 3701291649} 2024/11/23-01:19:27.094805 140024726648384 (Original Log Time 2024/11/23-01:19:27.094005) [compaction_job.cc:2022] [default] [JOB 16202] Compacted 1@2 + 15@3 files to L3 => 503641929 bytes 2024/11/23-01:19:27.094807 140024726648384 (Original Log Time 2024/11/23-01:19:27.094713) [compaction_job.cc:1224] [default] compacted to: files[0 0 0 14 0 0 0] max score 0.02, MB/sec: 12.3 rd, 11.8 wr, level 3, files in(1, 15) out(14 +0 blob) MB in(27.1, 474.1 +0.0 blob) out(480.3 +0.0 blob), read-write-amplify(36.2) write-amplify(17.7) OK, records in: 12486572, records dropped: 81470 output_compression: Snappy 2024/11/23-01:19:27.094814 140024726648384 (Original Log Time 2024/11/23-01:19:27.094763) EVENT_LOG_v1 {"time_micros": 1732295967094739, "cf": "default", "job": 16202, "event": "compaction_finished", "compaction_time_micros": 42574359, "compaction_time_cpu_micros": 19102677, "output_level": 3, "num_output_files": 14, "total_output_size": 503641929, "num_input_records": 12486572, "num_output_records": 12405102, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "file_write_nanos": 319039016, "file_range_sync_nanos": 0, "file_fsync_nanos": 12568, "file_prepare_write_nanos": 33753, "lsm_state": [0, 0, 0, 14, 0, 0, 0]} 2024/11/23-01:19:27.220826 140024726648384 DEBG dcompact_worker.cpp:240: HttpPost: 200 OK: url = http://nlb-7zny4kaa1poal01o64.cn-shenzhen.nlb.aliyuncs.com:8443, body = {"instanceId":"nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137","labourId":"","dbId":"d89b4006-2803-486e-b7a2-759bcf348921","dbStarts":1732256054,"starts":1732295924,"executesMs":42811,"compactionJobId":16202,"attempt":0,"compactionInputRawBytes":1805342800,"compactionInputZipBytes":525515824,"compactionOutputRawBytes":0,"compactionOutputZipBytes":503641929,"headers":{"Accept":"*/*","Connection":"close","Host":"aliyun-topling-saas.topling.cn:18443","RemoteIp":"120.24.192.169","X-Forwarded-For":"120.24.192.169","region":"cn-shenzhen","token":"e6474c481bd4415abc537135cc03626b","instance-token":"e6474c481bd4415abc537135cc03626b","provider":"aliyun","CloudMarketInstanceId":"si-59c0ae5c955845588903","MeteringAssit":"","Transfer-Encoding":"chunked","traceparent":"00-9adc0e219b8866ae652c8d3ec2764c3c-005d69633bdc90db-00"}}, response = 2024/11/23-01:19:27.220903 140024726648384 INFO dcompact_worker.cpp:1459: finish /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-16202/att-00: olev 3, work 42.811 s, result 6.453 ms, install 0.833 ms, input{raw 1.681 GiB zip 501.171 MiB}