2024/11/23-04:51:13.598942 140024961644096 DEBG dcompact_worker.cpp:2214: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19638/att-00: fork to child time = 0.009030 sec 2024/11/23-04:51:13.599854 140024961644096 DEBG dcompact_worker.cpp:1013: Beg SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19638/att-00 2024/11/23-04:51:13.606580 140024961644096 DEBG dcompact_worker.cpp:1033: End SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19638/att-00 2024/11/23-04:51:13.607712 140024961644096 TRAC dcompact_worker.cpp:1083: INFO_LOG_LEVEL: rpc = INFO_LEVEL, env_var = undefined 2024/11/23-04:51:13.607958 140024961644096 [WARN] [column_family.cc:386] multiple cf_paths/db_paths and level_compaction_dynamic_level_bytes can't be used together 2024/11/23-04:51:13.653622 140024961644096 [version_set.cc:6208] Recovering from manifest file: /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-19638/att-00/MANIFEST-206347 2024/11/23-04:51:13.671417 140024961644096 [version_set.cc:6251] Recovered from manifest file:/worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-19638/att-00/MANIFEST-206347 succeeded,manifest_file_number is 206347, next_file_number is 245453, last_sequence is 3795535888, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 245248 2024/11/23-04:51:13.671424 140024961644096 [version_set.cc:6266] Column family [default] (ID 0), log number is 0 2024/11/23-04:51:13.671548 140024961644096 [version_set.cc:5721] Creating manifest 245453 2024/11/23-04:51:13.699196 140024961644096 DEBG dcompact_worker.cpp:1218: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19638/att-00: bottommost_level: fake = 1, rpc = 0 2024/11/23-04:51:13.718133 140024961644096 [compaction_job.cc:2437] [default] [JOB 19638] Compacting 1@2 + 14@3 files to L3, score 1.00, subcompactions 1 : 1 2024/11/23-04:51:13.718150 140024961644096 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 14682 Base level 2, inputs: [245393(23MB)], [245450(35MB) 245451(9240KB) 245322(35MB) 245348(35MB) 245349(34MB) 245350(34MB) 245351(35MB) 245352(35MB) 245353(34MB) 245354(35MB) 245355(33MB) 245356(33MB) 245357(35MB) 245426(34MB)] 2024/11/23-04:51:13.723716 140024961644096 [top_zip_table.cc:59] core git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-04:51:13.723748 140024961644096 [top_zip_table.cc:60] fsa git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-04:51:13.723769 140024961644096 [top_zip_table.cc:61] zbs git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-04:51:13.723774 140024961644096 [top_zip_table.cc:62] topling-zip_table_reader: git_version_hash_info_is: commit a4a382006cb82713acf5b3425835f22711877681 Author: leipeng Date: 2024-04-11 19:44:14 +0800 fixed_len_hole_index.cc: Add env bool FixedLenHoleIndexUseAVX512 for ut & debug 1. FixedLenHoleIndexUseAVX512 is only in unit tests or debug 2. In release mode, use avx512 by compile options(-march=) g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/23-04:51:13.723790 140024961644096 [top_zip_table.cc:64] topling-rocks git_version_hash_info_is: commit feab587e468621ba0204d47b4ffacc52e7c4290d Author: leipeng Date: 2024-03-22 13:35:06 +0800 ToplingZipTableBuilder::Add: immediately return after error This function returns void, and caller does not check builder->status() after calling this function and graceful abandon. So immediately return after error, and return error status in Finish(). g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/23-04:51:14.154130 140024961644096 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19638/att-00/245454.sst) /dev/shm/ToplingTemp/Topling-413684-xKUMU2 2024/11/23-04:51:14.720475 140024961644096 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19638/att-00/245454.sst): first pass time = 0.57's, 237.009'MB/sec 2024/11/23-04:51:16.511654 140024961644096 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19638/att-00/245454.sst): old prealloc_size = 147639500, real_size = 33107536 2024/11/23-04:51:16.512374 140024961644096 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19638/att-00/245454.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 932675 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1081 GB zip-val = 0.0311 GB avg-val = 115.91 avg-zval = 33.33 2024/11/23-04:51:16.513266 140024961644096 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19638/att-00/245454.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-04:51:17.784290 140024961644096 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19638/att-00/245454.sst): second pass time = 1.79's, 60.385'MB/sec, value only(80.5% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.27's, 29.248'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2609.943'MB/sec (index lex order gen) rebuild zvType time = 1.12's, 0.208'MB/sec write SST data time = 0.15's, 247.734'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 33426.099'MB/sec zip my value time = 1.79's, unzip length = 0.108'GB zip my value throughput = 60.385'MB/sec zip pipeline throughput = 60.385'MB/sec entries = 932675 avg-key = 28.00 avg-zkey = 1.92 avg-val = 115.91 avg-zval = 33.33 usrkeys = 932675 avg-key = 20.00 avg-zkey = 1.92 avg-val = 122.91 avg-zval = 33.33 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 932675 bytes = 3264384 } seq expand size = 6528725 multi value expand size = 0 cnt WriteAppend = 15 UnZipSize{ index = 0.0187 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0311 GB dict = 1.08 MB all = 0.0372 GB } UnZip/Zip{ index = 10.4436 value = 3.4773 dict = 1.00 all = 3.6058 } Zip/UnZip{ index = 0.0958 value = 0.2876 dict = 1.00 all = 0.2773 } ---------------------------- total value len = 0.114632 GB avg = 0.123 KB (by entry num) total key len = 0.026115 GB avg = 0.028 KB total ukey len = 0.018653 GB avg = 0.020 KB total ukey num = 0.000932675 Billion total entry num = 0.000932675 Billion write speed all = 0.001956588 MB/sec (with seq num) write speed all = 0.001852863 MB/sec (without seq num) 2024/11/23-04:51:17.817608 140024961644096 [compaction_job.cc:1948] [default] [JOB 19638] Generated table #245454: 932675 keys, 37222450 bytes, temperature: kWarm 2024/11/23-04:51:17.817698 140024961644096 EVENT_LOG_v1 {"time_micros": 1732308677817646, "cf_name": "default", "job": 19638, "event": "table_file_creation", "file_number": 245454, "file_size": 37222450, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3583362754, "largest_seqno": 3795143921, "table_properties": {"data_size": 31088064, "index_size": 1786112, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26114900, "raw_average_key_size": 28, "raw_value_size": 108102918, "raw_average_value_size": 115, "num_data_blocks": 1, "num_entries": 932675, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732308674, "oldest_key_time": 0, "file_creation_time": 1732308674, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 245454, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-04:51:17.853352 140024961644096 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19638/att-00/245455.sst) /dev/shm/ToplingTemp/Topling-413684-bM2b60 2024/11/23-04:51:18.833979 140024961644096 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19638/att-00/245455.sst): first pass time = 0.98's, 136.874'MB/sec 2024/11/23-04:51:20.465381 140024961644096 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19638/att-00/245455.sst): old prealloc_size = 147639500, real_size = 31766080 2024/11/23-04:51:20.465950 140024961644096 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19638/att-00/245455.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 931902 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1081 GB zip-val = 0.0297 GB avg-val = 116.03 avg-zval = 31.92 2024/11/23-04:51:20.466753 140024961644096 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19638/att-00/245455.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-04:51:21.624518 140024961644096 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19638/att-00/245455.sst): second pass time = 1.63's, 66.302'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.16's, 31.053'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3265.632'MB/sec (index lex order gen) rebuild zvType time = 1.01's, 0.231'MB/sec write SST data time = 0.15's, 241.707'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 32771.851'MB/sec zip my value time = 1.63's, unzip length = 0.108'GB zip my value throughput = 66.302'MB/sec zip pipeline throughput = 66.522'MB/sec entries = 931902 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.03 avg-zval = 31.92 usrkeys = 931902 avg-key = 20.00 avg-zkey = 1.91 avg-val = 123.03 avg-zval = 31.92 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 931902 bytes = 3378160 } seq expand size = 6523314 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0297 GB dict = 1.08 MB all = 0.0360 GB } UnZip/Zip{ index = 10.4451 value = 3.6346 dict = 1.00 all = 3.7288 } Zip/UnZip{ index = 0.0957 value = 0.2751 dict = 1.00 all = 0.2682 } ---------------------------- total value len = 0.229280 GB avg = 0.123 KB (by entry num) total key len = 0.052208 GB avg = 0.028 KB total ukey len = 0.037292 GB avg = 0.020 KB total ukey num = 0.001864577 Billion total entry num = 0.001864577 Billion write speed all = 0.003912892 MB/sec (with seq num) write speed all = 0.003705539 MB/sec (without seq num) 2024/11/23-04:51:21.656354 140024961644096 [compaction_job.cc:1948] [default] [JOB 19638] Generated table #245455: 931902 keys, 35994676 bytes, temperature: kWarm 2024/11/23-04:51:21.656419 140024961644096 EVENT_LOG_v1 {"time_micros": 1732308681656387, "cf_name": "default", "job": 19638, "event": "table_file_creation", "file_number": 245455, "file_size": 35994676, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3376774746, "largest_seqno": 3795143935, "table_properties": {"data_size": 29748528, "index_size": 1784384, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26093256, "raw_average_key_size": 28, "raw_value_size": 108124552, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 931902, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732308677, "oldest_key_time": 0, "file_creation_time": 1732308677, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 245455, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-04:51:21.696125 140024961644096 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19638/att-00/245456.sst) /dev/shm/ToplingTemp/Topling-413684-SfBPI0 2024/11/23-04:51:22.777362 140024961644096 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19638/att-00/245456.sst): first pass time = 1.08's, 124.138'MB/sec 2024/11/23-04:51:24.293892 140024961644096 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19638/att-00/245456.sst): old prealloc_size = 147639500, real_size = 32874784 2024/11/23-04:51:24.294446 140024961644096 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19638/att-00/245456.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 928115 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0309 GB avg-val = 116.61 avg-zval = 33.27 2024/11/23-04:51:24.295245 140024961644096 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19638/att-00/245456.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-04:51:25.265840 140024961644096 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19638/att-00/245456.sst): second pass time = 1.52's, 71.395'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.97's, 38.165'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3302.473'MB/sec (index lex order gen) rebuild zvType time = 0.83's, 0.280'MB/sec write SST data time = 0.14's, 258.447'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 34902.738'MB/sec zip my value time = 1.52's, unzip length = 0.108'GB zip my value throughput = 71.395'MB/sec zip pipeline throughput = 71.395'MB/sec entries = 928115 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.61 avg-zval = 33.27 usrkeys = 928115 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.61 avg-zval = 33.27 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 928115 bytes = 3364432 } seq expand size = 6496805 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0309 GB dict = 1.08 MB all = 0.0371 GB } UnZip/Zip{ index = 10.5154 value = 3.5052 dict = 1.00 all = 3.6184 } Zip/UnZip{ index = 0.0951 value = 0.2853 dict = 1.00 all = 0.2764 } ---------------------------- total value len = 0.344007 GB avg = 0.123 KB (by entry num) total key len = 0.078195 GB avg = 0.028 KB total ukey len = 0.055854 GB avg = 0.020 KB total ukey num = 0.002792692 Billion total entry num = 0.002792692 Billion write speed all = 0.005868634 MB/sec (with seq num) write speed all = 0.005558085 MB/sec (without seq num) 2024/11/23-04:51:25.301615 140024961644096 [compaction_job.cc:1948] [default] [JOB 19638] Generated table #245456: 928115 keys, 37092794 bytes, temperature: kWarm 2024/11/23-04:51:25.301798 140024961644096 EVENT_LOG_v1 {"time_micros": 1732308685301652, "cf_name": "default", "job": 19638, "event": "table_file_creation", "file_number": 245456, "file_size": 37092794, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3504428200, "largest_seqno": 3795143945, "table_properties": {"data_size": 30877328, "index_size": 1765248, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25987220, "raw_average_key_size": 28, "raw_value_size": 108230562, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 928115, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732308681, "oldest_key_time": 0, "file_creation_time": 1732308681, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 245456, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-04:51:25.350410 140024961644096 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19638/att-00/245457.sst) /dev/shm/ToplingTemp/Topling-413684-NVlAF4 2024/11/23-04:51:26.315209 140024961644096 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19638/att-00/245457.sst): first pass time = 0.96's, 139.122'MB/sec 2024/11/23-04:51:27.941047 140024961644096 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19638/att-00/245457.sst): old prealloc_size = 147639500, real_size = 32747360 2024/11/23-04:51:27.941605 140024961644096 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19638/att-00/245457.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 930859 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0307 GB avg-val = 116.19 avg-zval = 33.03 2024/11/23-04:51:27.942364 140024961644096 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19638/att-00/245457.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-04:51:28.893531 140024961644096 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19638/att-00/245457.sst): second pass time = 1.62's, 66.565'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.95's, 38.697'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3348.555'MB/sec (index lex order gen) rebuild zvType time = 0.82's, 0.283'MB/sec write SST data time = 0.13's, 284.334'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 31156.006'MB/sec zip my value time = 1.62's, unzip length = 0.108'GB zip my value throughput = 66.565'MB/sec zip pipeline throughput = 111.865'MB/sec entries = 930859 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.19 avg-zval = 33.03 usrkeys = 930859 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.19 avg-zval = 33.03 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 930859 bytes = 3258016 } seq expand size = 6516013 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0307 GB dict = 1.08 MB all = 0.0369 GB } UnZip/Zip{ index = 10.5130 value = 3.5179 dict = 1.00 all = 3.6416 } Zip/UnZip{ index = 0.0951 value = 0.2843 dict = 1.00 all = 0.2746 } ---------------------------- total value len = 0.458677 GB avg = 0.123 KB (by entry num) total key len = 0.104259 GB avg = 0.028 KB total ukey len = 0.074471 GB avg = 0.020 KB total ukey num = 0.003723551 Billion total entry num = 0.003723551 Billion write speed all = 0.007824446 MB/sec (with seq num) write speed all = 0.007410407 MB/sec (without seq num) 2024/11/23-04:51:28.926072 140024961644096 [compaction_job.cc:1948] [default] [JOB 19638] Generated table #245457: 930859 keys, 36856882 bytes, temperature: kWarm 2024/11/23-04:51:28.926137 140024961644096 EVENT_LOG_v1 {"time_micros": 1732308688926104, "cf_name": "default", "job": 19638, "event": "table_file_creation", "file_number": 245457, "file_size": 36856882, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3587898319, "largest_seqno": 3795143972, "table_properties": {"data_size": 30743568, "index_size": 1770880, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26064052, "raw_average_key_size": 28, "raw_value_size": 108153722, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 930859, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732308685, "oldest_key_time": 0, "file_creation_time": 1732308685, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 245457, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-04:51:28.961366 140024961644096 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19638/att-00/245458.sst) /dev/shm/ToplingTemp/Topling-413684-okHD62 2024/11/23-04:51:29.864326 140024961644096 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19638/att-00/245458.sst): first pass time = 0.90's, 148.647'MB/sec 2024/11/23-04:51:31.229131 140024961644096 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19638/att-00/245458.sst): old prealloc_size = 147639500, real_size = 34932288 2024/11/23-04:51:31.229829 140024961644096 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19638/att-00/245458.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 1084187 prefix = 4 raw-key = 0.0173 GB zip-key = 0.0021 GB avg-key = 16.00 avg-zkey = 1.93 raw-val = 0.1039 GB zip-val = 0.0326 GB avg-val = 95.80 avg-zval = 30.04 2024/11/23-04:51:31.230086 140024961644096 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19638/att-00/245458.sst: sumWaitingMem = 0.003 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0028 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-04:51:31.892430 140024961644096 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19638/att-00/245458.sst): second pass time = 1.36's, 76.172'MB/sec, value only(77.4% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.66's, 54.750'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3097.693'MB/sec (index lex order gen) rebuild zvType time = 0.52's, 0.522'MB/sec write SST data time = 0.14's, 254.055'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.031'MB, throughput = 30601.875'MB/sec zip my value time = 1.36's, unzip length = 0.104'GB zip my value throughput = 76.172'MB/sec zip pipeline throughput = 76.172'MB/sec entries = 1084187 avg-key = 28.00 avg-zkey = 1.93 avg-val = 95.80 avg-zval = 30.04 usrkeys = 1084187 avg-key = 20.00 avg-zkey = 1.93 avg-val = 96.71 avg-zval = 30.04 TagRS{ kinds = RS_Key0_TagN bytes = 169520 } TagArray{ size = 141328 bytes = 441664 } seq expand size = 989296 multi value expand size = 0 cnt WriteAppend = 17 UnZipSize{ index = 0.0217 GB value = 0.1039 GB dict = 1.03 MB all = 0.1342 GB } __ZipSize{ index = 0.0021 GB value = 0.0326 GB dict = 1.03 MB all = 0.0363 GB } UnZip/Zip{ index = 10.3802 value = 3.1886 dict = 1.00 all = 3.6960 } Zip/UnZip{ index = 0.0963 value = 0.3136 dict = 1.00 all = 0.2706 } ---------------------------- total value len = 0.563527 GB avg = 0.117 KB (by entry num) total key len = 0.134617 GB avg = 0.028 KB total ukey len = 0.096155 GB avg = 0.020 KB total ukey num = 0.004807738 Billion total entry num = 0.004807738 Billion write speed all = 0.009703334 MB/sec (with seq num) write speed all = 0.009168761 MB/sec (without seq num) 2024/11/23-04:51:31.925720 140024961644096 [compaction_job.cc:1948] [default] [JOB 19638] Generated table #245458: 1084187 keys, 36314437 bytes, temperature: kWarm 2024/11/23-04:51:31.925789 140024961644096 EVENT_LOG_v1 {"time_micros": 1732308691925751, "cf_name": "default", "job": 19638, "event": "table_file_creation", "file_number": 245458, "file_size": 36314437, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3795142827, "table_properties": {"data_size": 32572080, "index_size": 2088960, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 30357236, "raw_average_key_size": 28, "raw_value_size": 103860627, "raw_average_value_size": 95, "num_data_blocks": 1, "num_entries": 1084187, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732308688, "oldest_key_time": 0, "file_creation_time": 1732308688, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 245458, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-04:51:31.959927 140024961644096 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19638/att-00/245459.sst) /dev/shm/ToplingTemp/Topling-413684-IZrhB4 2024/11/23-04:51:32.766113 140024961644096 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19638/att-00/245459.sst): first pass time = 0.81's, 166.492'MB/sec 2024/11/23-04:51:34.157138 140024961644096 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19638/att-00/245459.sst): old prealloc_size = 147639500, real_size = 35619424 2024/11/23-04:51:34.157689 140024961644096 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19638/att-00/245459.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 923107 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1084 GB zip-val = 0.0336 GB avg-val = 117.40 avg-zval = 36.43 2024/11/23-04:51:34.158191 140024961644096 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19638/att-00/245459.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-04:51:34.963127 140024961644096 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19638/att-00/245459.sst): second pass time = 1.39's, 77.966'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.81's, 47.590'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3338.677'MB/sec (index lex order gen) rebuild zvType time = 0.68's, 0.342'MB/sec write SST data time = 0.13's, 295.123'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.083'MB, throughput = 26490.604'MB/sec zip my value time = 1.39's, unzip length = 0.108'GB zip my value throughput = 77.966'MB/sec zip pipeline throughput = 77.966'MB/sec entries = 923107 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.40 avg-zval = 36.43 usrkeys = 923107 avg-key = 20.00 avg-zkey = 1.90 avg-val = 121.02 avg-zval = 36.43 TagRS{ kinds = RS_Key0_TagN bytes = 144320 } TagArray{ size = 477563 bytes = 1731184 } seq expand size = 3342941 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0185 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0336 GB dict = 1.08 MB all = 0.0384 GB } UnZip/Zip{ index = 10.5124 value = 3.2222 dict = 1.00 all = 3.4992 } Zip/UnZip{ index = 0.0951 value = 0.3103 dict = 1.00 all = 0.2858 } ---------------------------- total value len = 0.675240 GB avg = 0.118 KB (by entry num) total key len = 0.160464 GB avg = 0.028 KB total ukey len = 0.114617 GB avg = 0.020 KB total ukey num = 0.005730845 Billion total entry num = 0.005730845 Billion write speed all = 0.011614765 MB/sec (with seq num) write speed all = 0.010977578 MB/sec (without seq num) 2024/11/23-04:51:34.997670 140024961644096 [compaction_job.cc:1948] [default] [JOB 19638] Generated table #245459: 923107 keys, 38356361 bytes, temperature: kWarm 2024/11/23-04:51:34.997737 140024961644096 EVENT_LOG_v1 {"time_micros": 1732308694997702, "cf_name": "default", "job": 19638, "event": "table_file_creation", "file_number": 245459, "file_size": 38356361, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3702350095, "table_properties": {"data_size": 33632208, "index_size": 1756224, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25846996, "raw_average_key_size": 28, "raw_value_size": 108370870, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 923107, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732308691, "oldest_key_time": 0, "file_creation_time": 1732308691, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 245459, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-04:51:35.037702 140024961644096 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19638/att-00/245460.sst) /dev/shm/ToplingTemp/Topling-413684-gCsIW0 2024/11/23-04:51:35.840994 140024961644096 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19638/att-00/245460.sst): first pass time = 0.80's, 167.091'MB/sec 2024/11/23-04:51:37.171571 140024961644096 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19638/att-00/245460.sst): old prealloc_size = 147639500, real_size = 32152704 2024/11/23-04:51:37.172125 140024961644096 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19638/att-00/245460.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927799 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0302 GB avg-val = 116.66 avg-zval = 32.50 2024/11/23-04:51:37.172932 140024961644096 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19638/att-00/245460.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-04:51:38.074528 140024961644096 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19638/att-00/245460.sst): second pass time = 1.33's, 81.417'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.90's, 40.280'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3331.950'MB/sec (index lex order gen) rebuild zvType time = 0.77's, 0.300'MB/sec write SST data time = 0.13's, 279.895'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 32178.405'MB/sec zip my value time = 1.33's, unzip length = 0.108'GB zip my value throughput = 81.417'MB/sec zip pipeline throughput = 81.417'MB/sec entries = 927799 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.66 avg-zval = 32.50 usrkeys = 927799 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.66 avg-zval = 32.50 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 927799 bytes = 3363280 } seq expand size = 6494593 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0302 GB dict = 1.08 MB all = 0.0364 GB } UnZip/Zip{ index = 10.5122 value = 3.5894 dict = 1.00 all = 3.6904 } Zip/UnZip{ index = 0.0951 value = 0.2786 dict = 1.00 all = 0.2710 } ---------------------------- total value len = 0.789974 GB avg = 0.119 KB (by entry num) total key len = 0.186442 GB avg = 0.028 KB total ukey len = 0.133173 GB avg = 0.020 KB total ukey num = 0.006658644 Billion total entry num = 0.006658644 Billion write speed all = 0.013569824 MB/sec (with seq num) write speed all = 0.012829511 MB/sec (without seq num) 2024/11/23-04:51:38.105791 140024961644096 [compaction_job.cc:1948] [default] [JOB 19638] Generated table #245460: 927799 keys, 36369908 bytes, temperature: kWarm 2024/11/23-04:51:38.105852 140024961644096 EVENT_LOG_v1 {"time_micros": 1732308698105820, "cf_name": "default", "job": 19638, "event": "table_file_creation", "file_number": 245460, "file_size": 36369908, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3487497056, "largest_seqno": 3795143440, "table_properties": {"data_size": 30155376, "index_size": 1765184, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25978372, "raw_average_key_size": 28, "raw_value_size": 108239394, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927799, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732308695, "oldest_key_time": 0, "file_creation_time": 1732308695, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 245460, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-04:51:38.140403 140024961644096 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19638/att-00/245461.sst) /dev/shm/ToplingTemp/Topling-413684-hilLk2 2024/11/23-04:51:39.043530 140024961644096 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19638/att-00/245461.sst): first pass time = 0.90's, 148.620'MB/sec 2024/11/23-04:51:40.343648 140024961644096 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19638/att-00/245461.sst): old prealloc_size = 147639500, real_size = 31155728 2024/11/23-04:51:40.344203 140024961644096 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19638/att-00/245461.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 922691 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1084 GB zip-val = 0.0292 GB avg-val = 117.46 avg-zval = 31.60 2024/11/23-04:51:40.344985 140024961644096 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19638/att-00/245461.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-04:51:41.203036 140024961644096 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19638/att-00/245461.sst): second pass time = 1.30's, 83.407'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.86's, 41.009'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3326.412'MB/sec (index lex order gen) rebuild zvType time = 0.73's, 0.316'MB/sec write SST data time = 0.13's, 272.793'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.083'MB, throughput = 33286.887'MB/sec zip my value time = 1.30's, unzip length = 0.108'GB zip my value throughput = 83.407'MB/sec zip pipeline throughput = 83.407'MB/sec entries = 922691 avg-key = 28.00 avg-zkey = 1.92 avg-val = 117.46 avg-zval = 31.60 usrkeys = 922691 avg-key = 20.00 avg-zkey = 1.92 avg-val = 124.46 avg-zval = 31.60 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 922691 bytes = 3229440 } seq expand size = 6458837 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0292 GB dict = 1.08 MB all = 0.0352 GB } UnZip/Zip{ index = 10.4434 value = 3.7171 dict = 1.00 all = 3.8085 } Zip/UnZip{ index = 0.0958 value = 0.2690 dict = 1.00 all = 0.2626 } ---------------------------- total value len = 0.904816 GB avg = 0.119 KB (by entry num) total key len = 0.212277 GB avg = 0.028 KB total ukey len = 0.151627 GB avg = 0.020 KB total ukey num = 0.007581335 Billion total entry num = 0.007581335 Billion write speed all = 0.015524214 MB/sec (with seq num) write speed all = 0.014681353 MB/sec (without seq num) 2024/11/23-04:51:41.234830 140024961644096 [compaction_job.cc:1948] [default] [JOB 19638] Generated table #245461: 922691 keys, 35241602 bytes, temperature: kWarm 2024/11/23-04:51:41.234893 140024961644096 EVENT_LOG_v1 {"time_micros": 1732308701234859, "cf_name": "default", "job": 19638, "event": "table_file_creation", "file_number": 245461, "file_size": 35241602, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3640424783, "largest_seqno": 3795143457, "table_properties": {"data_size": 29157824, "index_size": 1767040, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25835348, "raw_average_key_size": 28, "raw_value_size": 108382482, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 922691, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732308698, "oldest_key_time": 0, "file_creation_time": 1732308698, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 245461, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-04:51:41.271132 140024961644096 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19638/att-00/245462.sst) /dev/shm/ToplingTemp/Topling-413684-yLJtO3 2024/11/23-04:51:42.105724 140024961644096 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19638/att-00/245462.sst): first pass time = 0.83's, 160.826'MB/sec 2024/11/23-04:51:43.465563 140024961644096 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19638/att-00/245462.sst): old prealloc_size = 147639500, real_size = 32197040 2024/11/23-04:51:43.466097 140024961644096 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19638/att-00/245462.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 930625 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0302 GB avg-val = 116.22 avg-zval = 32.44 2024/11/23-04:51:43.466912 140024961644096 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19638/att-00/245462.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-04:51:44.394849 140024961644096 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19638/att-00/245462.sst): second pass time = 1.36's, 79.583'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.93's, 39.194'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3462.700'MB/sec (index lex order gen) rebuild zvType time = 0.80's, 0.291'MB/sec write SST data time = 0.13's, 282.271'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 31732.199'MB/sec zip my value time = 1.36's, unzip length = 0.108'GB zip my value throughput = 79.583'MB/sec zip pipeline throughput = 79.583'MB/sec entries = 930625 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.22 avg-zval = 32.44 usrkeys = 930625 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.22 avg-zval = 32.44 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 930625 bytes = 3373536 } seq expand size = 6514375 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0302 GB dict = 1.08 MB all = 0.0364 GB } UnZip/Zip{ index = 10.5118 value = 3.5822 dict = 1.00 all = 3.6851 } Zip/UnZip{ index = 0.0951 value = 0.2792 dict = 1.00 all = 0.2714 } ---------------------------- total value len = 1.019490 GB avg = 0.120 KB (by entry num) total key len = 0.238335 GB avg = 0.028 KB total ukey len = 0.170239 GB avg = 0.020 KB total ukey num = 0.008511960 Billion total entry num = 0.008511960 Billion write speed all = 0.017479190 MB/sec (with seq num) write speed all = 0.016532908 MB/sec (without seq num) 2024/11/23-04:51:44.427548 140024961644096 [compaction_job.cc:1948] [default] [JOB 19638] Generated table #245462: 930625 keys, 36421798 bytes, temperature: kWarm 2024/11/23-04:51:44.427615 140024961644096 EVENT_LOG_v1 {"time_micros": 1732308704427578, "cf_name": "default", "job": 19638, "event": "table_file_creation", "file_number": 245462, "file_size": 36421798, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3375334738, "largest_seqno": 3795143469, "table_properties": {"data_size": 30193568, "index_size": 1770624, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26057500, "raw_average_key_size": 28, "raw_value_size": 108160302, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 930625, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732308701, "oldest_key_time": 0, "file_creation_time": 1732308701, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 245462, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-04:51:44.469114 140024961644096 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19638/att-00/245463.sst) /dev/shm/ToplingTemp/Topling-413684-kRayc3 2024/11/23-04:51:45.259211 140024961644096 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19638/att-00/245463.sst): first pass time = 0.79's, 169.882'MB/sec 2024/11/23-04:51:46.579566 140024961644096 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19638/att-00/245463.sst): old prealloc_size = 147639500, real_size = 32254368 2024/11/23-04:51:46.580119 140024961644096 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19638/att-00/245463.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 921752 prefix = 4 raw-key = 0.0147 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1084 GB zip-val = 0.0303 GB avg-val = 117.61 avg-zval = 32.83 2024/11/23-04:51:46.580940 140024961644096 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19638/att-00/245463.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-04:51:47.453072 140024961644096 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19638/att-00/245463.sst): second pass time = 1.32's, 82.147'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.87's, 41.734'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3336.905'MB/sec (index lex order gen) rebuild zvType time = 0.74's, 0.309'MB/sec write SST data time = 0.13's, 284.605'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.083'MB, throughput = 31374.685'MB/sec zip my value time = 1.32's, unzip length = 0.108'GB zip my value throughput = 82.147'MB/sec zip pipeline throughput = 82.147'MB/sec entries = 921752 avg-key = 28.00 avg-zkey = 1.92 avg-val = 117.61 avg-zval = 32.83 usrkeys = 921752 avg-key = 20.00 avg-zkey = 1.92 avg-val = 124.61 avg-zval = 32.83 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 921752 bytes = 3341360 } seq expand size = 6452264 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0184 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0303 GB dict = 1.08 MB all = 0.0365 GB } UnZip/Zip{ index = 10.4426 value = 3.5828 dict = 1.00 all = 3.6818 } Zip/UnZip{ index = 0.0958 value = 0.2791 dict = 1.00 all = 0.2716 } ---------------------------- total value len = 1.134351 GB avg = 0.120 KB (by entry num) total key len = 0.264144 GB avg = 0.028 KB total ukey len = 0.188674 GB avg = 0.020 KB total ukey num = 0.009433712 Billion total entry num = 0.009433712 Billion write speed all = 0.019433165 MB/sec (with seq num) write speed all = 0.018384456 MB/sec (without seq num) 2024/11/23-04:51:47.485004 140024961644096 [compaction_job.cc:1948] [default] [JOB 19638] Generated table #245463: 921752 keys, 36454614 bytes, temperature: kWarm 2024/11/23-04:51:47.485066 140024961644096 EVENT_LOG_v1 {"time_micros": 1732308707485034, "cf_name": "default", "job": 19638, "event": "table_file_creation", "file_number": 245463, "file_size": 36454614, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3273701103, "largest_seqno": 3795143483, "table_properties": {"data_size": 30258384, "index_size": 1765376, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25809056, "raw_average_key_size": 28, "raw_value_size": 108408708, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 921752, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732308704, "oldest_key_time": 0, "file_creation_time": 1732308704, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 245463, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-04:51:47.520221 140024961644096 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19638/att-00/245464.sst) /dev/shm/ToplingTemp/Topling-413684-KBQQV2 2024/11/23-04:51:48.299533 140024961644096 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19638/att-00/245464.sst): first pass time = 0.78's, 172.235'MB/sec 2024/11/23-04:51:49.660465 140024961644096 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19638/att-00/245464.sst): old prealloc_size = 147639500, real_size = 33008496 2024/11/23-04:51:49.661015 140024961644096 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19638/att-00/245464.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 928591 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1082 GB zip-val = 0.0310 GB avg-val = 116.54 avg-zval = 33.38 2024/11/23-04:51:49.661772 140024961644096 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19638/att-00/245464.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-04:51:50.616839 140024961644096 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19638/att-00/245464.sst): second pass time = 1.36's, 79.587'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.96's, 38.684'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3375.582'MB/sec (index lex order gen) rebuild zvType time = 0.83's, 0.280'MB/sec write SST data time = 0.13's, 289.358'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 30779.663'MB/sec zip my value time = 1.36's, unzip length = 0.108'GB zip my value throughput = 79.587'MB/sec zip pipeline throughput = 79.587'MB/sec entries = 928591 avg-key = 28.00 avg-zkey = 1.92 avg-val = 116.54 avg-zval = 33.38 usrkeys = 928591 avg-key = 20.00 avg-zkey = 1.92 avg-val = 123.54 avg-zval = 33.38 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 928591 bytes = 3134016 } seq expand size = 6500137 multi value expand size = 0 cnt WriteAppend = 15 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0310 GB dict = 1.08 MB all = 0.0370 GB } UnZip/Zip{ index = 10.4436 value = 3.4911 dict = 1.00 all = 3.6279 } Zip/UnZip{ index = 0.0958 value = 0.2864 dict = 1.00 all = 0.2756 } ---------------------------- total value len = 1.249069 GB avg = 0.121 KB (by entry num) total key len = 0.290144 GB avg = 0.028 KB total ukey len = 0.207246 GB avg = 0.020 KB total ukey num = 0.010362303 Billion total entry num = 0.010362303 Billion write speed all = 0.021387609 MB/sec (with seq num) write speed all = 0.020235722 MB/sec (without seq num) 2024/11/23-04:51:50.651791 140024961644096 [compaction_job.cc:1948] [default] [JOB 19638] Generated table #245464: 928591 keys, 36995652 bytes, temperature: kWarm 2024/11/23-04:51:50.651854 140024961644096 EVENT_LOG_v1 {"time_micros": 1732308710651821, "cf_name": "default", "job": 19638, "event": "table_file_creation", "file_number": 245464, "file_size": 36995652, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3680980241, "largest_seqno": 3795143786, "table_properties": {"data_size": 30997856, "index_size": 1778304, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26000548, "raw_average_key_size": 28, "raw_value_size": 108217238, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 928591, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732308707, "oldest_key_time": 0, "file_creation_time": 1732308707, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 245464, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-04:51:50.685573 140024961644096 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19638/att-00/245465.sst) /dev/shm/ToplingTemp/Topling-413684-XbXy22 2024/11/23-04:51:51.550030 140024961644096 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19638/att-00/245465.sst): first pass time = 0.86's, 155.268'MB/sec 2024/11/23-04:51:52.908344 140024961644096 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19638/att-00/245465.sst): old prealloc_size = 147639500, real_size = 34429936 2024/11/23-04:51:52.908881 140024961644096 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19638/att-00/245465.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 928713 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0324 GB avg-val = 116.52 avg-zval = 34.92 2024/11/23-04:51:52.909675 140024961644096 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19638/att-00/245465.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-04:51:53.827377 140024961644096 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19638/att-00/245465.sst): second pass time = 1.36's, 79.735'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.92's, 42.056'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3431.159'MB/sec (index lex order gen) rebuild zvType time = 0.79's, 0.294'MB/sec write SST data time = 0.13's, 302.917'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 28272.477'MB/sec zip my value time = 1.36's, unzip length = 0.108'GB zip my value throughput = 79.735'MB/sec zip pipeline throughput = 79.735'MB/sec entries = 928713 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.52 avg-zval = 34.92 usrkeys = 928713 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.52 avg-zval = 34.92 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 928713 bytes = 3366592 } seq expand size = 6500991 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0324 GB dict = 1.08 MB all = 0.0386 GB } UnZip/Zip{ index = 10.5127 value = 3.3368 dict = 1.00 all = 3.4727 } Zip/UnZip{ index = 0.0951 value = 0.2997 dict = 1.00 all = 0.2880 } ---------------------------- total value len = 1.363784 GB avg = 0.121 KB (by entry num) total key len = 0.316148 GB avg = 0.028 KB total ukey len = 0.225820 GB avg = 0.020 KB total ukey num = 0.011291016 Billion total entry num = 0.011291016 Billion write speed all = 0.023341877 MB/sec (with seq num) write speed all = 0.022086809 MB/sec (without seq num) 2024/11/23-04:51:53.860575 140024961644096 [compaction_job.cc:1948] [default] [JOB 19638] Generated table #245465: 928713 keys, 38649784 bytes, temperature: kWarm 2024/11/23-04:51:53.860642 140024961644096 EVENT_LOG_v1 {"time_micros": 1732308713860605, "cf_name": "default", "job": 19638, "event": "table_file_creation", "file_number": 245465, "file_size": 38649784, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3369194706, "largest_seqno": 3795143521, "table_properties": {"data_size": 32430752, "index_size": 1766848, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26003964, "raw_average_key_size": 28, "raw_value_size": 108213842, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 928713, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732308710, "oldest_key_time": 0, "file_creation_time": 1732308710, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 245465, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-04:51:53.894945 140024961644096 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19638/att-00/245466.sst) /dev/shm/ToplingTemp/Topling-413684-o6UjN2 2024/11/23-04:51:54.712054 140024961644096 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19638/att-00/245466.sst): first pass time = 0.82's, 164.266'MB/sec 2024/11/23-04:51:56.030292 140024961644096 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19638/att-00/245466.sst): old prealloc_size = 147639500, real_size = 33042352 2024/11/23-04:51:56.030844 140024961644096 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19638/att-00/245466.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 929322 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1082 GB zip-val = 0.0310 GB avg-val = 116.43 avg-zval = 33.39 2024/11/23-04:51:56.031613 140024961644096 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19638/att-00/245466.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-04:51:56.986952 140024961644096 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19638/att-00/245466.sst): second pass time = 1.32's, 82.148'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.96's, 38.832'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3380.133'MB/sec (index lex order gen) rebuild zvType time = 0.83's, 0.280'MB/sec write SST data time = 0.13's, 291.845'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 31943.542'MB/sec zip my value time = 1.32's, unzip length = 0.108'GB zip my value throughput = 82.148'MB/sec zip pipeline throughput = 82.148'MB/sec entries = 929322 avg-key = 28.00 avg-zkey = 1.92 avg-val = 116.43 avg-zval = 33.39 usrkeys = 929322 avg-key = 20.00 avg-zkey = 1.92 avg-val = 123.43 avg-zval = 33.39 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 929322 bytes = 3252640 } seq expand size = 6505254 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0310 GB dict = 1.08 MB all = 0.0371 GB } UnZip/Zip{ index = 10.4420 value = 3.4869 dict = 1.00 all = 3.6131 } Zip/UnZip{ index = 0.0958 value = 0.2868 dict = 1.00 all = 0.2768 } ---------------------------- total value len = 1.478486 GB avg = 0.121 KB (by entry num) total key len = 0.342169 GB avg = 0.028 KB total ukey len = 0.244407 GB avg = 0.020 KB total ukey num = 0.012220338 Billion total entry num = 0.012220338 Billion write speed all = 0.025296049 MB/sec (with seq num) write speed all = 0.023937741 MB/sec (without seq num) 2024/11/23-04:51:57.018879 140024961644096 [compaction_job.cc:1948] [default] [JOB 19638] Generated table #245466: 929322 keys, 37148028 bytes, temperature: kWarm 2024/11/23-04:51:57.018943 140024961644096 EVENT_LOG_v1 {"time_micros": 1732308717018911, "cf_name": "default", "job": 19638, "event": "table_file_creation", "file_number": 245466, "file_size": 37148028, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3610601794, "largest_seqno": 3795143837, "table_properties": {"data_size": 31029856, "index_size": 1779968, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26021016, "raw_average_key_size": 28, "raw_value_size": 108196852, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 929322, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732308713, "oldest_key_time": 0, "file_creation_time": 1732308713, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 245466, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-04:51:57.055174 140024961644096 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19638/att-00/245467.sst) /dev/shm/ToplingTemp/Topling-413684-9O96I4 2024/11/23-04:51:57.257425 140024961644096 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19638/att-00/245467.sst): first pass time = 0.20's, 245.430'MB/sec 2024/11/23-04:51:57.731131 140024961644096 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19638/att-00/245467.sst): old prealloc_size = 147639500, real_size = 13166944 2024/11/23-04:51:57.731383 140024961644096 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19638/att-00/245467.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 346989 prefix = 4 raw-key = 0.0056 GB zip-key = 0.0007 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.0399 GB zip-val = 0.0124 GB avg-val = 115.03 avg-zval = 35.79 2024/11/23-04:51:57.731713 140024961644096 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19638/att-00/245467.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0008 GB, waited 0.000 sec, Key+Value = 0.050 GB 2024/11/23-04:51:58.061555 140024961644096 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19638/att-00/245467.sst): second pass time = 0.47's, 84.423'MB/sec, value only(80.4% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.33's, 44.632'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2881.794'MB/sec (index lex order gen) rebuild zvType time = 0.28's, 0.308'MB/sec write SST data time = 0.05's, 303.237'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.406'MB, throughput = 11725.245'MB/sec zip my value time = 0.47's, unzip length = 0.040'GB zip my value throughput = 84.423'MB/sec zip pipeline throughput = 84.423'MB/sec entries = 346989 avg-key = 28.00 avg-zkey = 1.90 avg-val = 115.03 avg-zval = 35.79 usrkeys = 346989 avg-key = 20.00 avg-zkey = 1.90 avg-val = 122.03 avg-zval = 35.79 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 346989 bytes = 1257856 } seq expand size = 2428923 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0069 GB value = 0.0399 GB dict = 0.41 MB all = 0.0496 GB } __ZipSize{ index = 0.0007 GB value = 0.0124 GB dict = 0.41 MB all = 0.0147 GB } UnZip/Zip{ index = 10.5001 value = 3.2140 dict = 1.00 all = 3.3654 } Zip/UnZip{ index = 0.0952 value = 0.3111 dict = 1.00 all = 0.2971 } ---------------------------- total value len = 1.520829 GB avg = 0.121 KB (by entry num) total key len = 0.351885 GB avg = 0.028 KB total ukey len = 0.251347 GB avg = 0.020 KB total ukey num = 0.012567327 Billion total entry num = 0.012567327 Billion write speed all = 0.026018965 MB/sec (with seq num) write speed all = 0.024622110 MB/sec (without seq num) 2024/11/23-04:51:58.077880 140024961644096 [compaction_job.cc:1948] [default] [JOB 19638] Generated table #245467: 346989 keys, 14747275 bytes, temperature: kWarm 2024/11/23-04:51:58.077937 140024961644096 EVENT_LOG_v1 {"time_micros": 1732308718077907, "cf_name": "default", "job": 19638, "event": "table_file_creation", "file_number": 245467, "file_size": 14747275, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3516470397, "largest_seqno": 3795139002, "table_properties": {"data_size": 12419088, "index_size": 660928, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 9715692, "raw_average_key_size": 28, "raw_value_size": 39914450, "raw_average_value_size": 115, "num_data_blocks": 1, "num_entries": 346989, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732308717, "oldest_key_time": 0, "file_creation_time": 1732308717, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 245467, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-04:51:58.092560 140024961644096 [compaction_job.cc:703] job-19638: subcompact[0], size: 0.493866 G, files: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19638/att-00 [245454,245455,245456,245457,245458,245459,245460,245461,245462,245463,245464,245465,245466,245467] 2024/11/23-04:51:58.178276 140024961644096 (Original Log Time 2024/11/23-04:51:13.718206) EVENT_LOG_v1 {"time_micros": 1732308673718161, "job": 19638, "event": "compaction_started", "compaction_reason": "FilesMarkedForCompaction", "files_L2": [245393], "files_L3": [245450, 245451, 245322, 245348, 245349, 245350, 245351, 245352, 245353, 245354, 245355, 245356, 245357, 245426], "score": 0.997454, "input_data_size": 509762434, "oldest_snapshot_seqno": 3795535854} 2024/11/23-04:51:58.178280 140024961644096 (Original Log Time 2024/11/23-04:51:58.177568) [compaction_job.cc:2022] [default] [JOB 19638] Compacted 1@2 + 14@3 files to L3 => 493866261 bytes 2024/11/23-04:51:58.178281 140024961644096 (Original Log Time 2024/11/23-04:51:58.178213) [compaction_job.cc:1224] [default] compacted to: files[0 0 0 14 0 0 0] max score 0.02, MB/sec: 11.5 rd, 11.1 wr, level 3, files in(1, 14) out(14 +0 blob) MB in(24.0, 462.2 +0.0 blob) out(471.0 +0.0 blob), read-write-amplify(39.9) write-amplify(19.7) OK, records in: 12636324, records dropped: 68997 output_compression: Snappy 2024/11/23-04:51:58.178287 140024961644096 (Original Log Time 2024/11/23-04:51:58.178257) EVENT_LOG_v1 {"time_micros": 1732308718178236, "cf": "default", "job": 19638, "event": "compaction_finished", "compaction_time_micros": 44374361, "compaction_time_cpu_micros": 20002113, "output_level": 3, "num_output_files": 14, "total_output_size": 493866261, "num_input_records": 12636324, "num_output_records": 12567327, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "file_write_nanos": 317744874, "file_range_sync_nanos": 0, "file_fsync_nanos": 13351, "file_prepare_write_nanos": 33282, "lsm_state": [0, 0, 0, 14, 0, 0, 0]} 2024/11/23-04:51:58.320896 140024961644096 DEBG dcompact_worker.cpp:240: HttpPost: 200 OK: url = http://nlb-7zny4kaa1poal01o64.cn-shenzhen.nlb.aliyuncs.com:8443, body = {"instanceId":"nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137","labourId":"","dbId":"d89b4006-2803-486e-b7a2-759bcf348921","dbStarts":1732256054,"starts":1732308673,"executesMs":44572,"compactionJobId":19638,"attempt":0,"compactionInputRawBytes":1804259249,"compactionInputZipBytes":509762434,"compactionOutputRawBytes":0,"compactionOutputZipBytes":493866261,"headers":{"Accept":"*/*","Connection":"close","Host":"aliyun-topling-saas.topling.cn:18443","RemoteIp":"120.24.192.169","X-Forwarded-For":"120.24.192.169","region":"cn-shenzhen","token":"e6474c481bd4415abc537135cc03626b","instance-token":"e6474c481bd4415abc537135cc03626b","provider":"aliyun","CloudMarketInstanceId":"si-59c0ae5c955845588903","MeteringAssit":"","Transfer-Encoding":"chunked","traceparent":"00-c8fa190f083a2cf6387492f153921dfb-de91e3c5e0e65be3-00"}}, response = 2024/11/23-04:51:58.320958 140024961644096 INFO dcompact_worker.cpp:1459: finish /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-19638/att-00: olev 3, work 44.572 s, result 6.303 ms, install 0.737 ms, input{raw 1.680 GiB zip 486.147 MiB}