2024/11/22-16:32:39.975616 140025104320064 DEBG dcompact_worker.cpp:2214: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04657/att-00: fork to child time = 0.009657 sec 2024/11/22-16:32:39.976379 140025104320064 DEBG dcompact_worker.cpp:1013: Beg SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04657/att-00 2024/11/22-16:32:39.983457 140025104320064 DEBG dcompact_worker.cpp:1033: End SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04657/att-00 2024/11/22-16:32:39.984557 140025104320064 TRAC dcompact_worker.cpp:1083: INFO_LOG_LEVEL: rpc = INFO_LEVEL, env_var = undefined 2024/11/22-16:32:39.984834 140025104320064 [WARN] [column_family.cc:386] multiple cf_paths/db_paths and level_compaction_dynamic_level_bytes can't be used together 2024/11/22-16:32:40.029835 140025104320064 [version_set.cc:6208] Recovering from manifest file: /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-04657/att-00/MANIFEST-206347 2024/11/22-16:32:40.061870 140025104320064 [version_set.cc:6251] Recovered from manifest file:/worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-04657/att-00/MANIFEST-206347 succeeded,manifest_file_number is 206347, next_file_number is 214772, last_sequence is 3382824101, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 214634 2024/11/22-16:32:40.061877 140025104320064 [version_set.cc:6266] Column family [default] (ID 0), log number is 0 2024/11/22-16:32:40.061974 140025104320064 [version_set.cc:5721] Creating manifest 214772 2024/11/22-16:32:40.092094 140025104320064 DEBG dcompact_worker.cpp:1218: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04657/att-00: bottommost_level: fake = 1, rpc = 0 2024/11/22-16:32:40.112585 140025104320064 [compaction_job.cc:2437] [default] [JOB 4657] Compacting 1@2 + 13@3 files to L3, score 0.89, subcompactions 1 : 1 2024/11/22-16:32:40.112599 140025104320064 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 3627 Base level 2, inputs: [214766(27MB)], [214727(36MB) 214728(36MB) 214729(36MB) 214730(36MB) 214731(35MB) 214732(36MB) 214733(38MB) 214734(38MB) 214735(37MB) 214736(35MB) 214737(35MB) 214738(37MB) 214739(38MB)] 2024/11/22-16:32:40.119247 140025104320064 [top_zip_table.cc:59] core git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/22-16:32:40.119277 140025104320064 [top_zip_table.cc:60] fsa git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/22-16:32:40.119298 140025104320064 [top_zip_table.cc:61] zbs git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/22-16:32:40.119303 140025104320064 [top_zip_table.cc:62] topling-zip_table_reader: git_version_hash_info_is: commit a4a382006cb82713acf5b3425835f22711877681 Author: leipeng Date: 2024-04-11 19:44:14 +0800 fixed_len_hole_index.cc: Add env bool FixedLenHoleIndexUseAVX512 for ut & debug 1. FixedLenHoleIndexUseAVX512 is only in unit tests or debug 2. In release mode, use avx512 by compile options(-march=) g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/22-16:32:40.119314 140025104320064 [top_zip_table.cc:64] topling-rocks git_version_hash_info_is: commit feab587e468621ba0204d47b4ffacc52e7c4290d Author: leipeng Date: 2024-03-22 13:35:06 +0800 ToplingZipTableBuilder::Add: immediately return after error This function returns void, and caller does not check builder->status() after calling this function and graceful abandon. So immediately return after error, and return error status in Finish(). g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/22-16:32:40.602328 140025104320064 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04657/att-00/214773.sst) /dev/shm/ToplingTemp/Topling-200173-uwzgBn 2024/11/22-16:32:41.146717 140025104320064 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04657/att-00/214773.sst): first pass time = 0.54's, 246.565'MB/sec 2024/11/22-16:32:43.774462 140025104320064 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04657/att-00/214773.sst): old prealloc_size = 147639500, real_size = 33869888 2024/11/22-16:32:43.775175 140025104320064 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04657/att-00/214773.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 921221 prefix = 4 raw-key = 0.0147 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1084 GB zip-val = 0.0319 GB avg-val = 117.70 avg-zval = 34.60 2024/11/22-16:32:43.776036 140025104320064 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04657/att-00/214773.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-16:32:45.364160 140025104320064 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04657/att-00/214773.sst): second pass time = 2.63's, 41.284'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.59's, 23.802'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2537.028'MB/sec (index lex order gen) rebuild zvType time = 1.26's, 0.183'MB/sec write SST data time = 0.33's, 114.025'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.084'MB, throughput = 28532.410'MB/sec zip my value time = 2.63's, unzip length = 0.108'GB zip my value throughput = 41.284'MB/sec zip pipeline throughput = 131.092'MB/sec entries = 921221 avg-key = 28.00 avg-zkey = 1.92 avg-val = 117.70 avg-zval = 34.60 usrkeys = 921221 avg-key = 20.00 avg-zkey = 1.92 avg-val = 124.70 avg-zval = 34.60 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 921221 bytes = 3109136 } seq expand size = 6448547 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0184 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0319 GB dict = 1.08 MB all = 0.0378 GB } UnZip/Zip{ index = 10.4434 value = 3.4015 dict = 1.00 all = 3.5471 } Zip/UnZip{ index = 0.0958 value = 0.2940 dict = 1.00 all = 0.2819 } ---------------------------- total value len = 0.114872 GB avg = 0.125 KB (by entry num) total key len = 0.025794 GB avg = 0.028 KB total ukey len = 0.018424 GB avg = 0.020 KB total ukey num = 0.000921221 Billion total entry num = 0.000921221 Billion write speed all = 0.005092498 MB/sec (with seq num) write speed all = 0.004825693 MB/sec (without seq num) 2024/11/22-16:32:45.427319 140025104320064 [compaction_job.cc:1948] [default] [JOB 4657] Generated table #214773: 921221 keys, 37838294 bytes, temperature: kWarm 2024/11/22-16:32:45.427428 140025104320064 EVENT_LOG_v1 {"time_micros": 1732264365427360, "cf_name": "default", "job": 4657, "event": "table_file_creation", "file_number": 214773, "file_size": 37838294, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3273702550, "largest_seqno": 3382795768, "table_properties": {"data_size": 31875184, "index_size": 1764224, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25794188, "raw_average_key_size": 28, "raw_value_size": 108423614, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 921221, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732264360, "oldest_key_time": 0, "file_creation_time": 1732264360, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 214773, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-16:32:45.534919 140025104320064 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04657/att-00/214774.sst) /dev/shm/ToplingTemp/Topling-200173-a323Qm 2024/11/22-16:32:46.623270 140025104320064 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04657/att-00/214774.sst): first pass time = 1.09's, 123.327'MB/sec 2024/11/22-16:32:49.282547 140025104320064 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04657/att-00/214774.sst): old prealloc_size = 147639500, real_size = 34487792 2024/11/22-16:32:49.283255 140025104320064 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04657/att-00/214774.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 923219 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1084 GB zip-val = 0.0325 GB avg-val = 117.38 avg-zval = 35.19 2024/11/22-16:32:49.284085 140025104320064 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04657/att-00/214774.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-16:32:51.278888 140025104320064 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04657/att-00/214774.sst): second pass time = 2.66's, 40.768'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 2.00's, 19.266'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2584.116'MB/sec (index lex order gen) rebuild zvType time = 1.62's, 0.143'MB/sec write SST data time = 0.38's, 102.146'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.083'MB, throughput = 17356.725'MB/sec zip my value time = 2.66's, unzip length = 0.108'GB zip my value throughput = 40.768'MB/sec zip pipeline throughput = 103.763'MB/sec entries = 923219 avg-key = 28.00 avg-zkey = 1.91 avg-val = 117.38 avg-zval = 35.19 usrkeys = 923219 avg-key = 20.00 avg-zkey = 1.91 avg-val = 124.38 avg-zval = 35.19 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 923219 bytes = 3115872 } seq expand size = 6462533 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0325 GB dict = 1.08 MB all = 0.0385 GB } UnZip/Zip{ index = 10.4471 value = 3.3355 dict = 1.00 all = 3.4897 } Zip/UnZip{ index = 0.0957 value = 0.2998 dict = 1.00 all = 0.2866 } ---------------------------- total value len = 0.229702 GB avg = 0.125 KB (by entry num) total key len = 0.051644 GB avg = 0.028 KB total ukey len = 0.036889 GB avg = 0.020 KB total ukey num = 0.001844440 Billion total entry num = 0.001844440 Billion write speed all = 0.010183319 MB/sec (with seq num) write speed all = 0.009649245 MB/sec (without seq num) 2024/11/22-16:32:51.312189 140025104320064 [compaction_job.cc:1948] [default] [JOB 4657] Generated table #214774: 923219 keys, 38461538 bytes, temperature: kWarm 2024/11/22-16:32:51.312252 140025104320064 EVENT_LOG_v1 {"time_micros": 1732264371312221, "cf_name": "default", "job": 4657, "event": "table_file_creation", "file_number": 214774, "file_size": 38461538, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3273702561, "largest_seqno": 3382795221, "table_properties": {"data_size": 32489376, "index_size": 1767424, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25850132, "raw_average_key_size": 28, "raw_value_size": 108367598, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 923219, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732264365, "oldest_key_time": 0, "file_creation_time": 1732264365, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 214774, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-16:32:51.347789 140025104320064 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04657/att-00/214775.sst) /dev/shm/ToplingTemp/Topling-200173-PPz1Ej 2024/11/22-16:32:52.356767 140025104320064 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04657/att-00/214775.sst): first pass time = 1.01's, 133.028'MB/sec 2024/11/22-16:32:54.259869 140025104320064 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04657/att-00/214775.sst): old prealloc_size = 147639500, real_size = 33856432 2024/11/22-16:32:54.260478 140025104320064 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04657/att-00/214775.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 921103 prefix = 4 raw-key = 0.0147 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1084 GB zip-val = 0.0319 GB avg-val = 117.71 avg-zval = 34.60 2024/11/22-16:32:54.261272 140025104320064 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04657/att-00/214775.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-16:32:55.678641 140025104320064 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04657/att-00/214775.sst): second pass time = 1.90's, 56.999'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.42's, 26.661'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2988.633'MB/sec (index lex order gen) rebuild zvType time = 1.26's, 0.183'MB/sec write SST data time = 0.16's, 239.449'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.084'MB, throughput = 29194.527'MB/sec zip my value time = 1.90's, unzip length = 0.108'GB zip my value throughput = 56.999'MB/sec zip pipeline throughput = 65.026'MB/sec entries = 921103 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.71 avg-zval = 34.60 usrkeys = 921103 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.71 avg-zval = 34.60 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 921103 bytes = 3108736 } seq expand size = 6447721 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0184 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0319 GB dict = 1.08 MB all = 0.0378 GB } UnZip/Zip{ index = 10.5122 value = 3.4018 dict = 1.00 all = 3.5484 } Zip/UnZip{ index = 0.0951 value = 0.2940 dict = 1.00 all = 0.2818 } ---------------------------- total value len = 0.344577 GB avg = 0.125 KB (by entry num) total key len = 0.077435 GB avg = 0.028 KB total ukey len = 0.055311 GB avg = 0.020 KB total ukey num = 0.002765543 Billion total entry num = 0.002765543 Billion write speed all = 0.015272267 MB/sec (with seq num) write speed all = 0.014471605 MB/sec (without seq num) 2024/11/22-16:32:55.712383 140025104320064 [compaction_job.cc:1948] [default] [JOB 4657] Generated table #214775: 921103 keys, 37824628 bytes, temperature: kWarm 2024/11/22-16:32:55.712442 140025104320064 EVENT_LOG_v1 {"time_micros": 1732264375712411, "cf_name": "default", "job": 4657, "event": "table_file_creation", "file_number": 214775, "file_size": 37824628, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3273702585, "largest_seqno": 3382795231, "table_properties": {"data_size": 31873504, "index_size": 1752448, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25790884, "raw_average_key_size": 28, "raw_value_size": 108426950, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 921103, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732264371, "oldest_key_time": 0, "file_creation_time": 1732264371, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 214775, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-16:32:55.748421 140025104320064 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04657/att-00/214776.sst) /dev/shm/ToplingTemp/Topling-200173-9E2b6j 2024/11/22-16:32:56.627066 140025104320064 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04657/att-00/214776.sst): first pass time = 0.88's, 152.761'MB/sec 2024/11/22-16:32:58.516193 140025104320064 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04657/att-00/214776.sst): old prealloc_size = 147639500, real_size = 34456496 2024/11/22-16:32:58.516847 140025104320064 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04657/att-00/214776.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 922932 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1084 GB zip-val = 0.0325 GB avg-val = 117.43 avg-zval = 35.17 2024/11/22-16:32:58.517629 140025104320064 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04657/att-00/214776.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-16:32:59.761657 140025104320064 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04657/att-00/214776.sst): second pass time = 1.89's, 57.390'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.25's, 30.855'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2780.472'MB/sec (index lex order gen) rebuild zvType time = 1.02's, 0.227'MB/sec write SST data time = 0.23's, 168.592'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.083'MB, throughput = 25974.477'MB/sec zip my value time = 1.89's, unzip length = 0.108'GB zip my value throughput = 57.390'MB/sec zip pipeline throughput = 67.373'MB/sec entries = 922932 avg-key = 28.00 avg-zkey = 1.91 avg-val = 117.43 avg-zval = 35.17 usrkeys = 922932 avg-key = 20.00 avg-zkey = 1.91 avg-val = 124.43 avg-zval = 35.17 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 922932 bytes = 3114912 } seq expand size = 6460524 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0325 GB dict = 1.08 MB all = 0.0384 GB } UnZip/Zip{ index = 10.4446 value = 3.3389 dict = 1.00 all = 3.4926 } Zip/UnZip{ index = 0.0957 value = 0.2995 dict = 1.00 all = 0.2863 } ---------------------------- total value len = 0.459413 GB avg = 0.125 KB (by entry num) total key len = 0.103277 GB avg = 0.028 KB total ukey len = 0.073770 GB avg = 0.020 KB total ukey num = 0.003688475 Billion total entry num = 0.003688475 Billion write speed all = 0.020360289 MB/sec (with seq num) write speed all = 0.019292584 MB/sec (without seq num) 2024/11/22-16:32:59.812735 140025104320064 [compaction_job.cc:1948] [default] [JOB 4657] Generated table #214776: 922932 keys, 38429336 bytes, temperature: kWarm 2024/11/22-16:32:59.812803 140025104320064 EVENT_LOG_v1 {"time_micros": 1732264379812765, "cf_name": "default", "job": 4657, "event": "table_file_creation", "file_number": 214776, "file_size": 38429336, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3273702604, "largest_seqno": 3382795996, "table_properties": {"data_size": 32458272, "index_size": 1767296, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25842096, "raw_average_key_size": 28, "raw_value_size": 108375704, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 922932, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732264375, "oldest_key_time": 0, "file_creation_time": 1732264375, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 214776, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-16:32:59.850575 140025104320064 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04657/att-00/214777.sst) /dev/shm/ToplingTemp/Topling-200173-FCWagm 2024/11/22-16:33:00.755205 140025104320064 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04657/att-00/214777.sst): first pass time = 0.90's, 148.374'MB/sec 2024/11/22-16:33:02.258555 140025104320064 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04657/att-00/214777.sst): old prealloc_size = 147639500, real_size = 33980736 2024/11/22-16:33:02.259129 140025104320064 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04657/att-00/214777.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 921135 prefix = 4 raw-key = 0.0147 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1084 GB zip-val = 0.0320 GB avg-val = 117.71 avg-zval = 34.74 2024/11/22-16:33:02.259871 140025104320064 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04657/att-00/214777.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-16:33:03.335699 140025104320064 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04657/att-00/214777.sst): second pass time = 1.50's, 72.152'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.08's, 35.231'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3180.190'MB/sec (index lex order gen) rebuild zvType time = 0.95's, 0.243'MB/sec write SST data time = 0.13's, 294.806'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.084'MB, throughput = 34077.479'MB/sec zip my value time = 1.50's, unzip length = 0.108'GB zip my value throughput = 72.152'MB/sec zip pipeline throughput = 72.152'MB/sec entries = 921135 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.71 avg-zval = 34.74 usrkeys = 921135 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.71 avg-zval = 34.74 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 921135 bytes = 3108848 } seq expand size = 6447945 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0184 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0320 GB dict = 1.08 MB all = 0.0379 GB } UnZip/Zip{ index = 10.5106 value = 3.3886 dict = 1.00 all = 3.5368 } Zip/UnZip{ index = 0.0951 value = 0.2951 dict = 1.00 all = 0.2827 } ---------------------------- total value len = 0.574287 GB avg = 0.125 KB (by entry num) total key len = 0.129069 GB avg = 0.028 KB total ukey len = 0.092192 GB avg = 0.020 KB total ukey num = 0.004609610 Billion total entry num = 0.004609610 Billion write speed all = 0.025446821 MB/sec (with seq num) write speed all = 0.024112648 MB/sec (without seq num) 2024/11/22-16:33:03.371013 140025104320064 [compaction_job.cc:1948] [default] [JOB 4657] Generated table #214777: 921135 keys, 37948836 bytes, temperature: kWarm 2024/11/22-16:33:03.371073 140025104320064 EVENT_LOG_v1 {"time_micros": 1732264383371040, "cf_name": "default", "job": 4657, "event": "table_file_creation", "file_number": 214777, "file_size": 37948836, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3273702634, "largest_seqno": 3382795279, "table_properties": {"data_size": 31997488, "index_size": 1752768, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25791780, "raw_average_key_size": 28, "raw_value_size": 108426026, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 921135, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732264379, "oldest_key_time": 0, "file_creation_time": 1732264379, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 214777, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-16:33:03.409959 140025104320064 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04657/att-00/214778.sst) /dev/shm/ToplingTemp/Topling-200173-yM281i 2024/11/22-16:33:04.367562 140025104320064 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04657/att-00/214778.sst): first pass time = 0.96's, 140.165'MB/sec 2024/11/22-16:33:05.813275 140025104320064 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04657/att-00/214778.sst): old prealloc_size = 147639500, real_size = 34278272 2024/11/22-16:33:05.813877 140025104320064 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04657/att-00/214778.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 923100 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1084 GB zip-val = 0.0323 GB avg-val = 117.40 avg-zval = 34.98 2024/11/22-16:33:05.814614 140025104320064 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04657/att-00/214778.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-16:33:06.719380 140025104320064 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04657/att-00/214778.sst): second pass time = 1.44's, 74.998'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.91's, 42.216'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3020.746'MB/sec (index lex order gen) rebuild zvType time = 0.78's, 0.297'MB/sec write SST data time = 0.13's, 300.139'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.083'MB, throughput = 37026.713'MB/sec zip my value time = 1.44's, unzip length = 0.108'GB zip my value throughput = 74.998'MB/sec zip pipeline throughput = 74.998'MB/sec entries = 923100 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.40 avg-zval = 34.98 usrkeys = 923100 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.40 avg-zval = 34.98 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 923100 bytes = 3115472 } seq expand size = 6461700 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0323 GB dict = 1.08 MB all = 0.0383 GB } UnZip/Zip{ index = 10.5112 value = 3.3561 dict = 1.00 all = 3.5088 } Zip/UnZip{ index = 0.0951 value = 0.2980 dict = 1.00 all = 0.2850 } ---------------------------- total value len = 0.689120 GB avg = 0.125 KB (by entry num) total key len = 0.154916 GB avg = 0.028 KB total ukey len = 0.110654 GB avg = 0.020 KB total ukey num = 0.005532710 Billion total entry num = 0.005532710 Billion write speed all = 0.030532749 MB/sec (with seq num) write speed all = 0.028931596 MB/sec (without seq num) 2024/11/22-16:33:06.753201 140025104320064 [compaction_job.cc:1948] [default] [JOB 4657] Generated table #214778: 923100 keys, 38251398 bytes, temperature: kWarm 2024/11/22-16:33:06.753253 140025104320064 EVENT_LOG_v1 {"time_micros": 1732264386753222, "cf_name": "default", "job": 4657, "event": "table_file_creation", "file_number": 214778, "file_size": 38251398, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3273702649, "largest_seqno": 3382795892, "table_properties": {"data_size": 32290928, "index_size": 1756416, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25846800, "raw_average_key_size": 28, "raw_value_size": 108371072, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 923100, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732264383, "oldest_key_time": 0, "file_creation_time": 1732264383, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 214778, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-16:33:06.790602 140025104320064 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04657/att-00/214779.sst) /dev/shm/ToplingTemp/Topling-200173-wYgJGk 2024/11/22-16:33:07.610267 140025104320064 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04657/att-00/214779.sst): first pass time = 0.82's, 163.753'MB/sec 2024/11/22-16:33:09.499671 140025104320064 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04657/att-00/214779.sst): old prealloc_size = 147639500, real_size = 36423136 2024/11/22-16:33:09.500271 140025104320064 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04657/att-00/214779.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 922794 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1084 GB zip-val = 0.0344 GB avg-val = 117.45 avg-zval = 37.32 2024/11/22-16:33:09.501095 140025104320064 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04657/att-00/214779.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-16:33:10.555696 140025104320064 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04657/att-00/214779.sst): second pass time = 1.89's, 57.411'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.06's, 38.365'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3024.433'MB/sec (index lex order gen) rebuild zvType time = 0.90's, 0.256'MB/sec write SST data time = 0.15's, 262.687'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.083'MB, throughput = 34241.945'MB/sec zip my value time = 1.89's, unzip length = 0.108'GB zip my value throughput = 57.411'MB/sec zip pipeline throughput = 107.433'MB/sec entries = 922794 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.45 avg-zval = 37.32 usrkeys = 922794 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.45 avg-zval = 37.32 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 922794 bytes = 3229792 } seq expand size = 6459558 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0185 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0344 GB dict = 1.08 MB all = 0.0405 GB } UnZip/Zip{ index = 10.5108 value = 3.1472 dict = 1.00 all = 3.3128 } Zip/UnZip{ index = 0.0951 value = 0.3177 dict = 1.00 all = 0.3019 } ---------------------------- total value len = 0.803959 GB avg = 0.125 KB (by entry num) total key len = 0.180754 GB avg = 0.028 KB total ukey len = 0.129110 GB avg = 0.020 KB total ukey num = 0.006455504 Billion total entry num = 0.006455504 Billion write speed all = 0.035616771 MB/sec (with seq num) write speed all = 0.033748822 MB/sec (without seq num) 2024/11/22-16:33:10.591296 140025104320064 [compaction_job.cc:1948] [default] [JOB 4657] Generated table #214779: 922794 keys, 40514666 bytes, temperature: kWarm 2024/11/22-16:33:10.591365 140025104320064 EVENT_LOG_v1 {"time_micros": 1732264390591325, "cf_name": "default", "job": 4657, "event": "table_file_creation", "file_number": 214779, "file_size": 40514666, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237868609, "largest_seqno": 3382795325, "table_properties": {"data_size": 34436368, "index_size": 1755904, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25838232, "raw_average_key_size": 28, "raw_value_size": 108379628, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 922794, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732264386, "oldest_key_time": 0, "file_creation_time": 1732264386, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 214779, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-16:33:10.625985 140025104320064 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04657/att-00/214780.sst) /dev/shm/ToplingTemp/Topling-200173-Nv6flm 2024/11/22-16:33:11.460832 140025104320064 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04657/att-00/214780.sst): first pass time = 0.83's, 160.775'MB/sec 2024/11/22-16:33:13.078106 140025104320064 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04657/att-00/214780.sst): old prealloc_size = 147639500, real_size = 36694064 2024/11/22-16:33:13.078646 140025104320064 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04657/att-00/214780.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 922495 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1084 GB zip-val = 0.0347 GB avg-val = 117.49 avg-zval = 37.61 2024/11/22-16:33:13.079388 140025104320064 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04657/att-00/214780.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-16:33:13.912880 140025104320064 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04657/att-00/214780.sst): second pass time = 1.62's, 67.069'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.83's, 48.637'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3394.421'MB/sec (index lex order gen) rebuild zvType time = 0.70's, 0.328'MB/sec write SST data time = 0.13's, 311.058'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.083'MB, throughput = 33805.324'MB/sec zip my value time = 1.62's, unzip length = 0.108'GB zip my value throughput = 67.069'MB/sec zip pipeline throughput = 120.801'MB/sec entries = 922495 avg-key = 28.00 avg-zkey = 1.91 avg-val = 117.49 avg-zval = 37.61 usrkeys = 922495 avg-key = 20.00 avg-zkey = 1.91 avg-val = 124.27 avg-zval = 37.61 TagRS{ kinds = RS_Key0_TagN bytes = 144240 } TagArray{ size = 893457 bytes = 2903744 } seq expand size = 6254199 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0184 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0347 GB dict = 1.08 MB all = 0.0406 GB } UnZip/Zip{ index = 10.4468 value = 3.1238 dict = 1.00 all = 3.3058 } Zip/UnZip{ index = 0.0957 value = 0.3201 dict = 1.00 all = 0.3025 } ---------------------------- total value len = 0.918601 GB avg = 0.125 KB (by entry num) total key len = 0.206584 GB avg = 0.028 KB total ukey len = 0.147560 GB avg = 0.020 KB total ukey num = 0.007377999 Billion total entry num = 0.007377999 Billion write speed all = 0.040692657 MB/sec (with seq num) write speed all = 0.038558037 MB/sec (without seq num) 2024/11/22-16:33:13.948487 140025104320064 [compaction_job.cc:1948] [default] [JOB 4657] Generated table #214780: 922495 keys, 40600488 bytes, temperature: kWarm 2024/11/22-16:33:13.948549 140025104320064 EVENT_LOG_v1 {"time_micros": 1732264393948518, "cf_name": "default", "job": 4657, "event": "table_file_creation", "file_number": 214780, "file_size": 40600488, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3273699965, "table_properties": {"data_size": 34697184, "index_size": 1766080, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25829860, "raw_average_key_size": 28, "raw_value_size": 108387910, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 922495, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732264390, "oldest_key_time": 0, "file_creation_time": 1732264390, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 214780, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-16:33:13.990827 140025104320064 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04657/att-00/214781.sst) /dev/shm/ToplingTemp/Topling-200173-cGXfAn 2024/11/22-16:33:14.802218 140025104320064 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04657/att-00/214781.sst): first pass time = 0.81's, 165.424'MB/sec 2024/11/22-16:33:16.383838 140025104320064 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04657/att-00/214781.sst): old prealloc_size = 147639500, real_size = 36558800 2024/11/22-16:33:16.384426 140025104320064 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04657/att-00/214781.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 923925 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0017 GB avg-key = 16.00 avg-zkey = 1.89 raw-val = 0.1083 GB zip-val = 0.0346 GB avg-val = 117.27 avg-zval = 37.43 2024/11/22-16:33:16.385041 140025104320064 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04657/att-00/214781.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-16:33:17.189761 140025104320064 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04657/att-00/214781.sst): second pass time = 1.58's, 68.531'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.81's, 49.409'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3068.123'MB/sec (index lex order gen) rebuild zvType time = 0.68's, 0.342'MB/sec write SST data time = 0.13's, 308.130'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.082'MB, throughput = 30568.822'MB/sec zip my value time = 1.58's, unzip length = 0.108'GB zip my value throughput = 68.531'MB/sec zip pipeline throughput = 103.453'MB/sec entries = 923925 avg-key = 28.00 avg-zkey = 1.89 avg-val = 117.27 avg-zval = 37.43 usrkeys = 923925 avg-key = 20.00 avg-zkey = 1.89 avg-val = 122.53 avg-zval = 37.43 TagRS{ kinds = RS_Key0_TagN bytes = 144480 } TagArray{ size = 693908 bytes = 2255216 } seq expand size = 4857356 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0017 GB value = 0.0346 GB dict = 1.08 MB all = 0.0398 GB } UnZip/Zip{ index = 10.5823 value = 3.1331 dict = 1.00 all = 3.3707 } Zip/UnZip{ index = 0.0945 value = 0.3192 dict = 1.00 all = 0.2967 } ---------------------------- total value len = 1.031806 GB avg = 0.124 KB (by entry num) total key len = 0.232454 GB avg = 0.028 KB total ukey len = 0.166038 GB avg = 0.020 KB total ukey num = 0.008301924 Billion total entry num = 0.008301924 Billion write speed all = 0.045716933 MB/sec (with seq num) write speed all = 0.043315285 MB/sec (without seq num) 2024/11/22-16:33:17.233272 140025104320064 [compaction_job.cc:1948] [default] [JOB 4657] Generated table #214781: 923925 keys, 39819482 bytes, temperature: kWarm 2024/11/22-16:33:17.233331 140025104320064 EVENT_LOG_v1 {"time_micros": 1732264397233300, "cf_name": "default", "job": 4657, "event": "table_file_creation", "file_number": 214781, "file_size": 39819482, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3273700833, "table_properties": {"data_size": 34581440, "index_size": 1746176, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25869900, "raw_average_key_size": 28, "raw_value_size": 108347878, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 923925, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732264393, "oldest_key_time": 0, "file_creation_time": 1732264393, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 214781, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-16:33:17.268946 140025104320064 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04657/att-00/214782.sst) /dev/shm/ToplingTemp/Topling-200173-CfkNGk 2024/11/22-16:33:18.068219 140025104320064 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04657/att-00/214782.sst): first pass time = 0.80's, 167.932'MB/sec 2024/11/22-16:33:19.740257 140025104320064 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04657/att-00/214782.sst): old prealloc_size = 147639500, real_size = 36501072 2024/11/22-16:33:19.740827 140025104320064 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04657/att-00/214782.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927143 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.89 raw-val = 0.1083 GB zip-val = 0.0345 GB avg-val = 116.76 avg-zval = 37.23 2024/11/22-16:33:19.740870 140025104320064 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04657/att-00/214782.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-16:33:20.377920 140025104320064 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04657/att-00/214782.sst): second pass time = 1.67's, 64.789'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.64's, 58.589'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3175.210'MB/sec (index lex order gen) rebuild zvType time = 0.51's, 0.451'MB/sec write SST data time = 0.12's, 303.912'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 33508.279'MB/sec zip my value time = 1.67's, unzip length = 0.108'GB zip my value throughput = 64.789'MB/sec zip pipeline throughput = 68.624'MB/sec entries = 927143 avg-key = 28.00 avg-zkey = 1.89 avg-val = 116.76 avg-zval = 37.23 usrkeys = 927143 avg-key = 20.00 avg-zkey = 1.89 avg-val = 116.76 avg-zval = 37.23 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0345 GB dict = 1.08 MB all = 0.0374 GB } UnZip/Zip{ index = 10.5827 value = 3.1364 dict = 1.00 all = 3.5926 } Zip/UnZip{ index = 0.0945 value = 0.3188 dict = 1.00 all = 0.2783 } ---------------------------- total value len = 1.140064 GB avg = 0.124 KB (by entry num) total key len = 0.258414 GB avg = 0.028 KB total ukey len = 0.184581 GB avg = 0.020 KB total ukey num = 0.009229067 Billion total entry num = 0.009229067 Billion write speed all = 0.050564553 MB/sec (with seq num) write speed all = 0.047895001 MB/sec (without seq num) 2024/11/22-16:33:20.409390 140025104320064 [compaction_job.cc:1948] [default] [JOB 4657] Generated table #214782: 927143 keys, 37359428 bytes, temperature: kWarm 2024/11/22-16:33:20.409447 140025104320064 EVENT_LOG_v1 {"time_micros": 1732264400409418, "cf_name": "default", "job": 4657, "event": "table_file_creation", "file_number": 214782, "file_size": 37359428, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 34516928, "index_size": 1752192, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25960004, "raw_average_key_size": 28, "raw_value_size": 108257750, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927143, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732264397, "oldest_key_time": 0, "file_creation_time": 1732264397, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 214782, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-16:33:20.443701 140025104320064 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04657/att-00/214783.sst) /dev/shm/ToplingTemp/Topling-200173-9WPW4m 2024/11/22-16:33:21.302282 140025104320064 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04657/att-00/214783.sst): first pass time = 0.86's, 156.330'MB/sec 2024/11/22-16:33:23.153427 140025104320064 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04657/att-00/214783.sst): old prealloc_size = 147639500, real_size = 36397568 2024/11/22-16:33:23.153962 140025104320064 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04657/att-00/214783.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 926827 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0344 GB avg-val = 116.81 avg-zval = 37.12 2024/11/22-16:33:23.154003 140025104320064 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04657/att-00/214783.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-16:33:23.794729 140025104320064 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04657/att-00/214783.sst): second pass time = 1.85's, 58.521'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.64's, 58.095'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3424.264'MB/sec (index lex order gen) rebuild zvType time = 0.52's, 0.449'MB/sec write SST data time = 0.12's, 299.751'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 33213.517'MB/sec zip my value time = 1.85's, unzip length = 0.108'GB zip my value throughput = 58.521'MB/sec zip pipeline throughput = 100.729'MB/sec entries = 926827 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.81 avg-zval = 37.12 usrkeys = 926827 avg-key = 20.00 avg-zkey = 1.90 avg-val = 116.81 avg-zval = 37.12 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 10 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0344 GB dict = 1.08 MB all = 0.0373 GB } UnZip/Zip{ index = 10.5122 value = 3.1471 dict = 1.00 all = 3.6026 } Zip/UnZip{ index = 0.0951 value = 0.3178 dict = 1.00 all = 0.2776 } ---------------------------- total value len = 1.248331 GB avg = 0.123 KB (by entry num) total key len = 0.284365 GB avg = 0.028 KB total ukey len = 0.203118 GB avg = 0.020 KB total ukey num = 0.010155894 Billion total entry num = 0.010155894 Billion write speed all = 0.055410600 MB/sec (with seq num) write speed all = 0.052473322 MB/sec (without seq num) 2024/11/22-16:33:23.828458 140025104320064 [compaction_job.cc:1948] [default] [JOB 4657] Generated table #214783: 926827 keys, 37255532 bytes, temperature: kWarm 2024/11/22-16:33:23.828519 140025104320064 EVENT_LOG_v1 {"time_micros": 1732264403828487, "cf_name": "default", "job": 4657, "event": "table_file_creation", "file_number": 214783, "file_size": 37255532, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 34402352, "index_size": 1763328, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25951156, "raw_average_key_size": 28, "raw_value_size": 108266662, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 926827, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732264400, "oldest_key_time": 0, "file_creation_time": 1732264400, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 214783, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-16:33:23.863540 140025104320064 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04657/att-00/214784.sst) /dev/shm/ToplingTemp/Topling-200173-s1hr7k 2024/11/22-16:33:24.732547 140025104320064 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04657/att-00/214784.sst): first pass time = 0.87's, 154.455'MB/sec 2024/11/22-16:33:26.065707 140025104320064 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04657/att-00/214784.sst): old prealloc_size = 147639500, real_size = 35605664 2024/11/22-16:33:26.066258 140025104320064 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04657/att-00/214784.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 923381 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0017 GB avg-key = 16.00 avg-zkey = 1.89 raw-val = 0.1084 GB zip-val = 0.0336 GB avg-val = 117.35 avg-zval = 36.42 2024/11/22-16:33:26.067996 140025104320064 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04657/att-00/214784.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-16:33:26.918142 140025104320064 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04657/att-00/214784.sst): second pass time = 1.33's, 81.324'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.85's, 45.988'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3299.462'MB/sec (index lex order gen) rebuild zvType time = 0.72's, 0.320'MB/sec write SST data time = 0.13's, 298.794'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.083'MB, throughput = 32778.457'MB/sec zip my value time = 1.33's, unzip length = 0.108'GB zip my value throughput = 81.324'MB/sec zip pipeline throughput = 81.324'MB/sec entries = 923381 avg-key = 28.00 avg-zkey = 1.89 avg-val = 117.35 avg-zval = 36.42 usrkeys = 923381 avg-key = 20.00 avg-zkey = 1.89 avg-val = 123.17 avg-zval = 36.42 TagRS{ kinds = RS_Key0_TagN bytes = 144360 } TagArray{ size = 767162 bytes = 2589184 } seq expand size = 5370134 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0017 GB value = 0.0336 GB dict = 1.08 MB all = 0.0392 GB } UnZip/Zip{ index = 10.5795 value = 3.2223 dict = 1.00 all = 3.4239 } Zip/UnZip{ index = 0.0945 value = 0.3103 dict = 1.00 all = 0.2921 } ---------------------------- total value len = 1.362064 GB avg = 0.123 KB (by entry num) total key len = 0.310220 GB avg = 0.028 KB total ukey len = 0.221585 GB avg = 0.020 KB total ukey num = 0.011079275 Billion total entry num = 0.011079275 Billion write speed all = 0.060450211 MB/sec (with seq num) write speed all = 0.057246236 MB/sec (without seq num) 2024/11/22-16:33:26.951640 140025104320064 [compaction_job.cc:1948] [default] [JOB 4657] Generated table #214784: 923381 keys, 39200578 bytes, temperature: kWarm 2024/11/22-16:33:26.951703 140025104320064 EVENT_LOG_v1 {"time_micros": 1732264406951671, "cf_name": "default", "job": 4657, "event": "table_file_creation", "file_number": 214784, "file_size": 39200578, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3382795723, "table_properties": {"data_size": 33629008, "index_size": 1745600, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25854668, "raw_average_key_size": 28, "raw_value_size": 108363170, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 923381, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732264403, "oldest_key_time": 0, "file_creation_time": 1732264403, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 214784, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-16:33:26.988920 140025104320064 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04657/att-00/214785.sst) /dev/shm/ToplingTemp/Topling-200173-7V6Nkj 2024/11/22-16:33:27.808553 140025104320064 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04657/att-00/214785.sst): first pass time = 0.82's, 163.762'MB/sec 2024/11/22-16:33:29.166155 140025104320064 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04657/att-00/214785.sst): old prealloc_size = 147639500, real_size = 37023808 2024/11/22-16:33:29.166717 140025104320064 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04657/att-00/214785.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 928854 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1082 GB zip-val = 0.0350 GB avg-val = 116.50 avg-zval = 37.69 2024/11/22-16:33:29.167394 140025104320064 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04657/att-00/214785.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-16:33:29.949900 140025104320064 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04657/att-00/214785.sst): second pass time = 1.36's, 79.743'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.78's, 51.725'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3298.450'MB/sec (index lex order gen) rebuild zvType time = 0.65's, 0.355'MB/sec write SST data time = 0.13's, 313.534'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 25214.499'MB/sec zip my value time = 1.36's, unzip length = 0.108'GB zip my value throughput = 79.743'MB/sec zip pipeline throughput = 79.743'MB/sec entries = 928854 avg-key = 28.00 avg-zkey = 1.92 avg-val = 116.50 avg-zval = 37.69 usrkeys = 928854 avg-key = 20.00 avg-zkey = 1.92 avg-val = 122.11 avg-zval = 37.69 TagRS{ kinds = RS_Key0_TagN bytes = 145240 } TagArray{ size = 744468 bytes = 2512592 } seq expand size = 5211276 multi value expand size = 0 cnt WriteAppend = 17 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0350 GB dict = 1.08 MB all = 0.0405 GB } UnZip/Zip{ index = 10.4420 value = 3.0906 dict = 1.00 all = 3.3109 } Zip/UnZip{ index = 0.0958 value = 0.3236 dict = 1.00 all = 0.3020 } ---------------------------- total value len = 1.475485 GB avg = 0.123 KB (by entry num) total key len = 0.336228 GB avg = 0.028 KB total ukey len = 0.240163 GB avg = 0.020 KB total ukey num = 0.012008129 Billion total entry num = 0.012008129 Billion write speed all = 0.065483159 MB/sec (with seq num) write speed all = 0.062010952 MB/sec (without seq num) 2024/11/22-16:33:29.989123 140025104320064 [compaction_job.cc:1948] [default] [JOB 4657] Generated table #214785: 928854 keys, 40538480 bytes, temperature: kWarm 2024/11/22-16:33:29.989179 140025104320064 EVENT_LOG_v1 {"time_micros": 1732264409989149, "cf_name": "default", "job": 4657, "event": "table_file_creation", "file_number": 214785, "file_size": 40538480, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3382795607, "table_properties": {"data_size": 35012336, "index_size": 1779072, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26007912, "raw_average_key_size": 28, "raw_value_size": 108209920, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 928854, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732264406, "oldest_key_time": 0, "file_creation_time": 1732264406, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 214785, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-16:33:30.023277 140025104320064 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04657/att-00/214786.sst) /dev/shm/ToplingTemp/Topling-200173-ZP62in 2024/11/22-16:33:30.109043 140025104320064 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04657/att-00/214786.sst): first pass time = 0.09's, 264.388'MB/sec 2024/11/22-16:33:30.283260 140025104320064 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04657/att-00/214786.sst): old prealloc_size = 147639500, real_size = 6261776 2024/11/22-16:33:30.283400 140025104320064 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04657/att-00/214786.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 156555 prefix = 4 raw-key = 0.0025 GB zip-key = 0.0003 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.0183 GB zip-val = 0.0059 GB avg-val = 116.78 avg-zval = 37.84 2024/11/22-16:33:30.283434 140025104320064 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04657/att-00/214786.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0004 GB, waited 0.000 sec, Key+Value = 0.023 GB 2024/11/22-16:33:30.395212 140025104320064 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04657/att-00/214786.sst): second pass time = 0.17's, 105.274'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.11's, 57.318'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2578.540'MB/sec (index lex order gen) rebuild zvType time = 0.08's, 0.475'MB/sec write SST data time = 0.03's, 218.583'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.191'MB, throughput = 7662.655'MB/sec zip my value time = 0.17's, unzip length = 0.018'GB zip my value throughput = 105.274'MB/sec zip pipeline throughput = 105.274'MB/sec entries = 156555 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.78 avg-zval = 37.84 usrkeys = 156555 avg-key = 20.00 avg-zkey = 1.91 avg-val = 116.78 avg-zval = 37.84 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 11 UnZipSize{ index = 0.0031 GB value = 0.0183 GB dict = 0.19 MB all = 0.0227 GB } __ZipSize{ index = 0.0003 GB value = 0.0059 GB dict = 0.19 MB all = 0.0064 GB } UnZip/Zip{ index = 10.4694 value = 3.0866 dict = 1.00 all = 3.5327 } Zip/UnZip{ index = 0.0955 value = 0.3240 dict = 1.00 all = 0.2831 } ---------------------------- total value len = 1.493768 GB avg = 0.123 KB (by entry num) total key len = 0.340611 GB avg = 0.028 KB total ukey len = 0.243294 GB avg = 0.020 KB total ukey num = 0.012164684 Billion total entry num = 0.012164684 Billion write speed all = 0.066301361 MB/sec (with seq num) write speed all = 0.062783943 MB/sec (without seq num) 2024/11/22-16:33:30.407301 140025104320064 [compaction_job.cc:1948] [default] [JOB 4657] Generated table #214786: 156555 keys, 6416248 bytes, temperature: kWarm 2024/11/22-16:33:30.407354 140025104320064 EVENT_LOG_v1 {"time_micros": 1732264410407326, "cf_name": "default", "job": 4657, "event": "table_file_creation", "file_number": 214786, "file_size": 6416248, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 5923392, "index_size": 299072, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 4383540, "raw_average_key_size": 28, "raw_value_size": 18283066, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 156555, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732264410, "oldest_key_time": 0, "file_creation_time": 1732264410, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 214786, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-16:33:30.418096 140025104320064 [compaction_job.cc:703] job-04657: subcompact[0], size: 0.510459 G, files: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04657/att-00 [214773,214774,214775,214776,214777,214778,214779,214780,214781,214782,214783,214784,214785,214786] 2024/11/22-16:33:30.525070 140025104320064 (Original Log Time 2024/11/22-16:32:40.112656) EVENT_LOG_v1 {"time_micros": 1732264360112614, "job": 4657, "event": "compaction_started", "compaction_reason": "FilesMarkedForCompaction", "files_L2": [214766], "files_L3": [214727, 214728, 214729, 214730, 214731, 214732, 214733, 214734, 214735, 214736, 214737, 214738, 214739], "score": 0.890843, "input_data_size": 530895306, "oldest_snapshot_seqno": 3382824068} 2024/11/22-16:33:30.525073 140025104320064 (Original Log Time 2024/11/22-16:33:30.524343) [compaction_job.cc:2022] [default] [JOB 4657] Compacted 1@2 + 13@3 files to L3 => 510458932 bytes 2024/11/22-16:33:30.525075 140025104320064 (Original Log Time 2024/11/22-16:33:30.524998) [compaction_job.cc:1224] [default] compacted to: files[0 0 0 14 0 0 0] max score 0.02, MB/sec: 10.6 rd, 10.1 wr, level 3, files in(1, 13) out(14 +0 blob) MB in(27.1, 479.2 +0.0 blob) out(486.8 +0.0 blob), read-write-amplify(36.7) write-amplify(18.0) OK, records in: 12241032, records dropped: 76348 output_compression: Snappy 2024/11/22-16:33:30.525080 140025104320064 (Original Log Time 2024/11/22-16:33:30.525041) EVENT_LOG_v1 {"time_micros": 1732264410525021, "cf": "default", "job": 4657, "event": "compaction_finished", "compaction_time_micros": 50305443, "compaction_time_cpu_micros": 20532074, "output_level": 3, "num_output_files": 14, "total_output_size": 510458932, "num_input_records": 12241032, "num_output_records": 12164684, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "file_write_nanos": 360018964, "file_range_sync_nanos": 0, "file_fsync_nanos": 13790, "file_prepare_write_nanos": 26998, "lsm_state": [0, 0, 0, 14, 0, 0, 0]} 2024/11/22-16:33:30.655362 140025104320064 DEBG dcompact_worker.cpp:240: HttpPost: 200 OK: url = http://nlb-7zny4kaa1poal01o64.cn-shenzhen.nlb.aliyuncs.com:8443, body = {"instanceId":"nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137","labourId":"","dbId":"d89b4006-2803-486e-b7a2-759bcf348921","dbStarts":1732256054,"starts":1732264359,"executesMs":50543,"compactionJobId":4657,"attempt":0,"compactionInputRawBytes":1778339516,"compactionInputZipBytes":530895306,"compactionOutputRawBytes":0,"compactionOutputZipBytes":510458932,"headers":{"Accept":"*/*","Connection":"close","Host":"aliyun-topling-saas.topling.cn:18443","RemoteIp":"120.24.192.169","X-Forwarded-For":"120.24.192.169","region":"cn-shenzhen","token":"e6474c481bd4415abc537135cc03626b","instance-token":"e6474c481bd4415abc537135cc03626b","provider":"aliyun","CloudMarketInstanceId":"si-59c0ae5c955845588903","MeteringAssit":"","Transfer-Encoding":"chunked","traceparent":"00-20c9b54006af12ccc8fd591b68d1e50c-d400b7872edcd83a-00"}}, response = 2024/11/22-16:33:30.655416 140025104320064 INFO dcompact_worker.cpp:1459: finish /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-04657/att-00: olev 3, work 50.544 s, result 4.862 ms, install 0.754 ms, input{raw 1.656 GiB zip 506.301 MiB}