2024/11/22-16:36:43.456687 140024735041088 DEBG dcompact_worker.cpp:2214: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04749/att-00: fork to child time = 0.010051 sec 2024/11/22-16:36:43.457508 140024735041088 DEBG dcompact_worker.cpp:1013: Beg SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04749/att-00 2024/11/22-16:36:43.465379 140024735041088 DEBG dcompact_worker.cpp:1033: End SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04749/att-00 2024/11/22-16:36:43.466518 140024735041088 TRAC dcompact_worker.cpp:1083: INFO_LOG_LEVEL: rpc = INFO_LEVEL, env_var = undefined 2024/11/22-16:36:43.466770 140024735041088 [WARN] [column_family.cc:386] multiple cf_paths/db_paths and level_compaction_dynamic_level_bytes can't be used together 2024/11/22-16:36:43.528586 140024735041088 [version_set.cc:6208] Recovering from manifest file: /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-04749/att-00/MANIFEST-206347 2024/11/22-16:36:43.543765 140024735041088 [version_set.cc:6251] Recovered from manifest file:/worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-04749/att-00/MANIFEST-206347 succeeded,manifest_file_number is 206347, next_file_number is 214979, last_sequence is 3385833917, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 214848 2024/11/22-16:36:43.543772 140024735041088 [version_set.cc:6266] Column family [default] (ID 0), log number is 0 2024/11/22-16:36:43.543873 140024735041088 [version_set.cc:5721] Creating manifest 214979 2024/11/22-16:36:43.575238 140024735041088 DEBG dcompact_worker.cpp:1218: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04749/att-00: bottommost_level: fake = 1, rpc = 0 2024/11/22-16:36:43.607516 140024735041088 [compaction_job.cc:2437] [default] [JOB 4749] Compacting 1@2 + 13@3 files to L3, score 0.96, subcompactions 1 : 1 2024/11/22-16:36:43.607538 140024735041088 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 3700 Base level 2, inputs: [214977(27MB)], [214940(36MB) 214941(36MB) 214942(36MB) 214943(36MB) 214944(36MB) 214945(36MB) 214946(38MB) 214947(38MB) 214948(38MB) 214949(35MB) 214950(35MB) 214951(37MB) 214952(38MB)] 2024/11/22-16:36:43.613737 140024735041088 [top_zip_table.cc:59] core git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/22-16:36:43.613776 140024735041088 [top_zip_table.cc:60] fsa git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/22-16:36:43.613804 140024735041088 [top_zip_table.cc:61] zbs git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/22-16:36:43.613809 140024735041088 [top_zip_table.cc:62] topling-zip_table_reader: git_version_hash_info_is: commit a4a382006cb82713acf5b3425835f22711877681 Author: leipeng Date: 2024-04-11 19:44:14 +0800 fixed_len_hole_index.cc: Add env bool FixedLenHoleIndexUseAVX512 for ut & debug 1. FixedLenHoleIndexUseAVX512 is only in unit tests or debug 2. In release mode, use avx512 by compile options(-march=) g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/22-16:36:43.613820 140024735041088 [top_zip_table.cc:64] topling-rocks git_version_hash_info_is: commit feab587e468621ba0204d47b4ffacc52e7c4290d Author: leipeng Date: 2024-03-22 13:35:06 +0800 ToplingZipTableBuilder::Add: immediately return after error This function returns void, and caller does not check builder->status() after calling this function and graceful abandon. So immediately return after error, and return error status in Finish(). g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/22-16:36:44.100089 140024735041088 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04749/att-00/214980.sst) /dev/shm/ToplingTemp/Topling-201558-qJYhu5 2024/11/22-16:36:44.646202 140024735041088 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04749/att-00/214980.sst): first pass time = 0.55's, 245.786'MB/sec 2024/11/22-16:36:46.187106 140024735041088 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04749/att-00/214980.sst): old prealloc_size = 147639500, real_size = 33870224 2024/11/22-16:36:46.187796 140024735041088 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04749/att-00/214980.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 921267 prefix = 4 raw-key = 0.0147 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1084 GB zip-val = 0.0319 GB avg-val = 117.69 avg-zval = 34.60 2024/11/22-16:36:46.188614 140024735041088 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04749/att-00/214980.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-16:36:47.839525 140024735041088 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04749/att-00/214980.sst): second pass time = 1.54's, 70.398'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.65's, 22.899'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2625.511'MB/sec (index lex order gen) rebuild zvType time = 1.36's, 0.170'MB/sec write SST data time = 0.29's, 128.970'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.084'MB, throughput = 34896.818'MB/sec zip my value time = 1.54's, unzip length = 0.108'GB zip my value throughput = 70.398'MB/sec zip pipeline throughput = 70.398'MB/sec entries = 921267 avg-key = 28.00 avg-zkey = 1.92 avg-val = 117.69 avg-zval = 34.60 usrkeys = 921267 avg-key = 20.00 avg-zkey = 1.92 avg-val = 124.69 avg-zval = 34.60 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 921267 bytes = 3109296 } seq expand size = 6448869 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0184 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0319 GB dict = 1.08 MB all = 0.0378 GB } UnZip/Zip{ index = 10.4435 value = 3.4014 dict = 1.00 all = 3.5471 } Zip/UnZip{ index = 0.0958 value = 0.2940 dict = 1.00 all = 0.2819 } ---------------------------- total value len = 0.114871 GB avg = 0.125 KB (by entry num) total key len = 0.025795 GB avg = 0.028 KB total ukey len = 0.018425 GB avg = 0.020 KB total ukey num = 0.000921267 Billion total entry num = 0.000921267 Billion write speed all = 0.005048193 MB/sec (with seq num) write speed all = 0.004783696 MB/sec (without seq num) 2024/11/22-16:36:47.879946 140024735041088 [compaction_job.cc:1948] [default] [JOB 4749] Generated table #214980: 921267 keys, 37838640 bytes, temperature: kWarm 2024/11/22-16:36:47.880054 140024735041088 EVENT_LOG_v1 {"time_micros": 1732264607879984, "cf_name": "default", "job": 4749, "event": "table_file_creation", "file_number": 214980, "file_size": 37838640, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3273702550, "largest_seqno": 3385806633, "table_properties": {"data_size": 31875456, "index_size": 1764288, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25795476, "raw_average_key_size": 28, "raw_value_size": 108422254, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 921267, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732264604, "oldest_key_time": 0, "file_creation_time": 1732264604, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 214980, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-16:36:47.951027 140024735041088 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04749/att-00/214981.sst) /dev/shm/ToplingTemp/Topling-201558-TzPjx4 2024/11/22-16:36:49.078531 140024735041088 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04749/att-00/214981.sst): first pass time = 1.13's, 119.045'MB/sec 2024/11/22-16:36:51.016799 140024735041088 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04749/att-00/214981.sst): old prealloc_size = 147639500, real_size = 34157408 2024/11/22-16:36:51.017472 140024735041088 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04749/att-00/214981.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 923315 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1084 GB zip-val = 0.0322 GB avg-val = 117.37 avg-zval = 34.84 2024/11/22-16:36:51.018287 140024735041088 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04749/att-00/214981.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-16:36:52.568433 140024735041088 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04749/att-00/214981.sst): second pass time = 1.94's, 55.935'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.55's, 24.575'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2719.773'MB/sec (index lex order gen) rebuild zvType time = 1.28's, 0.180'MB/sec write SST data time = 0.27's, 140.280'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.083'MB, throughput = 35053.933'MB/sec zip my value time = 1.94's, unzip length = 0.108'GB zip my value throughput = 55.935'MB/sec zip pipeline throughput = 55.935'MB/sec entries = 923315 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.37 avg-zval = 34.84 usrkeys = 923315 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.37 avg-zval = 34.84 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 923315 bytes = 3116208 } seq expand size = 6463205 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0185 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0322 GB dict = 1.08 MB all = 0.0381 GB } UnZip/Zip{ index = 10.5144 value = 3.3685 dict = 1.00 all = 3.5199 } Zip/UnZip{ index = 0.0951 value = 0.2969 dict = 1.00 all = 0.2841 } ---------------------------- total value len = 0.229699 GB avg = 0.125 KB (by entry num) total key len = 0.051648 GB avg = 0.028 KB total ukey len = 0.036892 GB avg = 0.020 KB total ukey num = 0.001844582 Billion total entry num = 0.001844582 Billion write speed all = 0.010095192 MB/sec (with seq num) write speed all = 0.009565700 MB/sec (without seq num) 2024/11/22-16:36:52.608187 140024735041088 [compaction_job.cc:1948] [default] [JOB 4749] Generated table #214981: 923315 keys, 38131408 bytes, temperature: kWarm 2024/11/22-16:36:52.608267 140024735041088 EVENT_LOG_v1 {"time_micros": 1732264612608223, "cf_name": "default", "job": 4749, "event": "table_file_creation", "file_number": 214981, "file_size": 38131408, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3273702561, "largest_seqno": 3385809911, "table_properties": {"data_size": 32170128, "index_size": 1756288, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25852820, "raw_average_key_size": 28, "raw_value_size": 108365050, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 923315, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732264607, "oldest_key_time": 0, "file_creation_time": 1732264607, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 214981, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-16:36:52.682888 140024735041088 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04749/att-00/214982.sst) /dev/shm/ToplingTemp/Topling-201558-2hugn5 2024/11/22-16:36:54.093943 140024735041088 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04749/att-00/214982.sst): first pass time = 1.41's, 95.122'MB/sec 2024/11/22-16:36:55.651288 140024735041088 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04749/att-00/214982.sst): old prealloc_size = 147639500, real_size = 33735696 2024/11/22-16:36:55.651966 140024735041088 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04749/att-00/214982.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 921141 prefix = 4 raw-key = 0.0147 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1084 GB zip-val = 0.0318 GB avg-val = 117.71 avg-zval = 34.47 2024/11/22-16:36:55.652738 140024735041088 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04749/att-00/214982.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-16:36:57.228007 140024735041088 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04749/att-00/214982.sst): second pass time = 1.56's, 69.692'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.58's, 23.913'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2671.443'MB/sec (index lex order gen) rebuild zvType time = 1.31's, 0.175'MB/sec write SST data time = 0.26's, 144.239'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.084'MB, throughput = 31579.530'MB/sec zip my value time = 1.56's, unzip length = 0.108'GB zip my value throughput = 69.692'MB/sec zip pipeline throughput = 69.692'MB/sec entries = 921141 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.71 avg-zval = 34.47 usrkeys = 921141 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.71 avg-zval = 34.47 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 921141 bytes = 3108864 } seq expand size = 6447987 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0184 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0318 GB dict = 1.08 MB all = 0.0377 GB } UnZip/Zip{ index = 10.5126 value = 3.4147 dict = 1.00 all = 3.5598 } Zip/UnZip{ index = 0.0951 value = 0.2929 dict = 1.00 all = 0.2809 } ---------------------------- total value len = 0.344573 GB avg = 0.125 KB (by entry num) total key len = 0.077440 GB avg = 0.028 KB total ukey len = 0.055314 GB avg = 0.020 KB total ukey num = 0.002765723 Billion total entry num = 0.002765723 Billion write speed all = 0.015139969 MB/sec (with seq num) write speed all = 0.014346194 MB/sec (without seq num) 2024/11/22-16:36:57.268539 140024735041088 [compaction_job.cc:1948] [default] [JOB 4749] Generated table #214982: 921141 keys, 37703732 bytes, temperature: kWarm 2024/11/22-16:36:57.268623 140024735041088 EVENT_LOG_v1 {"time_micros": 1732264617268576, "cf_name": "default", "job": 4749, "event": "table_file_creation", "file_number": 214982, "file_size": 37703732, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3273702585, "largest_seqno": 3385809701, "table_properties": {"data_size": 31752768, "index_size": 1752448, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25791948, "raw_average_key_size": 28, "raw_value_size": 108425890, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 921141, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732264612, "oldest_key_time": 0, "file_creation_time": 1732264612, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 214982, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-16:36:57.335155 140024735041088 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04749/att-00/214983.sst) /dev/shm/ToplingTemp/Topling-201558-PHQpG3 2024/11/22-16:36:58.594879 140024735041088 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04749/att-00/214983.sst): first pass time = 1.26's, 106.549'MB/sec 2024/11/22-16:37:00.154920 140024735041088 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04749/att-00/214983.sst): old prealloc_size = 147639500, real_size = 34224144 2024/11/22-16:37:00.155619 140024735041088 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04749/att-00/214983.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 923009 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1084 GB zip-val = 0.0322 GB avg-val = 117.41 avg-zval = 34.93 2024/11/22-16:37:00.156425 140024735041088 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04749/att-00/214983.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-16:37:01.998395 140024735041088 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04749/att-00/214983.sst): second pass time = 1.56's, 69.600'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.84's, 20.721'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2607.147'MB/sec (index lex order gen) rebuild zvType time = 1.58's, 0.146'MB/sec write SST data time = 0.26's, 144.926'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.083'MB, throughput = 37625.213'MB/sec zip my value time = 1.56's, unzip length = 0.108'GB zip my value throughput = 69.600'MB/sec zip pipeline throughput = 69.600'MB/sec entries = 923009 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.41 avg-zval = 34.93 usrkeys = 923009 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.41 avg-zval = 34.93 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 923009 bytes = 3115168 } seq expand size = 6461063 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0322 GB dict = 1.08 MB all = 0.0382 GB } UnZip/Zip{ index = 10.5128 value = 3.3617 dict = 1.00 all = 3.5138 } Zip/UnZip{ index = 0.0951 value = 0.2975 dict = 1.00 all = 0.2846 } ---------------------------- total value len = 0.459408 GB avg = 0.125 KB (by entry num) total key len = 0.103284 GB avg = 0.028 KB total ukey len = 0.073775 GB avg = 0.020 KB total ukey num = 0.003688732 Billion total entry num = 0.003688732 Billion write speed all = 0.020183446 MB/sec (with seq num) write speed all = 0.019124945 MB/sec (without seq num) 2024/11/22-16:37:02.035664 140024735041088 [compaction_job.cc:1948] [default] [JOB 4749] Generated table #214983: 923009 keys, 38197200 bytes, temperature: kWarm 2024/11/22-16:37:02.035742 140024735041088 EVENT_LOG_v1 {"time_micros": 1732264622035700, "cf_name": "default", "job": 4749, "event": "table_file_creation", "file_number": 214983, "file_size": 38197200, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3273702604, "largest_seqno": 3385809997, "table_properties": {"data_size": 32237248, "index_size": 1755968, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25844252, "raw_average_key_size": 28, "raw_value_size": 108373502, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 923009, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732264617, "oldest_key_time": 0, "file_creation_time": 1732264617, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 214983, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-16:37:02.106889 140024735041088 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04749/att-00/214984.sst) /dev/shm/ToplingTemp/Topling-201558-M0qh73 2024/11/22-16:37:03.545111 140024735041088 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04749/att-00/214984.sst): first pass time = 1.44's, 93.326'MB/sec 2024/11/22-16:37:06.124083 140024735041088 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04749/att-00/214984.sst): old prealloc_size = 147639500, real_size = 33864288 2024/11/22-16:37:06.124639 140024735041088 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04749/att-00/214984.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 921187 prefix = 4 raw-key = 0.0147 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1084 GB zip-val = 0.0319 GB avg-val = 117.70 avg-zval = 34.61 2024/11/22-16:37:06.125392 140024735041088 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04749/att-00/214984.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-16:37:07.295613 140024735041088 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04749/att-00/214984.sst): second pass time = 2.58's, 42.053'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.17's, 32.294'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3258.500'MB/sec (index lex order gen) rebuild zvType time = 1.04's, 0.221'MB/sec write SST data time = 0.13's, 293.136'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.084'MB, throughput = 37427.930'MB/sec zip my value time = 2.58's, unzip length = 0.108'GB zip my value throughput = 42.053'MB/sec zip pipeline throughput = 150.874'MB/sec entries = 921187 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.70 avg-zval = 34.61 usrkeys = 921187 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.70 avg-zval = 34.61 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 921187 bytes = 3109024 } seq expand size = 6448309 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0184 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0319 GB dict = 1.08 MB all = 0.0378 GB } UnZip/Zip{ index = 10.5108 value = 3.4009 dict = 1.00 all = 3.5477 } Zip/UnZip{ index = 0.0951 value = 0.2940 dict = 1.00 all = 0.2819 } ---------------------------- total value len = 0.574281 GB avg = 0.125 KB (by entry num) total key len = 0.129078 GB avg = 0.028 KB total ukey len = 0.092198 GB avg = 0.020 KB total ukey num = 0.004609919 Billion total entry num = 0.004609919 Billion write speed all = 0.025224263 MB/sec (with seq num) write speed all = 0.023901673 MB/sec (without seq num) 2024/11/22-16:37:07.341109 140024735041088 [compaction_job.cc:1948] [default] [JOB 4749] Generated table #214984: 921187 keys, 37832654 bytes, temperature: kWarm 2024/11/22-16:37:07.341181 140024735041088 EVENT_LOG_v1 {"time_micros": 1732264627341138, "cf_name": "default", "job": 4749, "event": "table_file_creation", "file_number": 214984, "file_size": 37832654, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3273702634, "largest_seqno": 3385809314, "table_properties": {"data_size": 31880976, "index_size": 1752832, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25793236, "raw_average_key_size": 28, "raw_value_size": 108424518, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 921187, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732264622, "oldest_key_time": 0, "file_creation_time": 1732264622, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 214984, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-16:37:07.396069 140024735041088 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04749/att-00/214985.sst) /dev/shm/ToplingTemp/Topling-201558-dOAnt6 2024/11/22-16:37:08.309459 140024735041088 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04749/att-00/214985.sst): first pass time = 0.91's, 146.951'MB/sec 2024/11/22-16:37:09.659256 140024735041088 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04749/att-00/214985.sst): old prealloc_size = 147639500, real_size = 34354672 2024/11/22-16:37:09.659833 140024735041088 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04749/att-00/214985.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 923206 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1084 GB zip-val = 0.0324 GB avg-val = 117.38 avg-zval = 35.06 2024/11/22-16:37:09.660573 140024735041088 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04749/att-00/214985.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-16:37:10.566454 140024735041088 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04749/att-00/214985.sst): second pass time = 1.35's, 80.324'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.91's, 42.250'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3188.777'MB/sec (index lex order gen) rebuild zvType time = 0.78's, 0.297'MB/sec write SST data time = 0.13's, 294.975'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.083'MB, throughput = 35401.007'MB/sec zip my value time = 1.35's, unzip length = 0.108'GB zip my value throughput = 80.324'MB/sec zip pipeline throughput = 80.324'MB/sec entries = 923206 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.38 avg-zval = 35.06 usrkeys = 923206 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.38 avg-zval = 35.06 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 923206 bytes = 3115840 } seq expand size = 6462442 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0324 GB dict = 1.08 MB all = 0.0383 GB } UnZip/Zip{ index = 10.5116 value = 3.3481 dict = 1.00 all = 3.5018 } Zip/UnZip{ index = 0.0951 value = 0.2987 dict = 1.00 all = 0.2856 } ---------------------------- total value len = 0.689111 GB avg = 0.125 KB (by entry num) total key len = 0.154927 GB avg = 0.028 KB total ukey len = 0.110662 GB avg = 0.020 KB total ukey num = 0.005533125 Billion total entry num = 0.005533125 Billion write speed all = 0.030265872 MB/sec (with seq num) write speed all = 0.028678600 MB/sec (without seq num) 2024/11/22-16:37:10.609336 140024735041088 [compaction_job.cc:1948] [default] [JOB 4749] Generated table #214985: 923206 keys, 38328430 bytes, temperature: kWarm 2024/11/22-16:37:10.609414 140024735041088 EVENT_LOG_v1 {"time_micros": 1732264630609371, "cf_name": "default", "job": 4749, "event": "table_file_creation", "file_number": 214985, "file_size": 38328430, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3273702649, "largest_seqno": 3385809605, "table_properties": {"data_size": 32367136, "index_size": 1756544, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25849768, "raw_average_key_size": 28, "raw_value_size": 108368032, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 923206, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732264627, "oldest_key_time": 0, "file_creation_time": 1732264627, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 214985, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-16:37:10.660441 140024735041088 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04749/att-00/214986.sst) /dev/shm/ToplingTemp/Topling-201558-Mtwxf5 2024/11/22-16:37:11.561522 140024735041088 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04749/att-00/214986.sst): first pass time = 0.90's, 148.959'MB/sec 2024/11/22-16:37:12.941673 140024735041088 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04749/att-00/214986.sst): old prealloc_size = 147639500, real_size = 35363488 2024/11/22-16:37:12.942236 140024735041088 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04749/att-00/214986.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 922515 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1084 GB zip-val = 0.0334 GB avg-val = 117.49 avg-zval = 36.18 2024/11/22-16:37:12.943045 140024735041088 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04749/att-00/214986.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-16:37:13.924064 140024735041088 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04749/att-00/214986.sst): second pass time = 1.38's, 78.570'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.98's, 40.163'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3237.312'MB/sec (index lex order gen) rebuild zvType time = 0.80's, 0.287'MB/sec write SST data time = 0.18's, 220.564'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.084'MB, throughput = 35880.658'MB/sec zip my value time = 1.38's, unzip length = 0.108'GB zip my value throughput = 78.570'MB/sec zip pipeline throughput = 78.570'MB/sec entries = 922515 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.49 avg-zval = 36.18 usrkeys = 922515 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.49 avg-zval = 36.18 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 922515 bytes = 3228816 } seq expand size = 6457605 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0185 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0334 GB dict = 1.08 MB all = 0.0395 GB } UnZip/Zip{ index = 10.5114 value = 3.2473 dict = 1.00 all = 3.4018 } Zip/UnZip{ index = 0.0951 value = 0.3079 dict = 1.00 all = 0.2940 } ---------------------------- total value len = 0.803956 GB avg = 0.125 KB (by entry num) total key len = 0.180758 GB avg = 0.028 KB total ukey len = 0.129113 GB avg = 0.020 KB total ukey num = 0.006455640 Billion total entry num = 0.006455640 Billion write speed all = 0.035306018 MB/sec (with seq num) write speed all = 0.033454330 MB/sec (without seq num) 2024/11/22-16:37:13.965022 140024735041088 [compaction_job.cc:1948] [default] [JOB 4749] Generated table #214986: 922515 keys, 39454712 bytes, temperature: kWarm 2024/11/22-16:37:13.965104 140024735041088 EVENT_LOG_v1 {"time_micros": 1732264633965059, "cf_name": "default", "job": 4749, "event": "table_file_creation", "file_number": 214986, "file_size": 39454712, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237868609, "largest_seqno": 3385807814, "table_properties": {"data_size": 33377424, "index_size": 1755264, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25830420, "raw_average_key_size": 28, "raw_value_size": 108387438, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 922515, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732264630, "oldest_key_time": 0, "file_creation_time": 1732264630, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 214986, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-16:37:14.016566 140024735041088 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04749/att-00/214987.sst) /dev/shm/ToplingTemp/Topling-201558-BTTPd4 2024/11/22-16:37:14.971937 140024735041088 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04749/att-00/214987.sst): first pass time = 0.96's, 140.495'MB/sec 2024/11/22-16:37:16.330152 140024735041088 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04749/att-00/214987.sst): old prealloc_size = 147639500, real_size = 36448944 2024/11/22-16:37:16.330717 140024735041088 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04749/att-00/214987.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 922829 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1084 GB zip-val = 0.0345 GB avg-val = 117.44 avg-zval = 37.34 2024/11/22-16:37:16.331487 140024735041088 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04749/att-00/214987.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-16:37:17.314562 140024735041088 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04749/att-00/214987.sst): second pass time = 1.36's, 79.836'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.98's, 40.996'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3217.892'MB/sec (index lex order gen) rebuild zvType time = 0.76's, 0.303'MB/sec write SST data time = 0.22's, 181.810'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.083'MB, throughput = 31519.821'MB/sec zip my value time = 1.36's, unzip length = 0.108'GB zip my value throughput = 79.836'MB/sec zip pipeline throughput = 79.836'MB/sec entries = 922829 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.44 avg-zval = 37.34 usrkeys = 922829 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.22 avg-zval = 37.34 TagRS{ kinds = RS_Key0_TagN bytes = 144280 } TagArray{ size = 893791 bytes = 2904832 } seq expand size = 6256537 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0185 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0345 GB dict = 1.08 MB all = 0.0404 GB } UnZip/Zip{ index = 10.5142 value = 3.1448 dict = 1.00 all = 3.3258 } Zip/UnZip{ index = 0.0951 value = 0.3180 dict = 1.00 all = 0.3007 } ---------------------------- total value len = 0.918591 GB avg = 0.124 KB (by entry num) total key len = 0.206597 GB avg = 0.028 KB total ukey len = 0.147569 GB avg = 0.020 KB total ukey num = 0.007378469 Billion total entry num = 0.007378469 Billion write speed all = 0.040337695 MB/sec (with seq num) write speed all = 0.038221567 MB/sec (without seq num) 2024/11/22-16:37:17.351437 140024735041088 [compaction_job.cc:1948] [default] [JOB 4749] Generated table #214987: 922829 keys, 40356190 bytes, temperature: kWarm 2024/11/22-16:37:17.351497 140024735041088 EVENT_LOG_v1 {"time_micros": 1732264637351465, "cf_name": "default", "job": 4749, "event": "table_file_creation", "file_number": 214987, "file_size": 40356190, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3273700579, "table_properties": {"data_size": 34462688, "index_size": 1755392, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25839212, "raw_average_key_size": 28, "raw_value_size": 108378658, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 922829, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732264634, "oldest_key_time": 0, "file_creation_time": 1732264634, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 214987, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-16:37:17.388207 140024735041088 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04749/att-00/214988.sst) /dev/shm/ToplingTemp/Topling-201558-5HDRL2 2024/11/22-16:37:18.201343 140024735041088 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04749/att-00/214988.sst): first pass time = 0.81's, 165.068'MB/sec 2024/11/22-16:37:19.601545 140024735041088 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04749/att-00/214988.sst): old prealloc_size = 147639500, real_size = 36331744 2024/11/22-16:37:19.602125 140024735041088 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04749/att-00/214988.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 922693 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1084 GB zip-val = 0.0343 GB avg-val = 117.46 avg-zval = 37.22 2024/11/22-16:37:19.602847 140024735041088 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04749/att-00/214988.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-16:37:20.581038 140024735041088 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04749/att-00/214988.sst): second pass time = 1.40's, 77.439'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.98's, 40.959'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3133.750'MB/sec (index lex order gen) rebuild zvType time = 0.78's, 0.294'MB/sec write SST data time = 0.19's, 206.562'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.083'MB, throughput = 33988.706'MB/sec zip my value time = 1.40's, unzip length = 0.108'GB zip my value throughput = 77.439'MB/sec zip pipeline throughput = 77.439'MB/sec entries = 922693 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.46 avg-zval = 37.22 usrkeys = 922693 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.95 avg-zval = 37.22 TagRS{ kinds = RS_Key0_TagN bytes = 144280 } TagArray{ size = 855304 bytes = 2779760 } seq expand size = 5987128 multi value expand size = 0 cnt WriteAppend = 15 UnZipSize{ index = 0.0185 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0343 GB dict = 1.08 MB all = 0.0401 GB } UnZip/Zip{ index = 10.5127 value = 3.1557 dict = 1.00 all = 3.3456 } Zip/UnZip{ index = 0.0951 value = 0.3169 dict = 1.00 all = 0.2989 } ---------------------------- total value len = 1.032961 GB avg = 0.124 KB (by entry num) total key len = 0.232433 GB avg = 0.028 KB total ukey len = 0.166023 GB avg = 0.020 KB total ukey num = 0.008301162 Billion total entry num = 0.008301162 Billion write speed all = 0.045358691 MB/sec (with seq num) write speed all = 0.042978215 MB/sec (without seq num) 2024/11/22-16:37:20.619040 140024735041088 [compaction_job.cc:1948] [default] [JOB 4749] Generated table #214988: 922693 keys, 40117902 bytes, temperature: kWarm 2024/11/22-16:37:20.619099 140024735041088 EVENT_LOG_v1 {"time_micros": 1732264640619068, "cf_name": "default", "job": 4749, "event": "table_file_creation", "file_number": 214988, "file_size": 40117902, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3273700833, "table_properties": {"data_size": 34345488, "index_size": 1755392, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25835404, "raw_average_key_size": 28, "raw_value_size": 108382370, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 922693, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732264637, "oldest_key_time": 0, "file_creation_time": 1732264637, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 214988, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-16:37:20.654682 140024735041088 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04749/att-00/214989.sst) /dev/shm/ToplingTemp/Topling-201558-pVaex2 2024/11/22-16:37:21.455023 140024735041088 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04749/att-00/214989.sst): first pass time = 0.80's, 167.707'MB/sec 2024/11/22-16:37:23.027911 140024735041088 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04749/att-00/214989.sst): old prealloc_size = 147639500, real_size = 36395936 2024/11/22-16:37:23.028442 140024735041088 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04749/att-00/214989.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 926896 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0344 GB avg-val = 116.80 avg-zval = 37.11 2024/11/22-16:37:23.028488 140024735041088 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04749/att-00/214989.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-16:37:23.672978 140024735041088 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04749/att-00/214989.sst): second pass time = 1.57's, 68.887'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.65's, 57.754'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3442.588'MB/sec (index lex order gen) rebuild zvType time = 0.52's, 0.445'MB/sec write SST data time = 0.12's, 299.780'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 31352.064'MB/sec zip my value time = 1.57's, unzip length = 0.108'GB zip my value throughput = 68.887'MB/sec zip pipeline throughput = 68.887'MB/sec entries = 926896 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.80 avg-zval = 37.11 usrkeys = 926896 avg-key = 20.00 avg-zkey = 1.90 avg-val = 116.80 avg-zval = 37.11 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 10 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0344 GB dict = 1.08 MB all = 0.0373 GB } UnZip/Zip{ index = 10.5149 value = 3.1471 dict = 1.00 all = 3.6028 } Zip/UnZip{ index = 0.0951 value = 0.3177 dict = 1.00 all = 0.2776 } ---------------------------- total value len = 1.141226 GB avg = 0.124 KB (by entry num) total key len = 0.258386 GB avg = 0.028 KB total ukey len = 0.184561 GB avg = 0.020 KB total ukey num = 0.009228058 Billion total entry num = 0.009228058 Billion write speed all = 0.050164238 MB/sec (with seq num) write speed all = 0.047518254 MB/sec (without seq num) 2024/11/22-16:37:23.705800 140024735041088 [compaction_job.cc:1948] [default] [JOB 4749] Generated table #214989: 926896 keys, 37254030 bytes, temperature: kWarm 2024/11/22-16:37:23.705859 140024735041088 EVENT_LOG_v1 {"time_micros": 1732264643705829, "cf_name": "default", "job": 4749, "event": "table_file_creation", "file_number": 214989, "file_size": 37254030, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 34401040, "index_size": 1763008, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25953088, "raw_average_key_size": 28, "raw_value_size": 108264696, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 926896, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732264640, "oldest_key_time": 0, "file_creation_time": 1732264640, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 214989, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-16:37:23.741873 140024735041088 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04749/att-00/214990.sst) /dev/shm/ToplingTemp/Topling-201558-mQAp04 2024/11/22-16:37:24.469238 140024735041088 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04749/att-00/214990.sst): first pass time = 0.73's, 184.536'MB/sec 2024/11/22-16:37:25.995881 140024735041088 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04749/att-00/214990.sst): old prealloc_size = 147639500, real_size = 36445712 2024/11/22-16:37:25.996412 140024735041088 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04749/att-00/214990.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927075 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.89 raw-val = 0.1083 GB zip-val = 0.0345 GB avg-val = 116.78 avg-zval = 37.17 2024/11/22-16:37:25.996452 140024735041088 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04749/att-00/214990.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-16:37:26.635555 140024735041088 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04749/att-00/214990.sst): second pass time = 1.53's, 70.942'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.64's, 58.319'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3434.391'MB/sec (index lex order gen) rebuild zvType time = 0.52's, 0.450'MB/sec write SST data time = 0.12's, 301.215'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 32470.698'MB/sec zip my value time = 1.53's, unzip length = 0.108'GB zip my value throughput = 70.942'MB/sec zip pipeline throughput = 70.942'MB/sec entries = 927075 avg-key = 28.00 avg-zkey = 1.89 avg-val = 116.78 avg-zval = 37.17 usrkeys = 927075 avg-key = 20.00 avg-zkey = 1.89 avg-val = 116.78 avg-zval = 37.17 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0345 GB dict = 1.08 MB all = 0.0373 GB } UnZip/Zip{ index = 10.5819 value = 3.1415 dict = 1.00 all = 3.5980 } Zip/UnZip{ index = 0.0945 value = 0.3183 dict = 1.00 all = 0.2779 } ---------------------------- total value len = 1.249485 GB avg = 0.123 KB (by entry num) total key len = 0.284344 GB avg = 0.028 KB total ukey len = 0.203103 GB avg = 0.020 KB total ukey num = 0.010155133 Billion total entry num = 0.010155133 Billion write speed all = 0.054968976 MB/sec (with seq num) write speed all = 0.052057479 MB/sec (without seq num) 2024/11/22-16:37:26.668248 140024735041088 [compaction_job.cc:1948] [default] [JOB 4749] Generated table #214990: 927075 keys, 37303856 bytes, temperature: kWarm 2024/11/22-16:37:26.668305 140024735041088 EVENT_LOG_v1 {"time_micros": 1732264646668274, "cf_name": "default", "job": 4749, "event": "table_file_creation", "file_number": 214990, "file_size": 37303856, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 34461568, "index_size": 1752192, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25958100, "raw_average_key_size": 28, "raw_value_size": 108259722, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927075, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732264643, "oldest_key_time": 0, "file_creation_time": 1732264643, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 214990, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-16:37:26.700966 140024735041088 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04749/att-00/214991.sst) /dev/shm/ToplingTemp/Topling-201558-Hr1v02 2024/11/22-16:37:27.606757 140024735041088 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04749/att-00/214991.sst): first pass time = 0.91's, 148.183'MB/sec 2024/11/22-16:37:28.976680 140024735041088 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04749/att-00/214991.sst): old prealloc_size = 147639500, real_size = 35622256 2024/11/22-16:37:28.977223 140024735041088 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04749/att-00/214991.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 925549 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0017 GB avg-key = 16.00 avg-zkey = 1.89 raw-val = 0.1083 GB zip-val = 0.0336 GB avg-val = 117.01 avg-zval = 36.35 2024/11/22-16:37:28.977771 140024735041088 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04749/att-00/214991.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-16:37:29.800706 140024735041088 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04749/att-00/214991.sst): second pass time = 1.37's, 79.092'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.82's, 46.933'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3356.113'MB/sec (index lex order gen) rebuild zvType time = 0.70's, 0.332'MB/sec write SST data time = 0.13's, 303.197'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 34158.821'MB/sec zip my value time = 1.37's, unzip length = 0.108'GB zip my value throughput = 79.092'MB/sec zip pipeline throughput = 79.092'MB/sec entries = 925549 avg-key = 28.00 avg-zkey = 1.89 avg-val = 117.01 avg-zval = 36.35 usrkeys = 925549 avg-key = 20.00 avg-zkey = 1.89 avg-val = 121.60 avg-zval = 36.35 TagRS{ kinds = RS_Key0_TagN bytes = 144720 } TagArray{ size = 606703 bytes = 2047632 } seq expand size = 4246921 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0017 GB value = 0.0336 GB dict = 1.08 MB all = 0.0387 GB } UnZip/Zip{ index = 10.5795 value = 3.2194 dict = 1.00 all = 3.4706 } Zip/UnZip{ index = 0.0945 value = 0.3106 dict = 1.00 all = 0.2881 } ---------------------------- total value len = 1.362035 GB avg = 0.123 KB (by entry num) total key len = 0.310259 GB avg = 0.028 KB total ukey len = 0.221614 GB avg = 0.020 KB total ukey num = 0.011080682 Billion total entry num = 0.011080682 Billion write speed all = 0.059924444 MB/sec (with seq num) write speed all = 0.056747951 MB/sec (without seq num) 2024/11/22-16:37:29.835308 140024735041088 [compaction_job.cc:1948] [default] [JOB 4749] Generated table #214991: 925549 keys, 38673330 bytes, temperature: kWarm 2024/11/22-16:37:29.835366 140024735041088 EVENT_LOG_v1 {"time_micros": 1732264649835336, "cf_name": "default", "job": 4749, "event": "table_file_creation", "file_number": 214991, "file_size": 38673330, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3385809666, "table_properties": {"data_size": 33640992, "index_size": 1749696, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25915372, "raw_average_key_size": 28, "raw_value_size": 108302478, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 925549, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732264646, "oldest_key_time": 0, "file_creation_time": 1732264646, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 214991, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-16:37:29.870091 140024735041088 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04749/att-00/214992.sst) /dev/shm/ToplingTemp/Topling-201558-teF4n5 2024/11/22-16:37:30.678192 140024735041088 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04749/att-00/214992.sst): first pass time = 0.81's, 166.097'MB/sec 2024/11/22-16:37:32.013350 140024735041088 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04749/att-00/214992.sst): old prealloc_size = 147639500, real_size = 35391920 2024/11/22-16:37:32.013919 140024735041088 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04749/att-00/214992.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 925910 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1083 GB zip-val = 0.0334 GB avg-val = 116.96 avg-zval = 36.06 2024/11/22-16:37:32.014706 140024735041088 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04749/att-00/214992.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-16:37:32.897915 140024735041088 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04749/att-00/214992.sst): second pass time = 1.33's, 81.141'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.88's, 44.511'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3236.267'MB/sec (index lex order gen) rebuild zvType time = 0.76's, 0.306'MB/sec write SST data time = 0.13's, 306.408'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 34588.759'MB/sec zip my value time = 1.33's, unzip length = 0.108'GB zip my value throughput = 81.141'MB/sec zip pipeline throughput = 81.141'MB/sec entries = 925910 avg-key = 28.00 avg-zkey = 1.92 avg-val = 116.96 avg-zval = 36.06 usrkeys = 925910 avg-key = 20.00 avg-zkey = 1.92 avg-val = 123.96 avg-zval = 36.06 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 925910 bytes = 3124960 } seq expand size = 6481370 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0334 GB dict = 1.08 MB all = 0.0394 GB } UnZip/Zip{ index = 10.4431 value = 3.2435 dict = 1.00 all = 3.4090 } Zip/UnZip{ index = 0.0958 value = 0.3083 dict = 1.00 all = 0.2933 } ---------------------------- total value len = 1.476808 GB avg = 0.123 KB (by entry num) total key len = 0.336185 GB avg = 0.028 KB total ukey len = 0.240132 GB avg = 0.020 KB total ukey num = 0.012006592 Billion total entry num = 0.012006592 Billion write speed all = 0.064959003 MB/sec (with seq num) write speed all = 0.061517461 MB/sec (without seq num) 2024/11/22-16:37:32.933029 140024735041088 [compaction_job.cc:1948] [default] [JOB 4749] Generated table #214992: 925910 keys, 39371902 bytes, temperature: kWarm 2024/11/22-16:37:32.933093 140024735041088 EVENT_LOG_v1 {"time_micros": 1732264652933061, "cf_name": "default", "job": 4749, "event": "table_file_creation", "file_number": 214992, "file_size": 39371902, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3273701386, "largest_seqno": 3385810087, "table_properties": {"data_size": 33387040, "index_size": 1773248, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25925480, "raw_average_key_size": 28, "raw_value_size": 108292276, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 925910, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732264649, "oldest_key_time": 0, "file_creation_time": 1732264649, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 214992, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-16:37:32.968737 140024735041088 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04749/att-00/214993.sst) /dev/shm/ToplingTemp/Topling-201558-lP1Ev5 2024/11/22-16:37:33.062808 140024735041088 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04749/att-00/214993.sst): first pass time = 0.09's, 237.831'MB/sec 2024/11/22-16:37:33.262421 140024735041088 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04749/att-00/214993.sst): old prealloc_size = 147639500, real_size = 6571680 2024/11/22-16:37:33.262574 140024735041088 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04749/att-00/214993.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 155398 prefix = 4 raw-key = 0.0025 GB zip-key = 0.0003 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.0180 GB zip-val = 0.0062 GB avg-val = 115.91 avg-zval = 40.13 2024/11/22-16:37:33.262714 140024735041088 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04749/att-00/214993.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.022 GB 2024/11/22-16:37:33.399405 140024735041088 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04749/att-00/214993.sst): second pass time = 0.20's, 90.517'MB/sec, value only(80.5% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.14's, 52.348'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2314.286'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.338'MB/sec write SST data time = 0.02's, 328.598'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.189'MB, throughput = 4692.620'MB/sec zip my value time = 0.20's, unzip length = 0.018'GB zip my value throughput = 90.517'MB/sec zip pipeline throughput = 90.517'MB/sec entries = 155398 avg-key = 28.00 avg-zkey = 1.91 avg-val = 115.91 avg-zval = 40.13 usrkeys = 155398 avg-key = 20.00 avg-zkey = 1.91 avg-val = 122.91 avg-zval = 40.13 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 155398 bytes = 446784 } seq expand size = 1087786 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0031 GB value = 0.0180 GB dict = 0.19 MB all = 0.0224 GB } __ZipSize{ index = 0.0003 GB value = 0.0062 GB dict = 0.19 MB all = 0.0072 GB } UnZip/Zip{ index = 10.4592 value = 2.8887 dict = 1.00 all = 3.1190 } Zip/UnZip{ index = 0.0956 value = 0.3462 dict = 1.00 all = 0.3206 } ---------------------------- total value len = 1.495908 GB avg = 0.123 KB (by entry num) total key len = 0.340536 GB avg = 0.028 KB total ukey len = 0.243240 GB avg = 0.020 KB total ukey num = 0.012161990 Billion total entry num = 0.012161990 Billion write speed all = 0.065798071 MB/sec (with seq num) write speed all = 0.062312050 MB/sec (without seq num) 2024/11/22-16:37:33.410460 140024735041088 [compaction_job.cc:1948] [default] [JOB 4749] Generated table #214993: 155398 keys, 7170109 bytes, temperature: kWarm 2024/11/22-16:37:33.410521 140024735041088 EVENT_LOG_v1 {"time_micros": 1732264653410488, "cf_name": "default", "job": 4749, "event": "table_file_creation", "file_number": 214993, "file_size": 7170109, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3376772971, "largest_seqno": 3384309373, "table_properties": {"data_size": 6235472, "index_size": 297152, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 4351144, "raw_average_key_size": 28, "raw_value_size": 18012308, "raw_average_value_size": 115, "num_data_blocks": 1, "num_entries": 155398, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732264652, "oldest_key_time": 0, "file_creation_time": 1732264652, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 214993, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-16:37:33.422356 140024735041088 [compaction_job.cc:703] job-04749: subcompact[0], size: 0.507734 G, files: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-04749/att-00 [214980,214981,214982,214983,214984,214985,214986,214987,214988,214989,214990,214991,214992,214993] 2024/11/22-16:37:33.514680 140024735041088 (Original Log Time 2024/11/22-16:36:43.607605) EVENT_LOG_v1 {"time_micros": 1732264603607555, "job": 4749, "event": "compaction_started", "compaction_reason": "FilesMarkedForCompaction", "files_L2": [214977], "files_L3": [214940, 214941, 214942, 214943, 214944, 214945, 214946, 214947, 214948, 214949, 214950, 214951, 214952], "score": 0.956561, "input_data_size": 531830026, "oldest_snapshot_seqno": 3385833917} 2024/11/22-16:37:33.514683 140024735041088 (Original Log Time 2024/11/22-16:37:33.513956) [compaction_job.cc:2022] [default] [JOB 4749] Compacted 1@2 + 13@3 files to L3 => 507734095 bytes 2024/11/22-16:37:33.514684 140024735041088 (Original Log Time 2024/11/22-16:37:33.514617) [compaction_job.cc:1224] [default] compacted to: files[0 0 0 14 0 0 0] max score 0.02, MB/sec: 10.7 rd, 10.2 wr, level 3, files in(1, 13) out(14 +0 blob) MB in(27.2, 480.0 +0.0 blob) out(484.2 +0.0 blob), read-write-amplify(36.5) write-amplify(17.8) OK, records in: 12240935, records dropped: 78945 output_compression: Snappy 2024/11/22-16:37:33.514691 140024735041088 (Original Log Time 2024/11/22-16:37:33.514660) EVENT_LOG_v1 {"time_micros": 1732264653514641, "cf": "default", "job": 4749, "event": "compaction_finished", "compaction_time_micros": 49814759, "compaction_time_cpu_micros": 22387567, "output_level": 3, "num_output_files": 14, "total_output_size": 507734095, "num_input_records": 12240935, "num_output_records": 12161990, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "file_write_nanos": 379994207, "file_range_sync_nanos": 0, "file_fsync_nanos": 13705, "file_prepare_write_nanos": 31738, "lsm_state": [0, 0, 0, 14, 0, 0, 0]} 2024/11/22-16:37:33.648029 140024735041088 DEBG dcompact_worker.cpp:240: HttpPost: 200 OK: url = http://nlb-7zny4kaa1poal01o64.cn-shenzhen.nlb.aliyuncs.com:8443, body = {"instanceId":"nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137","labourId":"","dbId":"d89b4006-2803-486e-b7a2-759bcf348921","dbStarts":1732256054,"starts":1732264603,"executesMs":50050,"compactionJobId":4749,"attempt":0,"compactionInputRawBytes":1778405102,"compactionInputZipBytes":531830026,"compactionOutputRawBytes":0,"compactionOutputZipBytes":507734095,"headers":{"Accept":"*/*","Connection":"close","Host":"aliyun-topling-saas.topling.cn:18443","RemoteIp":"120.24.192.169","X-Forwarded-For":"120.24.192.169","region":"cn-shenzhen","token":"e6474c481bd4415abc537135cc03626b","instance-token":"e6474c481bd4415abc537135cc03626b","provider":"aliyun","CloudMarketInstanceId":"si-59c0ae5c955845588903","MeteringAssit":"","Transfer-Encoding":"chunked","traceparent":"00-4d4f0ff2cf7db43a0c97d55703247bd5-68719bf411503705-00"}}, response = 2024/11/22-16:37:33.648095 140024735041088 INFO dcompact_worker.cpp:1459: finish /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-04749/att-00: olev 3, work 50.051 s, result 6.379 ms, install 0.754 ms, input{raw 1.656 GiB zip 507.193 MiB}