2024/11/24-03:55:58.411566 139957626406464 DEBG dcompact_worker.cpp:2214: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00: fork to child time = 0.034390 sec 2024/11/24-03:55:58.412509 139957626406464 DEBG dcompact_worker.cpp:1013: Beg SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00 2024/11/24-03:55:58.420945 139957626406464 DEBG dcompact_worker.cpp:1033: End SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00 2024/11/24-03:55:58.422153 139957626406464 TRAC dcompact_worker.cpp:1083: INFO_LOG_LEVEL: rpc = INFO_LEVEL, env_var = undefined 2024/11/24-03:55:58.422496 139957626406464 [WARN] [column_family.cc:386] multiple cf_paths/db_paths and level_compaction_dynamic_level_bytes can't be used together 2024/11/24-03:55:58.476159 139957626406464 [version_set.cc:6208] Recovering from manifest file: /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-41129/att-00/MANIFEST-206347 2024/11/24-03:55:58.504999 139957626406464 [version_set.cc:6251] Recovered from manifest file:/worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-41129/att-00/MANIFEST-206347 succeeded,manifest_file_number is 206347, next_file_number is 291072, last_sequence is 4427755417, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 290925 2024/11/24-03:55:58.505010 139957626406464 [version_set.cc:6266] Column family [default] (ID 0), log number is 0 2024/11/24-03:55:58.505208 139957626406464 [version_set.cc:5721] Creating manifest 291072 2024/11/24-03:55:58.537601 139957626406464 DEBG dcompact_worker.cpp:1218: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00: bottommost_level: fake = 1, rpc = 0 2024/11/24-03:55:58.557561 139957626406464 [compaction_job.cc:2437] [default] [JOB 41129] Compacting 1@2 + 17@3 files to L3, score 0.76, subcompactions 1 : 1 2024/11/24-03:55:58.557592 139957626406464 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 30806 Base level 2, inputs: [291059(27MB)], [290997(35MB) 290998(35MB) 290999(33MB) 291000(35MB) 291001(35MB) 291002(34MB) 291003(33MB) 291004(35MB) 291005(35MB) 291006(33MB) 291007(33MB) 291008(35MB) 291009(26MB) 291010(33MB) 291011(35MB) 291012(35MB) 291013(33MB)] 2024/11/24-03:55:58.567594 139957626406464 [top_zip_table.cc:59] core git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/24-03:55:58.567649 139957626406464 [top_zip_table.cc:60] fsa git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/24-03:55:58.567680 139957626406464 [top_zip_table.cc:61] zbs git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/24-03:55:58.567689 139957626406464 [top_zip_table.cc:62] topling-zip_table_reader: git_version_hash_info_is: commit a4a382006cb82713acf5b3425835f22711877681 Author: leipeng Date: 2024-04-11 19:44:14 +0800 fixed_len_hole_index.cc: Add env bool FixedLenHoleIndexUseAVX512 for ut & debug 1. FixedLenHoleIndexUseAVX512 is only in unit tests or debug 2. In release mode, use avx512 by compile options(-march=) g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/24-03:55:58.567706 139957626406464 [top_zip_table.cc:64] topling-rocks git_version_hash_info_is: commit feab587e468621ba0204d47b4ffacc52e7c4290d Author: leipeng Date: 2024-03-22 13:35:06 +0800 ToplingZipTableBuilder::Add: immediately return after error This function returns void, and caller does not check builder->status() after calling this function and graceful abandon. So immediately return after error, and return error status in Finish(). g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/24-03:55:59.349615 139957626406464 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291073.sst) /dev/shm/ToplingTemp/Topling-263392-GJR3qH 2024/11/24-03:56:00.314393 139957626406464 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291073.sst): first pass time = 0.96's, 139.126'MB/sec 2024/11/24-03:56:01.758938 139957626406464 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291073.sst): old prealloc_size = 147639500, real_size = 33327472 2024/11/24-03:56:01.759536 139957626406464 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291073.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 926959 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0313 GB avg-val = 116.79 avg-zval = 33.80 2024/11/24-03:56:01.760499 139957626406464 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291073.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-03:56:02.733899 139957626406464 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291073.sst): second pass time = 1.44's, 74.996'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.97's, 38.389'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3026.446'MB/sec (index lex order gen) rebuild zvType time = 0.75's, 0.310'MB/sec write SST data time = 0.23's, 164.725'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 39689.080'MB/sec zip my value time = 1.44's, unzip length = 0.108'GB zip my value throughput = 74.996'MB/sec zip pipeline throughput = 74.996'MB/sec entries = 926959 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.79 avg-zval = 33.80 usrkeys = 926959 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.79 avg-zval = 33.80 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 926959 bytes = 3244368 } seq expand size = 6488713 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0313 GB dict = 1.08 MB all = 0.0374 GB } UnZip/Zip{ index = 10.5134 value = 3.4553 dict = 1.00 all = 3.5862 } Zip/UnZip{ index = 0.0951 value = 0.2894 dict = 1.00 all = 0.2788 } ---------------------------- total value len = 2251.440325 GB avg = 0.200 KB (by entry num) total key len = 306.908917 GB avg = 0.027 KB total ukey len = 237.373267 GB avg = 0.015 KB total ukey num = 15.739588122 Billion total entry num = 11.280902070 Billion write speed all = 37.375161961 MB/sec (with seq num) write speed all = 36.056731983 MB/sec (without seq num) 2024/11/24-03:56:02.782359 139957626406464 [compaction_job.cc:1948] [default] [JOB 41129] Generated table #291073: 926959 keys, 37426114 bytes, temperature: kWarm 2024/11/24-03:56:02.782468 139957626406464 EVENT_LOG_v1 {"time_micros": 1732391762782397, "cf_name": "default", "job": 41129, "event": "table_file_creation", "file_number": 291073, "file_size": 37426114, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4259662645, "largest_seqno": 4427728549, "table_properties": {"data_size": 31332128, "index_size": 1763392, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25954852, "raw_average_key_size": 28, "raw_value_size": 108262990, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 926959, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732391759, "oldest_key_time": 0, "file_creation_time": 1732391759, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 291073, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-03:56:02.839228 139957626406464 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291074.sst) /dev/shm/ToplingTemp/Topling-263392-uXXrEE 2024/11/24-03:56:04.023726 139957626406464 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291074.sst): first pass time = 1.18's, 113.318'MB/sec 2024/11/24-03:56:06.372502 139957626406464 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291074.sst): old prealloc_size = 147639500, real_size = 32621504 2024/11/24-03:56:06.373104 139957626406464 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291074.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927069 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0306 GB avg-val = 116.78 avg-zval = 33.04 2024/11/24-03:56:06.373918 139957626406464 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291074.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-03:56:07.530108 139957626406464 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291074.sst): second pass time = 2.35's, 46.108'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.16's, 31.723'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3029.167'MB/sec (index lex order gen) rebuild zvType time = 0.96's, 0.242'MB/sec write SST data time = 0.20's, 185.234'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 27985.235'MB/sec zip my value time = 2.35's, unzip length = 0.108'GB zip my value throughput = 46.108'MB/sec zip pipeline throughput = 134.295'MB/sec entries = 927069 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.78 avg-zval = 33.04 usrkeys = 927069 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.78 avg-zval = 33.04 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 927069 bytes = 3244752 } seq expand size = 6489483 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0306 GB dict = 1.08 MB all = 0.0367 GB } UnZip/Zip{ index = 10.5135 value = 3.5349 dict = 1.00 all = 3.6551 } Zip/UnZip{ index = 0.0951 value = 0.2829 dict = 1.00 all = 0.2736 } ---------------------------- total value len = 2251.555074 GB avg = 0.200 KB (by entry num) total key len = 306.934875 GB avg = 0.027 KB total ukey len = 237.391808 GB avg = 0.015 KB total ukey num = 15.740515191 Billion total entry num = 11.281829139 Billion write speed all = 37.374598793 MB/sec (with seq num) write speed all = 36.056152847 MB/sec (without seq num) 2024/11/24-03:56:07.579432 139957626406464 [compaction_job.cc:1948] [default] [JOB 41129] Generated table #291074: 927069 keys, 36720706 bytes, temperature: kWarm 2024/11/24-03:56:07.579524 139957626406464 EVENT_LOG_v1 {"time_micros": 1732391767579475, "cf_name": "default", "job": 41129, "event": "table_file_creation", "file_number": 291074, "file_size": 36720706, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4261178503, "largest_seqno": 4427725396, "table_properties": {"data_size": 30625968, "index_size": 1763584, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25957932, "raw_average_key_size": 28, "raw_value_size": 108259906, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927069, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732391762, "oldest_key_time": 0, "file_creation_time": 1732391762, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 291074, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-03:56:07.642116 139957626406464 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291075.sst) /dev/shm/ToplingTemp/Topling-263392-rHo2CH 2024/11/24-03:56:08.677176 139957626406464 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291075.sst): first pass time = 1.04's, 129.678'MB/sec 2024/11/24-03:56:10.018066 139957626406464 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291075.sst): old prealloc_size = 147639500, real_size = 31228464 2024/11/24-03:56:10.018645 139957626406464 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291075.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 922333 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1084 GB zip-val = 0.0292 GB avg-val = 117.52 avg-zval = 31.69 2024/11/24-03:56:10.019433 139957626406464 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291075.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-03:56:10.950655 139957626406464 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291075.sst): second pass time = 1.34's, 80.937'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.93's, 37.867'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3195.392'MB/sec (index lex order gen) rebuild zvType time = 0.80's, 0.287'MB/sec write SST data time = 0.13's, 274.892'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.083'MB, throughput = 37461.757'MB/sec zip my value time = 1.34's, unzip length = 0.108'GB zip my value throughput = 80.937'MB/sec zip pipeline throughput = 80.937'MB/sec entries = 922333 avg-key = 28.00 avg-zkey = 1.92 avg-val = 117.52 avg-zval = 31.69 usrkeys = 922333 avg-key = 20.00 avg-zkey = 1.92 avg-val = 124.52 avg-zval = 31.69 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 922333 bytes = 3228176 } seq expand size = 6456331 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0184 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0292 GB dict = 1.08 MB all = 0.0353 GB } UnZip/Zip{ index = 10.4427 value = 3.7081 dict = 1.00 all = 3.8008 } Zip/UnZip{ index = 0.0958 value = 0.2697 dict = 1.00 all = 0.2631 } ---------------------------- total value len = 2251.669923 GB avg = 0.200 KB (by entry num) total key len = 306.960701 GB avg = 0.027 KB total ukey len = 237.410255 GB avg = 0.015 KB total ukey num = 15.741437524 Billion total entry num = 11.282751472 Billion write speed all = 37.374786230 MB/sec (with seq num) write speed all = 36.056298378 MB/sec (without seq num) 2024/11/24-03:56:10.995892 139957626406464 [compaction_job.cc:1948] [default] [JOB 41129] Generated table #291075: 922333 keys, 35313490 bytes, temperature: kWarm 2024/11/24-03:56:10.995962 139957626406464 EVENT_LOG_v1 {"time_micros": 1732391770995927, "cf_name": "default", "job": 41129, "event": "table_file_creation", "file_number": 291075, "file_size": 35313490, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4293171796, "largest_seqno": 4427724264, "table_properties": {"data_size": 29231264, "index_size": 1766464, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25825324, "raw_average_key_size": 28, "raw_value_size": 108392454, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 922333, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732391767, "oldest_key_time": 0, "file_creation_time": 1732391767, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 291075, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-03:56:11.032999 139957626406464 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291076.sst) /dev/shm/ToplingTemp/Topling-263392-BTo97C 2024/11/24-03:56:11.899816 139957626406464 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291076.sst): first pass time = 0.87's, 154.846'MB/sec 2024/11/24-03:56:13.488752 139957626406464 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291076.sst): old prealloc_size = 147639500, real_size = 32695776 2024/11/24-03:56:13.489297 139957626406464 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291076.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 923890 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0307 GB avg-val = 117.27 avg-zval = 33.24 2024/11/24-03:56:13.490103 139957626406464 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291076.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-03:56:14.629989 139957626406464 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291076.sst): second pass time = 1.59's, 68.224'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.14's, 32.235'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3351.693'MB/sec (index lex order gen) rebuild zvType time = 0.91's, 0.254'MB/sec write SST data time = 0.23's, 159.723'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.082'MB, throughput = 29708.896'MB/sec zip my value time = 1.59's, unzip length = 0.108'GB zip my value throughput = 68.224'MB/sec zip pipeline throughput = 68.224'MB/sec entries = 923890 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.27 avg-zval = 33.24 usrkeys = 923890 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.27 avg-zval = 33.24 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 923890 bytes = 3233632 } seq expand size = 6467230 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0307 GB dict = 1.08 MB all = 0.0368 GB } UnZip/Zip{ index = 10.5137 value = 3.5285 dict = 1.00 all = 3.6486 } Zip/UnZip{ index = 0.0951 value = 0.2834 dict = 1.00 all = 0.2741 } ---------------------------- total value len = 2251.784739 GB avg = 0.200 KB (by entry num) total key len = 306.986570 GB avg = 0.027 KB total ukey len = 237.428732 GB avg = 0.015 KB total ukey num = 15.742361414 Billion total entry num = 11.283675362 Billion write speed all = 37.374832564 MB/sec (with seq num) write speed all = 36.056307611 MB/sec (without seq num) 2024/11/24-03:56:14.679986 139957626406464 [compaction_job.cc:1948] [default] [JOB 41129] Generated table #291076: 923890 keys, 36786206 bytes, temperature: kWarm 2024/11/24-03:56:14.680078 139957626406464 EVENT_LOG_v1 {"time_micros": 1732391774680031, "cf_name": "default", "job": 41129, "event": "table_file_creation", "file_number": 291076, "file_size": 36786206, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4261178518, "largest_seqno": 4427728774, "table_properties": {"data_size": 30707088, "index_size": 1757504, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25868920, "raw_average_key_size": 28, "raw_value_size": 108348928, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 923890, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732391771, "oldest_key_time": 0, "file_creation_time": 1732391771, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 291076, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-03:56:14.729444 139957626406464 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291077.sst) /dev/shm/ToplingTemp/Topling-263392-Cg7PxD 2024/11/24-03:56:15.742897 139957626406464 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291077.sst): first pass time = 1.01's, 132.442'MB/sec 2024/11/24-03:56:17.112576 139957626406464 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291077.sst): old prealloc_size = 147639500, real_size = 33474512 2024/11/24-03:56:17.113150 139957626406464 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291077.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927022 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0315 GB avg-val = 116.78 avg-zval = 33.96 2024/11/24-03:56:17.113935 139957626406464 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291077.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-03:56:18.103455 139957626406464 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291077.sst): second pass time = 1.37's, 79.088'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.99's, 37.920'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3200.319'MB/sec (index lex order gen) rebuild zvType time = 0.82's, 0.284'MB/sec write SST data time = 0.17's, 216.458'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 34420.426'MB/sec zip my value time = 1.37's, unzip length = 0.108'GB zip my value throughput = 79.088'MB/sec zip pipeline throughput = 79.088'MB/sec entries = 927022 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.78 avg-zval = 33.96 usrkeys = 927022 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.78 avg-zval = 33.96 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 927022 bytes = 3244592 } seq expand size = 6489154 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0315 GB dict = 1.08 MB all = 0.0376 GB } UnZip/Zip{ index = 10.5137 value = 3.4391 dict = 1.00 all = 3.5721 } Zip/UnZip{ index = 0.0951 value = 0.2908 dict = 1.00 all = 0.2799 } ---------------------------- total value len = 2251.899490 GB avg = 0.200 KB (by entry num) total key len = 307.012526 GB avg = 0.027 KB total ukey len = 237.447273 GB avg = 0.015 KB total ukey num = 15.743288436 Billion total entry num = 11.284602384 Billion write speed all = 37.374991553 MB/sec (with seq num) write speed all = 36.056425174 MB/sec (without seq num) 2024/11/24-03:56:18.149608 139957626406464 [compaction_job.cc:1948] [default] [JOB 41129] Generated table #291077: 927022 keys, 37573662 bytes, temperature: kWarm 2024/11/24-03:56:18.149679 139957626406464 EVENT_LOG_v1 {"time_micros": 1732391778149643, "cf_name": "default", "job": 41129, "event": "table_file_creation", "file_number": 291077, "file_size": 37573662, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4261178530, "largest_seqno": 4427728241, "table_properties": {"data_size": 31479104, "index_size": 1763456, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25956616, "raw_average_key_size": 28, "raw_value_size": 108261132, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927022, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732391774, "oldest_key_time": 0, "file_creation_time": 1732391774, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 291077, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-03:56:18.186431 139957626406464 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291078.sst) /dev/shm/ToplingTemp/Topling-263392-0Eh0wE 2024/11/24-03:56:19.197310 139957626406464 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291078.sst): first pass time = 1.01's, 132.778'MB/sec 2024/11/24-03:56:20.510523 139957626406464 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291078.sst): old prealloc_size = 147639500, real_size = 31264272 2024/11/24-03:56:20.511082 139957626406464 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291078.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 926940 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0293 GB avg-val = 116.80 avg-zval = 31.58 2024/11/24-03:56:20.511876 139957626406464 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291078.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-03:56:21.478576 139957626406464 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291078.sst): second pass time = 1.31's, 82.549'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.97's, 36.531'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3294.424'MB/sec (index lex order gen) rebuild zvType time = 0.73's, 0.316'MB/sec write SST data time = 0.23's, 150.540'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 31977.737'MB/sec zip my value time = 1.31's, unzip length = 0.108'GB zip my value throughput = 82.549'MB/sec zip pipeline throughput = 82.549'MB/sec entries = 926940 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.80 avg-zval = 31.58 usrkeys = 926940 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.80 avg-zval = 31.58 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 926940 bytes = 3244304 } seq expand size = 6488580 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0293 GB dict = 1.08 MB all = 0.0354 GB } UnZip/Zip{ index = 10.5120 value = 3.6989 dict = 1.00 all = 3.7954 } Zip/UnZip{ index = 0.0951 value = 0.2703 dict = 1.00 all = 0.2635 } ---------------------------- total value len = 2252.014242 GB avg = 0.200 KB (by entry num) total key len = 307.038480 GB avg = 0.027 KB total ukey len = 237.465812 GB avg = 0.015 KB total ukey num = 15.744215376 Billion total entry num = 11.285529324 Billion write speed all = 37.375204232 MB/sec (with seq num) write speed all = 36.056594546 MB/sec (without seq num) 2024/11/24-03:56:21.523539 139957626406464 [compaction_job.cc:1948] [default] [JOB 41129] Generated table #291078: 926940 keys, 35362848 bytes, temperature: kWarm 2024/11/24-03:56:21.523608 139957626406464 EVENT_LOG_v1 {"time_micros": 1732391781523574, "cf_name": "default", "job": 41129, "event": "table_file_creation", "file_number": 291078, "file_size": 35362848, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4261178548, "largest_seqno": 4427728806, "table_properties": {"data_size": 29268800, "index_size": 1763584, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25954320, "raw_average_key_size": 28, "raw_value_size": 108263512, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 926940, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732391778, "oldest_key_time": 0, "file_creation_time": 1732391778, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 291078, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-03:56:21.560821 139957626406464 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291079.sst) /dev/shm/ToplingTemp/Topling-263392-phZjeF 2024/11/24-03:56:22.498418 139957626406464 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291079.sst): first pass time = 0.94's, 143.157'MB/sec 2024/11/24-03:56:23.835276 139957626406464 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291079.sst): old prealloc_size = 147639500, real_size = 31348976 2024/11/24-03:56:23.835817 139957626406464 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291079.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 919300 prefix = 4 raw-key = 0.0147 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1085 GB zip-val = 0.0294 GB avg-val = 118.00 avg-zval = 31.94 2024/11/24-03:56:23.836607 139957626406464 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291079.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-03:56:24.782931 139957626406464 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291079.sst): second pass time = 1.34's, 81.196'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.95's, 37.383'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3404.682'MB/sec (index lex order gen) rebuild zvType time = 0.78's, 0.294'MB/sec write SST data time = 0.17's, 213.726'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.085'MB, throughput = 28295.259'MB/sec zip my value time = 1.34's, unzip length = 0.108'GB zip my value throughput = 81.196'MB/sec zip pipeline throughput = 81.196'MB/sec entries = 919300 avg-key = 28.00 avg-zkey = 1.91 avg-val = 118.00 avg-zval = 31.94 usrkeys = 919300 avg-key = 20.00 avg-zkey = 1.91 avg-val = 125.00 avg-zval = 31.94 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 919300 bytes = 3217568 } seq expand size = 6435100 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0184 GB value = 0.1085 GB dict = 1.09 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0294 GB dict = 1.09 MB all = 0.0354 GB } UnZip/Zip{ index = 10.4462 value = 3.6949 dict = 1.00 all = 3.7887 } Zip/UnZip{ index = 0.0957 value = 0.2706 dict = 1.00 all = 0.2639 } ---------------------------- total value len = 2252.129154 GB avg = 0.200 KB (by entry num) total key len = 307.064221 GB avg = 0.027 KB total ukey len = 237.484198 GB avg = 0.015 KB total ukey num = 15.745134676 Billion total entry num = 11.286448624 Billion write speed all = 37.375454716 MB/sec (with seq num) write speed all = 36.056801257 MB/sec (without seq num) 2024/11/24-03:56:24.826149 139957626406464 [compaction_job.cc:1948] [default] [JOB 41129] Generated table #291079: 919300 keys, 35425714 bytes, temperature: kWarm 2024/11/24-03:56:24.826220 139957626406464 EVENT_LOG_v1 {"time_micros": 1732391784826184, "cf_name": "default", "job": 41129, "event": "table_file_creation", "file_number": 291079, "file_size": 35425714, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4269013618, "largest_seqno": 4421535225, "table_properties": {"data_size": 29358880, "index_size": 1760064, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25740400, "raw_average_key_size": 28, "raw_value_size": 108477400, "raw_average_value_size": 118, "num_data_blocks": 1, "num_entries": 919300, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 118, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732391781, "oldest_key_time": 0, "file_creation_time": 1732391781, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 291079, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-03:56:24.863694 139957626406464 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291080.sst) /dev/shm/ToplingTemp/Topling-263392-CgubyD 2024/11/24-03:56:25.890647 139957626406464 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291080.sst): first pass time = 1.03's, 130.700'MB/sec 2024/11/24-03:56:27.293382 139957626406464 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291080.sst): old prealloc_size = 147639500, real_size = 33255344 2024/11/24-03:56:27.293899 139957626406464 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291080.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 926892 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0313 GB avg-val = 116.80 avg-zval = 33.73 2024/11/24-03:56:27.294691 139957626406464 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291080.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-03:56:28.154251 139957626406464 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291080.sst): second pass time = 1.40's, 77.222'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.86's, 43.392'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3577.338'MB/sec (index lex order gen) rebuild zvType time = 0.73's, 0.317'MB/sec write SST data time = 0.13's, 290.278'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 22904.509'MB/sec zip my value time = 1.40's, unzip length = 0.108'GB zip my value throughput = 77.222'MB/sec zip pipeline throughput = 91.964'MB/sec entries = 926892 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.80 avg-zval = 33.73 usrkeys = 926892 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.80 avg-zval = 33.73 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 926892 bytes = 3244144 } seq expand size = 6488244 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0313 GB dict = 1.08 MB all = 0.0374 GB } UnZip/Zip{ index = 10.5122 value = 3.4634 dict = 1.00 all = 3.5932 } Zip/UnZip{ index = 0.0951 value = 0.2887 dict = 1.00 all = 0.2783 } ---------------------------- total value len = 2252.243907 GB avg = 0.200 KB (by entry num) total key len = 307.090174 GB avg = 0.027 KB total ukey len = 237.502735 GB avg = 0.015 KB total ukey num = 15.746061568 Billion total entry num = 11.287375516 Billion write speed all = 37.375669417 MB/sec (with seq num) write speed all = 36.056972592 MB/sec (without seq num) 2024/11/24-03:56:28.200355 139957626406464 [compaction_job.cc:1948] [default] [JOB 41129] Generated table #291080: 926892 keys, 37353472 bytes, temperature: kWarm 2024/11/24-03:56:28.200425 139957626406464 EVENT_LOG_v1 {"time_micros": 1732391788200389, "cf_name": "default", "job": 41129, "event": "table_file_creation", "file_number": 291080, "file_size": 37353472, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4261178559, "largest_seqno": 4427728060, "table_properties": {"data_size": 31260000, "index_size": 1763456, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25952976, "raw_average_key_size": 28, "raw_value_size": 108264892, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 926892, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732391784, "oldest_key_time": 0, "file_creation_time": 1732391784, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 291080, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-03:56:28.237373 139957626406464 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291081.sst) /dev/shm/ToplingTemp/Topling-263392-FO6MRF 2024/11/24-03:56:29.272362 139957626406464 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291081.sst): first pass time = 1.03's, 129.685'MB/sec 2024/11/24-03:56:30.590520 139957626406464 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291081.sst): old prealloc_size = 147639500, real_size = 32982208 2024/11/24-03:56:30.591103 139957626406464 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291081.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927013 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0310 GB avg-val = 116.79 avg-zval = 33.43 2024/11/24-03:56:30.591900 139957626406464 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291081.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-03:56:31.437684 139957626406464 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291081.sst): second pass time = 1.32's, 82.215'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.85's, 43.772'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3142.061'MB/sec (index lex order gen) rebuild zvType time = 0.72's, 0.323'MB/sec write SST data time = 0.13's, 288.398'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 35945.628'MB/sec zip my value time = 1.32's, unzip length = 0.108'GB zip my value throughput = 82.215'MB/sec zip pipeline throughput = 82.215'MB/sec entries = 927013 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.79 avg-zval = 33.43 usrkeys = 927013 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.79 avg-zval = 33.43 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 927013 bytes = 3244560 } seq expand size = 6489091 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0310 GB dict = 1.08 MB all = 0.0371 GB } UnZip/Zip{ index = 10.5144 value = 3.4938 dict = 1.00 all = 3.6196 } Zip/UnZip{ index = 0.0951 value = 0.2862 dict = 1.00 all = 0.2763 } ---------------------------- total value len = 2252.358658 GB avg = 0.200 KB (by entry num) total key len = 307.116130 GB avg = 0.027 KB total ukey len = 237.521276 GB avg = 0.015 KB total ukey num = 15.746988581 Billion total entry num = 11.288302529 Billion write speed all = 37.375932068 MB/sec (with seq num) write speed all = 36.057190175 MB/sec (without seq num) 2024/11/24-03:56:31.483079 139957626406464 [compaction_job.cc:1948] [default] [JOB 41129] Generated table #291081: 927013 keys, 37081086 bytes, temperature: kWarm 2024/11/24-03:56:31.483150 139957626406464 EVENT_LOG_v1 {"time_micros": 1732391791483115, "cf_name": "default", "job": 41129, "event": "table_file_creation", "file_number": 291081, "file_size": 37081086, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4261178575, "largest_seqno": 4427727744, "table_properties": {"data_size": 30986928, "index_size": 1763328, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25956364, "raw_average_key_size": 28, "raw_value_size": 108261410, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927013, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732391788, "oldest_key_time": 0, "file_creation_time": 1732391788, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 291081, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-03:56:31.519956 139957626406464 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291082.sst) /dev/shm/ToplingTemp/Topling-263392-hcNtPF 2024/11/24-03:56:32.467767 139957626406464 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291082.sst): first pass time = 0.95's, 141.616'MB/sec 2024/11/24-03:56:33.769969 139957626406464 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291082.sst): old prealloc_size = 147639500, real_size = 30911072 2024/11/24-03:56:33.770517 139957626406464 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291082.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 924187 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.93 raw-val = 0.1083 GB zip-val = 0.0289 GB avg-val = 117.23 avg-zval = 31.27 2024/11/24-03:56:33.771323 139957626406464 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291082.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-03:56:34.578671 139957626406464 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291082.sst): second pass time = 1.30's, 83.284'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.81's, 43.139'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3536.792'MB/sec (index lex order gen) rebuild zvType time = 0.68's, 0.339'MB/sec write SST data time = 0.13's, 274.102'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.082'MB, throughput = 33412.778'MB/sec zip my value time = 1.30's, unzip length = 0.108'GB zip my value throughput = 83.284'MB/sec zip pipeline throughput = 83.284'MB/sec entries = 924187 avg-key = 28.00 avg-zkey = 1.93 avg-val = 117.23 avg-zval = 31.27 usrkeys = 924187 avg-key = 20.00 avg-zkey = 1.93 avg-val = 124.23 avg-zval = 31.27 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 924187 bytes = 3119152 } seq expand size = 6469309 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0289 GB dict = 1.08 MB all = 0.0349 GB } UnZip/Zip{ index = 10.3761 value = 3.7490 dict = 1.00 all = 3.8474 } Zip/UnZip{ index = 0.0964 value = 0.2667 dict = 1.00 all = 0.2599 } ---------------------------- total value len = 2252.473468 GB avg = 0.200 KB (by entry num) total key len = 307.142007 GB avg = 0.027 KB total ukey len = 237.539759 GB avg = 0.015 KB total ukey num = 15.747912768 Billion total entry num = 11.289226716 Billion write speed all = 37.376272152 MB/sec (with seq num) write speed all = 36.057482782 MB/sec (without seq num) 2024/11/24-03:56:34.622425 139957626406464 [compaction_job.cc:1948] [default] [JOB 41129] Generated table #291082: 924187 keys, 34885094 bytes, temperature: kWarm 2024/11/24-03:56:34.622498 139957626406464 EVENT_LOG_v1 {"time_micros": 1732391794622461, "cf_name": "default", "job": 41129, "event": "table_file_creation", "file_number": 291082, "file_size": 34885094, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4304297189, "largest_seqno": 4427724337, "table_properties": {"data_size": 28898448, "index_size": 1781376, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25877236, "raw_average_key_size": 28, "raw_value_size": 108340590, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 924187, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732391791, "oldest_key_time": 0, "file_creation_time": 1732391791, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 291082, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-03:56:34.659490 139957626406464 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291083.sst) /dev/shm/ToplingTemp/Topling-263392-18Kb4E 2024/11/24-03:56:35.663716 139957626406464 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291083.sst): first pass time = 1.00's, 133.658'MB/sec 2024/11/24-03:56:36.980672 139957626406464 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291083.sst): old prealloc_size = 147639500, real_size = 32429136 2024/11/24-03:56:36.981283 139957626406464 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291083.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 921967 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1084 GB zip-val = 0.0304 GB avg-val = 117.58 avg-zval = 33.01 2024/11/24-03:56:36.982077 139957626406464 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291083.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-03:56:37.812075 139957626406464 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291083.sst): second pass time = 1.32's, 82.396'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.83's, 43.921'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2989.234'MB/sec (index lex order gen) rebuild zvType time = 0.70's, 0.328'MB/sec write SST data time = 0.13's, 284.823'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.083'MB, throughput = 27241.525'MB/sec zip my value time = 1.32's, unzip length = 0.108'GB zip my value throughput = 82.396'MB/sec zip pipeline throughput = 82.396'MB/sec entries = 921967 avg-key = 28.00 avg-zkey = 1.91 avg-val = 117.58 avg-zval = 33.01 usrkeys = 921967 avg-key = 20.00 avg-zkey = 1.91 avg-val = 124.58 avg-zval = 33.01 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 921967 bytes = 3226896 } seq expand size = 6453769 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0184 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0304 GB dict = 1.08 MB all = 0.0365 GB } UnZip/Zip{ index = 10.4450 value = 3.5620 dict = 1.00 all = 3.6757 } Zip/UnZip{ index = 0.0957 value = 0.2807 dict = 1.00 all = 0.2721 } ---------------------------- total value len = 2252.588324 GB avg = 0.200 KB (by entry num) total key len = 307.167822 GB avg = 0.027 KB total ukey len = 237.558199 GB avg = 0.015 KB total ukey num = 15.748834735 Billion total entry num = 11.290148683 Billion write speed all = 37.376561543 MB/sec (with seq num) write speed all = 36.057726738 MB/sec (without seq num) 2024/11/24-03:56:37.856785 139957626406464 [compaction_job.cc:1948] [default] [JOB 41129] Generated table #291083: 921967 keys, 36514608 bytes, temperature: kWarm 2024/11/24-03:56:37.856856 139957626406464 EVENT_LOG_v1 {"time_micros": 1732391797856820, "cf_name": "default", "job": 41129, "event": "table_file_creation", "file_number": 291083, "file_size": 36514608, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4261178589, "largest_seqno": 4427727264, "table_properties": {"data_size": 30433088, "index_size": 1765376, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25815076, "raw_average_key_size": 28, "raw_value_size": 108402754, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 921967, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732391794, "oldest_key_time": 0, "file_creation_time": 1732391794, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 291083, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-03:56:37.895918 139957626406464 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291084.sst) /dev/shm/ToplingTemp/Topling-263392-UdWexH 2024/11/24-03:56:38.812103 139957626406464 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291084.sst): first pass time = 0.92's, 146.502'MB/sec 2024/11/24-03:56:40.142722 139957626406464 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291084.sst): old prealloc_size = 147639500, real_size = 33478592 2024/11/24-03:56:40.143320 139957626406464 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291084.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 926933 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0315 GB avg-val = 116.80 avg-zval = 33.96 2024/11/24-03:56:40.144087 139957626406464 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291084.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-03:56:40.999889 139957626406464 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291084.sst): second pass time = 1.33's, 81.413'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.86's, 43.840'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3068.288'MB/sec (index lex order gen) rebuild zvType time = 0.73's, 0.317'MB/sec write SST data time = 0.12's, 301.148'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 34777.234'MB/sec zip my value time = 1.33's, unzip length = 0.108'GB zip my value throughput = 81.413'MB/sec zip pipeline throughput = 81.413'MB/sec entries = 926933 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.80 avg-zval = 33.96 usrkeys = 926933 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.80 avg-zval = 33.96 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 926933 bytes = 3244288 } seq expand size = 6488531 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0315 GB dict = 1.08 MB all = 0.0376 GB } UnZip/Zip{ index = 10.5123 value = 3.4388 dict = 1.00 all = 3.5718 } Zip/UnZip{ index = 0.0951 value = 0.2908 dict = 1.00 all = 0.2800 } ---------------------------- total value len = 2252.703076 GB avg = 0.200 KB (by entry num) total key len = 307.193777 GB avg = 0.027 KB total ukey len = 237.576737 GB avg = 0.015 KB total ukey num = 15.749761668 Billion total entry num = 11.291075616 Billion write speed all = 37.376876292 MB/sec (with seq num) write speed all = 36.057994601 MB/sec (without seq num) 2024/11/24-03:56:41.046467 139957626406464 [compaction_job.cc:1948] [default] [JOB 41129] Generated table #291084: 926933 keys, 37577360 bytes, temperature: kWarm 2024/11/24-03:56:41.046537 139957626406464 EVENT_LOG_v1 {"time_micros": 1732391801046502, "cf_name": "default", "job": 41129, "event": "table_file_creation", "file_number": 291084, "file_size": 37577360, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4261178599, "largest_seqno": 4427728469, "table_properties": {"data_size": 31483184, "index_size": 1763520, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25954124, "raw_average_key_size": 28, "raw_value_size": 108263694, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 926933, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732391797, "oldest_key_time": 0, "file_creation_time": 1732391797, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 291084, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-03:56:41.084758 139957626406464 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291085.sst) /dev/shm/ToplingTemp/Topling-263392-NkAliD 2024/11/24-03:56:42.380577 139957626406464 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291085.sst): first pass time = 1.30's, 90.642'MB/sec 2024/11/24-03:56:43.529857 139957626406464 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291085.sst): old prealloc_size = 147639500, real_size = 27359536 2024/11/24-03:56:43.530393 139957626406464 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291085.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 812177 prefix = 4 raw-key = 0.0130 GB zip-key = 0.0016 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.0947 GB zip-val = 0.0256 GB avg-val = 116.61 avg-zval = 31.52 2024/11/24-03:56:43.531072 139957626406464 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291085.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0020 GB, waited 0.000 sec, Key+Value = 0.117 GB 2024/11/24-03:56:44.261212 139957626406464 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291085.sst): second pass time = 1.15's, 82.464'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.73's, 42.180'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3028.527'MB/sec (index lex order gen) rebuild zvType time = 0.62's, 0.326'MB/sec write SST data time = 0.11's, 283.576'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.946'MB, throughput = 30888.011'MB/sec zip my value time = 1.15's, unzip length = 0.095'GB zip my value throughput = 82.464'MB/sec zip pipeline throughput = 82.464'MB/sec entries = 812177 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.61 avg-zval = 31.52 usrkeys = 812177 avg-key = 20.00 avg-zkey = 1.91 avg-val = 123.61 avg-zval = 31.52 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 812177 bytes = 2741120 } seq expand size = 5685239 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0162 GB value = 0.0947 GB dict = 0.95 MB all = 0.1175 GB } __ZipSize{ index = 0.0016 GB value = 0.0256 GB dict = 0.95 MB all = 0.0308 GB } UnZip/Zip{ index = 10.4447 value = 3.6995 dict = 1.00 all = 3.8075 } Zip/UnZip{ index = 0.0957 value = 0.2703 dict = 1.00 all = 0.2626 } ---------------------------- total value len = 2252.803472 GB avg = 0.200 KB (by entry num) total key len = 307.216518 GB avg = 0.027 KB total ukey len = 237.592981 GB avg = 0.015 KB total ukey num = 15.750573845 Billion total entry num = 11.291887793 Billion write speed all = 37.376894381 MB/sec (with seq num) write speed all = 36.057980626 MB/sec (without seq num) 2024/11/24-03:56:44.300531 139957626406464 [compaction_job.cc:1948] [default] [JOB 41129] Generated table #291085: 812177 keys, 30847644 bytes, temperature: kWarm 2024/11/24-03:56:44.300601 139957626406464 EVENT_LOG_v1 {"time_micros": 1732391804300566, "cf_name": "default", "job": 41129, "event": "table_file_creation", "file_number": 291085, "file_size": 30847644, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4339910297, "largest_seqno": 4427728336, "table_properties": {"data_size": 25601120, "index_size": 1555200, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 22740956, "raw_average_key_size": 28, "raw_value_size": 94710830, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 812177, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732391801, "oldest_key_time": 0, "file_creation_time": 1732391801, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 291085, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-03:56:44.336752 139957626406464 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291086.sst) /dev/shm/ToplingTemp/Topling-263392-6HYAKH 2024/11/24-03:56:45.327865 139957626406464 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291086.sst): first pass time = 0.99's, 135.426'MB/sec 2024/11/24-03:56:46.647091 139957626406464 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291086.sst): old prealloc_size = 147639500, real_size = 31398672 2024/11/24-03:56:46.647647 139957626406464 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291086.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 919300 prefix = 4 raw-key = 0.0147 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1085 GB zip-val = 0.0294 GB avg-val = 118.00 avg-zval = 31.99 2024/11/24-03:56:46.648426 139957626406464 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291086.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-03:56:47.481767 139957626406464 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291086.sst): second pass time = 1.32's, 82.278'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.83's, 42.503'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3275.132'MB/sec (index lex order gen) rebuild zvType time = 0.71's, 0.325'MB/sec write SST data time = 0.13's, 280.993'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.085'MB, throughput = 30039.037'MB/sec zip my value time = 1.32's, unzip length = 0.108'GB zip my value throughput = 82.278'MB/sec zip pipeline throughput = 82.278'MB/sec entries = 919300 avg-key = 28.00 avg-zkey = 1.91 avg-val = 118.00 avg-zval = 31.99 usrkeys = 919300 avg-key = 20.00 avg-zkey = 1.91 avg-val = 125.00 avg-zval = 31.99 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 919300 bytes = 3217568 } seq expand size = 6435100 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0184 GB value = 0.1085 GB dict = 1.09 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0294 GB dict = 1.09 MB all = 0.0355 GB } UnZip/Zip{ index = 10.4458 value = 3.6886 dict = 1.00 all = 3.7834 } Zip/UnZip{ index = 0.0957 value = 0.2711 dict = 1.00 all = 0.2643 } ---------------------------- total value len = 2252.918385 GB avg = 0.200 KB (by entry num) total key len = 307.242258 GB avg = 0.027 KB total ukey len = 237.611367 GB avg = 0.015 KB total ukey num = 15.751493145 Billion total entry num = 11.292807093 Billion write speed all = 37.377190438 MB/sec (with seq num) write speed all = 36.058231326 MB/sec (without seq num) 2024/11/24-03:56:47.525169 139957626406464 [compaction_job.cc:1948] [default] [JOB 41129] Generated table #291086: 919300 keys, 35475378 bytes, temperature: kWarm 2024/11/24-03:56:47.525245 139957626406464 EVENT_LOG_v1 {"time_micros": 1732391807525203, "cf_name": "default", "job": 41129, "event": "table_file_creation", "file_number": 291086, "file_size": 35475378, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4261178645, "largest_seqno": 4414357721, "table_properties": {"data_size": 29408512, "index_size": 1760128, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25740400, "raw_average_key_size": 28, "raw_value_size": 108477400, "raw_average_value_size": 118, "num_data_blocks": 1, "num_entries": 919300, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 118, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732391804, "oldest_key_time": 0, "file_creation_time": 1732391804, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 291086, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-03:56:47.568784 139957626406464 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291087.sst) /dev/shm/ToplingTemp/Topling-263392-WVvkMD 2024/11/24-03:56:48.113113 139957626406464 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291087.sst): first pass time = 0.54's, 246.594'MB/sec 2024/11/24-03:56:49.448231 139957626406464 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291087.sst): old prealloc_size = 147639500, real_size = 33355200 2024/11/24-03:56:49.448786 139957626406464 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291087.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 926878 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1083 GB zip-val = 0.0313 GB avg-val = 116.81 avg-zval = 33.82 2024/11/24-03:56:49.449581 139957626406464 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291087.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-03:56:50.303133 139957626406464 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291087.sst): second pass time = 1.33's, 81.173'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.85's, 43.812'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3403.058'MB/sec (index lex order gen) rebuild zvType time = 0.73's, 0.318'MB/sec write SST data time = 0.13's, 298.475'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 28683.201'MB/sec zip my value time = 1.33's, unzip length = 0.108'GB zip my value throughput = 81.173'MB/sec zip pipeline throughput = 81.173'MB/sec entries = 926878 avg-key = 28.00 avg-zkey = 1.92 avg-val = 116.81 avg-zval = 33.82 usrkeys = 926878 avg-key = 20.00 avg-zkey = 1.92 avg-val = 123.81 avg-zval = 33.82 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 926878 bytes = 3244080 } seq expand size = 6488146 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0313 GB dict = 1.08 MB all = 0.0375 GB } UnZip/Zip{ index = 10.4427 value = 3.4536 dict = 1.00 all = 3.5836 } Zip/UnZip{ index = 0.0958 value = 0.2895 dict = 1.00 all = 0.2791 } ---------------------------- total value len = 2253.033138 GB avg = 0.199 KB (by entry num) total key len = 307.268211 GB avg = 0.027 KB total ukey len = 237.629905 GB avg = 0.015 KB total ukey num = 15.752420023 Billion total entry num = 11.293733971 Billion write speed all = 37.377705069 MB/sec (with seq num) write speed all = 36.058692031 MB/sec (without seq num) 2024/11/24-03:56:50.348640 139957626406464 [compaction_job.cc:1948] [default] [JOB 41129] Generated table #291087: 926878 keys, 37453480 bytes, temperature: kWarm 2024/11/24-03:56:50.348726 139957626406464 EVENT_LOG_v1 {"time_micros": 1732391810348677, "cf_name": "default", "job": 41129, "event": "table_file_creation", "file_number": 291087, "file_size": 37453480, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4261178655, "largest_seqno": 4427728567, "table_properties": {"data_size": 31348144, "index_size": 1775168, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25952584, "raw_average_key_size": 28, "raw_value_size": 108265160, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 926878, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732391807, "oldest_key_time": 0, "file_creation_time": 1732391807, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 291087, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-03:56:50.385908 139957626406464 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291088.sst) /dev/shm/ToplingTemp/Topling-263392-B7wZ5E 2024/11/24-03:56:51.316782 139957626406464 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291088.sst): first pass time = 0.93's, 144.191'MB/sec 2024/11/24-03:56:52.673666 139957626406464 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291088.sst): old prealloc_size = 147639500, real_size = 32876272 2024/11/24-03:56:52.674282 139957626406464 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291088.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 926613 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1083 GB zip-val = 0.0309 GB avg-val = 116.85 avg-zval = 33.31 2024/11/24-03:56:52.675061 139957626406464 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291088.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-03:56:53.514266 139957626406464 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291088.sst): second pass time = 1.36's, 79.845'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.84's, 43.987'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2990.822'MB/sec (index lex order gen) rebuild zvType time = 0.72's, 0.324'MB/sec write SST data time = 0.12's, 296.624'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 33537.416'MB/sec zip my value time = 1.36's, unzip length = 0.108'GB zip my value throughput = 79.845'MB/sec zip pipeline throughput = 79.845'MB/sec entries = 926613 avg-key = 28.00 avg-zkey = 1.92 avg-val = 116.85 avg-zval = 33.31 usrkeys = 926613 avg-key = 20.00 avg-zkey = 1.92 avg-val = 123.85 avg-zval = 33.31 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 926613 bytes = 3243168 } seq expand size = 6486291 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0309 GB dict = 1.08 MB all = 0.0370 GB } UnZip/Zip{ index = 10.4431 value = 3.5074 dict = 1.00 all = 3.6300 } Zip/UnZip{ index = 0.0958 value = 0.2851 dict = 1.00 all = 0.2755 } ---------------------------- total value len = 2253.147897 GB avg = 0.199 KB (by entry num) total key len = 307.294156 GB avg = 0.027 KB total ukey len = 237.648437 GB avg = 0.015 KB total ukey num = 15.753346636 Billion total entry num = 11.294660584 Billion write speed all = 37.378006955 MB/sec (with seq num) write speed all = 36.058947533 MB/sec (without seq num) 2024/11/24-03:56:53.561151 139957626406464 [compaction_job.cc:1948] [default] [JOB 41129] Generated table #291088: 926613 keys, 36974190 bytes, temperature: kWarm 2024/11/24-03:56:53.561222 139957626406464 EVENT_LOG_v1 {"time_micros": 1732391813561186, "cf_name": "default", "job": 41129, "event": "table_file_creation", "file_number": 291088, "file_size": 36974190, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4261178675, "largest_seqno": 4427728585, "table_properties": {"data_size": 30869856, "index_size": 1774592, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25945164, "raw_average_key_size": 28, "raw_value_size": 108272606, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 926613, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732391810, "oldest_key_time": 0, "file_creation_time": 1732391810, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 291088, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-03:56:53.598885 139957626406464 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291089.sst) /dev/shm/ToplingTemp/Topling-263392-lGyMrE 2024/11/24-03:56:54.598442 139957626406464 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291089.sst): first pass time = 1.00's, 134.283'MB/sec 2024/11/24-03:56:55.877080 139957626406464 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291089.sst): old prealloc_size = 147639500, real_size = 31183600 2024/11/24-03:56:55.877656 139957626406464 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291089.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 923639 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.93 raw-val = 0.1084 GB zip-val = 0.0292 GB avg-val = 117.31 avg-zval = 31.58 2024/11/24-03:56:55.878549 139957626406464 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291089.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-03:56:56.697373 139957626406464 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291089.sst): second pass time = 1.28's, 84.821'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.82's, 42.860'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3225.282'MB/sec (index lex order gen) rebuild zvType time = 0.69's, 0.335'MB/sec write SST data time = 0.13's, 270.650'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.083'MB, throughput = 33586.449'MB/sec zip my value time = 1.28's, unzip length = 0.108'GB zip my value throughput = 84.821'MB/sec zip pipeline throughput = 84.821'MB/sec entries = 923639 avg-key = 28.00 avg-zkey = 1.93 avg-val = 117.31 avg-zval = 31.58 usrkeys = 923639 avg-key = 20.00 avg-zkey = 1.93 avg-val = 124.31 avg-zval = 31.58 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 923639 bytes = 3117296 } seq expand size = 6465473 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0185 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0292 GB dict = 1.08 MB all = 0.0352 GB } UnZip/Zip{ index = 10.3763 value = 3.7144 dict = 1.00 all = 3.8177 } Zip/UnZip{ index = 0.0964 value = 0.2692 dict = 1.00 all = 0.2619 } ---------------------------- total value len = 2253.262719 GB avg = 0.199 KB (by entry num) total key len = 307.320018 GB avg = 0.027 KB total ukey len = 237.666910 GB avg = 0.015 KB total ukey num = 15.754270275 Billion total entry num = 11.295584223 Billion write speed all = 37.378323794 MB/sec (with seq num) write speed all = 36.059217799 MB/sec (without seq num) 2024/11/24-03:56:56.740571 139957626406464 [compaction_job.cc:1948] [default] [JOB 41129] Generated table #291089: 923639 keys, 35156464 bytes, temperature: kWarm 2024/11/24-03:56:56.740641 139957626406464 EVENT_LOG_v1 {"time_micros": 1732391816740606, "cf_name": "default", "job": 41129, "event": "table_file_creation", "file_number": 291089, "file_size": 35156464, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4299628100, "largest_seqno": 4426381022, "table_properties": {"data_size": 29172192, "index_size": 1780288, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25861892, "raw_average_key_size": 28, "raw_value_size": 108355934, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 923639, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732391813, "oldest_key_time": 0, "file_creation_time": 1732391813, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 291089, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-03:56:56.785624 139957626406464 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291090.sst) /dev/shm/ToplingTemp/Topling-263392-mS3i9D 2024/11/24-03:56:56.802494 139957626406464 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291090.sst): first pass time = 0.02's, 176.401'MB/sec 2024/11/24-03:56:56.842525 139957626406464 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291090.sst): old prealloc_size = 147639500, real_size = 934048 2024/11/24-03:56:56.842591 139957626406464 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291090.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 20898 prefix = 4 raw-key = 0.0003 GB zip-key = 0.0000 GB avg-key = 16.00 avg-zkey = 1.98 raw-val = 0.0024 GB zip-val = 0.0009 GB avg-val = 114.00 avg-zval = 42.45 2024/11/24-03:56:56.842648 139957626406464 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291090.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0000 GB, waited 0.000 sec, Key+Value = 0.003 GB 2024/11/24-03:56:56.859971 139957626406464 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00/291090.sst): second pass time = 0.04's, 60.484'MB/sec, value only(80.3% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.02's, 58.008'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 924.023'MB/sec (index lex order gen) rebuild zvType time = 0.01's, 0.375'MB/sec write SST data time = 0.00's, 291.155'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.024'MB, throughput = 960.039'MB/sec zip my value time = 0.04's, unzip length = 0.002'GB zip my value throughput = 60.484'MB/sec zip pipeline throughput = 60.484'MB/sec entries = 20898 avg-key = 28.00 avg-zkey = 1.98 avg-val = 114.00 avg-zval = 42.45 usrkeys = 20898 avg-key = 20.00 avg-zkey = 1.98 avg-val = 121.00 avg-zval = 42.45 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 20898 bytes = 57488 } seq expand size = 146286 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0004 GB value = 0.0024 GB dict = 0.02 MB all = 0.0030 GB } __ZipSize{ index = 0.0000 GB value = 0.0009 GB dict = 0.02 MB all = 0.0010 GB } UnZip/Zip{ index = 10.0781 value = 2.6853 dict = 1.00 all = 2.9345 } Zip/UnZip{ index = 0.0992 value = 0.3724 dict = 1.00 all = 0.3408 } ---------------------------- total value len = 2253.265247 GB avg = 0.199 KB (by entry num) total key len = 307.320603 GB avg = 0.027 KB total ukey len = 237.667328 GB avg = 0.015 KB total ukey num = 15.754291173 Billion total entry num = 11.295605121 Billion write speed all = 37.378280519 MB/sec (with seq num) write speed all = 36.059175215 MB/sec (without seq num) 2024/11/24-03:56:56.868382 139957626406464 [compaction_job.cc:1948] [default] [JOB 41129] Generated table #291090: 20898 keys, 1011257 bytes, temperature: kWarm 2024/11/24-03:56:56.868432 139957626406464 EVENT_LOG_v1 {"time_micros": 1732391816868405, "cf_name": "default", "job": 41129, "event": "table_file_creation", "file_number": 291090, "file_size": 1011257, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4409838410, "largest_seqno": 4412701633, "table_properties": {"data_size": 887184, "index_size": 41472, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 585144, "raw_average_key_size": 28, "raw_value_size": 2382372, "raw_average_value_size": 114, "num_data_blocks": 1, "num_entries": 20898, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 114, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732391816, "oldest_key_time": 0, "file_creation_time": 1732391816, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 291090, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-03:56:56.879558 139957626406464 [compaction_job.cc:703] job-41129: subcompact[0], size: 0.614939 G, files: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41129/att-00 [291073,291074,291075,291076,291077,291078,291079,291080,291081,291082,291083,291084,291085,291086,291087,291088,291089,291090] 2024/11/24-03:56:56.984705 139957626406464 (Original Log Time 2024/11/24-03:55:58.557681) EVENT_LOG_v1 {"time_micros": 1732391758557616, "job": 41129, "event": "compaction_started", "compaction_reason": "FilesMarkedForCompaction", "files_L2": [291059], "files_L3": [290997, 290998, 290999, 291000, 291001, 291002, 291003, 291004, 291005, 291006, 291007, 291008, 291009, 291010, 291011, 291012, 291013], "score": 0.759821, "input_data_size": 638332786, "oldest_snapshot_seqno": 4427755294} 2024/11/24-03:56:56.984709 139957626406464 (Original Log Time 2024/11/24-03:56:56.983244) [compaction_job.cc:2022] [default] [JOB 41129] Compacted 1@2 + 17@3 files to L3 => 614938773 bytes 2024/11/24-03:56:56.984711 139957626406464 (Original Log Time 2024/11/24-03:56:56.984639) [compaction_job.cc:1224] [default] compacted to: files[0 0 0 18 0 0 0] max score 0.02, MB/sec: 10.9 rd, 10.5 wr, level 3, files in(1, 17) out(18 +0 blob) MB in(27.1, 581.7 +0.0 blob) out(586.5 +0.0 blob), read-write-amplify(44.1) write-amplify(21.6) OK, records in: 15738312, records dropped: 108302 output_compression: Snappy 2024/11/24-03:56:56.984716 139957626406464 (Original Log Time 2024/11/24-03:56:56.984684) EVENT_LOG_v1 {"time_micros": 1732391816984662, "cf": "default", "job": 41129, "event": "compaction_finished", "compaction_time_micros": 58321884, "compaction_time_cpu_micros": 25235722, "output_level": 3, "num_output_files": 18, "total_output_size": 614938773, "num_input_records": 15738312, "num_output_records": 15630010, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "file_write_nanos": 467089506, "file_range_sync_nanos": 0, "file_fsync_nanos": 13261, "file_prepare_write_nanos": 45771, "lsm_state": [0, 0, 0, 18, 0, 0, 0]} 2024/11/24-03:56:57.119074 139957626406464 DEBG dcompact_worker.cpp:240: HttpPost: 200 OK: url = http://nlb-7zny4kaa1poal01o64.cn-shenzhen.nlb.aliyuncs.com:8443, body = {"instanceId":"nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137","labourId":"","dbId":"d89b4006-2803-486e-b7a2-759bcf348921","dbStarts":1732256054,"starts":1732391758,"executesMs":58563,"compactionJobId":41129,"attempt":0,"compactionInputRawBytes":2283283128,"compactionInputZipBytes":638332786,"compactionOutputRawBytes":0,"compactionOutputZipBytes":614938773,"headers":{"Accept":"*/*","Connection":"close","Host":"aliyun-topling-saas.topling.cn:18443","RemoteIp":"120.24.192.169","X-Forwarded-For":"120.24.192.169","region":"cn-shenzhen","token":"e6474c481bd4415abc537135cc03626b","instance-token":"e6474c481bd4415abc537135cc03626b","provider":"aliyun","CloudMarketInstanceId":"si-59c0ae5c955845588903","MeteringAssit":"","Transfer-Encoding":"chunked","traceparent":"00-1c32c9ae5ba23174c14d08e6c741c14f-1da012cb1d0eef05-00"}}, response = 2024/11/24-03:56:57.119173 139957626406464 INFO dcompact_worker.cpp:1459: finish /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-41129/att-00: olev 3, work 58.564 s, result 7.736 ms, install 1.494 ms, input{raw 2.126 GiB zip 608.762 MiB}