2024/11/23-01:03:12.001421 140024860931648 DEBG dcompact_worker.cpp:2214: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-15918/att-00: fork to child time = 0.008924 sec 2024/11/23-01:03:12.002356 140024860931648 DEBG dcompact_worker.cpp:1013: Beg SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-15918/att-00 2024/11/23-01:03:12.009129 140024860931648 DEBG dcompact_worker.cpp:1033: End SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-15918/att-00 2024/11/23-01:03:12.010280 140024860931648 TRAC dcompact_worker.cpp:1083: INFO_LOG_LEVEL: rpc = INFO_LEVEL, env_var = undefined 2024/11/23-01:03:12.010539 140024860931648 [WARN] [column_family.cc:386] multiple cf_paths/db_paths and level_compaction_dynamic_level_bytes can't be used together 2024/11/23-01:03:12.063476 140024860931648 [version_set.cc:6208] Recovering from manifest file: /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-15918/att-00/MANIFEST-206347 2024/11/23-01:03:12.098611 140024860931648 [version_set.cc:6251] Recovered from manifest file:/worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-15918/att-00/MANIFEST-206347 succeeded,manifest_file_number is 206347, next_file_number is 237745, last_sequence is 3693531479, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 237540 2024/11/23-01:03:12.098622 140024860931648 [version_set.cc:6266] Column family [default] (ID 0), log number is 0 2024/11/23-01:03:12.098723 140024860931648 [version_set.cc:5721] Creating manifest 237745 2024/11/23-01:03:12.131179 140024860931648 DEBG dcompact_worker.cpp:1218: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-15918/att-00: bottommost_level: fake = 1, rpc = 0 2024/11/23-01:03:12.150277 140024860931648 [compaction_job.cc:2437] [default] [JOB 15918] Compacting 1@2 + 14@3 files to L3, score 1.00, subcompactions 1 : 1 2024/11/23-01:03:12.150298 140024860931648 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 11930 Base level 2, inputs: [237671(22MB)], [237742(34MB) 237743(7598KB) 237639(35MB) 237640(35MB) 237641(35MB) 237642(34MB) 237643(34MB) 237644(36MB) 237645(33MB) 237646(35MB) 237647(33MB) 237648(37MB) 237649(33MB) 237721(35MB)] 2024/11/23-01:03:12.157129 140024860931648 [top_zip_table.cc:59] core git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-01:03:12.157162 140024860931648 [top_zip_table.cc:60] fsa git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-01:03:12.157183 140024860931648 [top_zip_table.cc:61] zbs git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-01:03:12.157188 140024860931648 [top_zip_table.cc:62] topling-zip_table_reader: git_version_hash_info_is: commit a4a382006cb82713acf5b3425835f22711877681 Author: leipeng Date: 2024-04-11 19:44:14 +0800 fixed_len_hole_index.cc: Add env bool FixedLenHoleIndexUseAVX512 for ut & debug 1. FixedLenHoleIndexUseAVX512 is only in unit tests or debug 2. In release mode, use avx512 by compile options(-march=) g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/23-01:03:12.157199 140024860931648 [top_zip_table.cc:64] topling-rocks git_version_hash_info_is: commit feab587e468621ba0204d47b4ffacc52e7c4290d Author: leipeng Date: 2024-03-22 13:35:06 +0800 ToplingZipTableBuilder::Add: immediately return after error This function returns void, and caller does not check builder->status() after calling this function and graceful abandon. So immediately return after error, and return error status in Finish(). g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/23-01:03:12.691640 140024860931648 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-15918/att-00/237746.sst) /dev/shm/ToplingTemp/Topling-360647-1RS2iE 2024/11/23-01:03:13.243109 140024860931648 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-15918/att-00/237746.sst): first pass time = 0.55's, 243.402'MB/sec 2024/11/23-01:03:14.571871 140024860931648 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-15918/att-00/237746.sst): old prealloc_size = 147639500, real_size = 32163248 2024/11/23-01:03:14.572426 140024860931648 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-15918/att-00/237746.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 928075 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1082 GB zip-val = 0.0302 GB avg-val = 116.62 avg-zval = 32.49 2024/11/23-01:03:14.573197 140024860931648 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-15918/att-00/237746.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-01:03:15.455234 140024860931648 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-15918/att-00/237746.sst): second pass time = 1.33's, 81.502'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.88's, 40.922'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3333.811'MB/sec (index lex order gen) rebuild zvType time = 0.75's, 0.308'MB/sec write SST data time = 0.13's, 281.340'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 32054.038'MB/sec zip my value time = 1.33's, unzip length = 0.108'GB zip my value throughput = 81.502'MB/sec zip pipeline throughput = 81.502'MB/sec entries = 928075 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.62 avg-zval = 32.49 usrkeys = 928075 avg-key = 20.00 avg-zkey = 1.91 avg-val = 123.62 avg-zval = 32.49 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 928075 bytes = 3132272 } seq expand size = 6496525 multi value expand size = 0 cnt WriteAppend = 15 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0302 GB dict = 1.08 MB all = 0.0361 GB } UnZip/Zip{ index = 10.4449 value = 3.5893 dict = 1.00 all = 3.7129 } Zip/UnZip{ index = 0.0957 value = 0.2786 dict = 1.00 all = 0.2693 } ---------------------------- total value len = 0.114728 GB avg = 0.124 KB (by entry num) total key len = 0.025986 GB avg = 0.028 KB total ukey len = 0.018562 GB avg = 0.020 KB total ukey num = 0.000928075 Billion total entry num = 0.000928075 Billion write speed all = 0.002415599 MB/sec (with seq num) write speed all = 0.002288143 MB/sec (without seq num) 2024/11/23-01:03:15.488821 140024860931648 [compaction_job.cc:1948] [default] [JOB 15918] Generated table #237746: 928075 keys, 36148908 bytes, temperature: kWarm 2024/11/23-01:03:15.488911 140024860931648 EVENT_LOG_v1 {"time_micros": 1732294995488857, "cf_name": "default", "job": 15918, "event": "table_file_creation", "file_number": 237746, "file_size": 36148908, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3583362754, "largest_seqno": 3693087521, "table_properties": {"data_size": 30153952, "index_size": 1777088, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25986100, "raw_average_key_size": 28, "raw_value_size": 108231690, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 928075, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732294992, "oldest_key_time": 0, "file_creation_time": 1732294992, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 237746, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-01:03:15.534200 140024860931648 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-15918/att-00/237747.sst) /dev/shm/ToplingTemp/Topling-360647-DEtITE 2024/11/23-01:03:16.386138 140024860931648 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-15918/att-00/237747.sst): first pass time = 0.85's, 157.551'MB/sec 2024/11/23-01:03:17.735417 140024860931648 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-15918/att-00/237747.sst): old prealloc_size = 147639500, real_size = 33457360 2024/11/23-01:03:17.735975 140024860931648 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-15918/att-00/237747.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 926208 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0315 GB avg-val = 116.91 avg-zval = 33.97 2024/11/23-01:03:17.736755 140024860931648 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-15918/att-00/237747.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-01:03:18.677760 140024860931648 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-15918/att-00/237747.sst): second pass time = 1.35's, 80.297'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.94's, 39.975'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3294.841'MB/sec (index lex order gen) rebuild zvType time = 0.81's, 0.285'MB/sec write SST data time = 0.13's, 288.888'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 33878.336'MB/sec zip my value time = 1.35's, unzip length = 0.108'GB zip my value throughput = 80.297'MB/sec zip pipeline throughput = 80.297'MB/sec entries = 926208 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.91 avg-zval = 33.97 usrkeys = 926208 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.91 avg-zval = 33.97 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 926208 bytes = 3357520 } seq expand size = 6483456 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0315 GB dict = 1.08 MB all = 0.0377 GB } UnZip/Zip{ index = 10.5155 value = 3.4415 dict = 1.00 all = 3.5630 } Zip/UnZip{ index = 0.0951 value = 0.2906 dict = 1.00 all = 0.2807 } ---------------------------- total value len = 0.229496 GB avg = 0.124 KB (by entry num) total key len = 0.051920 GB avg = 0.028 KB total ukey len = 0.037086 GB avg = 0.020 KB total ukey num = 0.001854283 Billion total entry num = 0.001854283 Billion write speed all = 0.004830706 MB/sec (with seq num) write speed all = 0.004576065 MB/sec (without seq num) 2024/11/23-01:03:18.712808 140024860931648 [compaction_job.cc:1948] [default] [JOB 15918] Generated table #237747: 926208 keys, 37669550 bytes, temperature: kWarm 2024/11/23-01:03:18.712870 140024860931648 EVENT_LOG_v1 {"time_micros": 1732294998712838, "cf_name": "default", "job": 15918, "event": "table_file_creation", "file_number": 237747, "file_size": 37669550, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3376774746, "largest_seqno": 3693087177, "table_properties": {"data_size": 31464000, "index_size": 1761600, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25933824, "raw_average_key_size": 28, "raw_value_size": 108283976, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 926208, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732294995, "oldest_key_time": 0, "file_creation_time": 1732294995, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 237747, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-01:03:18.753443 140024860931648 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-15918/att-00/237748.sst) /dev/shm/ToplingTemp/Topling-360647-wk4R4D 2024/11/23-01:03:19.671602 140024860931648 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-15918/att-00/237748.sst): first pass time = 0.92's, 146.188'MB/sec 2024/11/23-01:03:21.016160 140024860931648 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-15918/att-00/237748.sst): old prealloc_size = 147639500, real_size = 33230752 2024/11/23-01:03:21.016727 140024860931648 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-15918/att-00/237748.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 926389 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0312 GB avg-val = 116.88 avg-zval = 33.72 2024/11/23-01:03:21.017487 140024860931648 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-15918/att-00/237748.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-01:03:21.948901 140024860931648 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-15918/att-00/237748.sst): second pass time = 1.34's, 80.577'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.93's, 39.897'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3239.780'MB/sec (index lex order gen) rebuild zvType time = 0.80's, 0.289'MB/sec write SST data time = 0.13's, 286.178'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 31776.771'MB/sec zip my value time = 1.34's, unzip length = 0.108'GB zip my value throughput = 80.577'MB/sec zip pipeline throughput = 80.577'MB/sec entries = 926389 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.88 avg-zval = 33.72 usrkeys = 926389 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.88 avg-zval = 33.72 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 926389 bytes = 3126576 } seq expand size = 6484723 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0312 GB dict = 1.08 MB all = 0.0372 GB } UnZip/Zip{ index = 10.5119 value = 3.4664 dict = 1.00 all = 3.6068 } Zip/UnZip{ index = 0.0951 value = 0.2885 dict = 1.00 all = 0.2773 } ---------------------------- total value len = 0.344259 GB avg = 0.124 KB (by entry num) total key len = 0.077859 GB avg = 0.028 KB total ukey len = 0.055613 GB avg = 0.020 KB total ukey num = 0.002780672 Billion total entry num = 0.002780672 Billion write speed all = 0.007245561 MB/sec (with seq num) write speed all = 0.006863725 MB/sec (without seq num) 2024/11/23-01:03:21.983835 140024860931648 [compaction_job.cc:1948] [default] [JOB 15918] Generated table #237748: 926389 keys, 37211978 bytes, temperature: kWarm 2024/11/23-01:03:21.983909 140024860931648 EVENT_LOG_v1 {"time_micros": 1732295001983876, "cf_name": "default", "job": 15918, "event": "table_file_creation", "file_number": 237748, "file_size": 37211978, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3563652023, "largest_seqno": 3693087197, "table_properties": {"data_size": 31236432, "index_size": 1762560, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25938892, "raw_average_key_size": 28, "raw_value_size": 108278910, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 926389, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732294998, "oldest_key_time": 0, "file_creation_time": 1732294998, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 237748, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-01:03:22.019574 140024860931648 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-15918/att-00/237749.sst) /dev/shm/ToplingTemp/Topling-360647-DbvPcC 2024/11/23-01:03:22.814015 140024860931648 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-15918/att-00/237749.sst): first pass time = 0.79's, 168.955'MB/sec 2024/11/23-01:03:24.169930 140024860931648 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-15918/att-00/237749.sst): old prealloc_size = 147639500, real_size = 33412576 2024/11/23-01:03:24.170449 140024860931648 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-15918/att-00/237749.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 926318 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0314 GB avg-val = 116.89 avg-zval = 33.92 2024/11/23-01:03:24.171228 140024860931648 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-15918/att-00/237749.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-01:03:25.107242 140024860931648 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-15918/att-00/237749.sst): second pass time = 1.36's, 79.901'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.94's, 40.019'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3542.258'MB/sec (index lex order gen) rebuild zvType time = 0.81's, 0.286'MB/sec write SST data time = 0.13's, 293.519'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 33107.175'MB/sec zip my value time = 1.36's, unzip length = 0.108'GB zip my value throughput = 79.901'MB/sec zip pipeline throughput = 79.901'MB/sec entries = 926318 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.89 avg-zval = 33.92 usrkeys = 926318 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.89 avg-zval = 33.92 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 926318 bytes = 3242128 } seq expand size = 6484226 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0314 GB dict = 1.08 MB all = 0.0375 GB } UnZip/Zip{ index = 10.5160 value = 3.4463 dict = 1.00 all = 3.5783 } Zip/UnZip{ index = 0.0951 value = 0.2902 dict = 1.00 all = 0.2795 } ---------------------------- total value len = 0.459024 GB avg = 0.124 KB (by entry num) total key len = 0.103796 GB avg = 0.028 KB total ukey len = 0.074140 GB avg = 0.020 KB total ukey num = 0.003706990 Billion total entry num = 0.003706990 Billion write speed all = 0.009660155 MB/sec (with seq num) write speed all = 0.009151146 MB/sec (without seq num) 2024/11/23-01:03:25.143676 140024860931648 [compaction_job.cc:1948] [default] [JOB 15918] Generated table #237749: 926318 keys, 37509198 bytes, temperature: kWarm 2024/11/23-01:03:25.143739 140024860931648 EVENT_LOG_v1 {"time_micros": 1732295005143707, "cf_name": "default", "job": 15918, "event": "table_file_creation", "file_number": 237749, "file_size": 37509198, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3504428200, "largest_seqno": 3693087781, "table_properties": {"data_size": 31419088, "index_size": 1761728, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25936904, "raw_average_key_size": 28, "raw_value_size": 108280844, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 926318, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732295002, "oldest_key_time": 0, "file_creation_time": 1732295002, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 237749, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-01:03:25.185247 140024860931648 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-15918/att-00/237750.sst) /dev/shm/ToplingTemp/Topling-360647-3v6H4D 2024/11/23-01:03:25.974757 140024860931648 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-15918/att-00/237750.sst): first pass time = 0.79's, 170.010'MB/sec 2024/11/23-01:03:27.308634 140024860931648 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-15918/att-00/237750.sst): old prealloc_size = 147639500, real_size = 33477056 2024/11/23-01:03:27.309184 140024860931648 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-15918/att-00/237750.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 926305 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0315 GB avg-val = 116.90 avg-zval = 33.99 2024/11/23-01:03:27.309938 140024860931648 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-15918/att-00/237750.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-01:03:28.255536 140024860931648 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-15918/att-00/237750.sst): second pass time = 1.33's, 81.217'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.95's, 39.559'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3321.246'MB/sec (index lex order gen) rebuild zvType time = 0.82's, 0.283'MB/sec write SST data time = 0.13's, 292.642'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 32915.423'MB/sec zip my value time = 1.33's, unzip length = 0.108'GB zip my value throughput = 81.217'MB/sec zip pipeline throughput = 81.217'MB/sec entries = 926305 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.90 avg-zval = 33.99 usrkeys = 926305 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.90 avg-zval = 33.99 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 926305 bytes = 3126288 } seq expand size = 6484135 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0315 GB dict = 1.08 MB all = 0.0375 GB } UnZip/Zip{ index = 10.5170 value = 3.4393 dict = 1.00 all = 3.5832 } Zip/UnZip{ index = 0.0951 value = 0.2908 dict = 1.00 all = 0.2791 } ---------------------------- total value len = 0.573790 GB avg = 0.124 KB (by entry num) total key len = 0.129732 GB avg = 0.028 KB total ukey len = 0.092666 GB avg = 0.020 KB total ukey num = 0.004633295 Billion total entry num = 0.004633295 Billion write speed all = 0.012074487 MB/sec (with seq num) write speed all = 0.011438321 MB/sec (without seq num) 2024/11/23-01:03:28.287744 140024860931648 [compaction_job.cc:1948] [default] [JOB 15918] Generated table #237750: 926305 keys, 37457966 bytes, temperature: kWarm 2024/11/23-01:03:28.287822 140024860931648 EVENT_LOG_v1 {"time_micros": 1732295008287788, "cf_name": "default", "job": 15918, "event": "table_file_creation", "file_number": 237750, "file_size": 37457966, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3587898319, "largest_seqno": 3693087222, "table_properties": {"data_size": 31483760, "index_size": 1761536, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25936540, "raw_average_key_size": 28, "raw_value_size": 108281190, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 926305, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732295005, "oldest_key_time": 0, "file_creation_time": 1732295005, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 237750, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-01:03:28.329866 140024860931648 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-15918/att-00/237751.sst) /dev/shm/ToplingTemp/Topling-360647-P9h68B 2024/11/23-01:03:29.220120 140024860931648 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-15918/att-00/237751.sst): first pass time = 0.89's, 150.771'MB/sec 2024/11/23-01:03:30.534969 140024860931648 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-15918/att-00/237751.sst): old prealloc_size = 147639500, real_size = 34269504 2024/11/23-01:03:30.535584 140024860931648 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-15918/att-00/237751.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 1086392 prefix = 4 raw-key = 0.0174 GB zip-key = 0.0021 GB avg-key = 16.00 avg-zkey = 1.93 raw-val = 0.1038 GB zip-val = 0.0319 GB avg-val = 95.54 avg-zval = 29.37 2024/11/23-01:03:30.535944 140024860931648 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-15918/att-00/237751.sst: sumWaitingMem = 0.003 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0029 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-01:03:31.244110 140024860931648 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-15918/att-00/237751.sst): second pass time = 1.31's, 79.016'MB/sec, value only(77.3% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.71's, 50.949'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3539.139'MB/sec (index lex order gen) rebuild zvType time = 0.57's, 0.479'MB/sec write SST data time = 0.14's, 254.397'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.036'MB, throughput = 30845.047'MB/sec zip my value time = 1.31's, unzip length = 0.104'GB zip my value throughput = 79.016'MB/sec zip pipeline throughput = 79.016'MB/sec entries = 1086392 avg-key = 28.00 avg-zkey = 1.93 avg-val = 95.54 avg-zval = 29.37 usrkeys = 1086392 avg-key = 20.00 avg-zkey = 1.93 avg-val = 97.36 avg-zval = 29.37 TagRS{ kinds = RS_Key0_TagN bytes = 169840 } TagArray{ size = 281387 bytes = 914528 } seq expand size = 1969709 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0217 GB value = 0.1038 GB dict = 1.04 MB all = 0.1342 GB } __ZipSize{ index = 0.0021 GB value = 0.0319 GB dict = 1.04 MB all = 0.0361 GB } UnZip/Zip{ index = 10.3796 value = 3.2534 dict = 1.00 all = 3.7150 } Zip/UnZip{ index = 0.0963 value = 0.3074 dict = 1.00 all = 0.2692 } ---------------------------- total value len = 0.679558 GB avg = 0.119 KB (by entry num) total key len = 0.160151 GB avg = 0.028 KB total ukey len = 0.114394 GB avg = 0.020 KB total ukey num = 0.005719687 Billion total entry num = 0.005719687 Billion write speed all = 0.014411124 MB/sec (with seq num) write speed all = 0.013625832 MB/sec (without seq num) 2024/11/23-01:03:31.276249 140024860931648 [compaction_job.cc:1948] [default] [JOB 15918] Generated table #237751: 1086392 keys, 36128914 bytes, temperature: kWarm 2024/11/23-01:03:31.276316 140024860931648 EVENT_LOG_v1 {"time_micros": 1732295011276283, "cf_name": "default", "job": 15918, "event": "table_file_creation", "file_number": 237751, "file_size": 36128914, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3693087239, "table_properties": {"data_size": 31904432, "index_size": 2093312, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 30418976, "raw_average_key_size": 28, "raw_value_size": 103798877, "raw_average_value_size": 95, "num_data_blocks": 1, "num_entries": 1086392, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732295008, "oldest_key_time": 0, "file_creation_time": 1732295008, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 237751, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-01:03:31.314668 140024860931648 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-15918/att-00/237752.sst) /dev/shm/ToplingTemp/Topling-360647-3XJNjC 2024/11/23-01:03:32.139830 140024860931648 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-15918/att-00/237752.sst): first pass time = 0.83's, 162.665'MB/sec 2024/11/23-01:03:33.572696 140024860931648 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-15918/att-00/237752.sst): old prealloc_size = 147639500, real_size = 36343280 2024/11/23-01:03:33.573270 140024860931648 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-15918/att-00/237752.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 924091 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1083 GB zip-val = 0.0343 GB avg-val = 117.24 avg-zval = 37.16 2024/11/23-01:03:33.573634 140024860931648 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-15918/att-00/237752.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-01:03:34.314437 140024860931648 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-15918/att-00/237752.sst): second pass time = 1.43's, 75.651'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.74's, 51.961'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3257.844'MB/sec (index lex order gen) rebuild zvType time = 0.61's, 0.376'MB/sec write SST data time = 0.13's, 303.982'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.082'MB, throughput = 33435.890'MB/sec zip my value time = 1.43's, unzip length = 0.108'GB zip my value throughput = 75.651'MB/sec zip pipeline throughput = 75.651'MB/sec entries = 924091 avg-key = 28.00 avg-zkey = 1.91 avg-val = 117.24 avg-zval = 37.16 usrkeys = 924091 avg-key = 20.00 avg-zkey = 1.91 avg-val = 119.82 avg-zval = 37.16 TagRS{ kinds = RS_Key0_TagN bytes = 144480 } TagArray{ size = 340693 bytes = 1192448 } seq expand size = 2384851 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0343 GB dict = 1.08 MB all = 0.0385 GB } UnZip/Zip{ index = 10.4448 value = 3.1548 dict = 1.00 all = 3.4825 } Zip/UnZip{ index = 0.0957 value = 0.3170 dict = 1.00 all = 0.2872 } ---------------------------- total value len = 0.790286 GB avg = 0.119 KB (by entry num) total key len = 0.186026 GB avg = 0.028 KB total ukey len = 0.132876 GB avg = 0.020 KB total ukey num = 0.006643778 Billion total entry num = 0.006643778 Billion write speed all = 0.016754621 MB/sec (with seq num) write speed all = 0.015842503 MB/sec (without seq num) 2024/11/23-01:03:34.347590 140024860931648 [compaction_job.cc:1948] [default] [JOB 15918] Generated table #237752: 924091 keys, 38540953 bytes, temperature: kWarm 2024/11/23-01:03:34.347653 140024860931648 EVENT_LOG_v1 {"time_micros": 1732295014347621, "cf_name": "default", "job": 15918, "event": "table_file_creation", "file_number": 237752, "file_size": 38540953, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3446794381, "table_properties": {"data_size": 34342624, "index_size": 1769472, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25874548, "raw_average_key_size": 28, "raw_value_size": 108343294, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 924091, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732295011, "oldest_key_time": 0, "file_creation_time": 1732295011, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 237752, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-01:03:34.383496 140024860931648 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-15918/att-00/237753.sst) /dev/shm/ToplingTemp/Topling-360647-PglgCF 2024/11/23-01:03:35.178151 140024860931648 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-15918/att-00/237753.sst): first pass time = 0.79's, 168.909'MB/sec 2024/11/23-01:03:36.489752 140024860931648 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-15918/att-00/237753.sst): old prealloc_size = 147639500, real_size = 31350640 2024/11/23-01:03:36.490310 140024860931648 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-15918/att-00/237753.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 919300 prefix = 4 raw-key = 0.0147 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1085 GB zip-val = 0.0294 GB avg-val = 118.00 avg-zval = 31.94 2024/11/23-01:03:36.491066 140024860931648 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-15918/att-00/237753.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-01:03:37.355198 140024860931648 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-15918/att-00/237753.sst): second pass time = 1.31's, 82.747'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.87's, 40.936'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3342.912'MB/sec (index lex order gen) rebuild zvType time = 0.74's, 0.311'MB/sec write SST data time = 0.13's, 279.042'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.085'MB, throughput = 31171.282'MB/sec zip my value time = 1.31's, unzip length = 0.108'GB zip my value throughput = 82.747'MB/sec zip pipeline throughput = 82.747'MB/sec entries = 919300 avg-key = 28.00 avg-zkey = 1.91 avg-val = 118.00 avg-zval = 31.94 usrkeys = 919300 avg-key = 20.00 avg-zkey = 1.91 avg-val = 125.00 avg-zval = 31.94 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 919300 bytes = 3217568 } seq expand size = 6435100 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0184 GB value = 0.1085 GB dict = 1.09 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0294 GB dict = 1.09 MB all = 0.0354 GB } UnZip/Zip{ index = 10.4443 value = 3.6947 dict = 1.00 all = 3.7885 } Zip/UnZip{ index = 0.0957 value = 0.2707 dict = 1.00 all = 0.2640 } ---------------------------- total value len = 0.905199 GB avg = 0.120 KB (by entry num) total key len = 0.211766 GB avg = 0.028 KB total ukey len = 0.151262 GB avg = 0.020 KB total ukey num = 0.007563078 Billion total entry num = 0.007563078 Billion write speed all = 0.019167384 MB/sec (with seq num) write speed all = 0.018129110 MB/sec (without seq num) 2024/11/23-01:03:37.385690 140024860931648 [compaction_job.cc:1948] [default] [JOB 15918] Generated table #237753: 919300 keys, 35427378 bytes, temperature: kWarm 2024/11/23-01:03:37.385752 140024860931648 EVENT_LOG_v1 {"time_micros": 1732295017385720, "cf_name": "default", "job": 15918, "event": "table_file_creation", "file_number": 237753, "file_size": 35427378, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3446794382, "largest_seqno": 3675846113, "table_properties": {"data_size": 29360224, "index_size": 1760384, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25740400, "raw_average_key_size": 28, "raw_value_size": 108477400, "raw_average_value_size": 118, "num_data_blocks": 1, "num_entries": 919300, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 118, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732295014, "oldest_key_time": 0, "file_creation_time": 1732295014, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 237753, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-01:03:37.436936 140024860931648 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-15918/att-00/237754.sst) /dev/shm/ToplingTemp/Topling-360647-Xz0zaD 2024/11/23-01:03:38.357312 140024860931648 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-15918/att-00/237754.sst): first pass time = 0.92's, 145.837'MB/sec 2024/11/23-01:03:39.688660 140024860931648 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-15918/att-00/237754.sst): old prealloc_size = 147639500, real_size = 32668752 2024/11/23-01:03:39.689238 140024860931648 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-15918/att-00/237754.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 931135 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1081 GB zip-val = 0.0307 GB avg-val = 116.14 avg-zval = 32.93 2024/11/23-01:03:39.690000 140024860931648 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-15918/att-00/237754.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-01:03:40.642363 140024860931648 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-15918/att-00/237754.sst): second pass time = 1.33's, 81.271'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.95's, 38.565'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3191.159'MB/sec (index lex order gen) rebuild zvType time = 0.82's, 0.283'MB/sec write SST data time = 0.13's, 284.235'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 32787.947'MB/sec zip my value time = 1.33's, unzip length = 0.108'GB zip my value throughput = 81.271'MB/sec zip pipeline throughput = 81.271'MB/sec entries = 931135 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.14 avg-zval = 32.93 usrkeys = 931135 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.14 avg-zval = 32.93 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 931135 bytes = 3258992 } seq expand size = 6517945 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0307 GB dict = 1.08 MB all = 0.0368 GB } UnZip/Zip{ index = 10.5108 value = 3.5268 dict = 1.00 all = 3.6493 } Zip/UnZip{ index = 0.0951 value = 0.2835 dict = 1.00 all = 0.2740 } ---------------------------- total value len = 1.019863 GB avg = 0.120 KB (by entry num) total key len = 0.237838 GB avg = 0.028 KB total ukey len = 0.169884 GB avg = 0.020 KB total ukey num = 0.008494213 Billion total entry num = 0.008494213 Billion write speed all = 0.021581224 MB/sec (with seq num) write speed all = 0.020415188 MB/sec (without seq num) 2024/11/23-01:03:40.677575 140024860931648 [compaction_job.cc:1948] [default] [JOB 15918] Generated table #237754: 931135 keys, 36779082 bytes, temperature: kWarm 2024/11/23-01:03:40.677649 140024860931648 EVENT_LOG_v1 {"time_micros": 1732295020677608, "cf_name": "default", "job": 15918, "event": "table_file_creation", "file_number": 237754, "file_size": 36779082, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3487497056, "largest_seqno": 3693087548, "table_properties": {"data_size": 30664000, "index_size": 1771776, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26071780, "raw_average_key_size": 28, "raw_value_size": 108145978, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 931135, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732295017, "oldest_key_time": 0, "file_creation_time": 1732295017, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 237754, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-01:03:40.762356 140024860931648 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-15918/att-00/237755.sst) /dev/shm/ToplingTemp/Topling-360647-0G1JZB 2024/11/23-01:03:41.601243 140024860931648 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-15918/att-00/237755.sst): first pass time = 0.84's, 160.003'MB/sec 2024/11/23-01:03:42.942045 140024860931648 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-15918/att-00/237755.sst): old prealloc_size = 147639500, real_size = 32205584 2024/11/23-01:03:42.942623 140024860931648 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-15918/att-00/237755.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 921668 prefix = 4 raw-key = 0.0147 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1084 GB zip-val = 0.0302 GB avg-val = 117.62 avg-zval = 32.79 2024/11/23-01:03:42.943388 140024860931648 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-15918/att-00/237755.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-01:03:43.830990 140024860931648 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-15918/att-00/237755.sst): second pass time = 1.34's, 80.899'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.89's, 40.955'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3168.855'MB/sec (index lex order gen) rebuild zvType time = 0.76's, 0.304'MB/sec write SST data time = 0.13's, 281.814'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.084'MB, throughput = 30782.784'MB/sec zip my value time = 1.34's, unzip length = 0.108'GB zip my value throughput = 80.899'MB/sec zip pipeline throughput = 80.899'MB/sec entries = 921668 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.62 avg-zval = 32.79 usrkeys = 921668 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.62 avg-zval = 32.79 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 921668 bytes = 3341056 } seq expand size = 6451676 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0184 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0302 GB dict = 1.08 MB all = 0.0364 GB } UnZip/Zip{ index = 10.5136 value = 3.5872 dict = 1.00 all = 3.6867 } Zip/UnZip{ index = 0.0951 value = 0.2788 dict = 1.00 all = 0.2712 } ---------------------------- total value len = 1.134726 GB avg = 0.121 KB (by entry num) total key len = 0.263645 GB avg = 0.028 KB total ukey len = 0.188318 GB avg = 0.020 KB total ukey num = 0.009415881 Billion total entry num = 0.009415881 Billion write speed all = 0.023993698 MB/sec (with seq num) write speed all = 0.022701211 MB/sec (without seq num) 2024/11/23-01:03:43.862947 140024860931648 [compaction_job.cc:1948] [default] [JOB 15918] Generated table #237755: 921668 keys, 36405618 bytes, temperature: kWarm 2024/11/23-01:03:43.863010 140024860931648 EVENT_LOG_v1 {"time_micros": 1732295023862978, "cf_name": "default", "job": 15918, "event": "table_file_creation", "file_number": 237755, "file_size": 36405618, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3375334738, "largest_seqno": 3693087563, "table_properties": {"data_size": 30221696, "index_size": 1753280, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25806704, "raw_average_key_size": 28, "raw_value_size": 108411164, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 921668, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732295020, "oldest_key_time": 0, "file_creation_time": 1732295020, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 237755, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-01:03:43.903114 140024860931648 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-15918/att-00/237756.sst) /dev/shm/ToplingTemp/Topling-360647-atFi9D 2024/11/23-01:03:44.835762 140024860931648 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-15918/att-00/237756.sst): first pass time = 0.93's, 143.916'MB/sec 2024/11/23-01:03:46.195035 140024860931648 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-15918/att-00/237756.sst): old prealloc_size = 147639500, real_size = 35128064 2024/11/23-01:03:46.195603 140024860931648 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-15918/att-00/237756.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 930475 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1082 GB zip-val = 0.0331 GB avg-val = 116.25 avg-zval = 35.59 2024/11/23-01:03:46.196378 140024860931648 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-15918/att-00/237756.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-01:03:47.078827 140024860931648 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-15918/att-00/237756.sst): second pass time = 1.36's, 79.618'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.88's, 44.528'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3225.458'MB/sec (index lex order gen) rebuild zvType time = 0.75's, 0.309'MB/sec write SST data time = 0.13's, 304.210'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 32207.593'MB/sec zip my value time = 1.36's, unzip length = 0.108'GB zip my value throughput = 79.618'MB/sec zip pipeline throughput = 79.618'MB/sec entries = 930475 avg-key = 28.00 avg-zkey = 1.92 avg-val = 116.25 avg-zval = 35.59 usrkeys = 930475 avg-key = 20.00 avg-zkey = 1.92 avg-val = 123.25 avg-zval = 35.59 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 930475 bytes = 3372992 } seq expand size = 6513325 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0331 GB dict = 1.08 MB all = 0.0394 GB } UnZip/Zip{ index = 10.4437 value = 3.2665 dict = 1.00 all = 3.4107 } Zip/UnZip{ index = 0.0958 value = 0.3061 dict = 1.00 all = 0.2932 } ---------------------------- total value len = 1.249404 GB avg = 0.121 KB (by entry num) total key len = 0.289698 GB avg = 0.028 KB total ukey len = 0.206927 GB avg = 0.020 KB total ukey num = 0.010346356 Billion total entry num = 0.010346356 Billion write speed all = 0.026406938 MB/sec (with seq num) write speed all = 0.024986808 MB/sec (without seq num) 2024/11/23-01:03:47.111937 140024860931648 [compaction_job.cc:1948] [default] [JOB 15918] Generated table #237756: 930475 keys, 39352534 bytes, temperature: kWarm 2024/11/23-01:03:47.112004 140024860931648 EVENT_LOG_v1 {"time_micros": 1732295027111969, "cf_name": "default", "job": 15918, "event": "table_file_creation", "file_number": 237756, "file_size": 39352534, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3273701103, "largest_seqno": 3693087598, "table_properties": {"data_size": 33113392, "index_size": 1781888, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26053300, "raw_average_key_size": 28, "raw_value_size": 108164570, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 930475, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732295023, "oldest_key_time": 0, "file_creation_time": 1732295023, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 237756, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-01:03:47.148827 140024860931648 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-15918/att-00/237757.sst) /dev/shm/ToplingTemp/Topling-360647-KCQanC 2024/11/23-01:03:48.002120 140024860931648 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-15918/att-00/237757.sst): first pass time = 0.85's, 157.300'MB/sec 2024/11/23-01:03:49.336824 140024860931648 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-15918/att-00/237757.sst): old prealloc_size = 147639500, real_size = 33338112 2024/11/23-01:03:49.337343 140024860931648 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-15918/att-00/237757.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 920265 prefix = 4 raw-key = 0.0147 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1085 GB zip-val = 0.0313 GB avg-val = 117.85 avg-zval = 34.06 2024/11/23-01:03:49.338116 140024860931648 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-15918/att-00/237757.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-01:03:50.247669 140024860931648 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-15918/att-00/237757.sst): second pass time = 1.33's, 81.298'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.91's, 41.209'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3556.043'MB/sec (index lex order gen) rebuild zvType time = 0.78's, 0.294'MB/sec write SST data time = 0.13's, 292.170'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.084'MB, throughput = 27901.801'MB/sec zip my value time = 1.33's, unzip length = 0.108'GB zip my value throughput = 81.298'MB/sec zip pipeline throughput = 81.298'MB/sec entries = 920265 avg-key = 28.00 avg-zkey = 1.91 avg-val = 117.85 avg-zval = 34.06 usrkeys = 920265 avg-key = 20.00 avg-zkey = 1.91 avg-val = 124.85 avg-zval = 34.06 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 920265 bytes = 3335968 } seq expand size = 6441855 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0184 GB value = 0.1085 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0313 GB dict = 1.08 MB all = 0.0375 GB } UnZip/Zip{ index = 10.4439 value = 3.4598 dict = 1.00 all = 3.5759 } Zip/UnZip{ index = 0.0957 value = 0.2890 dict = 1.00 all = 0.2797 } ---------------------------- total value len = 1.364296 GB avg = 0.121 KB (by entry num) total key len = 0.315465 GB avg = 0.028 KB total ukey len = 0.225332 GB avg = 0.020 KB total ukey num = 0.011266621 Billion total entry num = 0.011266621 Billion write speed all = 0.028818721 MB/sec (with seq num) write speed all = 0.027272360 MB/sec (without seq num) 2024/11/23-01:03:50.280262 140024860931648 [compaction_job.cc:1948] [default] [JOB 15918] Generated table #237757: 920265 keys, 37534136 bytes, temperature: kWarm 2024/11/23-01:03:50.280327 140024860931648 EVENT_LOG_v1 {"time_micros": 1732295030280294, "cf_name": "default", "job": 15918, "event": "table_file_creation", "file_number": 237757, "file_size": 37534136, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3339428666, "largest_seqno": 3693087756, "table_properties": {"data_size": 31345584, "index_size": 1762304, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25767420, "raw_average_key_size": 28, "raw_value_size": 108450346, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 920265, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732295027, "oldest_key_time": 0, "file_creation_time": 1732295027, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 237757, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-01:03:50.317397 140024860931648 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-15918/att-00/237758.sst) /dev/shm/ToplingTemp/Topling-360647-SmreDC 2024/11/23-01:03:51.166314 140024860931648 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-15918/att-00/237758.sst): first pass time = 0.85's, 158.112'MB/sec 2024/11/23-01:03:52.505268 140024860931648 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-15918/att-00/237758.sst): old prealloc_size = 147639500, real_size = 32916176 2024/11/23-01:03:52.505870 140024860931648 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-15918/att-00/237758.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 930318 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0309 GB avg-val = 116.27 avg-zval = 33.23 2024/11/23-01:03:52.506609 140024860931648 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-15918/att-00/237758.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-01:03:53.459949 140024860931648 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-15918/att-00/237758.sst): second pass time = 1.34's, 80.824'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.95's, 38.661'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3059.098'MB/sec (index lex order gen) rebuild zvType time = 0.82's, 0.283'MB/sec write SST data time = 0.13's, 279.800'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 32018.937'MB/sec zip my value time = 1.34's, unzip length = 0.108'GB zip my value throughput = 80.824'MB/sec zip pipeline throughput = 80.824'MB/sec entries = 930318 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.27 avg-zval = 33.23 usrkeys = 930318 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.27 avg-zval = 33.23 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 930318 bytes = 3139840 } seq expand size = 6512226 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0309 GB dict = 1.08 MB all = 0.0369 GB } UnZip/Zip{ index = 10.5133 value = 3.4991 dict = 1.00 all = 3.6366 } Zip/UnZip{ index = 0.0951 value = 0.2858 dict = 1.00 all = 0.2750 } ---------------------------- total value len = 1.478977 GB avg = 0.121 KB (by entry num) total key len = 0.341514 GB avg = 0.028 KB total ukey len = 0.243939 GB avg = 0.020 KB total ukey num = 0.012196939 Billion total entry num = 0.012196939 Billion write speed all = 0.031231425 MB/sec (with seq num) write speed all = 0.029557469 MB/sec (without seq num) 2024/11/23-01:03:53.494572 140024860931648 [compaction_job.cc:1948] [default] [JOB 15918] Generated table #237758: 930318 keys, 36907982 bytes, temperature: kWarm 2024/11/23-01:03:53.494637 140024860931648 EVENT_LOG_v1 {"time_micros": 1732295033494605, "cf_name": "default", "job": 15918, "event": "table_file_creation", "file_number": 237758, "file_size": 36907982, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3610601794, "largest_seqno": 3693087638, "table_properties": {"data_size": 30913600, "index_size": 1769792, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26048904, "raw_average_key_size": 28, "raw_value_size": 108168848, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 930318, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732295030, "oldest_key_time": 0, "file_creation_time": 1732295030, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 237758, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-01:03:53.534005 140024860931648 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-15918/att-00/237759.sst) /dev/shm/ToplingTemp/Topling-360647-YMqMbE 2024/11/23-01:03:53.708281 140024860931648 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-15918/att-00/237759.sst): first pass time = 0.17's, 246.401'MB/sec 2024/11/23-01:03:54.116728 140024860931648 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-15918/att-00/237759.sst): old prealloc_size = 147639500, real_size = 12082064 2024/11/23-01:03:54.116959 140024860931648 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-15918/att-00/237759.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 297211 prefix = 4 raw-key = 0.0048 GB zip-key = 0.0006 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.0346 GB zip-val = 0.0114 GB avg-val = 116.45 avg-zval = 38.50 2024/11/23-01:03:54.117237 140024860931648 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-15918/att-00/237759.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0007 GB, waited 0.000 sec, Key+Value = 0.043 GB 2024/11/23-01:03:54.396165 140024860931648 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-15918/att-00/237759.sst): second pass time = 0.41's, 84.858'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.28's, 47.968'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2770.248'MB/sec (index lex order gen) rebuild zvType time = 0.24's, 0.314'MB/sec write SST data time = 0.04's, 317.354'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.352'MB, throughput = 11364.487'MB/sec zip my value time = 0.41's, unzip length = 0.035'GB zip my value throughput = 84.858'MB/sec zip pipeline throughput = 84.858'MB/sec entries = 297211 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.45 avg-zval = 38.50 usrkeys = 297211 avg-key = 20.00 avg-zkey = 1.91 avg-val = 123.45 avg-zval = 38.50 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 297211 bytes = 1040256 } seq expand size = 2080477 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0059 GB value = 0.0346 GB dict = 0.35 MB all = 0.0429 GB } __ZipSize{ index = 0.0006 GB value = 0.0114 GB dict = 0.35 MB all = 0.0134 GB } UnZip/Zip{ index = 10.4971 value = 3.0250 dict = 1.00 all = 3.2032 } Zip/UnZip{ index = 0.0953 value = 0.3306 dict = 1.00 all = 0.3122 } ---------------------------- total value len = 1.515668 GB avg = 0.121 KB (by entry num) total key len = 0.349836 GB avg = 0.028 KB total ukey len = 0.249883 GB avg = 0.020 KB total ukey num = 0.012494150 Billion total entry num = 0.012494150 Billion write speed all = 0.032003127 MB/sec (with seq num) write speed all = 0.030288408 MB/sec (without seq num) 2024/11/23-01:03:54.412427 140024860931648 [compaction_job.cc:1948] [default] [JOB 15918] Generated table #237759: 297211 keys, 13403093 bytes, temperature: kWarm 2024/11/23-01:03:54.412495 140024860931648 EVENT_LOG_v1 {"time_micros": 1732295034412463, "cf_name": "default", "job": 15918, "event": "table_file_creation", "file_number": 237759, "file_size": 13403093, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3516470397, "largest_seqno": 3693086503, "table_properties": {"data_size": 11441280, "index_size": 566272, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 8321908, "raw_average_key_size": 28, "raw_value_size": 34610390, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 297211, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732295033, "oldest_key_time": 0, "file_creation_time": 1732295033, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 237759, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-01:03:54.430982 140024860931648 [compaction_job.cc:703] job-15918: subcompact[0], size: 0.496477 G, files: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-15918/att-00 [237746,237747,237748,237749,237750,237751,237752,237753,237754,237755,237756,237757,237758,237759] 2024/11/23-01:03:54.518164 140024860931648 (Original Log Time 2024/11/23-01:03:12.150360) EVENT_LOG_v1 {"time_micros": 1732294992150316, "job": 15918, "event": "compaction_started", "compaction_reason": "FilesMarkedForCompaction", "files_L2": [237671], "files_L3": [237742, 237743, 237639, 237640, 237641, 237642, 237643, 237644, 237645, 237646, 237647, 237648, 237649, 237721], "score": 0.997413, "input_data_size": 510028675, "oldest_snapshot_seqno": 3693531474} 2024/11/23-01:03:54.518168 140024860931648 (Original Log Time 2024/11/23-01:03:54.517428) [compaction_job.cc:2022] [default] [JOB 15918] Compacted 1@2 + 14@3 files to L3 => 496477290 bytes 2024/11/23-01:03:54.518170 140024860931648 (Original Log Time 2024/11/23-01:03:54.518101) [compaction_job.cc:1224] [default] compacted to: files[0 0 0 14 0 0 0] max score 0.02, MB/sec: 12.1 rd, 11.7 wr, level 3, files in(1, 14) out(14 +0 blob) MB in(22.9, 463.5 +0.0 blob) out(473.5 +0.0 blob), read-write-amplify(41.9) write-amplify(20.7) OK, records in: 12563889, records dropped: 69739 output_compression: Snappy 2024/11/23-01:03:54.518176 140024860931648 (Original Log Time 2024/11/23-01:03:54.518144) EVENT_LOG_v1 {"time_micros": 1732295034518124, "cf": "default", "job": 15918, "event": "compaction_finished", "compaction_time_micros": 42280631, "compaction_time_cpu_micros": 19132706, "output_level": 3, "num_output_files": 14, "total_output_size": 496477290, "num_input_records": 12563889, "num_output_records": 12494150, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "file_write_nanos": 307612119, "file_range_sync_nanos": 0, "file_fsync_nanos": 13703, "file_prepare_write_nanos": 36065, "lsm_state": [0, 0, 0, 14, 0, 0, 0]} 2024/11/23-01:03:54.650598 140024860931648 DEBG dcompact_worker.cpp:240: HttpPost: 200 OK: url = http://nlb-7zny4kaa1poal01o64.cn-shenzhen.nlb.aliyuncs.com:8443, body = {"instanceId":"nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137","labourId":"","dbId":"d89b4006-2803-486e-b7a2-759bcf348921","dbStarts":1732256054,"starts":1732294991,"executesMs":42509,"compactionJobId":15918,"attempt":0,"compactionInputRawBytes":1797666615,"compactionInputZipBytes":510028675,"compactionOutputRawBytes":0,"compactionOutputZipBytes":496477290,"headers":{"Accept":"*/*","Connection":"close","Host":"aliyun-topling-saas.topling.cn:18443","RemoteIp":"120.24.192.169","X-Forwarded-For":"120.24.192.169","region":"cn-shenzhen","token":"e6474c481bd4415abc537135cc03626b","instance-token":"e6474c481bd4415abc537135cc03626b","provider":"aliyun","CloudMarketInstanceId":"si-59c0ae5c955845588903","MeteringAssit":"","Transfer-Encoding":"chunked","traceparent":"00-4e3a94aa620022a233734868ef055e58-e547bad85fc71a45-00"}}, response = 2024/11/23-01:03:54.650677 140024860931648 INFO dcompact_worker.cpp:1459: finish /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-15918/att-00: olev 3, work 42.509 s, result 6.376 ms, install 0.767 ms, input{raw 1.674 GiB zip 486.401 MiB}