2024/11/23-18:59:58.450917 139957257127488 DEBG dcompact_worker.cpp:2214: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00: fork to child time = 0.008265 sec 2024/11/23-18:59:58.451701 139957257127488 DEBG dcompact_worker.cpp:1013: Beg SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00 2024/11/23-18:59:58.458665 139957257127488 DEBG dcompact_worker.cpp:1033: End SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00 2024/11/23-18:59:58.459547 139957257127488 TRAC dcompact_worker.cpp:1083: INFO_LOG_LEVEL: rpc = INFO_LEVEL, env_var = undefined 2024/11/23-18:59:58.459829 139957257127488 [WARN] [column_family.cc:386] multiple cf_paths/db_paths and level_compaction_dynamic_level_bytes can't be used together 2024/11/23-18:59:58.513666 139957257127488 [version_set.cc:6208] Recovering from manifest file: /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-33692/att-00/MANIFEST-206347 2024/11/23-18:59:58.548592 139957257127488 [version_set.cc:6251] Recovered from manifest file:/worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-33692/att-00/MANIFEST-206347 succeeded,manifest_file_number is 206347, next_file_number is 276134, last_sequence is 4201197649, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 275992 2024/11/23-18:59:58.548601 139957257127488 [version_set.cc:6266] Column family [default] (ID 0), log number is 0 2024/11/23-18:59:58.548852 139957257127488 [version_set.cc:5721] Creating manifest 276134 2024/11/23-18:59:58.581298 139957257127488 DEBG dcompact_worker.cpp:1218: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00: bottommost_level: fake = 1, rpc = 0 2024/11/23-18:59:58.602374 139957257127488 [compaction_job.cc:2437] [default] [JOB 33692] Compacting 1@2 + 17@3 files to L3, score 0.99, subcompactions 1 : 1 2024/11/23-18:59:58.602396 139957257127488 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 25230 Base level 2, inputs: [276132(26MB)], [276037(37MB) 276089(37MB) 276090(38MB) 276091(38MB) 276092(36MB) 276093(38MB) 276094(37MB) 276095(35MB) 276096(35MB) 276097(37MB) 276098(33MB) 276099(37MB) 276100(34MB) 276101(34MB) 276102(36MB) 276103(37MB) 276104(35MB)] 2024/11/23-18:59:58.614521 139957257127488 [top_zip_table.cc:59] core git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-18:59:58.614555 139957257127488 [top_zip_table.cc:60] fsa git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-18:59:58.614575 139957257127488 [top_zip_table.cc:61] zbs git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-18:59:58.614581 139957257127488 [top_zip_table.cc:62] topling-zip_table_reader: git_version_hash_info_is: commit a4a382006cb82713acf5b3425835f22711877681 Author: leipeng Date: 2024-04-11 19:44:14 +0800 fixed_len_hole_index.cc: Add env bool FixedLenHoleIndexUseAVX512 for ut & debug 1. FixedLenHoleIndexUseAVX512 is only in unit tests or debug 2. In release mode, use avx512 by compile options(-march=) g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/23-18:59:58.614593 139957257127488 [top_zip_table.cc:64] topling-rocks git_version_hash_info_is: commit feab587e468621ba0204d47b4ffacc52e7c4290d Author: leipeng Date: 2024-03-22 13:35:06 +0800 ToplingZipTableBuilder::Add: immediately return after error This function returns void, and caller does not check builder->status() after calling this function and graceful abandon. So immediately return after error, and return error status in Finish(). g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/23-18:59:59.191769 139957257127488 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276135.sst) /dev/shm/ToplingTemp/Topling-158713-Tbgpzl 2024/11/23-18:59:59.805799 139957257127488 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276135.sst): first pass time = 0.61's, 218.602'MB/sec 2024/11/23-19:00:02.213990 139957257127488 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276135.sst): old prealloc_size = 147639500, real_size = 35386544 2024/11/23-19:00:02.214696 139957257127488 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276135.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 928853 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0334 GB avg-val = 116.50 avg-zval = 35.94 2024/11/23-19:00:02.215576 139957257127488 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276135.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-19:00:03.896453 139957257127488 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276135.sst): second pass time = 2.41's, 44.953'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.68's, 23.334'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2582.927'MB/sec (index lex order gen) rebuild zvType time = 1.32's, 0.177'MB/sec write SST data time = 0.37's, 107.195'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 36939.654'MB/sec zip my value time = 2.41's, unzip length = 0.108'GB zip my value throughput = 44.953'MB/sec zip pipeline throughput = 99.635'MB/sec entries = 928853 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.50 avg-zval = 35.94 usrkeys = 928853 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.50 avg-zval = 35.94 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 928853 bytes = 3018784 } seq expand size = 6501971 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0334 GB dict = 1.08 MB all = 0.0393 GB } UnZip/Zip{ index = 10.5131 value = 3.2411 dict = 1.00 all = 3.4189 } Zip/UnZip{ index = 0.0951 value = 0.3085 dict = 1.00 all = 0.2925 } ---------------------------- total value len = 8.963332 GB avg = 0.168 KB (by entry num) total key len = 1.466829 GB avg = 0.028 KB total ukey len = 1.016455 GB avg = 0.015 KB total ukey num = 0.066479288 Billion total entry num = 0.053287017 Billion write speed all = 0.287398107 MB/sec (with seq num) write speed all = 0.275651720 MB/sec (without seq num) 2024/11/23-19:00:03.948390 139957257127488 [compaction_job.cc:1948] [default] [JOB 33692] Generated table #276135: 928853 keys, 39258152 bytes, temperature: kWarm 2024/11/23-19:00:03.948486 139957257127488 EVENT_LOG_v1 {"time_micros": 1732359603948430, "cf_name": "default", "job": 33692, "event": "table_file_creation", "file_number": 276135, "file_size": 39258152, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4136224572, "largest_seqno": 4201180578, "table_properties": {"data_size": 33387104, "index_size": 1767040, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26007884, "raw_average_key_size": 28, "raw_value_size": 108209902, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 928853, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732359599, "oldest_key_time": 0, "file_creation_time": 1732359599, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 276135, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-19:00:03.987991 139957257127488 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276136.sst) /dev/shm/ToplingTemp/Topling-158713-Sv3LRk 2024/11/23-19:00:05.113625 139957257127488 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276136.sst): first pass time = 1.13's, 119.243'MB/sec 2024/11/23-19:00:06.911353 139957257127488 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276136.sst): old prealloc_size = 147639500, real_size = 35181184 2024/11/23-19:00:06.912053 139957257127488 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276136.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927999 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1082 GB zip-val = 0.0332 GB avg-val = 116.63 avg-zval = 35.75 2024/11/23-19:00:06.912850 139957257127488 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276136.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-19:00:08.641291 139957257127488 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276136.sst): second pass time = 1.80's, 60.234'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.73's, 22.641'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2623.093'MB/sec (index lex order gen) rebuild zvType time = 1.40's, 0.166'MB/sec write SST data time = 0.33's, 118.321'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 34667.993'MB/sec zip my value time = 1.80's, unzip length = 0.108'GB zip my value throughput = 60.234'MB/sec zip pipeline throughput = 60.234'MB/sec entries = 927999 avg-key = 28.00 avg-zkey = 1.92 avg-val = 116.63 avg-zval = 35.75 usrkeys = 927999 avg-key = 20.00 avg-zkey = 1.92 avg-val = 123.63 avg-zval = 35.75 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 927999 bytes = 3132016 } seq expand size = 6495993 multi value expand size = 0 cnt WriteAppend = 15 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0332 GB dict = 1.08 MB all = 0.0392 GB } UnZip/Zip{ index = 10.4433 value = 3.2628 dict = 1.00 all = 3.4268 } Zip/UnZip{ index = 0.0958 value = 0.3065 dict = 1.00 all = 0.2918 } ---------------------------- total value len = 9.078061 GB avg = 0.167 KB (by entry num) total key len = 1.492813 GB avg = 0.028 KB total ukey len = 1.035015 GB avg = 0.015 KB total ukey num = 0.067407287 Billion total entry num = 0.054215016 Billion write speed all = 0.291237330 MB/sec (with seq num) write speed all = 0.279287941 MB/sec (without seq num) 2024/11/23-19:00:08.693229 139957257127488 [compaction_job.cc:1948] [default] [JOB 33692] Generated table #276136: 927999 keys, 39167044 bytes, temperature: kWarm 2024/11/23-19:00:08.693331 139957257127488 EVENT_LOG_v1 {"time_micros": 1732359608693282, "cf_name": "default", "job": 33692, "event": "table_file_creation", "file_number": 276136, "file_size": 39167044, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4131604997, "largest_seqno": 4201180645, "table_properties": {"data_size": 33171760, "index_size": 1777216, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25983972, "raw_average_key_size": 28, "raw_value_size": 108233770, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927999, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732359603, "oldest_key_time": 0, "file_creation_time": 1732359603, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 276136, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-19:00:08.766156 139957257127488 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276137.sst) /dev/shm/ToplingTemp/Topling-158713-WIkIil 2024/11/23-19:00:09.884411 139957257127488 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276137.sst): first pass time = 1.12's, 120.031'MB/sec 2024/11/23-19:00:11.805366 139957257127488 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276137.sst): old prealloc_size = 147639500, real_size = 36051056 2024/11/23-19:00:11.805897 139957257127488 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276137.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927787 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0341 GB avg-val = 116.66 avg-zval = 36.70 2024/11/23-19:00:11.806732 139957257127488 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276137.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-19:00:12.804125 139957257127488 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276137.sst): second pass time = 1.92's, 56.372'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.00's, 40.440'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3460.005'MB/sec (index lex order gen) rebuild zvType time = 0.76's, 0.304'MB/sec write SST data time = 0.24's, 170.975'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 39551.536'MB/sec zip my value time = 1.92's, unzip length = 0.108'GB zip my value throughput = 56.372'MB/sec zip pipeline throughput = 86.399'MB/sec entries = 927787 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.66 avg-zval = 36.70 usrkeys = 927787 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.66 avg-zval = 36.70 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 927787 bytes = 3479216 } seq expand size = 6494509 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0341 GB dict = 1.08 MB all = 0.0404 GB } UnZip/Zip{ index = 10.5128 value = 3.1785 dict = 1.00 all = 3.3232 } Zip/UnZip{ index = 0.0951 value = 0.3146 dict = 1.00 all = 0.3009 } ---------------------------- total value len = 9.192796 GB avg = 0.167 KB (by entry num) total key len = 1.518791 GB avg = 0.028 KB total ukey len = 1.053571 GB avg = 0.015 KB total ukey num = 0.068335074 Billion total entry num = 0.055142803 Billion write speed all = 0.295080241 MB/sec (with seq num) write speed all = 0.282927754 MB/sec (without seq num) 2024/11/23-19:00:12.817255 139957257127488 [compaction_job.cc:1948] [default] [JOB 33692] Generated table #276137: 927787 keys, 40388048 bytes, temperature: kWarm 2024/11/23-19:00:12.817332 139957257127488 EVENT_LOG_v1 {"time_micros": 1732359612817285, "cf_name": "default", "job": 33692, "event": "table_file_creation", "file_number": 276137, "file_size": 40388048, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3591110068, "largest_seqno": 4201180663, "table_properties": {"data_size": 34053856, "index_size": 1765056, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25978036, "raw_average_key_size": 28, "raw_value_size": 108239770, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927787, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732359608, "oldest_key_time": 0, "file_creation_time": 1732359608, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 276137, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-19:00:12.891092 139957257127488 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276138.sst) /dev/shm/ToplingTemp/Topling-158713-EZReHl 2024/11/23-19:00:13.876504 139957257127488 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276138.sst): first pass time = 0.99's, 136.210'MB/sec 2024/11/23-19:00:15.453904 139957257127488 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276138.sst): old prealloc_size = 147639500, real_size = 36506880 2024/11/23-19:00:15.454521 139957257127488 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276138.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 934275 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.93 raw-val = 0.1081 GB zip-val = 0.0345 GB avg-val = 115.66 avg-zval = 36.90 2024/11/23-19:00:15.455170 139957257127488 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276138.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-19:00:16.552268 139957257127488 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276138.sst): second pass time = 1.58's, 68.535'MB/sec, value only(80.5% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.10's, 36.292'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3019.261'MB/sec (index lex order gen) rebuild zvType time = 0.84's, 0.277'MB/sec write SST data time = 0.25's, 157.297'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 37160.416'MB/sec zip my value time = 1.58's, unzip length = 0.108'GB zip my value throughput = 68.535'MB/sec zip pipeline throughput = 68.535'MB/sec entries = 934275 avg-key = 28.00 avg-zkey = 1.93 avg-val = 115.66 avg-zval = 36.90 usrkeys = 934275 avg-key = 20.00 avg-zkey = 1.93 avg-val = 120.36 avg-zval = 36.90 TagRS{ kinds = RS_Key0_TagN bytes = 146080 } TagArray{ size = 627483 bytes = 2353072 } seq expand size = 4392381 multi value expand size = 0 cnt WriteAppend = 20 UnZipSize{ index = 0.0187 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0345 GB dict = 1.08 MB all = 0.0399 GB } UnZip/Zip{ index = 10.3760 value = 3.1346 dict = 1.00 all = 3.3672 } Zip/UnZip{ index = 0.0964 value = 0.3190 dict = 1.00 all = 0.2970 } ---------------------------- total value len = 9.305246 GB avg = 0.166 KB (by entry num) total key len = 1.544951 GB avg = 0.028 KB total ukey len = 1.072256 GB avg = 0.015 KB total ukey num = 0.069269349 Billion total entry num = 0.056077078 Billion write speed all = 0.298867781 MB/sec (with seq num) write speed all = 0.286510672 MB/sec (without seq num) 2024/11/23-19:00:16.603928 139957257127488 [compaction_job.cc:1948] [default] [JOB 33692] Generated table #276138: 934275 keys, 39860322 bytes, temperature: kWarm 2024/11/23-19:00:16.604034 139957257127488 EVENT_LOG_v1 {"time_micros": 1732359616603972, "cf_name": "default", "job": 33692, "event": "table_file_creation", "file_number": 276138, "file_size": 39860322, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4012776165, "table_properties": {"data_size": 34472304, "index_size": 1800832, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26159700, "raw_average_key_size": 28, "raw_value_size": 108058038, "raw_average_value_size": 115, "num_data_blocks": 1, "num_entries": 934275, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732359612, "oldest_key_time": 0, "file_creation_time": 1732359612, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 276138, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-19:00:16.666223 139957257127488 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276139.sst) /dev/shm/ToplingTemp/Topling-158713-0h6kvj 2024/11/23-19:00:17.641378 139957257127488 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276139.sst): first pass time = 0.98's, 137.646'MB/sec 2024/11/23-19:00:19.262087 139957257127488 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276139.sst): old prealloc_size = 147639500, real_size = 33306128 2024/11/23-19:00:19.262627 139957257127488 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276139.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 925405 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0313 GB avg-val = 117.04 avg-zval = 33.84 2024/11/23-19:00:19.263462 139957257127488 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276139.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-19:00:20.488663 139957257127488 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276139.sst): second pass time = 1.62's, 66.866'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.23's, 30.586'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3395.928'MB/sec (index lex order gen) rebuild zvType time = 1.05's, 0.220'MB/sec write SST data time = 0.17's, 215.878'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 38964.296'MB/sec zip my value time = 1.62's, unzip length = 0.108'GB zip my value throughput = 66.866'MB/sec zip pipeline throughput = 66.866'MB/sec entries = 925405 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.04 avg-zval = 33.84 usrkeys = 925405 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.04 avg-zval = 33.84 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 925405 bytes = 3354608 } seq expand size = 6477835 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0313 GB dict = 1.08 MB all = 0.0375 GB } UnZip/Zip{ index = 10.5141 value = 3.4587 dict = 1.00 all = 3.5777 } Zip/UnZip{ index = 0.0951 value = 0.2891 dict = 1.00 all = 0.2795 } ---------------------------- total value len = 9.420030 GB avg = 0.165 KB (by entry num) total key len = 1.570862 GB avg = 0.028 KB total ukey len = 1.090764 GB avg = 0.016 KB total ukey num = 0.070194754 Billion total entry num = 0.057002483 Billion write speed all = 0.302710407 MB/sec (with seq num) write speed all = 0.290150739 MB/sec (without seq num) 2024/11/23-19:00:20.536065 139957257127488 [compaction_job.cc:1948] [default] [JOB 33692] Generated table #276139: 925405 keys, 37515618 bytes, temperature: kWarm 2024/11/23-19:00:20.536135 139957257127488 EVENT_LOG_v1 {"time_micros": 1732359620536102, "cf_name": "default", "job": 33692, "event": "table_file_creation", "file_number": 276139, "file_size": 37515618, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3623676327, "largest_seqno": 4012775947, "table_properties": {"data_size": 31314304, "index_size": 1760320, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25911340, "raw_average_key_size": 28, "raw_value_size": 108306414, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 925405, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732359616, "oldest_key_time": 0, "file_creation_time": 1732359616, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 276139, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-19:00:20.574952 139957257127488 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276140.sst) /dev/shm/ToplingTemp/Topling-158713-ESPLBj 2024/11/23-19:00:21.515144 139957257127488 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276140.sst): first pass time = 0.94's, 142.763'MB/sec 2024/11/23-19:00:23.107530 139957257127488 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276140.sst): old prealloc_size = 147639500, real_size = 35952272 2024/11/23-19:00:23.108087 139957257127488 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276140.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 924151 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1083 GB zip-val = 0.0340 GB avg-val = 117.23 avg-zval = 36.74 2024/11/23-19:00:23.108901 139957257127488 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276140.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-19:00:24.287959 139957257127488 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276140.sst): second pass time = 1.59's, 68.070'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.18's, 34.021'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3308.727'MB/sec (index lex order gen) rebuild zvType time = 1.05's, 0.220'MB/sec write SST data time = 0.13's, 310.656'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.082'MB, throughput = 27879.355'MB/sec zip my value time = 1.59's, unzip length = 0.108'GB zip my value throughput = 68.070'MB/sec zip pipeline throughput = 68.070'MB/sec entries = 924151 avg-key = 28.00 avg-zkey = 1.92 avg-val = 117.23 avg-zval = 36.74 usrkeys = 924151 avg-key = 20.00 avg-zkey = 1.92 avg-val = 124.23 avg-zval = 36.74 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 924151 bytes = 3350064 } seq expand size = 6469057 multi value expand size = 0 cnt WriteAppend = 15 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0340 GB dict = 1.08 MB all = 0.0402 GB } UnZip/Zip{ index = 10.4436 value = 3.1911 dict = 1.00 all = 3.3422 } Zip/UnZip{ index = 0.0958 value = 0.3134 dict = 1.00 all = 0.2992 } ---------------------------- total value len = 9.534841 GB avg = 0.165 KB (by entry num) total key len = 1.596738 GB avg = 0.028 KB total ukey len = 1.109247 GB avg = 0.016 KB total ukey num = 0.071118905 Billion total entry num = 0.057926634 Billion write speed all = 0.306553116 MB/sec (with seq num) write speed all = 0.293791160 MB/sec (without seq num) 2024/11/23-19:00:24.337468 139957257127488 [compaction_job.cc:1948] [default] [JOB 33692] Generated table #276140: 924151 keys, 40159014 bytes, temperature: kWarm 2024/11/23-19:00:24.337543 139957257127488 EVENT_LOG_v1 {"time_micros": 1732359624337507, "cf_name": "default", "job": 33692, "event": "table_file_creation", "file_number": 276140, "file_size": 40159014, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3514720078, "largest_seqno": 4012775967, "table_properties": {"data_size": 33951232, "index_size": 1769792, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25876228, "raw_average_key_size": 28, "raw_value_size": 108341550, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 924151, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732359620, "oldest_key_time": 0, "file_creation_time": 1732359620, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 276140, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-19:00:24.376952 139957257127488 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276141.sst) /dev/shm/ToplingTemp/Topling-158713-pwU6wi 2024/11/23-19:00:25.256386 139957257127488 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276141.sst): first pass time = 0.88's, 152.641'MB/sec 2024/11/23-19:00:26.937444 139957257127488 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276141.sst): old prealloc_size = 147639500, real_size = 34227776 2024/11/23-19:00:26.937953 139957257127488 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276141.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 930612 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0322 GB avg-val = 116.23 avg-zval = 34.63 2024/11/23-19:00:26.938695 139957257127488 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276141.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-19:00:27.946284 139957257127488 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276141.sst): second pass time = 1.68's, 64.370'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.01's, 37.718'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3639.678'MB/sec (index lex order gen) rebuild zvType time = 0.88's, 0.266'MB/sec write SST data time = 0.13's, 286.956'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 37845.598'MB/sec zip my value time = 1.68's, unzip length = 0.108'GB zip my value throughput = 64.370'MB/sec zip pipeline throughput = 80.250'MB/sec entries = 930612 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.23 avg-zval = 34.63 usrkeys = 930612 avg-key = 20.00 avg-zkey = 1.90 avg-val = 121.89 avg-zval = 34.63 TagRS{ kinds = RS_Key0_TagN bytes = 145520 } TagArray{ size = 752471 bytes = 2821776 } seq expand size = 5267297 multi value expand size = 0 cnt WriteAppend = 15 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0322 GB dict = 1.08 MB all = 0.0381 GB } UnZip/Zip{ index = 10.5151 value = 3.3564 dict = 1.00 all = 3.5274 } Zip/UnZip{ index = 0.0951 value = 0.2979 dict = 1.00 all = 0.2835 } ---------------------------- total value len = 9.648269 GB avg = 0.164 KB (by entry num) total key len = 1.622795 GB avg = 0.028 KB total ukey len = 1.127860 GB avg = 0.016 KB total ukey num = 0.072049517 Billion total entry num = 0.058857246 Billion write speed all = 0.310363137 MB/sec (with seq num) write speed all = 0.297397462 MB/sec (without seq num) 2024/11/23-19:00:27.999855 139957257127488 [compaction_job.cc:1948] [default] [JOB 33692] Generated table #276141: 930612 keys, 38050406 bytes, temperature: kWarm 2024/11/23-19:00:27.999922 139957257127488 EVENT_LOG_v1 {"time_micros": 1732359627999886, "cf_name": "default", "job": 33692, "event": "table_file_creation", "file_number": 276141, "file_size": 38050406, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4012776021, "table_properties": {"data_size": 32224880, "index_size": 1770048, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26057136, "raw_average_key_size": 28, "raw_value_size": 108160724, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 930612, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732359624, "oldest_key_time": 0, "file_creation_time": 1732359624, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 276141, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-19:00:28.037075 139957257127488 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276142.sst) /dev/shm/ToplingTemp/Topling-158713-pqW9Nm 2024/11/23-19:00:29.014010 139957257127488 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276142.sst): first pass time = 0.98's, 137.391'MB/sec 2024/11/23-19:00:30.518105 139957257127488 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276142.sst): old prealloc_size = 147639500, real_size = 32549024 2024/11/23-19:00:30.518714 139957257127488 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276142.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 929038 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0305 GB avg-val = 116.47 avg-zval = 32.88 2024/11/23-19:00:30.519623 139957257127488 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276142.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-19:00:31.664927 139957257127488 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276142.sst): second pass time = 1.50's, 71.976'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.15's, 32.278'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3011.624'MB/sec (index lex order gen) rebuild zvType time = 0.99's, 0.234'MB/sec write SST data time = 0.15's, 243.793'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 33255.599'MB/sec zip my value time = 1.50's, unzip length = 0.108'GB zip my value throughput = 71.976'MB/sec zip pipeline throughput = 71.976'MB/sec entries = 929038 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.47 avg-zval = 32.88 usrkeys = 929038 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.43 avg-zval = 32.88 TagRS{ kinds = RS_Key0_TagN bytes = 145280 } TagArray{ size = 924182 bytes = 3465696 } seq expand size = 6469274 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0305 GB dict = 1.08 MB all = 0.0370 GB } UnZip/Zip{ index = 10.5137 value = 3.5420 dict = 1.00 all = 3.6259 } Zip/UnZip{ index = 0.0951 value = 0.2823 dict = 1.00 all = 0.2758 } ---------------------------- total value len = 9.762943 GB avg = 0.163 KB (by entry num) total key len = 1.648808 GB avg = 0.028 KB total ukey len = 1.146440 GB avg = 0.016 KB total ukey num = 0.072978555 Billion total entry num = 0.059786284 Billion write speed all = 0.314204962 MB/sec (with seq num) write speed all = 0.301035977 MB/sec (without seq num) 2024/11/23-19:00:31.712386 139957257127488 [compaction_job.cc:1948] [default] [JOB 33692] Generated table #276142: 929038 keys, 37016742 bytes, temperature: kWarm 2024/11/23-19:00:31.712455 139957257127488 EVENT_LOG_v1 {"time_micros": 1732359631712420, "cf_name": "default", "job": 33692, "event": "table_file_creation", "file_number": 276142, "file_size": 37016742, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4012776210, "table_properties": {"data_size": 30549264, "index_size": 1767296, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26013064, "raw_average_key_size": 28, "raw_value_size": 108204760, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 929038, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732359628, "oldest_key_time": 0, "file_creation_time": 1732359628, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 276142, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-19:00:31.757529 139957257127488 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276143.sst) /dev/shm/ToplingTemp/Topling-158713-LdAjuk 2024/11/23-19:00:32.936504 139957257127488 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276143.sst): first pass time = 1.18's, 113.846'MB/sec 2024/11/23-19:00:34.361231 139957257127488 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276143.sst): old prealloc_size = 147639500, real_size = 32351904 2024/11/23-19:00:34.361900 139957257127488 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276143.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 931692 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1081 GB zip-val = 0.0303 GB avg-val = 116.06 avg-zval = 32.57 2024/11/23-19:00:34.362793 139957257127488 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276143.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-19:00:35.369837 139957257127488 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276143.sst): second pass time = 1.42's, 75.982'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.01's, 36.268'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2746.772'MB/sec (index lex order gen) rebuild zvType time = 0.85's, 0.273'MB/sec write SST data time = 0.16's, 234.199'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 32123.361'MB/sec zip my value time = 1.42's, unzip length = 0.108'GB zip my value throughput = 75.982'MB/sec zip pipeline throughput = 75.982'MB/sec entries = 931692 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.06 avg-zval = 32.57 usrkeys = 931692 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.06 avg-zval = 32.57 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 931692 bytes = 3377392 } seq expand size = 6521844 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0186 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0303 GB dict = 1.08 MB all = 0.0366 GB } UnZip/Zip{ index = 10.5136 value = 3.5632 dict = 1.00 all = 3.6691 } Zip/UnZip{ index = 0.0951 value = 0.2806 dict = 1.00 all = 0.2725 } ---------------------------- total value len = 9.877595 GB avg = 0.163 KB (by entry num) total key len = 1.674896 GB avg = 0.028 KB total ukey len = 1.165074 GB avg = 0.016 KB total ukey num = 0.073910247 Billion total entry num = 0.060717976 Billion write speed all = 0.318047566 MB/sec (with seq num) write speed all = 0.304674724 MB/sec (without seq num) 2024/11/23-19:00:35.415940 139957257127488 [compaction_job.cc:1948] [default] [JOB 33692] Generated table #276143: 931692 keys, 36580220 bytes, temperature: kWarm 2024/11/23-19:00:35.416013 139957257127488 EVENT_LOG_v1 {"time_micros": 1732359635415970, "cf_name": "default", "job": 33692, "event": "table_file_creation", "file_number": 276143, "file_size": 36580220, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3512539342, "largest_seqno": 4012776228, "table_properties": {"data_size": 30346448, "index_size": 1772352, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26087376, "raw_average_key_size": 28, "raw_value_size": 108130408, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 931692, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732359631, "oldest_key_time": 0, "file_creation_time": 1732359631, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 276143, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-19:00:35.454468 139957257127488 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276144.sst) /dev/shm/ToplingTemp/Topling-158713-ft9V4l 2024/11/23-19:00:36.675162 139957257127488 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276144.sst): first pass time = 1.22's, 109.956'MB/sec 2024/11/23-19:00:38.289404 139957257127488 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276144.sst): old prealloc_size = 147639500, real_size = 33692592 2024/11/23-19:00:38.289961 139957257127488 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276144.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 933210 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.93 raw-val = 0.1081 GB zip-val = 0.0317 GB avg-val = 115.82 avg-zval = 33.93 2024/11/23-19:00:38.290753 139957257127488 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276144.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-19:00:39.148475 139957257127488 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276144.sst): second pass time = 1.61's, 67.016'MB/sec, value only(80.5% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.86's, 44.149'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3278.671'MB/sec (index lex order gen) rebuild zvType time = 0.73's, 0.319'MB/sec write SST data time = 0.13's, 296.032'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 36371.208'MB/sec zip my value time = 1.61's, unzip length = 0.108'GB zip my value throughput = 67.016'MB/sec zip pipeline throughput = 79.980'MB/sec entries = 933210 avg-key = 28.00 avg-zkey = 1.93 avg-val = 115.82 avg-zval = 33.93 usrkeys = 933210 avg-key = 20.00 avg-zkey = 1.93 avg-val = 122.82 avg-zval = 33.93 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 933210 bytes = 3382896 } seq expand size = 6532470 multi value expand size = 0 cnt WriteAppend = 16 UnZipSize{ index = 0.0187 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0317 GB dict = 1.08 MB all = 0.0379 GB } UnZip/Zip{ index = 10.3767 value = 3.4140 dict = 1.00 all = 3.5389 } Zip/UnZip{ index = 0.0964 value = 0.2929 dict = 1.00 all = 0.2826 } ---------------------------- total value len = 9.992216 GB avg = 0.162 KB (by entry num) total key len = 1.701026 GB avg = 0.028 KB total ukey len = 1.183738 GB avg = 0.016 KB total ukey num = 0.074843457 Billion total entry num = 0.061651186 Billion write speed all = 0.321889025 MB/sec (with seq num) write speed all = 0.308312060 MB/sec (without seq num) 2024/11/23-19:00:39.194418 139957257127488 [compaction_job.cc:1948] [default] [JOB 33692] Generated table #276144: 933210 keys, 37925868 bytes, temperature: kWarm 2024/11/23-19:00:39.194488 139957257127488 EVENT_LOG_v1 {"time_micros": 1732359639194454, "cf_name": "default", "job": 33692, "event": "table_file_creation", "file_number": 276144, "file_size": 37925868, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3485447251, "largest_seqno": 4012776268, "table_properties": {"data_size": 31660448, "index_size": 1798656, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26129880, "raw_average_key_size": 28, "raw_value_size": 108087848, "raw_average_value_size": 115, "num_data_blocks": 1, "num_entries": 933210, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732359635, "oldest_key_time": 0, "file_creation_time": 1732359635, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 276144, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-19:00:39.287986 139957257127488 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276145.sst) /dev/shm/ToplingTemp/Topling-158713-vONlek 2024/11/23-19:00:40.418243 139957257127488 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276145.sst): first pass time = 1.13's, 118.755'MB/sec 2024/11/23-19:00:42.199077 139957257127488 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276145.sst): old prealloc_size = 147639500, real_size = 31693008 2024/11/23-19:00:42.199633 139957257127488 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276145.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927076 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1083 GB zip-val = 0.0297 GB avg-val = 116.78 avg-zval = 32.02 2024/11/23-19:00:42.200468 139957257127488 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276145.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-19:00:43.033409 139957257127488 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276145.sst): second pass time = 1.78's, 60.817'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.83's, 43.178'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3330.481'MB/sec (index lex order gen) rebuild zvType time = 0.70's, 0.329'MB/sec write SST data time = 0.13's, 279.442'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 28748.856'MB/sec zip my value time = 1.78's, unzip length = 0.108'GB zip my value throughput = 60.817'MB/sec zip pipeline throughput = 116.407'MB/sec entries = 927076 avg-key = 28.00 avg-zkey = 1.92 avg-val = 116.78 avg-zval = 32.02 usrkeys = 927076 avg-key = 20.00 avg-zkey = 1.92 avg-val = 123.78 avg-zval = 32.02 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 927076 bytes = 3476544 } seq expand size = 6489532 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0297 GB dict = 1.08 MB all = 0.0360 GB } UnZip/Zip{ index = 10.4423 value = 3.6469 dict = 1.00 all = 3.7258 } Zip/UnZip{ index = 0.0958 value = 0.2742 dict = 1.00 all = 0.2684 } ---------------------------- total value len = 10.106965 GB avg = 0.162 KB (by entry num) total key len = 1.726984 GB avg = 0.028 KB total ukey len = 1.202280 GB avg = 0.016 KB total ukey num = 0.075770533 Billion total entry num = 0.062578262 Billion write speed all = 0.325727553 MB/sec (with seq num) write speed all = 0.311947899 MB/sec (without seq num) 2024/11/23-19:00:43.077339 139957257127488 [compaction_job.cc:1948] [default] [JOB 33692] Generated table #276145: 927076 keys, 36023950 bytes, temperature: kWarm 2024/11/23-19:00:43.077410 139957257127488 EVENT_LOG_v1 {"time_micros": 1732359643077375, "cf_name": "default", "job": 33692, "event": "table_file_creation", "file_number": 276145, "file_size": 36023950, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3411274482, "largest_seqno": 4012776300, "table_properties": {"data_size": 29685440, "index_size": 1775616, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25958128, "raw_average_key_size": 28, "raw_value_size": 108259728, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927076, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732359639, "oldest_key_time": 0, "file_creation_time": 1732359639, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 276145, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-19:00:43.113894 139957257127488 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276146.sst) /dev/shm/ToplingTemp/Topling-158713-zIv17l 2024/11/23-19:00:44.014863 139957257127488 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276146.sst): first pass time = 0.90's, 148.978'MB/sec 2024/11/23-19:00:45.356488 139957257127488 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276146.sst): old prealloc_size = 147639500, real_size = 34792832 2024/11/23-19:00:45.357082 139957257127488 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276146.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927793 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0328 GB avg-val = 116.66 avg-zval = 35.35 2024/11/23-19:00:45.357898 139957257127488 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276146.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-19:00:46.205768 139957257127488 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276146.sst): second pass time = 1.34's, 80.729'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.85's, 46.071'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3102.329'MB/sec (index lex order gen) rebuild zvType time = 0.72's, 0.322'MB/sec write SST data time = 0.13's, 302.487'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 33590.020'MB/sec zip my value time = 1.34's, unzip length = 0.108'GB zip my value throughput = 80.729'MB/sec zip pipeline throughput = 80.729'MB/sec entries = 927793 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.66 avg-zval = 35.35 usrkeys = 927793 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.66 avg-zval = 35.35 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 927793 bytes = 3479232 } seq expand size = 6494551 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0328 GB dict = 1.08 MB all = 0.0391 GB } UnZip/Zip{ index = 10.5144 value = 3.3004 dict = 1.00 all = 3.4304 } Zip/UnZip{ index = 0.0951 value = 0.3030 dict = 1.00 all = 0.2915 } ---------------------------- total value len = 10.221699 GB avg = 0.161 KB (by entry num) total key len = 1.752962 GB avg = 0.028 KB total ukey len = 1.220836 GB avg = 0.016 KB total ukey num = 0.076698326 Billion total entry num = 0.063506055 Billion write speed all = 0.329571859 MB/sec (with seq num) write speed all = 0.315589128 MB/sec (without seq num) 2024/11/23-19:00:46.254620 139957257127488 [compaction_job.cc:1948] [default] [JOB 33692] Generated table #276146: 927793 keys, 39125652 bytes, temperature: kWarm 2024/11/23-19:00:46.254693 139957257127488 EVENT_LOG_v1 {"time_micros": 1732359646254656, "cf_name": "default", "job": 33692, "event": "table_file_creation", "file_number": 276146, "file_size": 39125652, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3405268578, "largest_seqno": 4012776316, "table_properties": {"data_size": 32795888, "index_size": 1764800, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25978204, "raw_average_key_size": 28, "raw_value_size": 108239558, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927793, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732359643, "oldest_key_time": 0, "file_creation_time": 1732359643, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 276146, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-19:00:46.292035 139957257127488 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276147.sst) /dev/shm/ToplingTemp/Topling-158713-cUL8Zm 2024/11/23-19:00:47.303494 139957257127488 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276147.sst): first pass time = 1.01's, 132.703'MB/sec 2024/11/23-19:00:48.578796 139957257127488 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276147.sst): old prealloc_size = 147639500, real_size = 30296560 2024/11/23-19:00:48.579401 139957257127488 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276147.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 931083 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1081 GB zip-val = 0.0283 GB avg-val = 116.15 avg-zval = 30.39 2024/11/23-19:00:48.580235 139957257127488 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276147.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-19:00:49.401312 139957257127488 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276147.sst): second pass time = 1.27's, 84.853'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.82's, 42.115'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3038.783'MB/sec (index lex order gen) rebuild zvType time = 0.69's, 0.336'MB/sec write SST data time = 0.13's, 268.168'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 35463.545'MB/sec zip my value time = 1.27's, unzip length = 0.108'GB zip my value throughput = 84.853'MB/sec zip pipeline throughput = 84.853'MB/sec entries = 931083 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.15 avg-zval = 30.39 usrkeys = 931083 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.15 avg-zval = 30.39 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 931083 bytes = 3491584 } seq expand size = 6517581 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0283 GB dict = 1.08 MB all = 0.0346 GB } UnZip/Zip{ index = 10.5128 value = 3.8225 dict = 1.00 all = 3.8747 } Zip/UnZip{ index = 0.0951 value = 0.2616 dict = 1.00 all = 0.2581 } ---------------------------- total value len = 10.336364 GB avg = 0.160 KB (by entry num) total key len = 1.779032 GB avg = 0.028 KB total ukey len = 1.239457 GB avg = 0.016 KB total ukey num = 0.077629409 Billion total entry num = 0.064437138 Billion write speed all = 0.333415918 MB/sec (with seq num) write speed all = 0.319229428 MB/sec (without seq num) 2024/11/23-19:00:49.445009 139957257127488 [compaction_job.cc:1948] [default] [JOB 33692] Generated table #276147: 931083 keys, 34639572 bytes, temperature: kWarm 2024/11/23-19:00:49.445079 139957257127488 EVENT_LOG_v1 {"time_micros": 1732359649445041, "cf_name": "default", "job": 33692, "event": "table_file_creation", "file_number": 276147, "file_size": 34639572, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3409504289, "largest_seqno": 4012776344, "table_properties": {"data_size": 28292256, "index_size": 1771328, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26070324, "raw_average_key_size": 28, "raw_value_size": 108147522, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 931083, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732359646, "oldest_key_time": 0, "file_creation_time": 1732359646, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 276147, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-19:00:49.484773 139957257127488 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276148.sst) /dev/shm/ToplingTemp/Topling-158713-wFie6k 2024/11/23-19:00:50.500764 139957257127488 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276148.sst): first pass time = 1.02's, 132.110'MB/sec 2024/11/23-19:00:51.802579 139957257127488 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276148.sst): old prealloc_size = 147639500, real_size = 31194032 2024/11/23-19:00:51.803147 139957257127488 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276148.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 923299 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.94 raw-val = 0.1084 GB zip-val = 0.0292 GB avg-val = 117.37 avg-zval = 31.60 2024/11/23-19:00:51.803968 139957257127488 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276148.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-19:00:52.616037 139957257127488 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276148.sst): second pass time = 1.30's, 83.292'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.81's, 43.658'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3277.344'MB/sec (index lex order gen) rebuild zvType time = 0.69's, 0.336'MB/sec write SST data time = 0.13's, 280.969'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.083'MB, throughput = 33531.383'MB/sec zip my value time = 1.30's, unzip length = 0.108'GB zip my value throughput = 83.292'MB/sec zip pipeline throughput = 83.292'MB/sec entries = 923299 avg-key = 28.00 avg-zkey = 1.94 avg-val = 117.37 avg-zval = 31.60 usrkeys = 923299 avg-key = 20.00 avg-zkey = 1.94 avg-val = 124.37 avg-zval = 31.60 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 923299 bytes = 3462384 } seq expand size = 6463093 multi value expand size = 0 cnt WriteAppend = 18 UnZipSize{ index = 0.0185 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0292 GB dict = 1.08 MB all = 0.0355 GB } UnZip/Zip{ index = 10.3084 value = 3.7147 dict = 1.00 all = 3.7795 } Zip/UnZip{ index = 0.0970 value = 0.2692 dict = 1.00 all = 0.2646 } ---------------------------- total value len = 10.451193 GB avg = 0.160 KB (by entry num) total key len = 1.804885 GB avg = 0.028 KB total ukey len = 1.257923 GB avg = 0.016 KB total ukey num = 0.078552708 Billion total entry num = 0.065360437 Billion write speed all = 0.337257620 MB/sec (with seq num) write speed all = 0.322869130 MB/sec (without seq num) 2024/11/23-19:00:52.659074 139957257127488 [compaction_job.cc:1948] [default] [JOB 33692] Generated table #276148: 923299 keys, 35512288 bytes, temperature: kWarm 2024/11/23-19:00:52.659145 139957257127488 EVENT_LOG_v1 {"time_micros": 1732359652659108, "cf_name": "default", "job": 33692, "event": "table_file_creation", "file_number": 276148, "file_size": 35512288, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3473051663, "largest_seqno": 4012776360, "table_properties": {"data_size": 29171680, "index_size": 1791360, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25852372, "raw_average_key_size": 28, "raw_value_size": 108365390, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 923299, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732359649, "oldest_key_time": 0, "file_creation_time": 1732359649, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 276148, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-19:00:52.696786 139957257127488 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276149.sst) /dev/shm/ToplingTemp/Topling-158713-eWVi1j 2024/11/23-19:00:53.663315 139957257127488 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276149.sst): first pass time = 0.97's, 138.871'MB/sec 2024/11/23-19:00:55.150651 139957257127488 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276149.sst): old prealloc_size = 147639500, real_size = 36604128 2024/11/23-19:00:55.151212 139957257127488 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276149.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 928179 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0346 GB avg-val = 116.60 avg-zval = 37.28 2024/11/23-19:00:55.151380 139957257127488 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276149.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-19:00:55.850176 139957257127488 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276149.sst): second pass time = 1.49's, 72.803'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.70's, 54.028'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3314.763'MB/sec (index lex order gen) rebuild zvType time = 0.58's, 0.403'MB/sec write SST data time = 0.12's, 308.042'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 28675.399'MB/sec zip my value time = 1.49's, unzip length = 0.108'GB zip my value throughput = 72.803'MB/sec zip pipeline throughput = 72.803'MB/sec entries = 928179 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.60 avg-zval = 37.28 usrkeys = 928179 avg-key = 20.00 avg-zkey = 1.90 avg-val = 117.07 avg-zval = 37.28 TagRS{ kinds = RS_Key0_TagN bytes = 145120 } TagArray{ size = 61861 bytes = 185600 } seq expand size = 433027 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0346 GB dict = 1.08 MB all = 0.0378 GB } UnZip/Zip{ index = 10.5127 value = 3.1274 dict = 1.00 all = 3.5514 } Zip/UnZip{ index = 0.0951 value = 0.3197 dict = 1.00 all = 0.2816 } ---------------------------- total value len = 10.559854 GB avg = 0.159 KB (by entry num) total key len = 1.830874 GB avg = 0.028 KB total ukey len = 1.276487 GB avg = 0.016 KB total ukey num = 0.079480887 Billion total entry num = 0.066288616 Billion write speed all = 0.340932545 MB/sec (with seq num) write speed all = 0.326341024 MB/sec (without seq num) 2024/11/23-19:00:55.897144 139957257127488 [compaction_job.cc:1948] [default] [JOB 33692] Generated table #276149: 928179 keys, 37792637 bytes, temperature: kWarm 2024/11/23-19:00:55.897225 139957257127488 EVENT_LOG_v1 {"time_micros": 1732359655897180, "cf_name": "default", "job": 33692, "event": "table_file_creation", "file_number": 276149, "file_size": 37792637, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4012773626, "table_properties": {"data_size": 34606096, "index_size": 1765824, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25989012, "raw_average_key_size": 28, "raw_value_size": 108228830, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 928179, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732359652, "oldest_key_time": 0, "file_creation_time": 1732359652, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 276149, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-19:00:55.935733 139957257127488 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276150.sst) /dev/shm/ToplingTemp/Topling-158713-kMfbJm 2024/11/23-19:00:56.971861 139957257127488 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276150.sst): first pass time = 1.04's, 129.543'MB/sec 2024/11/23-19:00:58.394711 139957257127488 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276150.sst): old prealloc_size = 147639500, real_size = 36586448 2024/11/23-19:00:58.395289 139957257127488 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276150.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 925067 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1083 GB zip-val = 0.0346 GB avg-val = 117.09 avg-zval = 37.39 2024/11/23-19:00:58.395795 139957257127488 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276150.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-19:00:59.163137 139957257127488 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276150.sst): second pass time = 1.42's, 76.189'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.77's, 51.312'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3188.800'MB/sec (index lex order gen) rebuild zvType time = 0.64's, 0.361'MB/sec write SST data time = 0.13's, 309.783'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 33829.042'MB/sec zip my value time = 1.42's, unzip length = 0.108'GB zip my value throughput = 76.189'MB/sec zip pipeline throughput = 76.189'MB/sec entries = 925067 avg-key = 28.00 avg-zkey = 1.91 avg-val = 117.09 avg-zval = 37.39 usrkeys = 925067 avg-key = 20.00 avg-zkey = 1.91 avg-val = 120.80 avg-zval = 37.39 TagRS{ kinds = RS_Key0_TagN bytes = 144640 } TagArray{ size = 489792 bytes = 1836736 } seq expand size = 3428544 multi value expand size = 0 cnt WriteAppend = 16 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0346 GB dict = 1.08 MB all = 0.0394 GB } UnZip/Zip{ index = 10.4457 value = 3.1320 dict = 1.00 all = 3.4042 } Zip/UnZip{ index = 0.0957 value = 0.3193 dict = 1.00 all = 0.2938 } ---------------------------- total value len = 10.671599 GB avg = 0.159 KB (by entry num) total key len = 1.856776 GB avg = 0.028 KB total ukey len = 1.294988 GB avg = 0.016 KB total ukey num = 0.080405954 Billion total entry num = 0.067213683 Billion write speed all = 0.344688482 MB/sec (with seq num) write speed all = 0.329894682 MB/sec (without seq num) 2024/11/23-19:00:59.210357 139957257127488 [compaction_job.cc:1948] [default] [JOB 33692] Generated table #276150: 925067 keys, 39427337 bytes, temperature: kWarm 2024/11/23-19:00:59.210428 139957257127488 EVENT_LOG_v1 {"time_micros": 1732359659210391, "cf_name": "default", "job": 33692, "event": "table_file_creation", "file_number": 276150, "file_size": 39427337, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4201177971, "table_properties": {"data_size": 34583808, "index_size": 1771200, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25901876, "raw_average_key_size": 28, "raw_value_size": 108315902, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 925067, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732359655, "oldest_key_time": 0, "file_creation_time": 1732359655, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 276150, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-19:00:59.257609 139957257127488 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276151.sst) /dev/shm/ToplingTemp/Topling-158713-B4uQKk 2024/11/23-19:01:00.201173 139957257127488 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276151.sst): first pass time = 0.94's, 142.252'MB/sec 2024/11/23-19:01:01.530662 139957257127488 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276151.sst): old prealloc_size = 147639500, real_size = 34093536 2024/11/23-19:01:01.531224 139957257127488 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276151.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 926426 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0321 GB avg-val = 116.88 avg-zval = 34.65 2024/11/23-19:01:01.531991 139957257127488 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276151.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-19:01:02.378128 139957257127488 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276151.sst): second pass time = 1.33's, 81.492'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.85's, 44.929'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3266.147'MB/sec (index lex order gen) rebuild zvType time = 0.71's, 0.324'MB/sec write SST data time = 0.13's, 287.563'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 33735.861'MB/sec zip my value time = 1.33's, unzip length = 0.108'GB zip my value throughput = 81.492'MB/sec zip pipeline throughput = 81.492'MB/sec entries = 926426 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.88 avg-zval = 34.65 usrkeys = 926426 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.88 avg-zval = 34.65 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 926426 bytes = 3126704 } seq expand size = 6484982 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0321 GB dict = 1.08 MB all = 0.0381 GB } UnZip/Zip{ index = 10.5123 value = 3.3732 dict = 1.00 all = 3.5251 } Zip/UnZip{ index = 0.0951 value = 0.2965 dict = 1.00 all = 0.2837 } ---------------------------- total value len = 10.786362 GB avg = 0.158 KB (by entry num) total key len = 1.882716 GB avg = 0.028 KB total ukey len = 1.313517 GB avg = 0.016 KB total ukey num = 0.081332380 Billion total entry num = 0.068140109 Billion write speed all = 0.348528755 MB/sec (with seq num) write speed all = 0.333532375 MB/sec (without seq num) 2024/11/23-19:01:02.425777 139957257127488 [compaction_job.cc:1948] [default] [JOB 33692] Generated table #276151: 926426 keys, 38074704 bytes, temperature: kWarm 2024/11/23-19:01:02.425847 139957257127488 EVENT_LOG_v1 {"time_micros": 1732359662425811, "cf_name": "default", "job": 33692, "event": "table_file_creation", "file_number": 276151, "file_size": 38074704, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4100102034, "largest_seqno": 4201180279, "table_properties": {"data_size": 32099216, "index_size": 1762560, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25939928, "raw_average_key_size": 28, "raw_value_size": 108277836, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 926426, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732359659, "oldest_key_time": 0, "file_creation_time": 1732359659, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 276151, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-19:01:02.464726 139957257127488 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276152.sst) /dev/shm/ToplingTemp/Topling-158713-geOeRj 2024/11/23-19:01:02.578365 139957257127488 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276152.sst): first pass time = 0.11's, 231.950'MB/sec 2024/11/23-19:01:02.819538 139957257127488 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276152.sst): old prealloc_size = 147639500, real_size = 7665920 2024/11/23-19:01:02.819712 139957257127488 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276152.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 182733 prefix = 4 raw-key = 0.0029 GB zip-key = 0.0003 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.0212 GB zip-val = 0.0073 GB avg-val = 116.18 avg-zval = 39.79 2024/11/23-19:01:02.819904 139957257127488 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276152.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0004 GB, waited 0.000 sec, Key+Value = 0.026 GB 2024/11/23-19:01:02.980523 139957257127488 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00/276152.sst): second pass time = 0.24's, 88.284'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 52.424'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2384.044'MB/sec (index lex order gen) rebuild zvType time = 0.13's, 0.339'MB/sec write SST data time = 0.03's, 322.832'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.222'MB, throughput = 6276.748'MB/sec zip my value time = 0.24's, unzip length = 0.021'GB zip my value throughput = 88.284'MB/sec zip pipeline throughput = 88.284'MB/sec entries = 182733 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.18 avg-zval = 39.79 usrkeys = 182733 avg-key = 20.00 avg-zkey = 1.91 avg-val = 123.18 avg-zval = 39.79 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 182733 bytes = 593904 } seq expand size = 1279131 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0037 GB value = 0.0212 GB dict = 0.22 MB all = 0.0263 GB } __ZipSize{ index = 0.0003 GB value = 0.0073 GB dict = 0.22 MB all = 0.0084 GB } UnZip/Zip{ index = 10.4778 value = 2.9197 dict = 1.00 all = 3.1221 } Zip/UnZip{ index = 0.0954 value = 0.3425 dict = 1.00 all = 0.3203 } ---------------------------- total value len = 10.808871 GB avg = 0.158 KB (by entry num) total key len = 1.887832 GB avg = 0.028 KB total ukey len = 1.317172 GB avg = 0.016 KB total ukey num = 0.081515113 Billion total entry num = 0.068322842 Billion write speed all = 0.349282947 MB/sec (with seq num) write speed all = 0.334246600 MB/sec (without seq num) 2024/11/23-19:01:02.998570 139957257127488 [compaction_job.cc:1948] [default] [JOB 33692] Generated table #276152: 182733 keys, 8438675 bytes, temperature: kWarm 2024/11/23-19:01:02.998635 139957257127488 EVENT_LOG_v1 {"time_micros": 1732359662998602, "cf_name": "default", "job": 33692, "event": "table_file_creation", "file_number": 276152, "file_size": 8438675, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4163386575, "largest_seqno": 4199677893, "table_properties": {"data_size": 7271280, "index_size": 348800, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5116524, "raw_average_key_size": 28, "raw_value_size": 21229758, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 182733, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732359662, "oldest_key_time": 0, "file_creation_time": 1732359662, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 276152, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-19:01:03.010395 139957257127488 [compaction_job.cc:703] job-33692: subcompact[0], size: 0.654956 G, files: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-33692/att-00 [276135,276136,276137,276138,276139,276140,276141,276142,276143,276144,276145,276146,276147,276148,276149,276150,276151,276152] 2024/11/23-19:01:03.147288 139957257127488 (Original Log Time 2024/11/23-18:59:58.602457) EVENT_LOG_v1 {"time_micros": 1732359598602414, "job": 33692, "event": "compaction_started", "compaction_reason": "FilesMarkedForCompaction", "files_L2": [276132], "files_L3": [276037, 276089, 276090, 276091, 276092, 276093, 276094, 276095, 276096, 276097, 276098, 276099, 276100, 276101, 276102, 276103, 276104], "score": 0.987458, "input_data_size": 680451303, "oldest_snapshot_seqno": 4201197589} 2024/11/23-19:01:03.147292 139957257127488 (Original Log Time 2024/11/23-19:01:03.145851) [compaction_job.cc:2022] [default] [JOB 33692] Compacted 1@2 + 17@3 files to L3 => 654956249 bytes 2024/11/23-19:01:03.147293 139957257127488 (Original Log Time 2024/11/23-19:01:03.147223) [compaction_job.cc:1224] [default] compacted to: files[0 0 0 18 0 0 0] max score 0.02, MB/sec: 10.6 rd, 10.2 wr, level 3, files in(1, 17) out(18 +0 blob) MB in(27.0, 622.0 +0.0 blob) out(624.6 +0.0 blob), read-write-amplify(47.2) write-amplify(23.2) OK, records in: 16014024, records dropped: 49346 output_compression: Snappy 2024/11/23-19:01:03.147299 139957257127488 (Original Log Time 2024/11/23-19:01:03.147268) EVENT_LOG_v1 {"time_micros": 1732359663147248, "cf": "default", "job": 33692, "event": "compaction_finished", "compaction_time_micros": 64407944, "compaction_time_cpu_micros": 26947338, "output_level": 3, "num_output_files": 18, "total_output_size": 654956249, "num_input_records": 16014024, "num_output_records": 15964678, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "file_write_nanos": 570460099, "file_range_sync_nanos": 0, "file_fsync_nanos": 14935, "file_prepare_write_nanos": 49559, "lsm_state": [0, 0, 0, 18, 0, 0, 0]} 2024/11/23-19:01:03.294470 139957257127488 DEBG dcompact_worker.cpp:240: HttpPost: 200 OK: url = http://nlb-7zny4kaa1poal01o64.cn-shenzhen.nlb.aliyuncs.com:8443, body = {"instanceId":"nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137","labourId":"","dbId":"d89b4006-2803-486e-b7a2-759bcf348921","dbStarts":1732256054,"starts":1732359598,"executesMs":64686,"compactionJobId":33692,"attempt":0,"compactionInputRawBytes":2315055824,"compactionInputZipBytes":680451303,"compactionOutputRawBytes":0,"compactionOutputZipBytes":654956249,"headers":{"Accept":"*/*","Connection":"close","Host":"aliyun-topling-saas.topling.cn:18443","RemoteIp":"120.24.192.169","X-Forwarded-For":"120.24.192.169","region":"cn-shenzhen","token":"e6474c481bd4415abc537135cc03626b","instance-token":"e6474c481bd4415abc537135cc03626b","provider":"aliyun","CloudMarketInstanceId":"si-59c0ae5c955845588903","MeteringAssit":"","Transfer-Encoding":"chunked","traceparent":"00-1f5590454f81bb674447765919c5e48b-a11dbc3172b3e8cd-00"}}, response = 2024/11/23-19:01:03.294558 139957257127488 INFO dcompact_worker.cpp:1459: finish /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-33692/att-00: olev 3, work 64.687 s, result 7.773 ms, install 1.464 ms, input{raw 2.156 GiB zip 648.929 MiB}