2024/11/23-09:23:10.007187 139957559264832 DEBG dcompact_worker.cpp:2214: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00: fork to child time = 0.007379 sec 2024/11/23-09:23:10.007702 139957559264832 DEBG dcompact_worker.cpp:1013: Beg SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00 2024/11/23-09:23:10.014469 139957559264832 DEBG dcompact_worker.cpp:1033: End SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00 2024/11/23-09:23:10.015930 139957559264832 TRAC dcompact_worker.cpp:1083: INFO_LOG_LEVEL: rpc = INFO_LEVEL, env_var = undefined 2024/11/23-09:23:10.016176 139957559264832 [WARN] [column_family.cc:386] multiple cf_paths/db_paths and level_compaction_dynamic_level_bytes can't be used together 2024/11/23-09:23:10.064559 139957559264832 [version_set.cc:6208] Recovering from manifest file: /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-23454/att-00/MANIFEST-206347 2024/11/23-09:23:10.108493 139957559264832 [version_set.cc:6251] Recovered from manifest file:/worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-23454/att-00/MANIFEST-206347 succeeded,manifest_file_number is 206347, next_file_number is 254043, last_sequence is 3904900971, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 253835 2024/11/23-09:23:10.108501 139957559264832 [version_set.cc:6266] Column family [default] (ID 0), log number is 0 2024/11/23-09:23:10.108601 139957559264832 [version_set.cc:5721] Creating manifest 254043 2024/11/23-09:23:10.140577 139957559264832 DEBG dcompact_worker.cpp:1218: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00: bottommost_level: fake = 1, rpc = 0 2024/11/23-09:23:10.163204 139957559264832 [compaction_job.cc:2437] [default] [JOB 23454] Compacting 1@2 + 18@3 files to L3, score 1.00, subcompactions 1 : 1 2024/11/23-09:23:10.163217 139957559264832 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 17602 Base level 2, inputs: [253983(27MB)], [254040(36MB) 254041(14MB) 253905(35MB) 253906(34MB) 253907(35MB) 253908(35MB) 253909(35MB) 253910(35MB) 253911(35MB) 253912(33MB) 253913(34MB) 253914(33MB) 253915(34MB) 253916(34MB) 253917(35MB) 253933(34MB) 253934(35MB) 254022(35MB)] 2024/11/23-09:23:10.170147 139957559264832 [top_zip_table.cc:59] core git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-09:23:10.170170 139957559264832 [top_zip_table.cc:60] fsa git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-09:23:10.170185 139957559264832 [top_zip_table.cc:61] zbs git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-09:23:10.170190 139957559264832 [top_zip_table.cc:62] topling-zip_table_reader: git_version_hash_info_is: commit a4a382006cb82713acf5b3425835f22711877681 Author: leipeng Date: 2024-04-11 19:44:14 +0800 fixed_len_hole_index.cc: Add env bool FixedLenHoleIndexUseAVX512 for ut & debug 1. FixedLenHoleIndexUseAVX512 is only in unit tests or debug 2. In release mode, use avx512 by compile options(-march=) g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/23-09:23:10.170199 139957559264832 [top_zip_table.cc:64] topling-rocks git_version_hash_info_is: commit feab587e468621ba0204d47b4ffacc52e7c4290d Author: leipeng Date: 2024-03-22 13:35:06 +0800 ToplingZipTableBuilder::Add: immediately return after error This function returns void, and caller does not check builder->status() after calling this function and graceful abandon. So immediately return after error, and return error status in Finish(). g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/23-09:23:10.713907 139957559264832 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254044.sst) /dev/shm/ToplingTemp/Topling-11837-P7XSif 2024/11/23-09:23:11.265442 139957559264832 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254044.sst): first pass time = 0.55's, 243.371'MB/sec 2024/11/23-09:23:12.578155 139957559264832 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254044.sst): old prealloc_size = 147639500, real_size = 33811104 2024/11/23-09:23:12.578687 139957559264832 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254044.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 933639 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.93 raw-val = 0.1081 GB zip-val = 0.0318 GB avg-val = 115.76 avg-zval = 34.04 2024/11/23-09:23:12.579542 139957559264832 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254044.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-09:23:13.424496 139957559264832 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254044.sst): second pass time = 1.31's, 82.404'MB/sec, value only(80.5% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.85's, 44.954'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3510.032'MB/sec (index lex order gen) rebuild zvType time = 0.72's, 0.323'MB/sec write SST data time = 0.12's, 311.680'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 34761.303'MB/sec zip my value time = 1.31's, unzip length = 0.108'GB zip my value throughput = 82.404'MB/sec zip pipeline throughput = 82.404'MB/sec entries = 933639 avg-key = 28.00 avg-zkey = 1.93 avg-val = 115.76 avg-zval = 34.04 usrkeys = 933639 avg-key = 20.00 avg-zkey = 1.93 avg-val = 122.76 avg-zval = 34.04 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 933639 bytes = 3384464 } seq expand size = 6535473 multi value expand size = 0 cnt WriteAppend = 16 UnZipSize{ index = 0.0187 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0318 GB dict = 1.08 MB all = 0.0380 GB } UnZip/Zip{ index = 10.3767 value = 3.4010 dict = 1.00 all = 3.5278 } Zip/UnZip{ index = 0.0964 value = 0.2940 dict = 1.00 all = 0.2835 } ---------------------------- total value len = 8.963231 GB avg = 0.168 KB (by entry num) total key len = 1.466963 GB avg = 0.028 KB total ukey len = 1.016551 GB avg = 0.015 KB total ukey num = 0.066484074 Billion total entry num = 0.053291803 Billion write speed all = 6.203981160 MB/sec (with seq num) write speed all = 5.950393289 MB/sec (without seq num) 2024/11/23-09:23:13.470209 139957559264832 [compaction_job.cc:1948] [default] [JOB 23454] Generated table #254044: 933639 keys, 38045836 bytes, temperature: kWarm 2024/11/23-09:23:13.470304 139957559264832 EVENT_LOG_v1 {"time_micros": 1732324993470244, "cf_name": "default", "job": 23454, "event": "table_file_creation", "file_number": 254044, "file_size": 38045836, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3583362754, "largest_seqno": 3904584470, "table_properties": {"data_size": 31778000, "index_size": 1799488, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26141892, "raw_average_key_size": 28, "raw_value_size": 108075926, "raw_average_value_size": 115, "num_data_blocks": 1, "num_entries": 933639, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732324990, "oldest_key_time": 0, "file_creation_time": 1732324990, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 254044, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-09:23:13.503696 139957559264832 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254045.sst) /dev/shm/ToplingTemp/Topling-11837-N3fULf 2024/11/23-09:23:14.721093 139957559264832 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254045.sst): first pass time = 1.22's, 110.253'MB/sec 2024/11/23-09:23:15.992287 139957559264832 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254045.sst): old prealloc_size = 147639500, real_size = 30841280 2024/11/23-09:23:15.992826 139957559264832 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254045.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 926694 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.94 raw-val = 0.1083 GB zip-val = 0.0288 GB avg-val = 116.84 avg-zval = 31.09 2024/11/23-09:23:15.993579 139957559264832 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254045.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-09:23:16.806555 139957559264832 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254045.sst): second pass time = 1.27's, 85.224'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.81's, 42.766'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3535.334'MB/sec (index lex order gen) rebuild zvType time = 0.69's, 0.335'MB/sec write SST data time = 0.12's, 285.476'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 32723.820'MB/sec zip my value time = 1.27's, unzip length = 0.108'GB zip my value throughput = 85.224'MB/sec zip pipeline throughput = 85.224'MB/sec entries = 926694 avg-key = 28.00 avg-zkey = 1.94 avg-val = 116.84 avg-zval = 31.09 usrkeys = 926694 avg-key = 20.00 avg-zkey = 1.94 avg-val = 123.84 avg-zval = 31.09 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 926694 bytes = 3127600 } seq expand size = 6486858 multi value expand size = 0 cnt WriteAppend = 15 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0288 GB dict = 1.08 MB all = 0.0348 GB } UnZip/Zip{ index = 10.3098 value = 3.7579 dict = 1.00 all = 3.8544 } Zip/UnZip{ index = 0.0970 value = 0.2661 dict = 1.00 all = 0.2594 } ---------------------------- total value len = 9.077988 GB avg = 0.167 KB (by entry num) total key len = 1.492910 GB avg = 0.028 KB total ukey len = 1.035085 GB avg = 0.015 KB total ukey num = 0.067410768 Billion total entry num = 0.054218497 Billion write speed all = 6.275050229 MB/sec (with seq num) write speed all = 6.017570672 MB/sec (without seq num) 2024/11/23-09:23:16.851832 139957559264832 [compaction_job.cc:1948] [default] [JOB 23454] Generated table #254045: 926694 keys, 34821806 bytes, temperature: kWarm 2024/11/23-09:23:16.851898 139957559264832 EVENT_LOG_v1 {"time_micros": 1732324996851862, "cf_name": "default", "job": 23454, "event": "table_file_creation", "file_number": 254045, "file_size": 34821806, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3772673614, "largest_seqno": 3904583832, "table_properties": {"data_size": 28811696, "index_size": 1797696, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25947432, "raw_average_key_size": 28, "raw_value_size": 108270340, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 926694, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732324993, "oldest_key_time": 0, "file_creation_time": 1732324993, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 254045, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-09:23:16.886454 139957559264832 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254046.sst) /dev/shm/ToplingTemp/Topling-11837-3Ghtqi 2024/11/23-09:23:17.885157 139957559264832 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254046.sst): first pass time = 1.00's, 134.399'MB/sec 2024/11/23-09:23:19.175881 139957559264832 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254046.sst): old prealloc_size = 147639500, real_size = 32224144 2024/11/23-09:23:19.176422 139957559264832 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254046.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 925250 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0302 GB avg-val = 117.06 avg-zval = 32.67 2024/11/23-09:23:19.177222 139957559264832 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254046.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-09:23:20.005241 139957559264832 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254046.sst): second pass time = 1.29's, 83.987'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.83's, 43.931'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3385.134'MB/sec (index lex order gen) rebuild zvType time = 0.71's, 0.327'MB/sec write SST data time = 0.12's, 299.444'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 28004.147'MB/sec zip my value time = 1.29's, unzip length = 0.108'GB zip my value throughput = 83.987'MB/sec zip pipeline throughput = 83.987'MB/sec entries = 925250 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.06 avg-zval = 32.67 usrkeys = 925250 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.06 avg-zval = 32.67 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 925250 bytes = 3354048 } seq expand size = 6476750 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0302 GB dict = 1.08 MB all = 0.0364 GB } UnZip/Zip{ index = 10.5127 value = 3.5826 dict = 1.00 all = 3.6839 } Zip/UnZip{ index = 0.0951 value = 0.2791 dict = 1.00 all = 0.2714 } ---------------------------- total value len = 9.192776 GB avg = 0.167 KB (by entry num) total key len = 1.518817 GB avg = 0.028 KB total ukey len = 1.053590 GB avg = 0.015 KB total ukey num = 0.068336018 Billion total entry num = 0.055143747 Billion write speed all = 6.346518031 MB/sec (with seq num) write speed all = 6.085140832 MB/sec (without seq num) 2024/11/23-09:23:20.048304 139957559264832 [compaction_job.cc:1948] [default] [JOB 23454] Generated table #254046: 925250 keys, 36433260 bytes, temperature: kWarm 2024/11/23-09:23:20.048374 139957559264832 EVENT_LOG_v1 {"time_micros": 1732325000048337, "cf_name": "default", "job": 23454, "event": "table_file_creation", "file_number": 254046, "file_size": 36433260, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3621075956, "largest_seqno": 3904583847, "table_properties": {"data_size": 30232384, "index_size": 1760256, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25907000, "raw_average_key_size": 28, "raw_value_size": 108310852, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 925250, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732324996, "oldest_key_time": 0, "file_creation_time": 1732324996, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 254046, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-09:23:20.087793 139957559264832 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254047.sst) /dev/shm/ToplingTemp/Topling-11837-fhBDOh 2024/11/23-09:23:21.139881 139957559264832 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254047.sst): first pass time = 1.05's, 127.578'MB/sec 2024/11/23-09:23:22.410009 139957559264832 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254047.sst): old prealloc_size = 147639500, real_size = 32404752 2024/11/23-09:23:22.410524 139957559264832 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254047.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 933923 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1081 GB zip-val = 0.0304 GB avg-val = 115.71 avg-zval = 32.54 2024/11/23-09:23:22.411329 139957559264832 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254047.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-09:23:23.257157 139957559264832 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254047.sst): second pass time = 1.27's, 85.139'MB/sec, value only(80.5% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.85's, 43.252'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3607.625'MB/sec (index lex order gen) rebuild zvType time = 0.72's, 0.322'MB/sec write SST data time = 0.12's, 299.000'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 33598.180'MB/sec zip my value time = 1.27's, unzip length = 0.108'GB zip my value throughput = 85.139'MB/sec zip pipeline throughput = 85.139'MB/sec entries = 933923 avg-key = 28.00 avg-zkey = 1.90 avg-val = 115.71 avg-zval = 32.54 usrkeys = 933923 avg-key = 20.00 avg-zkey = 1.90 avg-val = 122.71 avg-zval = 32.54 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 933923 bytes = 3385488 } seq expand size = 6537461 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0187 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0304 GB dict = 1.08 MB all = 0.0366 GB } UnZip/Zip{ index = 10.5134 value = 3.5555 dict = 1.00 all = 3.6631 } Zip/UnZip{ index = 0.0951 value = 0.2813 dict = 1.00 all = 0.2730 } ---------------------------- total value len = 9.307381 GB avg = 0.166 KB (by entry num) total key len = 1.544967 GB avg = 0.028 KB total ukey len = 1.072268 GB avg = 0.015 KB total ukey num = 0.069269941 Billion total entry num = 0.056077670 Billion write speed all = 6.417549272 MB/sec (with seq num) write speed all = 6.152256496 MB/sec (without seq num) 2024/11/23-09:23:23.302063 139957559264832 [compaction_job.cc:1948] [default] [JOB 23454] Generated table #254047: 933923 keys, 36640772 bytes, temperature: kWarm 2024/11/23-09:23:23.302130 139957559264832 EVENT_LOG_v1 {"time_micros": 1732325003302095, "cf_name": "default", "job": 23454, "event": "table_file_creation", "file_number": 254047, "file_size": 36640772, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3376774746, "largest_seqno": 3904584361, "table_properties": {"data_size": 30394432, "index_size": 1776640, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26149844, "raw_average_key_size": 28, "raw_value_size": 108067910, "raw_average_value_size": 115, "num_data_blocks": 1, "num_entries": 933923, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732325000, "oldest_key_time": 0, "file_creation_time": 1732325000, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 254047, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-09:23:23.336973 139957559264832 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254048.sst) /dev/shm/ToplingTemp/Topling-11837-aUtPji 2024/11/23-09:23:24.184923 139957559264832 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254048.sst): first pass time = 0.85's, 158.298'MB/sec 2024/11/23-09:23:25.449166 139957559264832 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254048.sst): old prealloc_size = 147639500, real_size = 30922512 2024/11/23-09:23:25.449693 139957559264832 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254048.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 929818 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0289 GB avg-val = 116.35 avg-zval = 31.10 2024/11/23-09:23:25.450499 139957559264832 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254048.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-09:23:26.269788 139957559264832 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254048.sst): second pass time = 1.26's, 85.638'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.82's, 42.829'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3490.682'MB/sec (index lex order gen) rebuild zvType time = 0.70's, 0.333'MB/sec write SST data time = 0.12's, 287.664'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 35738.557'MB/sec zip my value time = 1.26's, unzip length = 0.108'GB zip my value throughput = 85.638'MB/sec zip pipeline throughput = 85.638'MB/sec entries = 929818 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.35 avg-zval = 31.10 usrkeys = 929818 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.35 avg-zval = 31.10 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 929818 bytes = 3370608 } seq expand size = 6508726 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0289 GB dict = 1.08 MB all = 0.0351 GB } UnZip/Zip{ index = 10.5130 value = 3.7406 dict = 1.00 all = 3.8189 } Zip/UnZip{ index = 0.0951 value = 0.2673 dict = 1.00 all = 0.2619 } ---------------------------- total value len = 9.422073 GB avg = 0.165 KB (by entry num) total key len = 1.571002 GB avg = 0.028 KB total ukey len = 1.090864 GB avg = 0.016 KB total ukey num = 0.070199759 Billion total entry num = 0.057007488 Billion write speed all = 6.489207388 MB/sec (with seq num) write speed all = 6.219995428 MB/sec (without seq num) 2024/11/23-09:23:26.315786 139957559264832 [compaction_job.cc:1948] [default] [JOB 23454] Generated table #254048: 929818 keys, 35145538 bytes, temperature: kWarm 2024/11/23-09:23:26.315855 139957559264832 EVENT_LOG_v1 {"time_micros": 1732325006315818, "cf_name": "default", "job": 23454, "event": "table_file_creation", "file_number": 254048, "file_size": 35145538, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3566537713, "largest_seqno": 3904584614, "table_properties": {"data_size": 28920960, "index_size": 1768896, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26034904, "raw_average_key_size": 28, "raw_value_size": 108182856, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 929818, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732325003, "oldest_key_time": 0, "file_creation_time": 1732325003, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 254048, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-09:23:26.348263 139957559264832 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254049.sst) /dev/shm/ToplingTemp/Topling-11837-1wr9te 2024/11/23-09:23:27.368327 139957559264832 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254049.sst): first pass time = 1.02's, 131.583'MB/sec 2024/11/23-09:23:28.647616 139957559264832 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254049.sst): old prealloc_size = 147639500, real_size = 31126816 2024/11/23-09:23:28.648188 139957559264832 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254049.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 929573 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0291 GB avg-val = 116.39 avg-zval = 31.33 2024/11/23-09:23:28.648989 139957559264832 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254049.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-09:23:29.468658 139957559264832 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254049.sst): second pass time = 1.28's, 84.649'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.82's, 42.914'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3253.349'MB/sec (index lex order gen) rebuild zvType time = 0.70's, 0.332'MB/sec write SST data time = 0.12's, 291.137'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 37582.144'MB/sec zip my value time = 1.28's, unzip length = 0.108'GB zip my value throughput = 84.649'MB/sec zip pipeline throughput = 84.649'MB/sec entries = 929573 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.39 avg-zval = 31.33 usrkeys = 929573 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.39 avg-zval = 31.33 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 929573 bytes = 3253520 } seq expand size = 6507011 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0291 GB dict = 1.08 MB all = 0.0352 GB } UnZip/Zip{ index = 10.5144 value = 3.7145 dict = 1.00 all = 3.8094 } Zip/UnZip{ index = 0.0951 value = 0.2692 dict = 1.00 all = 0.2625 } ---------------------------- total value len = 9.536770 GB avg = 0.165 KB (by entry num) total key len = 1.597030 GB avg = 0.028 KB total ukey len = 1.109456 GB avg = 0.016 KB total ukey num = 0.071129332 Billion total entry num = 0.057937061 Billion write speed all = 6.559890238 MB/sec (with seq num) write speed all = 6.286804131 MB/sec (without seq num) 2024/11/23-09:23:29.516061 139957559264832 [compaction_job.cc:1948] [default] [JOB 23454] Generated table #254049: 929573 keys, 35233028 bytes, temperature: kWarm 2024/11/23-09:23:29.516130 139957559264832 EVENT_LOG_v1 {"time_micros": 1732325009516092, "cf_name": "default", "job": 23454, "event": "table_file_creation", "file_number": 254049, "file_size": 35233028, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3767707243, "largest_seqno": 3904583899, "table_properties": {"data_size": 29126032, "index_size": 1768192, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26028044, "raw_average_key_size": 28, "raw_value_size": 108189826, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 929573, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732325006, "oldest_key_time": 0, "file_creation_time": 1732325006, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 254049, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-09:23:29.557118 139957559264832 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254050.sst) /dev/shm/ToplingTemp/Topling-11837-p1WTQd 2024/11/23-09:23:30.510113 139957559264832 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254050.sst): first pass time = 0.95's, 140.843'MB/sec 2024/11/23-09:23:31.797178 139957559264832 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254050.sst): old prealloc_size = 147639500, real_size = 31308272 2024/11/23-09:23:31.797709 139957559264832 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254050.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 930502 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0293 GB avg-val = 116.24 avg-zval = 31.49 2024/11/23-09:23:31.798432 139957559264832 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254050.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-09:23:32.618129 139957559264832 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254050.sst): second pass time = 1.29's, 84.122'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.82's, 42.800'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3463.291'MB/sec (index lex order gen) rebuild zvType time = 0.70's, 0.334'MB/sec write SST data time = 0.12's, 282.171'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 33633.993'MB/sec zip my value time = 1.29's, unzip length = 0.108'GB zip my value throughput = 84.122'MB/sec zip pipeline throughput = 84.122'MB/sec entries = 930502 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.24 avg-zval = 31.49 usrkeys = 930502 avg-key = 20.00 avg-zkey = 1.90 avg-val = 122.54 avg-zval = 31.49 TagRS{ kinds = RS_Key0_TagN bytes = 145480 } TagArray{ size = 837406 bytes = 2826256 } seq expand size = 5861842 multi value expand size = 0 cnt WriteAppend = 16 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0293 GB dict = 1.08 MB all = 0.0351 GB } UnZip/Zip{ index = 10.5142 value = 3.6909 dict = 1.00 all = 3.8200 } Zip/UnZip{ index = 0.0951 value = 0.2709 dict = 1.00 all = 0.2618 } ---------------------------- total value len = 9.650795 GB avg = 0.164 KB (by entry num) total key len = 1.623084 GB avg = 0.028 KB total ukey len = 1.128066 GB avg = 0.016 KB total ukey num = 0.072059834 Billion total entry num = 0.058867563 Billion write speed all = 6.630120278 MB/sec (with seq num) write speed all = 6.353162185 MB/sec (without seq num) 2024/11/23-09:23:32.664355 139957559264832 [compaction_job.cc:1948] [default] [JOB 23454] Generated table #254050: 930502 keys, 35135642 bytes, temperature: kWarm 2024/11/23-09:23:32.664420 139957559264832 EVENT_LOG_v1 {"time_micros": 1732325012664385, "cf_name": "default", "job": 23454, "event": "table_file_creation", "file_number": 254050, "file_size": 35135642, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3904584233, "table_properties": {"data_size": 29305504, "index_size": 1769984, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26054056, "raw_average_key_size": 28, "raw_value_size": 108163696, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 930502, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732325009, "oldest_key_time": 0, "file_creation_time": 1732325009, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 254050, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-09:23:32.698459 139957559264832 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254051.sst) /dev/shm/ToplingTemp/Topling-11837-6jg4ni 2024/11/23-09:23:33.578152 139957559264832 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254051.sst): first pass time = 0.88's, 152.581'MB/sec 2024/11/23-09:23:34.932225 139957559264832 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254051.sst): old prealloc_size = 147639500, real_size = 35006064 2024/11/23-09:23:34.932842 139957559264832 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254051.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 1081663 prefix = 4 raw-key = 0.0173 GB zip-key = 0.0021 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1039 GB zip-val = 0.0327 GB avg-val = 96.08 avg-zval = 30.20 2024/11/23-09:23:34.932882 139957559264832 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254051.sst: sumWaitingMem = 0.003 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0028 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-09:23:35.619915 139957559264832 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254051.sst): second pass time = 1.35's, 76.798'MB/sec, value only(77.4% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.69's, 52.034'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3488.976'MB/sec (index lex order gen) rebuild zvType time = 0.55's, 0.490'MB/sec write SST data time = 0.14's, 264.222'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.036'MB, throughput = 35711.257'MB/sec zip my value time = 1.35's, unzip length = 0.104'GB zip my value throughput = 76.798'MB/sec zip pipeline throughput = 76.798'MB/sec entries = 1081663 avg-key = 28.00 avg-zkey = 1.91 avg-val = 96.08 avg-zval = 30.20 usrkeys = 1081663 avg-key = 20.00 avg-zkey = 1.91 avg-val = 96.08 avg-zval = 30.20 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0216 GB value = 0.1039 GB dict = 1.04 MB all = 0.1342 GB } __ZipSize{ index = 0.0021 GB value = 0.0327 GB dict = 1.04 MB all = 0.0358 GB } UnZip/Zip{ index = 10.4469 value = 3.1818 dict = 1.00 all = 3.7510 } Zip/UnZip{ index = 0.0957 value = 0.3143 dict = 1.00 all = 0.2666 } ---------------------------- total value len = 9.754727 GB avg = 0.163 KB (by entry num) total key len = 1.653371 GB avg = 0.028 KB total ukey len = 1.149699 GB avg = 0.016 KB total ukey num = 0.073141497 Billion total entry num = 0.059949226 Billion write speed all = 6.697230351 MB/sec (with seq num) write speed all = 6.415680318 MB/sec (without seq num) 2024/11/23-09:23:35.668724 139957559264832 [compaction_job.cc:1948] [default] [JOB 23454] Generated table #254051: 1081663 keys, 35782303 bytes, temperature: kWarm 2024/11/23-09:23:35.668791 139957559264832 EVENT_LOG_v1 {"time_micros": 1732325015668756, "cf_name": "default", "job": 23454, "event": "table_file_creation", "file_number": 254051, "file_size": 35782303, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 32664672, "index_size": 2070784, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 30286564, "raw_average_key_size": 28, "raw_value_size": 103931295, "raw_average_value_size": 96, "num_data_blocks": 1, "num_entries": 1081663, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732325012, "oldest_key_time": 0, "file_creation_time": 1732325012, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 254051, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-09:23:35.702891 139957559264832 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254052.sst) /dev/shm/ToplingTemp/Topling-11837-tHk2Tg 2024/11/23-09:23:36.498493 139957559264832 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254052.sst): first pass time = 0.80's, 168.709'MB/sec 2024/11/23-09:23:37.824685 139957559264832 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254052.sst): old prealloc_size = 147639500, real_size = 33786176 2024/11/23-09:23:37.825240 139957559264832 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254052.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 921026 prefix = 4 raw-key = 0.0147 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1084 GB zip-val = 0.0318 GB avg-val = 117.73 avg-zval = 34.52 2024/11/23-09:23:37.825923 139957559264832 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254052.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-09:23:38.635875 139957559264832 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254052.sst): second pass time = 1.33's, 81.807'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.81's, 46.163'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3311.084'MB/sec (index lex order gen) rebuild zvType time = 0.69's, 0.335'MB/sec write SST data time = 0.12's, 301.884'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.084'MB, throughput = 36214.663'MB/sec zip my value time = 1.33's, unzip length = 0.108'GB zip my value throughput = 81.807'MB/sec zip pipeline throughput = 81.807'MB/sec entries = 921026 avg-key = 28.00 avg-zkey = 1.92 avg-val = 117.73 avg-zval = 34.52 usrkeys = 921026 avg-key = 20.00 avg-zkey = 1.92 avg-val = 123.10 avg-zval = 34.52 TagRS{ kinds = RS_Key0_TagN bytes = 144000 } TagArray{ size = 707382 bytes = 2652704 } seq expand size = 4951674 multi value expand size = 0 cnt WriteAppend = 17 UnZipSize{ index = 0.0184 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0318 GB dict = 1.08 MB all = 0.0374 GB } UnZip/Zip{ index = 10.4430 value = 3.4106 dict = 1.00 all = 3.5843 } Zip/UnZip{ index = 0.0958 value = 0.2932 dict = 1.00 all = 0.2790 } ---------------------------- total value len = 9.868107 GB avg = 0.162 KB (by entry num) total key len = 1.679160 GB avg = 0.028 KB total ukey len = 1.168120 GB avg = 0.016 KB total ukey num = 0.074062523 Billion total entry num = 0.060870252 Billion write speed all = 6.766949906 MB/sec (with seq num) write speed all = 6.481579559 MB/sec (without seq num) 2024/11/23-09:23:38.684442 139957559264832 [compaction_job.cc:1948] [default] [JOB 23454] Generated table #254052: 921026 keys, 37445760 bytes, temperature: kWarm 2024/11/23-09:23:38.684520 139957559264832 EVENT_LOG_v1 {"time_micros": 1732325018684474, "cf_name": "default", "job": 23454, "event": "table_file_creation", "file_number": 254052, "file_size": 37445760, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3873076030, "table_properties": {"data_size": 31791856, "index_size": 1763904, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25788728, "raw_average_key_size": 28, "raw_value_size": 108429104, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 921026, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732325015, "oldest_key_time": 0, "file_creation_time": 1732325015, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 254052, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-09:23:38.717774 139957559264832 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254053.sst) /dev/shm/ToplingTemp/Topling-11837-PXNy5e 2024/11/23-09:23:39.628093 139957559264832 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254053.sst): first pass time = 0.91's, 147.446'MB/sec 2024/11/23-09:23:40.928649 139957559264832 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254053.sst): old prealloc_size = 147639500, real_size = 33130704 2024/11/23-09:23:40.929207 139957559264832 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254053.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 929503 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0311 GB avg-val = 116.40 avg-zval = 33.49 2024/11/23-09:23:40.930019 139957559264832 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254053.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-09:23:41.790399 139957559264832 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254053.sst): second pass time = 1.30's, 83.237'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.86's, 43.347'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3301.823'MB/sec (index lex order gen) rebuild zvType time = 0.74's, 0.315'MB/sec write SST data time = 0.12's, 304.234'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 36443.364'MB/sec zip my value time = 1.30's, unzip length = 0.108'GB zip my value throughput = 83.237'MB/sec zip pipeline throughput = 83.237'MB/sec entries = 929503 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.40 avg-zval = 33.49 usrkeys = 929503 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.40 avg-zval = 33.49 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 929503 bytes = 3369456 } seq expand size = 6506521 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0311 GB dict = 1.08 MB all = 0.0374 GB } UnZip/Zip{ index = 10.5136 value = 3.4755 dict = 1.00 all = 3.5932 } Zip/UnZip{ index = 0.0951 value = 0.2877 dict = 1.00 all = 0.2783 } ---------------------------- total value len = 9.982806 GB avg = 0.162 KB (by entry num) total key len = 1.705186 GB avg = 0.028 KB total ukey len = 1.186710 GB avg = 0.016 KB total ukey num = 0.074992026 Billion total entry num = 0.061799755 Billion write speed all = 6.836778840 MB/sec (with seq num) write speed all = 6.547585429 MB/sec (without seq num) 2024/11/23-09:23:41.837030 139957559264832 [compaction_job.cc:1948] [default] [JOB 23454] Generated table #254053: 929503 keys, 37353032 bytes, temperature: kWarm 2024/11/23-09:23:41.837097 139957559264832 EVENT_LOG_v1 {"time_micros": 1732325021837060, "cf_name": "default", "job": 23454, "event": "table_file_creation", "file_number": 254053, "file_size": 37353032, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3487497056, "largest_seqno": 3904584765, "table_properties": {"data_size": 31129984, "index_size": 1768192, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26026084, "raw_average_key_size": 28, "raw_value_size": 108191738, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 929503, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732325018, "oldest_key_time": 0, "file_creation_time": 1732325018, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 254053, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-09:23:41.874645 139957559264832 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254054.sst) /dev/shm/ToplingTemp/Topling-11837-eVjo0f 2024/11/23-09:23:42.883049 139957559264832 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254054.sst): first pass time = 1.01's, 133.104'MB/sec 2024/11/23-09:23:44.180500 139957559264832 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254054.sst): old prealloc_size = 147639500, real_size = 33165120 2024/11/23-09:23:44.181068 139957559264832 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254054.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 929440 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0312 GB avg-val = 116.41 avg-zval = 33.53 2024/11/23-09:23:44.182032 139957559264832 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254054.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-09:23:45.043444 139957559264832 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254054.sst): second pass time = 1.30's, 83.472'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.86's, 43.057'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3228.724'MB/sec (index lex order gen) rebuild zvType time = 0.74's, 0.314'MB/sec write SST data time = 0.12's, 304.493'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 34562.610'MB/sec zip my value time = 1.30's, unzip length = 0.108'GB zip my value throughput = 83.472'MB/sec zip pipeline throughput = 83.472'MB/sec entries = 929440 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.41 avg-zval = 33.53 usrkeys = 929440 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.41 avg-zval = 33.53 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 929440 bytes = 3136880 } seq expand size = 6506080 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0312 GB dict = 1.08 MB all = 0.0372 GB } UnZip/Zip{ index = 10.5125 value = 3.4717 dict = 1.00 all = 3.6124 } Zip/UnZip{ index = 0.0951 value = 0.2880 dict = 1.00 all = 0.2768 } ---------------------------- total value len = 10.097505 GB avg = 0.161 KB (by entry num) total key len = 1.731210 GB avg = 0.028 KB total ukey len = 1.205299 GB avg = 0.016 KB total ukey num = 0.075921466 Billion total entry num = 0.062729195 Billion write speed all = 6.905953038 MB/sec (with seq num) write speed all = 6.612967795 MB/sec (without seq num) 2024/11/23-09:23:45.091604 139957559264832 [compaction_job.cc:1948] [default] [JOB 23454] Generated table #254054: 929440 keys, 37154966 bytes, temperature: kWarm 2024/11/23-09:23:45.091673 139957559264832 EVENT_LOG_v1 {"time_micros": 1732325025091637, "cf_name": "default", "job": 23454, "event": "table_file_creation", "file_number": 254054, "file_size": 37154966, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3807172320, "largest_seqno": 3904584775, "table_properties": {"data_size": 31164336, "index_size": 1768256, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26024320, "raw_average_key_size": 28, "raw_value_size": 108193520, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 929440, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732325021, "oldest_key_time": 0, "file_creation_time": 1732325021, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 254054, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-09:23:45.125758 139957559264832 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254055.sst) /dev/shm/ToplingTemp/Topling-11837-O5D4Af 2024/11/23-09:23:46.002989 139957559264832 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254055.sst): first pass time = 0.88's, 153.011'MB/sec 2024/11/23-09:23:47.304007 139957559264832 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254055.sst): old prealloc_size = 147639500, real_size = 33341424 2024/11/23-09:23:47.304529 139957559264832 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254055.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 929576 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0313 GB avg-val = 116.39 avg-zval = 33.71 2024/11/23-09:23:47.305349 139957559264832 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254055.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-09:23:48.153964 139957559264832 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254055.sst): second pass time = 1.30's, 83.223'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.85's, 44.332'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3553.213'MB/sec (index lex order gen) rebuild zvType time = 0.73's, 0.319'MB/sec write SST data time = 0.12's, 311.721'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 33340.498'MB/sec zip my value time = 1.30's, unzip length = 0.108'GB zip my value throughput = 83.223'MB/sec zip pipeline throughput = 83.223'MB/sec entries = 929576 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.39 avg-zval = 33.71 usrkeys = 929576 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.39 avg-zval = 33.71 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 929576 bytes = 3485920 } seq expand size = 6507032 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0313 GB dict = 1.08 MB all = 0.0377 GB } UnZip/Zip{ index = 10.5110 value = 3.4521 dict = 1.00 all = 3.5620 } Zip/UnZip{ index = 0.0951 value = 0.2897 dict = 1.00 all = 0.2807 } ---------------------------- total value len = 10.212202 GB avg = 0.160 KB (by entry num) total key len = 1.757238 GB avg = 0.028 KB total ukey len = 1.223890 GB avg = 0.016 KB total ukey num = 0.076851042 Billion total entry num = 0.063658771 Billion write speed all = 6.975444829 MB/sec (with seq num) write speed all = 6.678656846 MB/sec (without seq num) 2024/11/23-09:23:48.202267 139957559264832 [compaction_job.cc:1948] [default] [JOB 23454] Generated table #254055: 929576 keys, 37680316 bytes, temperature: kWarm 2024/11/23-09:23:48.202336 139957559264832 EVENT_LOG_v1 {"time_micros": 1732325028202300, "cf_name": "default", "job": 23454, "event": "table_file_creation", "file_number": 254055, "file_size": 37680316, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3273701103, "largest_seqno": 3904584793, "table_properties": {"data_size": 31340064, "index_size": 1768768, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26028128, "raw_average_key_size": 28, "raw_value_size": 108189632, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 929576, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732325025, "oldest_key_time": 0, "file_creation_time": 1732325025, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 254055, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-09:23:48.236453 139957559264832 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254056.sst) /dev/shm/ToplingTemp/Topling-11837-5LFXVh 2024/11/23-09:23:49.249477 139957559264832 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254056.sst): first pass time = 1.01's, 132.498'MB/sec 2024/11/23-09:23:50.553215 139957559264832 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254056.sst): old prealloc_size = 147639500, real_size = 32912144 2024/11/23-09:23:50.553728 139957559264832 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254056.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 929798 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1082 GB zip-val = 0.0309 GB avg-val = 116.35 avg-zval = 33.23 2024/11/23-09:23:50.554537 139957559264832 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254056.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-09:23:51.400702 139957559264832 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254056.sst): second pass time = 1.30's, 83.031'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.85's, 43.682'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3636.364'MB/sec (index lex order gen) rebuild zvType time = 0.73's, 0.321'MB/sec write SST data time = 0.12's, 303.709'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 35378.065'MB/sec zip my value time = 1.30's, unzip length = 0.108'GB zip my value throughput = 83.031'MB/sec zip pipeline throughput = 83.031'MB/sec entries = 929798 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.35 avg-zval = 33.23 usrkeys = 929798 avg-key = 20.00 avg-zkey = 1.91 avg-val = 123.35 avg-zval = 33.23 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 929798 bytes = 3254304 } seq expand size = 6508586 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0309 GB dict = 1.08 MB all = 0.0370 GB } UnZip/Zip{ index = 10.4444 value = 3.5012 dict = 1.00 all = 3.6256 } Zip/UnZip{ index = 0.0957 value = 0.2856 dict = 1.00 all = 0.2758 } ---------------------------- total value len = 10.326894 GB avg = 0.160 KB (by entry num) total key len = 1.783272 GB avg = 0.028 KB total ukey len = 1.242486 GB avg = 0.016 KB total ukey num = 0.077780840 Billion total entry num = 0.064588569 Billion write speed all = 7.044127900 MB/sec (with seq num) write speed all = 6.743573721 MB/sec (without seq num) 2024/11/23-09:23:51.446582 139957559264832 [compaction_job.cc:1948] [default] [JOB 23454] Generated table #254056: 929798 keys, 37019106 bytes, temperature: kWarm 2024/11/23-09:23:51.446651 139957559264832 EVENT_LOG_v1 {"time_micros": 1732325031446614, "cf_name": "default", "job": 23454, "event": "table_file_creation", "file_number": 254056, "file_size": 37019106, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3680980241, "largest_seqno": 3904584803, "table_properties": {"data_size": 30899008, "index_size": 1780480, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26034344, "raw_average_key_size": 28, "raw_value_size": 108183508, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 929798, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732325028, "oldest_key_time": 0, "file_creation_time": 1732325028, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 254056, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-09:23:51.480087 139957559264832 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254057.sst) /dev/shm/ToplingTemp/Topling-11837-wZXrhe 2024/11/23-09:23:52.498821 139957559264832 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254057.sst): first pass time = 1.02's, 131.755'MB/sec 2024/11/23-09:23:53.778382 139957559264832 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254057.sst): old prealloc_size = 147639500, real_size = 33062096 2024/11/23-09:23:53.778950 139957559264832 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254057.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 929573 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0311 GB avg-val = 116.39 avg-zval = 33.41 2024/11/23-09:23:53.779759 139957559264832 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254057.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-09:23:54.631924 139957559264832 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254057.sst): second pass time = 1.28's, 84.598'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.85's, 43.684'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3290.052'MB/sec (index lex order gen) rebuild zvType time = 0.73's, 0.318'MB/sec write SST data time = 0.12's, 303.320'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 34839.513'MB/sec zip my value time = 1.28's, unzip length = 0.108'GB zip my value throughput = 84.598'MB/sec zip pipeline throughput = 84.598'MB/sec entries = 929573 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.39 avg-zval = 33.41 usrkeys = 929573 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.39 avg-zval = 33.41 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 929573 bytes = 3369712 } seq expand size = 6507011 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0311 GB dict = 1.08 MB all = 0.0373 GB } UnZip/Zip{ index = 10.5117 value = 3.4832 dict = 1.00 all = 3.5998 } Zip/UnZip{ index = 0.0951 value = 0.2871 dict = 1.00 all = 0.2778 } ---------------------------- total value len = 10.441591 GB avg = 0.159 KB (by entry num) total key len = 1.809300 GB avg = 0.028 KB total ukey len = 1.261078 GB avg = 0.016 KB total ukey num = 0.078710413 Billion total entry num = 0.065518142 Billion write speed all = 7.112615199 MB/sec (with seq num) write speed all = 6.808307326 MB/sec (without seq num) 2024/11/23-09:23:54.677810 139957559264832 [compaction_job.cc:1948] [default] [JOB 23454] Generated table #254057: 929573 keys, 37284772 bytes, temperature: kWarm 2024/11/23-09:23:54.677877 139957559264832 EVENT_LOG_v1 {"time_micros": 1732325034677841, "cf_name": "default", "job": 23454, "event": "table_file_creation", "file_number": 254057, "file_size": 37284772, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3369194706, "largest_seqno": 3904584819, "table_properties": {"data_size": 31060864, "index_size": 1768640, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26028044, "raw_average_key_size": 28, "raw_value_size": 108189774, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 929573, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732325031, "oldest_key_time": 0, "file_creation_time": 1732325031, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 254057, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-09:23:54.711757 139957559264832 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254058.sst) /dev/shm/ToplingTemp/Topling-11837-Rixtug 2024/11/23-09:23:55.715951 139957559264832 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254058.sst): first pass time = 1.00's, 133.663'MB/sec 2024/11/23-09:23:56.987703 139957559264832 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254058.sst): old prealloc_size = 147639500, real_size = 30610752 2024/11/23-09:23:56.988232 139957559264832 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254058.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927960 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.93 raw-val = 0.1082 GB zip-val = 0.0286 GB avg-val = 116.64 avg-zval = 30.81 2024/11/23-09:23:56.989007 139957559264832 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254058.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-09:23:57.801031 139957559264832 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254058.sst): second pass time = 1.27's, 85.184'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.81's, 42.679'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3531.307'MB/sec (index lex order gen) rebuild zvType time = 0.69's, 0.336'MB/sec write SST data time = 0.12's, 282.876'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 29344.890'MB/sec zip my value time = 1.27's, unzip length = 0.108'GB zip my value throughput = 85.184'MB/sec zip pipeline throughput = 85.184'MB/sec entries = 927960 avg-key = 28.00 avg-zkey = 1.93 avg-val = 116.64 avg-zval = 30.81 usrkeys = 927960 avg-key = 20.00 avg-zkey = 1.93 avg-val = 123.64 avg-zval = 30.81 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 927960 bytes = 3247872 } seq expand size = 6495720 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0286 GB dict = 1.08 MB all = 0.0347 GB } UnZip/Zip{ index = 10.3771 value = 3.7857 dict = 1.00 all = 3.8668 } Zip/UnZip{ index = 0.0964 value = 0.2641 dict = 1.00 all = 0.2586 } ---------------------------- total value len = 10.556321 GB avg = 0.159 KB (by entry num) total key len = 1.835283 GB avg = 0.028 KB total ukey len = 1.279637 GB avg = 0.016 KB total ukey num = 0.079638373 Billion total entry num = 0.066446102 Billion write speed all = 7.181097970 MB/sec (with seq num) write speed all = 6.873046847 MB/sec (without seq num) 2024/11/23-09:23:57.844518 139957559264832 [compaction_job.cc:1948] [default] [JOB 23454] Generated table #254058: 927960 keys, 34710652 bytes, temperature: kWarm 2024/11/23-09:23:57.844585 139957559264832 EVENT_LOG_v1 {"time_micros": 1732325037844549, "cf_name": "default", "job": 23454, "event": "table_file_creation", "file_number": 254058, "file_size": 34710652, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3690768748, "largest_seqno": 3904584829, "table_properties": {"data_size": 28590128, "index_size": 1788480, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25982880, "raw_average_key_size": 28, "raw_value_size": 108234852, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927960, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732325034, "oldest_key_time": 0, "file_creation_time": 1732325034, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 254058, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-09:23:57.878372 139957559264832 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254059.sst) /dev/shm/ToplingTemp/Topling-11837-hxvyqe 2024/11/23-09:23:58.879736 139957559264832 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254059.sst): first pass time = 1.00's, 134.040'MB/sec 2024/11/23-09:24:00.169161 139957559264832 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254059.sst): old prealloc_size = 147639500, real_size = 33136576 2024/11/23-09:24:00.169746 139957559264832 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254059.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 933579 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1081 GB zip-val = 0.0311 GB avg-val = 115.77 avg-zval = 33.34 2024/11/23-09:24:00.171233 139957559264832 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254059.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-09:24:01.021590 139957559264832 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254059.sst): second pass time = 1.29's, 83.872'MB/sec, value only(80.5% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.85's, 43.843'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3164.178'MB/sec (index lex order gen) rebuild zvType time = 0.73's, 0.321'MB/sec write SST data time = 0.13's, 297.198'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 18496.741'MB/sec zip my value time = 1.29's, unzip length = 0.108'GB zip my value throughput = 83.872'MB/sec zip pipeline throughput = 83.872'MB/sec entries = 933579 avg-key = 28.00 avg-zkey = 1.90 avg-val = 115.77 avg-zval = 33.34 usrkeys = 933579 avg-key = 20.00 avg-zkey = 1.90 avg-val = 122.77 avg-zval = 33.34 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 933579 bytes = 3384240 } seq expand size = 6535053 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0187 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0311 GB dict = 1.08 MB all = 0.0374 GB } UnZip/Zip{ index = 10.5137 value = 3.4721 dict = 1.00 all = 3.5914 } Zip/UnZip{ index = 0.0951 value = 0.2880 dict = 1.00 all = 0.2784 } ---------------------------- total value len = 10.670934 GB avg = 0.158 KB (by entry num) total key len = 1.861424 GB avg = 0.028 KB total ukey len = 1.298308 GB avg = 0.016 KB total ukey num = 0.080571952 Billion total entry num = 0.067379681 Billion write speed all = 7.249136560 MB/sec (with seq num) write speed all = 6.937339195 MB/sec (without seq num) 2024/11/23-09:24:01.067084 139957559264832 [compaction_job.cc:1948] [default] [JOB 23454] Generated table #254059: 933579 keys, 37371688 bytes, temperature: kWarm 2024/11/23-09:24:01.067150 139957559264832 EVENT_LOG_v1 {"time_micros": 1732325041067115, "cf_name": "default", "job": 23454, "event": "table_file_creation", "file_number": 254059, "file_size": 37371688, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3514720078, "largest_seqno": 3904584857, "table_properties": {"data_size": 31127088, "index_size": 1775936, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26140212, "raw_average_key_size": 28, "raw_value_size": 108077602, "raw_average_value_size": 115, "num_data_blocks": 1, "num_entries": 933579, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732325037, "oldest_key_time": 0, "file_creation_time": 1732325037, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 254059, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-09:24:01.103311 139957559264832 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254060.sst) /dev/shm/ToplingTemp/Topling-11837-1bCjTf 2024/11/23-09:24:02.096554 139957559264832 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254060.sst): first pass time = 0.99's, 135.136'MB/sec 2024/11/23-09:24:03.383296 139957559264832 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254060.sst): old prealloc_size = 147639500, real_size = 31930480 2024/11/23-09:24:03.383862 139957559264832 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254060.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 933308 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1081 GB zip-val = 0.0299 GB avg-val = 115.81 avg-zval = 32.06 2024/11/23-09:24:03.385325 139957559264832 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254060.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-09:24:04.225101 139957559264832 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254060.sst): second pass time = 1.29's, 84.064'MB/sec, value only(80.5% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.84's, 42.962'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3249.392'MB/sec (index lex order gen) rebuild zvType time = 0.72's, 0.325'MB/sec write SST data time = 0.12's, 291.340'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 38302.569'MB/sec zip my value time = 1.29's, unzip length = 0.108'GB zip my value throughput = 84.064'MB/sec zip pipeline throughput = 84.064'MB/sec entries = 933308 avg-key = 28.00 avg-zkey = 1.90 avg-val = 115.81 avg-zval = 32.06 usrkeys = 933308 avg-key = 20.00 avg-zkey = 1.90 avg-val = 122.81 avg-zval = 32.06 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 933308 bytes = 3383264 } seq expand size = 6533156 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0187 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0299 GB dict = 1.08 MB all = 0.0362 GB } UnZip/Zip{ index = 10.5117 value = 3.6123 dict = 1.00 all = 3.7113 } Zip/UnZip{ index = 0.0951 value = 0.2768 dict = 1.00 all = 0.2694 } ---------------------------- total value len = 10.785552 GB avg = 0.158 KB (by entry num) total key len = 1.887556 GB avg = 0.028 KB total ukey len = 1.316975 GB avg = 0.016 KB total ukey num = 0.081505260 Billion total entry num = 0.068312989 Billion write speed all = 7.316993102 MB/sec (with seq num) write speed all = 7.001461568 MB/sec (without seq num) 2024/11/23-09:24:04.270015 139957559264832 [compaction_job.cc:1948] [default] [JOB 23454] Generated table #254060: 933308 keys, 36164148 bytes, temperature: kWarm 2024/11/23-09:24:04.270080 139957559264832 EVENT_LOG_v1 {"time_micros": 1732325044270046, "cf_name": "default", "job": 23454, "event": "table_file_creation", "file_number": 254060, "file_size": 36164148, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3516470397, "largest_seqno": 3904584874, "table_properties": {"data_size": 29921248, "index_size": 1775744, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26132624, "raw_average_key_size": 28, "raw_value_size": 108085140, "raw_average_value_size": 115, "num_data_blocks": 1, "num_entries": 933308, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732325041, "oldest_key_time": 0, "file_creation_time": 1732325041, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 254060, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-09:24:04.303496 139957559264832 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254061.sst) /dev/shm/ToplingTemp/Topling-11837-3HNXuf 2024/11/23-09:24:04.587340 139957559264832 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254061.sst): first pass time = 0.28's, 252.768'MB/sec 2024/11/23-09:24:05.296867 139957559264832 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254061.sst): old prealloc_size = 147639500, real_size = 19369984 2024/11/23-09:24:05.297209 139957559264832 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254061.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 496848 prefix = 4 raw-key = 0.0079 GB zip-key = 0.0009 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.0578 GB zip-val = 0.0183 GB avg-val = 116.39 avg-zval = 36.83 2024/11/23-09:24:05.297618 139957559264832 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254061.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0012 GB, waited 0.000 sec, Key+Value = 0.072 GB 2024/11/23-09:24:05.724992 139957559264832 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00/254061.sst): second pass time = 0.71's, 81.575'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.43's, 49.743'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2923.752'MB/sec (index lex order gen) rebuild zvType time = 0.36's, 0.346'MB/sec write SST data time = 0.07's, 310.403'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.578'MB, throughput = 20133.677'MB/sec zip my value time = 0.71's, unzip length = 0.058'GB zip my value throughput = 81.575'MB/sec zip pipeline throughput = 81.575'MB/sec entries = 496848 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.39 avg-zval = 36.83 usrkeys = 496848 avg-key = 20.00 avg-zkey = 1.90 avg-val = 121.77 avg-zval = 36.83 TagRS{ kinds = RS_Key0_TagN bytes = 77720 } TagArray{ size = 382480 bytes = 1386512 } seq expand size = 2677360 multi value expand size = 0 cnt WriteAppend = 15 UnZipSize{ index = 0.0099 GB value = 0.0578 GB dict = 0.58 MB all = 0.0717 GB } __ZipSize{ index = 0.0009 GB value = 0.0183 GB dict = 0.58 MB all = 0.0213 GB } UnZip/Zip{ index = 10.5022 value = 3.1600 dict = 1.00 all = 3.3689 } Zip/UnZip{ index = 0.0952 value = 0.3165 dict = 1.00 all = 0.2968 } ---------------------------- total value len = 10.846056 GB avg = 0.158 KB (by entry num) total key len = 1.901468 GB avg = 0.028 KB total ukey len = 1.326911 GB avg = 0.016 KB total ukey num = 0.082002108 Billion total entry num = 0.068809837 Billion write speed all = 7.353589671 MB/sec (with seq num) write speed all = 7.036038233 MB/sec (without seq num) 2024/11/23-09:24:05.754055 139957559264832 [compaction_job.cc:1948] [default] [JOB 23454] Generated table #254061: 496848 keys, 21294087 bytes, temperature: kWarm 2024/11/23-09:24:05.754126 139957559264832 EVENT_LOG_v1 {"time_micros": 1732325045754088, "cf_name": "default", "job": 23454, "event": "table_file_creation", "file_number": 254061, "file_size": 21294087, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3904584886, "table_properties": {"data_size": 18299440, "index_size": 946176, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 13911744, "raw_average_key_size": 28, "raw_value_size": 57826012, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 496848, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732325044, "oldest_key_time": 0, "file_creation_time": 1732325044, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 254061, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-09:24:05.771760 139957559264832 [compaction_job.cc:703] job-23454: subcompact[0], size: 0.640717 G, files: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-23454/att-00 [254044,254045,254046,254047,254048,254049,254050,254051,254052,254053,254054,254055,254056,254057,254058,254059,254060,254061] 2024/11/23-09:24:05.868219 139957559264832 (Original Log Time 2024/11/23-09:23:10.163250) EVENT_LOG_v1 {"time_micros": 1732324990163226, "job": 23454, "event": "compaction_started", "compaction_reason": "FilesMarkedForCompaction", "files_L2": [253983], "files_L3": [254040, 254041, 253905, 253906, 253907, 253908, 253909, 253910, 253911, 253912, 253913, 253914, 253915, 253916, 253917, 253933, 253934, 254022], "score": 0.9984, "input_data_size": 666843791, "oldest_snapshot_seqno": 3904900804} 2024/11/23-09:24:05.868223 139957559264832 (Original Log Time 2024/11/23-09:24:05.866751) [compaction_job.cc:2022] [default] [JOB 23454] Compacted 1@2 + 18@3 files to L3 => 640716712 bytes 2024/11/23-09:24:05.868224 139957559264832 (Original Log Time 2024/11/23-09:24:05.868155) [compaction_job.cc:1224] [default] compacted to: files[0 0 0 18 0 0 0] max score 0.02, MB/sec: 12.0 rd, 11.5 wr, level 3, files in(1, 18) out(18 +0 blob) MB in(27.1, 608.8 +0.0 blob) out(611.0 +0.0 blob), read-write-amplify(46.0) write-amplify(22.5) OK, records in: 16538801, records dropped: 87128 output_compression: Snappy 2024/11/23-09:24:05.868230 139957559264832 (Original Log Time 2024/11/23-09:24:05.868199) EVENT_LOG_v1 {"time_micros": 1732325045868177, "cf": "default", "job": 23454, "event": "compaction_finished", "compaction_time_micros": 55608518, "compaction_time_cpu_micros": 24163587, "output_level": 3, "num_output_files": 18, "total_output_size": 640716712, "num_input_records": 16538801, "num_output_records": 16451673, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "file_write_nanos": 423703659, "file_range_sync_nanos": 0, "file_fsync_nanos": 13438, "file_prepare_write_nanos": 49098, "lsm_state": [0, 0, 0, 18, 0, 0, 0]} 2024/11/23-09:24:05.997108 139957559264832 DEBG dcompact_worker.cpp:240: HttpPost: 200 OK: url = http://nlb-7zny4kaa1poal01o64.cn-shenzhen.nlb.aliyuncs.com:8443, body = {"instanceId":"nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137","labourId":"","dbId":"d89b4006-2803-486e-b7a2-759bcf348921","dbStarts":1732256054,"starts":1732324989,"executesMs":55851,"compactionJobId":23454,"attempt":0,"compactionInputRawBytes":2365812603,"compactionInputZipBytes":666843791,"compactionOutputRawBytes":0,"compactionOutputZipBytes":640716712,"headers":{"Accept":"*/*","Connection":"close","Host":"aliyun-topling-saas.topling.cn:18443","RemoteIp":"120.24.192.169","X-Forwarded-For":"120.24.192.169","region":"cn-shenzhen","token":"e6474c481bd4415abc537135cc03626b","instance-token":"e6474c481bd4415abc537135cc03626b","provider":"aliyun","CloudMarketInstanceId":"si-59c0ae5c955845588903","MeteringAssit":"","Transfer-Encoding":"chunked","traceparent":"00-5dfebceab7cd9bea7cf643d13b6c4284-af9dba49f5acee20-00"}}, response = 2024/11/23-09:24:05.997197 139957559264832 INFO dcompact_worker.cpp:1459: finish /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-23454/att-00: olev 3, work 55.852 s, result 7.856 ms, install 1.497 ms, input{raw 2.203 GiB zip 635.952 MiB}