2024/11/23-16:30:02.161170 139957424981568 DEBG dcompact_worker.cpp:2214: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00: fork to child time = 0.008411 sec 2024/11/23-16:30:02.161944 139957424981568 DEBG dcompact_worker.cpp:1013: Beg SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00 2024/11/23-16:30:02.170078 139957424981568 DEBG dcompact_worker.cpp:1033: End SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00 2024/11/23-16:30:02.170989 139957424981568 TRAC dcompact_worker.cpp:1083: INFO_LOG_LEVEL: rpc = INFO_LEVEL, env_var = undefined 2024/11/23-16:30:02.171264 139957424981568 [WARN] [column_family.cc:386] multiple cf_paths/db_paths and level_compaction_dynamic_level_bytes can't be used together 2024/11/23-16:30:02.226235 139957424981568 [version_set.cc:6208] Recovering from manifest file: /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-30694/att-00/MANIFEST-206347 2024/11/23-16:30:02.258433 139957424981568 [version_set.cc:6251] Recovered from manifest file:/worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-30694/att-00/MANIFEST-206347 succeeded,manifest_file_number is 206347, next_file_number is 269591, last_sequence is 4110720482, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 269455 2024/11/23-16:30:02.258443 139957424981568 [version_set.cc:6266] Column family [default] (ID 0), log number is 0 2024/11/23-16:30:02.258555 139957424981568 [version_set.cc:5721] Creating manifest 269591 2024/11/23-16:30:02.295467 139957424981568 DEBG dcompact_worker.cpp:1218: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00: bottommost_level: fake = 1, rpc = 0 2024/11/23-16:30:02.319639 139957424981568 [compaction_job.cc:2437] [default] [JOB 30694] Compacting 1@2 + 21@3 files to L3, score 1.00, subcompactions 1 : 1 2024/11/23-16:30:02.319658 139957424981568 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 22949 Base level 2, inputs: [269585(31MB)], [269512(40MB) 269513(40MB) 269514(40MB) 269515(40MB) 269516(40MB) 269517(40MB) 269518(40MB) 269519(40MB) 269520(40MB) 269521(40MB) 269522(40MB) 269523(40MB) 269524(40MB) 269525(39MB) 269526(40MB) 269527(40MB) 269528(40MB) 269529(40MB) 269530(40MB) 269531(39MB) 269532(40MB)] 2024/11/23-16:30:02.326995 139957424981568 [top_zip_table.cc:59] core git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-16:30:02.327020 139957424981568 [top_zip_table.cc:60] fsa git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-16:30:02.327035 139957424981568 [top_zip_table.cc:61] zbs git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-16:30:02.327041 139957424981568 [top_zip_table.cc:62] topling-zip_table_reader: git_version_hash_info_is: commit a4a382006cb82713acf5b3425835f22711877681 Author: leipeng Date: 2024-04-11 19:44:14 +0800 fixed_len_hole_index.cc: Add env bool FixedLenHoleIndexUseAVX512 for ut & debug 1. FixedLenHoleIndexUseAVX512 is only in unit tests or debug 2. In release mode, use avx512 by compile options(-march=) g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/23-16:30:02.327051 139957424981568 [top_zip_table.cc:64] topling-rocks git_version_hash_info_is: commit feab587e468621ba0204d47b4ffacc52e7c4290d Author: leipeng Date: 2024-03-22 13:35:06 +0800 ToplingZipTableBuilder::Add: immediately return after error This function returns void, and caller does not check builder->status() after calling this function and graceful abandon. So immediately return after error, and return error status in Finish(). g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/23-16:30:02.991031 139957424981568 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269592.sst) /dev/shm/ToplingTemp/Topling-114559-pVzXtA 2024/11/23-16:30:03.317088 139957424981568 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269592.sst): first pass time = 0.33's, 411.700'MB/sec 2024/11/23-16:30:04.241047 139957424981568 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269592.sst): old prealloc_size = 147639500, real_size = 40630848 2024/11/23-16:30:04.241207 139957424981568 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269592.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129431 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.81 raw-val = 0.1316 GB zip-val = 0.0404 GB avg-val =1016.99 avg-zval = 311.86 2024/11/23-16:30:04.241447 139957424981568 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269592.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:30:04.572986 139957424981568 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269592.sst): second pass time = 0.92's, 142.824'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.33's, 127.938'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1640.116'MB/sec (index lex order gen) rebuild zvType time = 0.22's, 0.148'MB/sec write SST data time = 0.11's, 376.858'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 49226.963'MB/sec zip my value time = 0.92's, unzip length = 0.132'GB zip my value throughput = 142.824'MB/sec zip pipeline throughput = 142.824'MB/sec entries = 129431 avg-key = 20.00 avg-zkey = 1.81 avg-val = 1016.99 avg-zval = 311.86 usrkeys = 129431 avg-key = 12.00 avg-zkey = 1.81 avg-val = 1023.99 avg-zval = 311.86 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129431 bytes = 485376 } seq expand size = 906017 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0404 GB dict = 1.38 MB all = 0.0425 GB } UnZip/Zip{ index = 6.6470 value = 3.2610 dict = 1.00 all = 3.1608 } Zip/UnZip{ index = 0.1504 value = 0.3067 dict = 1.00 all = 0.3164 } ---------------------------- total value len = 8.981156 GB avg = 0.171 KB (by entry num) total key len = 1.443410 GB avg = 0.028 KB total ukey len = 0.999431 GB avg = 0.015 KB total ukey num = 0.065679866 Billion total entry num = 0.052487595 Billion write speed all = 0.381959125 MB/sec (with seq num) write speed all = 0.366573838 MB/sec (without seq num) 2024/11/23-16:30:04.631781 139957424981568 [compaction_job.cc:1948] [default] [JOB 30694] Generated table #269592: 129431 keys, 42463346 bytes, temperature: kWarm 2024/11/23-16:30:04.631897 139957424981568 EVENT_LOG_v1 {"time_micros": 1732350604631820, "cf_name": "default", "job": 30694, "event": "table_file_creation", "file_number": 269592, "file_size": 42463346, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237877277, "largest_seqno": 4110666839, "table_properties": {"data_size": 40364656, "index_size": 233664, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588620, "raw_average_key_size": 20, "raw_value_size": 131629795, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129431, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732350602, "oldest_key_time": 0, "file_creation_time": 1732350602, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 269592, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:30:04.710555 139957424981568 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269593.sst) /dev/shm/ToplingTemp/Topling-114559-aBrsJD 2024/11/23-16:30:05.389617 139957424981568 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269593.sst): first pass time = 0.68's, 197.666'MB/sec 2024/11/23-16:30:06.329027 139957424981568 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269593.sst): old prealloc_size = 147639500, real_size = 40855632 2024/11/23-16:30:06.329155 139957424981568 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269593.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129432 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.75 raw-val = 0.1316 GB zip-val = 0.0406 GB avg-val =1016.98 avg-zval = 313.66 2024/11/23-16:30:06.329315 139957424981568 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269593.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:30:06.497171 139957424981568 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269593.sst): second pass time = 0.94's, 140.217'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.17's, 253.916'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2125.270'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.269'MB/sec write SST data time = 0.05's, 897.615'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 49761.827'MB/sec zip my value time = 0.94's, unzip length = 0.132'GB zip my value throughput = 140.217'MB/sec zip pipeline throughput = 140.318'MB/sec entries = 129432 avg-key = 20.00 avg-zkey = 1.75 avg-val = 1016.98 avg-zval = 313.66 usrkeys = 129432 avg-key = 12.00 avg-zkey = 1.75 avg-val = 1023.98 avg-zval = 313.66 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129432 bytes = 485392 } seq expand size = 906024 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0406 GB dict = 1.38 MB all = 0.0427 GB } UnZip/Zip{ index = 6.8710 value = 3.2423 dict = 1.00 all = 3.1441 } Zip/UnZip{ index = 0.1455 value = 0.3084 dict = 1.00 all = 0.3181 } ---------------------------- total value len = 9.113691 GB avg = 0.173 KB (by entry num) total key len = 1.445998 GB avg = 0.027 KB total ukey len = 1.000984 GB avg = 0.015 KB total ukey num = 0.065809298 Billion total entry num = 0.052617027 Billion write speed all = 0.386882839 MB/sec (with seq num) write speed all = 0.371460700 MB/sec (without seq num) 2024/11/23-16:30:06.552105 139957424981568 [compaction_job.cc:1948] [default] [JOB 30694] Generated table #269593: 129432 keys, 42688304 bytes, temperature: kWarm 2024/11/23-16:30:06.552181 139957424981568 EVENT_LOG_v1 {"time_micros": 1732350606552139, "cf_name": "default", "job": 30694, "event": "table_file_creation", "file_number": 269593, "file_size": 42688304, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237868195, "largest_seqno": 4110690042, "table_properties": {"data_size": 40597056, "index_size": 226048, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588640, "raw_average_key_size": 20, "raw_value_size": 131629529, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129432, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732350604, "oldest_key_time": 0, "file_creation_time": 1732350604, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 269593, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:30:06.601090 139957424981568 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269594.sst) /dev/shm/ToplingTemp/Topling-114559-FAb1kB 2024/11/23-16:30:07.182685 139957424981568 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269594.sst): first pass time = 0.58's, 230.789'MB/sec 2024/11/23-16:30:08.068255 139957424981568 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269594.sst): old prealloc_size = 147639500, real_size = 40588304 2024/11/23-16:30:08.068379 139957424981568 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269594.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129432 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.81 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1016.98 avg-zval = 311.53 2024/11/23-16:30:08.068535 139957424981568 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269594.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:30:08.234364 139957424981568 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269594.sst): second pass time = 0.88's, 148.747'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.17's, 255.398'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2351.964'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.273'MB/sec write SST data time = 0.05's, 894.672'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 40081.236'MB/sec zip my value time = 0.88's, unzip length = 0.132'GB zip my value throughput = 148.747'MB/sec zip pipeline throughput = 148.747'MB/sec entries = 129432 avg-key = 20.00 avg-zkey = 1.81 avg-val = 1016.98 avg-zval = 311.53 usrkeys = 129432 avg-key = 12.00 avg-zkey = 1.81 avg-val = 1023.98 avg-zval = 311.53 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129432 bytes = 485392 } seq expand size = 906024 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0424 GB } UnZip/Zip{ index = 6.6253 value = 3.2645 dict = 1.00 all = 3.1640 } Zip/UnZip{ index = 0.1509 value = 0.3063 dict = 1.00 all = 0.3161 } ---------------------------- total value len = 9.246226 GB avg = 0.175 KB (by entry num) total key len = 1.448587 GB avg = 0.027 KB total ukey len = 1.002538 GB avg = 0.015 KB total ukey num = 0.065938730 Billion total entry num = 0.052746459 Billion write speed all = 0.391808528 MB/sec (with seq num) write speed all = 0.376349436 MB/sec (without seq num) 2024/11/23-16:30:08.288779 139957424981568 [compaction_job.cc:1948] [default] [JOB 30694] Generated table #269594: 129432 keys, 42420623 bytes, temperature: kWarm 2024/11/23-16:30:08.288845 139957424981568 EVENT_LOG_v1 {"time_micros": 1732350608288812, "cf_name": "default", "job": 30694, "event": "table_file_creation", "file_number": 269594, "file_size": 42420623, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237873554, "largest_seqno": 4110687024, "table_properties": {"data_size": 40321344, "index_size": 234432, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588640, "raw_average_key_size": 20, "raw_value_size": 131629139, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129432, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732350606, "oldest_key_time": 0, "file_creation_time": 1732350606, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 269594, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:30:08.329571 139957424981568 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269595.sst) /dev/shm/ToplingTemp/Topling-114559-FB5spB 2024/11/23-16:30:09.142031 139957424981568 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269595.sst): first pass time = 0.81's, 165.208'MB/sec 2024/11/23-16:30:10.150778 139957424981568 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269595.sst): old prealloc_size = 147639500, real_size = 40867760 2024/11/23-16:30:10.150904 139957424981568 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269595.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129434 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.74 raw-val = 0.1316 GB zip-val = 0.0406 GB avg-val =1016.96 avg-zval = 313.75 2024/11/23-16:30:10.151081 139957424981568 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269595.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:30:10.312028 139957424981568 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269595.sst): second pass time = 1.01's, 130.585'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 264.848'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2193.912'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.273'MB/sec write SST data time = 0.04's, 1000.181'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 46714.843'MB/sec zip my value time = 1.01's, unzip length = 0.132'GB zip my value throughput = 130.585'MB/sec zip pipeline throughput = 130.585'MB/sec entries = 129434 avg-key = 20.00 avg-zkey = 1.74 avg-val = 1016.96 avg-zval = 313.75 usrkeys = 129434 avg-key = 12.00 avg-zkey = 1.74 avg-val = 1023.96 avg-zval = 313.75 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129434 bytes = 485392 } seq expand size = 906038 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0406 GB dict = 1.38 MB all = 0.0427 GB } UnZip/Zip{ index = 6.8965 value = 3.2413 dict = 1.00 all = 3.1432 } Zip/UnZip{ index = 0.1450 value = 0.3085 dict = 1.00 all = 0.3181 } ---------------------------- total value len = 9.378761 GB avg = 0.177 KB (by entry num) total key len = 1.451176 GB avg = 0.027 KB total ukey len = 1.004091 GB avg = 0.015 KB total ukey num = 0.066068164 Billion total entry num = 0.052875893 Billion write speed all = 0.396728643 MB/sec (with seq num) write speed all = 0.381232796 MB/sec (without seq num) 2024/11/23-16:30:10.366390 139957424981568 [compaction_job.cc:1948] [default] [JOB 30694] Generated table #269595: 129434 keys, 42700787 bytes, temperature: kWarm 2024/11/23-16:30:10.366450 139957424981568 EVENT_LOG_v1 {"time_micros": 1732350610366417, "cf_name": "default", "job": 30694, "event": "table_file_creation", "file_number": 269595, "file_size": 42700787, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237868596, "largest_seqno": 4110691461, "table_properties": {"data_size": 40610016, "index_size": 225216, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588680, "raw_average_key_size": 20, "raw_value_size": 131629113, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129434, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732350608, "oldest_key_time": 0, "file_creation_time": 1732350608, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 269595, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:30:10.445840 139957424981568 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269596.sst) /dev/shm/ToplingTemp/Topling-114559-p2O5KC 2024/11/23-16:30:11.013760 139957424981568 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269596.sst): first pass time = 0.57's, 236.349'MB/sec 2024/11/23-16:30:11.908546 139957424981568 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269596.sst): old prealloc_size = 147639500, real_size = 40584464 2024/11/23-16:30:11.908690 139957424981568 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269596.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129431 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.81 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1016.99 avg-zval = 311.50 2024/11/23-16:30:11.908871 139957424981568 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269596.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:30:12.122278 139957424981568 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269596.sst): second pass time = 0.89's, 147.234'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.21's, 198.478'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1862.493'MB/sec (index lex order gen) rebuild zvType time = 0.16's, 0.197'MB/sec write SST data time = 0.05's, 863.381'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 50621.092'MB/sec zip my value time = 0.89's, unzip length = 0.132'GB zip my value throughput = 147.234'MB/sec zip pipeline throughput = 149.038'MB/sec entries = 129431 avg-key = 20.00 avg-zkey = 1.81 avg-val = 1016.99 avg-zval = 311.50 usrkeys = 129431 avg-key = 12.00 avg-zkey = 1.81 avg-val = 1023.99 avg-zval = 311.50 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129431 bytes = 485376 } seq expand size = 906017 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0424 GB } UnZip/Zip{ index = 6.6253 value = 3.2648 dict = 1.00 all = 3.1642 } Zip/UnZip{ index = 0.1509 value = 0.3063 dict = 1.00 all = 0.3160 } ---------------------------- total value len = 9.511297 GB avg = 0.179 KB (by entry num) total key len = 1.453764 GB avg = 0.027 KB total ukey len = 1.005644 GB avg = 0.015 KB total ukey num = 0.066197595 Billion total entry num = 0.053005324 Billion write speed all = 0.401651960 MB/sec (with seq num) write speed all = 0.386119212 MB/sec (without seq num) 2024/11/23-16:30:12.175919 139957424981568 [compaction_job.cc:1948] [default] [JOB 30694] Generated table #269596: 129431 keys, 42417289 bytes, temperature: kWarm 2024/11/23-16:30:12.176005 139957424981568 EVENT_LOG_v1 {"time_micros": 1732350612175950, "cf_name": "default", "job": 30694, "event": "table_file_creation", "file_number": 269596, "file_size": 42417289, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237869923, "largest_seqno": 4110691462, "table_properties": {"data_size": 40317504, "index_size": 234432, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588620, "raw_average_key_size": 20, "raw_value_size": 131629636, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129431, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732350610, "oldest_key_time": 0, "file_creation_time": 1732350610, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 269596, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:30:12.217310 139957424981568 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269597.sst) /dev/shm/ToplingTemp/Topling-114559-8JN0LA 2024/11/23-16:30:13.000552 139957424981568 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269597.sst): first pass time = 0.78's, 171.375'MB/sec 2024/11/23-16:30:13.814111 139957424981568 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269597.sst): old prealloc_size = 147639500, real_size = 40597824 2024/11/23-16:30:13.814250 139957424981568 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269597.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129429 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.81 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1017.00 avg-zval = 311.61 2024/11/23-16:30:13.814404 139957424981568 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269597.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:30:13.973803 139957424981568 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269597.sst): second pass time = 0.81's, 162.134'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 265.734'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2225.854'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.278'MB/sec write SST data time = 0.04's, 982.893'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 45050.572'MB/sec zip my value time = 0.81's, unzip length = 0.132'GB zip my value throughput = 162.134'MB/sec zip pipeline throughput = 162.134'MB/sec entries = 129429 avg-key = 20.00 avg-zkey = 1.81 avg-val = 1017.00 avg-zval = 311.61 usrkeys = 129429 avg-key = 12.00 avg-zkey = 1.81 avg-val = 1024.00 avg-zval = 311.61 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129429 bytes = 485376 } seq expand size = 906003 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0424 GB } UnZip/Zip{ index = 6.6306 value = 3.2637 dict = 1.00 all = 3.1632 } Zip/UnZip{ index = 0.1508 value = 0.3064 dict = 1.00 all = 0.3161 } ---------------------------- total value len = 9.643833 GB avg = 0.181 KB (by entry num) total key len = 1.456353 GB avg = 0.027 KB total ukey len = 1.007197 GB avg = 0.015 KB total ukey num = 0.066327024 Billion total entry num = 0.053134753 Billion write speed all = 0.406574009 MB/sec (with seq num) write speed all = 0.391004389 MB/sec (without seq num) 2024/11/23-16:30:14.026122 139957424981568 [compaction_job.cc:1948] [default] [JOB 30694] Generated table #269597: 129429 keys, 42430704 bytes, temperature: kWarm 2024/11/23-16:30:14.026199 139957424981568 EVENT_LOG_v1 {"time_micros": 1732350614026161, "cf_name": "default", "job": 30694, "event": "table_file_creation", "file_number": 269597, "file_size": 42430704, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237881756, "largest_seqno": 4110672172, "table_properties": {"data_size": 40331056, "index_size": 234240, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588580, "raw_average_key_size": 20, "raw_value_size": 131629690, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129429, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732350612, "oldest_key_time": 0, "file_creation_time": 1732350612, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 269597, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:30:14.063714 139957424981568 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269598.sst) /dev/shm/ToplingTemp/Topling-114559-zJZB8B 2024/11/23-16:30:14.672122 139957424981568 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269598.sst): first pass time = 0.61's, 220.618'MB/sec 2024/11/23-16:30:15.536088 139957424981568 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269598.sst): old prealloc_size = 147639500, real_size = 41075568 2024/11/23-16:30:15.536223 139957424981568 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269598.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129429 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.72 raw-val = 0.1316 GB zip-val = 0.0408 GB avg-val =1017.00 avg-zval = 315.39 2024/11/23-16:30:15.536387 139957424981568 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269598.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:30:15.699852 139957424981568 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269598.sst): second pass time = 0.86's, 152.473'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 262.054'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1955.954'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.271'MB/sec write SST data time = 0.04's, 969.761'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 43200.997'MB/sec zip my value time = 0.86's, unzip length = 0.132'GB zip my value throughput = 152.473'MB/sec zip pipeline throughput = 152.473'MB/sec entries = 129429 avg-key = 20.00 avg-zkey = 1.72 avg-val = 1017.00 avg-zval = 315.39 usrkeys = 129429 avg-key = 12.00 avg-zkey = 1.72 avg-val = 1024.00 avg-zval = 315.39 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129429 bytes = 485376 } seq expand size = 906003 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0408 GB dict = 1.38 MB all = 0.0429 GB } UnZip/Zip{ index = 6.9755 value = 3.2246 dict = 1.00 all = 3.1280 } Zip/UnZip{ index = 0.1434 value = 0.3101 dict = 1.00 all = 0.3197 } ---------------------------- total value len = 9.776368 GB avg = 0.184 KB (by entry num) total key len = 1.458941 GB avg = 0.027 KB total ukey len = 1.008750 GB avg = 0.015 KB total ukey num = 0.066456453 Billion total entry num = 0.053264182 Billion write speed all = 0.411497263 MB/sec (with seq num) write speed all = 0.395890704 MB/sec (without seq num) 2024/11/23-16:30:15.755428 139957424981568 [compaction_job.cc:1948] [default] [JOB 30694] Generated table #269598: 129429 keys, 42908522 bytes, temperature: kWarm 2024/11/23-16:30:15.755494 139957424981568 EVENT_LOG_v1 {"time_micros": 1732350615755461, "cf_name": "default", "job": 30694, "event": "table_file_creation", "file_number": 269598, "file_size": 42908522, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237882779, "largest_seqno": 4110668162, "table_properties": {"data_size": 40820384, "index_size": 222656, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588580, "raw_average_key_size": 20, "raw_value_size": 131629172, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129429, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732350614, "oldest_key_time": 0, "file_creation_time": 1732350614, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 269598, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:30:15.796843 139957424981568 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269599.sst) /dev/shm/ToplingTemp/Topling-114559-uPt5MB 2024/11/23-16:30:16.587812 139957424981568 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269599.sst): first pass time = 0.79's, 169.698'MB/sec 2024/11/23-16:30:17.483863 139957424981568 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269599.sst): old prealloc_size = 147639500, real_size = 40956144 2024/11/23-16:30:17.484010 139957424981568 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269599.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129431 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.71 raw-val = 0.1316 GB zip-val = 0.0407 GB avg-val =1016.99 avg-zval = 314.47 2024/11/23-16:30:17.484191 139957424981568 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269599.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:30:17.643440 139957424981568 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269599.sst): second pass time = 0.90's, 147.009'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 268.179'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1839.471'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.276'MB/sec write SST data time = 0.04's, 1015.315'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 50947.411'MB/sec zip my value time = 0.90's, unzip length = 0.132'GB zip my value throughput = 147.009'MB/sec zip pipeline throughput = 147.009'MB/sec entries = 129431 avg-key = 20.00 avg-zkey = 1.71 avg-val = 1016.99 avg-zval = 314.47 usrkeys = 129431 avg-key = 12.00 avg-zkey = 1.71 avg-val = 1023.99 avg-zval = 314.47 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129431 bytes = 485376 } seq expand size = 906017 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0407 GB dict = 1.38 MB all = 0.0428 GB } UnZip/Zip{ index = 6.9998 value = 3.2340 dict = 1.00 all = 3.1368 } Zip/UnZip{ index = 0.1429 value = 0.3092 dict = 1.00 all = 0.3188 } ---------------------------- total value len = 9.908904 GB avg = 0.186 KB (by entry num) total key len = 1.461530 GB avg = 0.027 KB total ukey len = 1.010303 GB avg = 0.015 KB total ukey num = 0.066585884 Billion total entry num = 0.053393613 Billion write speed all = 0.416416608 MB/sec (with seq num) write speed all = 0.400773239 MB/sec (without seq num) 2024/11/23-16:30:17.694884 139957424981568 [compaction_job.cc:1948] [default] [JOB 30694] Generated table #269599: 129431 keys, 42788561 bytes, temperature: kWarm 2024/11/23-16:30:17.694956 139957424981568 EVENT_LOG_v1 {"time_micros": 1732350617694917, "cf_name": "default", "job": 30694, "event": "table_file_creation", "file_number": 269599, "file_size": 42788561, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237868290, "largest_seqno": 4110693730, "table_properties": {"data_size": 40701728, "index_size": 221888, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588620, "raw_average_key_size": 20, "raw_value_size": 131629977, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129431, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732350615, "oldest_key_time": 0, "file_creation_time": 1732350615, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 269599, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:30:17.733423 139957424981568 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269600.sst) /dev/shm/ToplingTemp/Topling-114559-1fYzeC 2024/11/23-16:30:18.465860 139957424981568 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269600.sst): first pass time = 0.73's, 183.260'MB/sec 2024/11/23-16:30:19.270669 139957424981568 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269600.sst): old prealloc_size = 147639500, real_size = 40865856 2024/11/23-16:30:19.270789 139957424981568 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269600.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129431 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.75 raw-val = 0.1316 GB zip-val = 0.0406 GB avg-val =1016.99 avg-zval = 313.73 2024/11/23-16:30:19.270945 139957424981568 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269600.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:30:19.429838 139957424981568 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269600.sst): second pass time = 0.80's, 163.822'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 268.294'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2300.497'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.277'MB/sec write SST data time = 0.04's, 1010.686'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 46442.767'MB/sec zip my value time = 0.80's, unzip length = 0.132'GB zip my value throughput = 163.822'MB/sec zip pipeline throughput = 163.822'MB/sec entries = 129431 avg-key = 20.00 avg-zkey = 1.75 avg-val = 1016.99 avg-zval = 313.73 usrkeys = 129431 avg-key = 12.00 avg-zkey = 1.75 avg-val = 1023.99 avg-zval = 313.73 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129431 bytes = 485376 } seq expand size = 906017 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0406 GB dict = 1.38 MB all = 0.0427 GB } UnZip/Zip{ index = 6.8439 value = 3.2416 dict = 1.00 all = 3.1434 } Zip/UnZip{ index = 0.1461 value = 0.3085 dict = 1.00 all = 0.3181 } ---------------------------- total value len = 10.041440 GB avg = 0.188 KB (by entry num) total key len = 1.464119 GB avg = 0.027 KB total ukey len = 1.011857 GB avg = 0.015 KB total ukey num = 0.066715315 Billion total entry num = 0.053523044 Billion write speed all = 0.421337678 MB/sec (with seq num) write speed all = 0.405657414 MB/sec (without seq num) 2024/11/23-16:30:19.481769 139957424981568 [compaction_job.cc:1948] [default] [JOB 30694] Generated table #269600: 129431 keys, 42698921 bytes, temperature: kWarm 2024/11/23-16:30:19.481840 139957424981568 EVENT_LOG_v1 {"time_micros": 1732350619481805, "cf_name": "default", "job": 30694, "event": "table_file_creation", "file_number": 269600, "file_size": 42698921, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237874127, "largest_seqno": 4110693742, "table_properties": {"data_size": 40606384, "index_size": 226944, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588620, "raw_average_key_size": 20, "raw_value_size": 131629966, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129431, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732350617, "oldest_key_time": 0, "file_creation_time": 1732350617, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 269600, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:30:19.519148 139957424981568 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269601.sst) /dev/shm/ToplingTemp/Topling-114559-nsbbiE 2024/11/23-16:30:20.073880 139957424981568 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269601.sst): first pass time = 0.55's, 241.967'MB/sec 2024/11/23-16:30:20.986685 139957424981568 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269601.sst): old prealloc_size = 147639500, real_size = 40585968 2024/11/23-16:30:20.986823 139957424981568 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269601.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129432 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.81 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1016.98 avg-zval = 311.51 2024/11/23-16:30:20.986999 139957424981568 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269601.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:30:21.147691 139957424981568 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269601.sst): second pass time = 0.91's, 144.478'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 263.493'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2323.420'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.275'MB/sec write SST data time = 0.04's, 983.352'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 43853.169'MB/sec zip my value time = 0.91's, unzip length = 0.132'GB zip my value throughput = 144.478'MB/sec zip pipeline throughput = 145.765'MB/sec entries = 129432 avg-key = 20.00 avg-zkey = 1.81 avg-val = 1016.98 avg-zval = 311.51 usrkeys = 129432 avg-key = 12.00 avg-zkey = 1.81 avg-val = 1023.98 avg-zval = 311.51 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129432 bytes = 485392 } seq expand size = 906024 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0424 GB } UnZip/Zip{ index = 6.6271 value = 3.2647 dict = 1.00 all = 3.1642 } Zip/UnZip{ index = 0.1509 value = 0.3063 dict = 1.00 all = 0.3160 } ---------------------------- total value len = 10.173976 GB avg = 0.190 KB (by entry num) total key len = 1.466707 GB avg = 0.027 KB total ukey len = 1.013410 GB avg = 0.015 KB total ukey num = 0.066844747 Billion total entry num = 0.053652476 Billion write speed all = 0.426259172 MB/sec (with seq num) write speed all = 0.410541978 MB/sec (without seq num) 2024/11/23-16:30:21.201193 139957424981568 [compaction_job.cc:1948] [default] [JOB 30694] Generated table #269601: 129432 keys, 42418502 bytes, temperature: kWarm 2024/11/23-16:30:21.201264 139957424981568 EVENT_LOG_v1 {"time_micros": 1732350621201228, "cf_name": "default", "job": 30694, "event": "table_file_creation", "file_number": 269601, "file_size": 42418502, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237873877, "largest_seqno": 4110689404, "table_properties": {"data_size": 40319072, "index_size": 234368, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588640, "raw_average_key_size": 20, "raw_value_size": 131629881, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129432, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732350619, "oldest_key_time": 0, "file_creation_time": 1732350619, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 269601, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:30:21.237030 139957424981568 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269602.sst) /dev/shm/ToplingTemp/Topling-114559-E2tfMC 2024/11/23-16:30:21.758546 139957424981568 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269602.sst): first pass time = 0.52's, 257.378'MB/sec 2024/11/23-16:30:22.471410 139957424981568 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269602.sst): old prealloc_size = 147639500, real_size = 40587856 2024/11/23-16:30:22.471528 139957424981568 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269602.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129431 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.81 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1016.99 avg-zval = 311.52 2024/11/23-16:30:22.471690 139957424981568 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269602.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:30:22.632777 139957424981568 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269602.sst): second pass time = 0.71's, 184.826'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 262.926'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2421.443'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.275'MB/sec write SST data time = 0.04's, 976.770'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 47601.113'MB/sec zip my value time = 0.71's, unzip length = 0.132'GB zip my value throughput = 184.826'MB/sec zip pipeline throughput = 184.826'MB/sec entries = 129431 avg-key = 20.00 avg-zkey = 1.81 avg-val = 1016.99 avg-zval = 311.52 usrkeys = 129431 avg-key = 12.00 avg-zkey = 1.81 avg-val = 1023.99 avg-zval = 311.52 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129431 bytes = 485376 } seq expand size = 906017 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0424 GB } UnZip/Zip{ index = 6.6253 value = 3.2646 dict = 1.00 all = 3.1640 } Zip/UnZip{ index = 0.1509 value = 0.3063 dict = 1.00 all = 0.3161 } ---------------------------- total value len = 10.306512 GB avg = 0.192 KB (by entry num) total key len = 1.469296 GB avg = 0.027 KB total ukey len = 1.014963 GB avg = 0.015 KB total ukey num = 0.066974178 Billion total entry num = 0.053781907 Billion write speed all = 0.431183712 MB/sec (with seq num) write speed all = 0.415429458 MB/sec (without seq num) 2024/11/23-16:30:22.687233 139957424981568 [compaction_job.cc:1948] [default] [JOB 30694] Generated table #269602: 129431 keys, 42420342 bytes, temperature: kWarm 2024/11/23-16:30:22.687308 139957424981568 EVENT_LOG_v1 {"time_micros": 1732350622687269, "cf_name": "default", "job": 30694, "event": "table_file_creation", "file_number": 269602, "file_size": 42420342, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237872082, "largest_seqno": 4110693562, "table_properties": {"data_size": 40320896, "index_size": 234432, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588620, "raw_average_key_size": 20, "raw_value_size": 131629622, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129431, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732350621, "oldest_key_time": 0, "file_creation_time": 1732350621, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 269602, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:30:22.725163 139957424981568 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269603.sst) /dev/shm/ToplingTemp/Topling-114559-MEtzhE 2024/11/23-16:30:23.286649 139957424981568 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269603.sst): first pass time = 0.56's, 239.058'MB/sec 2024/11/23-16:30:24.201675 139957424981568 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269603.sst): old prealloc_size = 147639500, real_size = 41083312 2024/11/23-16:30:24.201825 139957424981568 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269603.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129429 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.72 raw-val = 0.1316 GB zip-val = 0.0408 GB avg-val =1017.01 avg-zval = 315.45 2024/11/23-16:30:24.202032 139957424981568 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269603.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:30:24.418347 139957424981568 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269603.sst): second pass time = 0.91's, 143.984'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.22's, 198.081'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1729.461'MB/sec (index lex order gen) rebuild zvType time = 0.17's, 0.189'MB/sec write SST data time = 0.05's, 943.578'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 45193.866'MB/sec zip my value time = 0.91's, unzip length = 0.132'GB zip my value throughput = 143.984'MB/sec zip pipeline throughput = 154.936'MB/sec entries = 129429 avg-key = 20.00 avg-zkey = 1.72 avg-val = 1017.01 avg-zval = 315.45 usrkeys = 129429 avg-key = 12.00 avg-zkey = 1.72 avg-val = 1024.01 avg-zval = 315.45 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129429 bytes = 485376 } seq expand size = 906003 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0408 GB dict = 1.38 MB all = 0.0429 GB } UnZip/Zip{ index = 6.9776 value = 3.2240 dict = 1.00 all = 3.1275 } Zip/UnZip{ index = 0.1433 value = 0.3102 dict = 1.00 all = 0.3197 } ---------------------------- total value len = 10.439048 GB avg = 0.194 KB (by entry num) total key len = 1.471885 GB avg = 0.027 KB total ukey len = 1.016516 GB avg = 0.015 KB total ukey num = 0.067103607 Billion total entry num = 0.053911336 Billion write speed all = 0.436102930 MB/sec (with seq num) write speed all = 0.420311795 MB/sec (without seq num) 2024/11/23-16:30:24.472318 139957424981568 [compaction_job.cc:1948] [default] [JOB 30694] Generated table #269603: 129429 keys, 42915846 bytes, temperature: kWarm 2024/11/23-16:30:24.472381 139957424981568 EVENT_LOG_v1 {"time_micros": 1732350624472348, "cf_name": "default", "job": 30694, "event": "table_file_creation", "file_number": 269603, "file_size": 42915846, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237916889, "largest_seqno": 4110685070, "table_properties": {"data_size": 40828192, "index_size": 222592, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588580, "raw_average_key_size": 20, "raw_value_size": 131630017, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129429, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732350622, "oldest_key_time": 0, "file_creation_time": 1732350622, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 269603, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:30:24.513005 139957424981568 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269604.sst) /dev/shm/ToplingTemp/Topling-114559-gbGH6z 2024/11/23-16:30:25.019419 139957424981568 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269604.sst): first pass time = 0.51's, 265.057'MB/sec 2024/11/23-16:30:25.793151 139957424981568 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269604.sst): old prealloc_size = 147639500, real_size = 40590304 2024/11/23-16:30:25.793288 139957424981568 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269604.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129427 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.81 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1017.02 avg-zval = 311.55 2024/11/23-16:30:25.793443 139957424981568 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269604.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:30:25.956928 139957424981568 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269604.sst): second pass time = 0.77's, 170.489'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 259.051'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2030.330'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.277'MB/sec write SST data time = 0.05's, 907.413'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 45956.217'MB/sec zip my value time = 0.77's, unzip length = 0.132'GB zip my value throughput = 170.489'MB/sec zip pipeline throughput = 170.489'MB/sec entries = 129427 avg-key = 20.00 avg-zkey = 1.81 avg-val = 1017.02 avg-zval = 311.55 usrkeys = 129427 avg-key = 12.00 avg-zkey = 1.81 avg-val = 1024.02 avg-zval = 311.55 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129427 bytes = 485360 } seq expand size = 905989 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0424 GB } UnZip/Zip{ index = 6.6251 value = 3.2643 dict = 1.00 all = 3.1638 } Zip/UnZip{ index = 0.1509 value = 0.3063 dict = 1.00 all = 0.3161 } ---------------------------- total value len = 10.571583 GB avg = 0.196 KB (by entry num) total key len = 1.474473 GB avg = 0.027 KB total ukey len = 1.018069 GB avg = 0.015 KB total ukey num = 0.067233034 Billion total entry num = 0.054040763 Billion write speed all = 0.441025469 MB/sec (with seq num) write speed all = 0.425197316 MB/sec (without seq num) 2024/11/23-16:30:26.008422 139957424981568 [compaction_job.cc:1948] [default] [JOB 30694] Generated table #269604: 129427 keys, 42423172 bytes, temperature: kWarm 2024/11/23-16:30:26.008478 139957424981568 EVENT_LOG_v1 {"time_micros": 1732350626008447, "cf_name": "default", "job": 30694, "event": "table_file_creation", "file_number": 269604, "file_size": 42423172, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237871365, "largest_seqno": 4110692283, "table_properties": {"data_size": 40323344, "index_size": 234432, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588540, "raw_average_key_size": 20, "raw_value_size": 131629421, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129427, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732350624, "oldest_key_time": 0, "file_creation_time": 1732350624, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 269604, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:30:26.056004 139957424981568 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269605.sst) /dev/shm/ToplingTemp/Topling-114559-yxMlVC 2024/11/23-16:30:26.600911 139957424981568 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269605.sst): first pass time = 0.54's, 246.332'MB/sec 2024/11/23-16:30:27.415012 139957424981568 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269605.sst): old prealloc_size = 147639500, real_size = 40451536 2024/11/23-16:30:27.415143 139957424981568 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269605.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129430 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.71 raw-val = 0.1316 GB zip-val = 0.0402 GB avg-val =1017.00 avg-zval = 310.57 2024/11/23-16:30:27.415230 139957424981568 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269605.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:30:27.577608 139957424981568 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269605.sst): second pass time = 0.81's, 161.954'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 257.834'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2043.685'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.275'MB/sec write SST data time = 0.04's, 933.913'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 48621.684'MB/sec zip my value time = 0.81's, unzip length = 0.132'GB zip my value throughput = 161.954'MB/sec zip pipeline throughput = 161.954'MB/sec entries = 129430 avg-key = 20.00 avg-zkey = 1.71 avg-val = 1017.00 avg-zval = 310.57 usrkeys = 129430 avg-key = 12.00 avg-zkey = 1.71 avg-val = 1018.44 avg-zval = 310.57 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 26758 bytes = 100352 } seq expand size = 187306 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0402 GB dict = 1.38 MB all = 0.0419 GB } UnZip/Zip{ index = 7.0159 value = 3.2746 dict = 1.00 all = 3.2018 } Zip/UnZip{ index = 0.1425 value = 0.3054 dict = 1.00 all = 0.3123 } ---------------------------- total value len = 10.703400 GB avg = 0.198 KB (by entry num) total key len = 1.477062 GB avg = 0.027 KB total ukey len = 1.019622 GB avg = 0.015 KB total ukey num = 0.067362464 Billion total entry num = 0.054170193 Billion write speed all = 0.445919823 MB/sec (with seq num) write speed all = 0.430054701 MB/sec (without seq num) 2024/11/23-16:30:27.628524 139957424981568 [compaction_job.cc:1948] [default] [JOB 30694] Generated table #269605: 129430 keys, 41919700 bytes, temperature: kWarm 2024/11/23-16:30:27.628595 139957424981568 EVENT_LOG_v1 {"time_micros": 1732350627628560, "cf_name": "default", "job": 30694, "event": "table_file_creation", "file_number": 269605, "file_size": 41919700, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4110658301, "table_properties": {"data_size": 40197632, "index_size": 221376, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588600, "raw_average_key_size": 20, "raw_value_size": 131629896, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129430, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732350626, "oldest_key_time": 0, "file_creation_time": 1732350626, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 269605, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:30:27.669701 139957424981568 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269606.sst) /dev/shm/ToplingTemp/Topling-114559-rNyelB 2024/11/23-16:30:28.270470 139957424981568 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269606.sst): first pass time = 0.60's, 223.428'MB/sec 2024/11/23-16:30:29.083884 139957424981568 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269606.sst): old prealloc_size = 147639500, real_size = 41057680 2024/11/23-16:30:29.084016 139957424981568 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269606.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129429 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.71 raw-val = 0.1316 GB zip-val = 0.0408 GB avg-val =1017.00 avg-zval = 315.26 2024/11/23-16:30:29.084182 139957424981568 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269606.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:30:29.244593 139957424981568 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269606.sst): second pass time = 0.81's, 162.085'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 266.684'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1952.030'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.276'MB/sec write SST data time = 0.04's, 986.934'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 47974.309'MB/sec zip my value time = 0.81's, unzip length = 0.132'GB zip my value throughput = 162.085'MB/sec zip pipeline throughput = 162.085'MB/sec entries = 129429 avg-key = 20.00 avg-zkey = 1.71 avg-val = 1017.00 avg-zval = 315.26 usrkeys = 129429 avg-key = 12.00 avg-zkey = 1.71 avg-val = 1023.17 avg-zval = 315.26 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 113979 bytes = 427440 } seq expand size = 797853 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0408 GB dict = 1.38 MB all = 0.0429 GB } UnZip/Zip{ index = 7.0342 value = 3.2259 dict = 1.00 all = 3.1321 } Zip/UnZip{ index = 0.1422 value = 0.3100 dict = 1.00 all = 0.3193 } ---------------------------- total value len = 10.835827 GB avg = 0.200 KB (by entry num) total key len = 1.479650 GB avg = 0.027 KB total ukey len = 1.021176 GB avg = 0.015 KB total ukey num = 0.067491893 Billion total entry num = 0.054299622 Billion write speed all = 0.450835164 MB/sec (with seq num) write speed all = 0.434933107 MB/sec (without seq num) 2024/11/23-16:30:29.296056 139957424981568 [compaction_job.cc:1948] [default] [JOB 30694] Generated table #269606: 129429 keys, 42852925 bytes, temperature: kWarm 2024/11/23-16:30:29.296124 139957424981568 EVENT_LOG_v1 {"time_micros": 1732350629296089, "cf_name": "default", "job": 30694, "event": "table_file_creation", "file_number": 269606, "file_size": 42852925, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4110680590, "table_properties": {"data_size": 40804352, "index_size": 220800, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588580, "raw_average_key_size": 20, "raw_value_size": 131629443, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129429, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732350627, "oldest_key_time": 0, "file_creation_time": 1732350627, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 269606, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:30:29.335089 139957424981568 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269607.sst) /dev/shm/ToplingTemp/Topling-114559-eju1PB 2024/11/23-16:30:30.017091 139957424981568 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269607.sst): first pass time = 0.68's, 196.810'MB/sec 2024/11/23-16:30:30.859099 139957424981568 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269607.sst): old prealloc_size = 147639500, real_size = 40800768 2024/11/23-16:30:30.859224 139957424981568 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269607.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129428 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.74 raw-val = 0.1316 GB zip-val = 0.0405 GB avg-val =1017.01 avg-zval = 313.25 2024/11/23-16:30:30.859369 139957424981568 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269607.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:30:31.021494 139957424981568 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269607.sst): second pass time = 0.84's, 156.574'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 261.860'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2388.582'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.273'MB/sec write SST data time = 0.04's, 971.440'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 38261.847'MB/sec zip my value time = 0.84's, unzip length = 0.132'GB zip my value throughput = 156.574'MB/sec zip pipeline throughput = 156.574'MB/sec entries = 129428 avg-key = 20.00 avg-zkey = 1.74 avg-val = 1017.01 avg-zval = 313.25 usrkeys = 129428 avg-key = 12.00 avg-zkey = 1.74 avg-val = 1022.05 avg-zval = 313.25 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 93212 bytes = 349552 } seq expand size = 652484 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0405 GB dict = 1.38 MB all = 0.0425 GB } UnZip/Zip{ index = 6.9001 value = 3.2467 dict = 1.00 all = 3.1567 } Zip/UnZip{ index = 0.1449 value = 0.3080 dict = 1.00 all = 0.3168 } ---------------------------- total value len = 10.968110 GB avg = 0.202 KB (by entry num) total key len = 1.482239 GB avg = 0.027 KB total ukey len = 1.022729 GB avg = 0.015 KB total ukey num = 0.067621321 Billion total entry num = 0.054429050 Billion write speed all = 0.455742757 MB/sec (with seq num) write speed all = 0.439803832 MB/sec (without seq num) 2024/11/23-16:30:31.072997 139957424981568 [compaction_job.cc:1948] [default] [JOB 30694] Generated table #269607: 129428 keys, 42518261 bytes, temperature: kWarm 2024/11/23-16:30:31.073066 139957424981568 EVENT_LOG_v1 {"time_micros": 1732350631073030, "cf_name": "default", "job": 30694, "event": "table_file_creation", "file_number": 269607, "file_size": 42518261, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4110683007, "table_properties": {"data_size": 40543152, "index_size": 225088, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588560, "raw_average_key_size": 20, "raw_value_size": 131629618, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129428, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732350629, "oldest_key_time": 0, "file_creation_time": 1732350629, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 269607, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:30:31.112429 139957424981568 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269608.sst) /dev/shm/ToplingTemp/Topling-114559-RD8wHD 2024/11/23-16:30:31.757301 139957424981568 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269608.sst): first pass time = 0.64's, 208.143'MB/sec 2024/11/23-16:30:32.558186 139957424981568 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269608.sst): old prealloc_size = 147639500, real_size = 40897072 2024/11/23-16:30:32.558321 139957424981568 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269608.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129428 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.75 raw-val = 0.1316 GB zip-val = 0.0406 GB avg-val =1017.01 avg-zval = 313.98 2024/11/23-16:30:32.558478 139957424981568 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269608.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:30:32.719706 139957424981568 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269608.sst): second pass time = 0.80's, 164.633'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 264.396'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2104.837'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.275'MB/sec write SST data time = 0.04's, 978.828'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 42647.305'MB/sec zip my value time = 0.80's, unzip length = 0.132'GB zip my value throughput = 164.633'MB/sec zip pipeline throughput = 164.633'MB/sec entries = 129428 avg-key = 20.00 avg-zkey = 1.75 avg-val = 1017.01 avg-zval = 313.98 usrkeys = 129428 avg-key = 12.00 avg-zkey = 1.75 avg-val = 1023.28 avg-zval = 313.98 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 115906 bytes = 434656 } seq expand size = 811342 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0406 GB dict = 1.38 MB all = 0.0427 GB } UnZip/Zip{ index = 6.8495 value = 3.2391 dict = 1.00 all = 3.1433 } Zip/UnZip{ index = 0.1460 value = 0.3087 dict = 1.00 all = 0.3181 } ---------------------------- total value len = 11.100550 GB avg = 0.203 KB (by entry num) total key len = 1.484827 GB avg = 0.027 KB total ukey len = 1.024282 GB avg = 0.015 KB total ukey num = 0.067750749 Billion total entry num = 0.054558478 Billion write speed all = 0.460656850 MB/sec (with seq num) write speed all = 0.444681017 MB/sec (without seq num) 2024/11/23-16:30:32.771513 139957424981568 [compaction_job.cc:1948] [default] [JOB 30694] Generated table #269608: 129428 keys, 42699704 bytes, temperature: kWarm 2024/11/23-16:30:32.771582 139957424981568 EVENT_LOG_v1 {"time_micros": 1732350632771545, "cf_name": "default", "job": 30694, "event": "table_file_creation", "file_number": 269608, "file_size": 42699704, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4110691089, "table_properties": {"data_size": 40637792, "index_size": 226752, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588560, "raw_average_key_size": 20, "raw_value_size": 131629544, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129428, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732350631, "oldest_key_time": 0, "file_creation_time": 1732350631, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 269608, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:30:32.807398 139957424981568 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269609.sst) /dev/shm/ToplingTemp/Topling-114559-Zy54OB 2024/11/23-16:30:33.386400 139957424981568 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269609.sst): first pass time = 0.58's, 231.824'MB/sec 2024/11/23-16:30:34.189400 139957424981568 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269609.sst): old prealloc_size = 147639500, real_size = 40499872 2024/11/23-16:30:34.189524 139957424981568 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269609.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129430 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.73 raw-val = 0.1316 GB zip-val = 0.0402 GB avg-val =1016.99 avg-zval = 310.93 2024/11/23-16:30:34.189617 139957424981568 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269609.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:30:34.350388 139957424981568 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269609.sst): second pass time = 0.80's, 164.069'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 261.174'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2193.985'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.279'MB/sec write SST data time = 0.04's, 937.592'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 41050.097'MB/sec zip my value time = 0.80's, unzip length = 0.132'GB zip my value throughput = 164.069'MB/sec zip pipeline throughput = 164.069'MB/sec entries = 129430 avg-key = 20.00 avg-zkey = 1.73 avg-val = 1016.99 avg-zval = 310.93 usrkeys = 129430 avg-key = 12.00 avg-zkey = 1.73 avg-val = 1019.48 avg-zval = 310.93 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 45864 bytes = 172000 } seq expand size = 321048 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0402 GB dict = 1.38 MB all = 0.0420 GB } UnZip/Zip{ index = 6.9258 value = 3.2709 dict = 1.00 all = 3.1926 } Zip/UnZip{ index = 0.1444 value = 0.3057 dict = 1.00 all = 0.3132 } ---------------------------- total value len = 11.232501 GB avg = 0.205 KB (by entry num) total key len = 1.487416 GB avg = 0.027 KB total ukey len = 1.025835 GB avg = 0.015 KB total ukey num = 0.067880179 Billion total entry num = 0.054687908 Billion write speed all = 0.465553542 MB/sec (with seq num) write speed all = 0.449540765 MB/sec (without seq num) 2024/11/23-16:30:34.401611 139957424981568 [compaction_job.cc:1948] [default] [JOB 30694] Generated table #269609: 129430 keys, 42039824 bytes, temperature: kWarm 2024/11/23-16:30:34.401680 139957424981568 EVENT_LOG_v1 {"time_micros": 1732350634401643, "cf_name": "default", "job": 30694, "event": "table_file_creation", "file_number": 269609, "file_size": 42039824, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4110689384, "table_properties": {"data_size": 40243088, "index_size": 224256, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588600, "raw_average_key_size": 20, "raw_value_size": 131629621, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129430, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732350632, "oldest_key_time": 0, "file_creation_time": 1732350632, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 269609, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:30:34.442511 139957424981568 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269610.sst) /dev/shm/ToplingTemp/Topling-114559-Hb02nB 2024/11/23-16:30:34.962291 139957424981568 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269610.sst): first pass time = 0.52's, 258.239'MB/sec 2024/11/23-16:30:35.975533 139957424981568 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269610.sst): old prealloc_size = 147639500, real_size = 40594640 2024/11/23-16:30:35.975654 139957424981568 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269610.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129425 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.72 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1017.04 avg-zval = 311.69 2024/11/23-16:30:35.975736 139957424981568 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269610.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:30:36.135393 139957424981568 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269610.sst): second pass time = 1.01's, 130.092'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 263.220'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2246.500'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.274'MB/sec write SST data time = 0.04's, 1007.569'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 35037.966'MB/sec zip my value time = 1.01's, unzip length = 0.132'GB zip my value throughput = 130.092'MB/sec zip pipeline throughput = 189.127'MB/sec entries = 129425 avg-key = 20.00 avg-zkey = 1.72 avg-val = 1017.04 avg-zval = 311.69 usrkeys = 129425 avg-key = 12.00 avg-zkey = 1.72 avg-val = 1018.62 avg-zval = 311.69 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 29261 bytes = 109744 } seq expand size = 204827 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0421 GB } UnZip/Zip{ index = 6.9934 value = 3.2630 dict = 1.00 all = 3.1902 } Zip/UnZip{ index = 0.1430 value = 0.3065 dict = 1.00 all = 0.3135 } ---------------------------- total value len = 11.364336 GB avg = 0.207 KB (by entry num) total key len = 1.490004 GB avg = 0.027 KB total ukey len = 1.027388 GB avg = 0.015 KB total ukey num = 0.068009604 Billion total entry num = 0.054817333 Billion write speed all = 0.470442744 MB/sec (with seq num) write speed all = 0.454393119 MB/sec (without seq num) 2024/11/23-16:30:36.186590 139957424981568 [compaction_job.cc:1948] [default] [JOB 30694] Generated table #269610: 129425 keys, 42071947 bytes, temperature: kWarm 2024/11/23-16:30:36.186660 139957424981568 EVENT_LOG_v1 {"time_micros": 1732350636186623, "cf_name": "default", "job": 30694, "event": "table_file_creation", "file_number": 269610, "file_size": 42071947, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4110666489, "table_properties": {"data_size": 40340032, "index_size": 222080, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588500, "raw_average_key_size": 20, "raw_value_size": 131629855, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129425, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732350634, "oldest_key_time": 0, "file_creation_time": 1732350634, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 269610, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:30:36.223017 139957424981568 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269611.sst) /dev/shm/ToplingTemp/Topling-114559-UwAZjC 2024/11/23-16:30:36.861403 139957424981568 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269611.sst): first pass time = 0.64's, 210.258'MB/sec 2024/11/23-16:30:37.662338 139957424981568 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269611.sst): old prealloc_size = 147639500, real_size = 40458336 2024/11/23-16:30:37.662471 139957424981568 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269611.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129431 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.72 raw-val = 0.1316 GB zip-val = 0.0402 GB avg-val =1016.99 avg-zval = 310.62 2024/11/23-16:30:37.662559 139957424981568 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269611.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:30:37.827140 139957424981568 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269611.sst): second pass time = 0.80's, 164.620'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 254.493'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2070.869'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.269'MB/sec write SST data time = 0.04's, 948.429'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 47387.057'MB/sec zip my value time = 0.80's, unzip length = 0.132'GB zip my value throughput = 164.620'MB/sec zip pipeline throughput = 164.620'MB/sec entries = 129431 avg-key = 20.00 avg-zkey = 1.72 avg-val = 1016.99 avg-zval = 310.62 usrkeys = 129431 avg-key = 12.00 avg-zkey = 1.72 avg-val = 1018.54 avg-zval = 310.62 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 28713 bytes = 107696 } seq expand size = 200991 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0402 GB dict = 1.38 MB all = 0.0419 GB } UnZip/Zip{ index = 6.9938 value = 3.2741 dict = 1.00 all = 3.2007 } Zip/UnZip{ index = 0.1430 value = 0.3054 dict = 1.00 all = 0.3124 } ---------------------------- total value len = 11.496166 GB avg = 0.209 KB (by entry num) total key len = 1.492593 GB avg = 0.027 KB total ukey len = 1.028941 GB avg = 0.015 KB total ukey num = 0.068139035 Billion total entry num = 0.054946764 Billion write speed all = 0.475332788 MB/sec (with seq num) write speed all = 0.459246264 MB/sec (without seq num) 2024/11/23-16:30:37.878663 139957424981568 [compaction_job.cc:1948] [default] [JOB 30694] Generated table #269611: 129431 keys, 41933774 bytes, temperature: kWarm 2024/11/23-16:30:37.878732 139957424981568 EVENT_LOG_v1 {"time_micros": 1732350637878696, "cf_name": "default", "job": 30694, "event": "table_file_creation", "file_number": 269611, "file_size": 41933774, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4110691411, "table_properties": {"data_size": 40203728, "index_size": 222080, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588620, "raw_average_key_size": 20, "raw_value_size": 131629712, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129431, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732350636, "oldest_key_time": 0, "file_creation_time": 1732350636, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 269611, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:30:37.919200 139957424981568 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269612.sst) /dev/shm/ToplingTemp/Topling-114559-OEYuFD 2024/11/23-16:30:38.475016 139957424981568 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269612.sst): first pass time = 0.56's, 241.496'MB/sec 2024/11/23-16:30:39.345578 139957424981568 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269612.sst): old prealloc_size = 147639500, real_size = 40660352 2024/11/23-16:30:39.345729 139957424981568 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269612.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129428 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.72 raw-val = 0.1316 GB zip-val = 0.0404 GB avg-val =1017.01 avg-zval = 312.19 2024/11/23-16:30:39.345867 139957424981568 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269612.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:30:39.575510 139957424981568 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269612.sst): second pass time = 0.87's, 151.609'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.23's, 183.764'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1723.929'MB/sec (index lex order gen) rebuild zvType time = 0.18's, 0.176'MB/sec write SST data time = 0.05's, 917.766'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 37791.323'MB/sec zip my value time = 0.87's, unzip length = 0.132'GB zip my value throughput = 151.609'MB/sec zip pipeline throughput = 163.579'MB/sec entries = 129428 avg-key = 20.00 avg-zkey = 1.72 avg-val = 1017.01 avg-zval = 312.19 usrkeys = 129428 avg-key = 12.00 avg-zkey = 1.72 avg-val = 1020.23 avg-zval = 312.19 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 59669 bytes = 223776 } seq expand size = 417683 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0404 GB dict = 1.38 MB all = 0.0423 GB } UnZip/Zip{ index = 6.9936 value = 3.2577 dict = 1.00 all = 3.1766 } Zip/UnZip{ index = 0.1430 value = 0.3070 dict = 1.00 all = 0.3148 } ---------------------------- total value len = 11.628213 GB avg = 0.211 KB (by entry num) total key len = 1.495182 GB avg = 0.027 KB total ukey len = 1.030494 GB avg = 0.015 KB total ukey num = 0.068268463 Billion total entry num = 0.055076192 Billion write speed all = 0.480229143 MB/sec (with seq num) write speed all = 0.464105759 MB/sec (without seq num) 2024/11/23-16:30:39.630490 139957424981568 [compaction_job.cc:1948] [default] [JOB 30694] Generated table #269612: 129428 keys, 42251840 bytes, temperature: kWarm 2024/11/23-16:30:39.630585 139957424981568 EVENT_LOG_v1 {"time_micros": 1732350639630530, "cf_name": "default", "job": 30694, "event": "table_file_creation", "file_number": 269612, "file_size": 42251840, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4110693513, "table_properties": {"data_size": 40405744, "index_size": 222080, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588560, "raw_average_key_size": 20, "raw_value_size": 131629278, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129428, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732350637, "oldest_key_time": 0, "file_creation_time": 1732350637, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 269612, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:30:39.690237 139957424981568 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269613.sst) /dev/shm/ToplingTemp/Topling-114559-IlQMfB 2024/11/23-16:30:39.699150 139957424981568 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269613.sst): first pass time = 0.01's, 336.927'MB/sec 2024/11/23-16:30:39.729467 139957424981568 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269613.sst): old prealloc_size = 147639500, real_size = 949048 2024/11/23-16:30:39.729507 139957424981568 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269613.sst): index type = UintIndex_IL_256_32 , store type = DictZipBlobStore usrkeys = 2883 prefix = 4 raw-key = 0.0000 GB zip-key = 0.0000 GB avg-key = 8.00 avg-zkey = 0.26 raw-val = 0.0029 GB zip-val = 0.0009 GB avg-val =1016.97 avg-zval = 328.61 2024/11/23-16:30:39.732859 139957424981568 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00/269613.sst): second pass time = 0.03's, 98.163'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.00's, 293.768'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 30.656'MB/sec (index lex order gen) rebuild zvType time = 0.00's, 0.309'MB/sec write SST data time = 0.00's, 975.605'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.032'MB, throughput = 1269.250'MB/sec zip my value time = 0.03's, unzip length = 0.003'GB zip my value throughput = 98.163'MB/sec zip pipeline throughput = 98.163'MB/sec entries = 2883 avg-key = 20.00 avg-zkey = 0.27 avg-val = 1016.97 avg-zval = 328.61 usrkeys = 2883 avg-key = 12.00 avg-zkey = 0.27 avg-val = 1023.97 avg-zval = 328.61 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 2883 bytes = 9744 } seq expand size = 20181 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0000 GB value = 0.0029 GB dict = 0.03 MB all = 0.0030 GB } __ZipSize{ index = 0.0000 GB value = 0.0009 GB dict = 0.03 MB all = 0.0010 GB } UnZip/Zip{ index = 45.0469 value = 3.0948 dict = 1.00 all = 3.0149 } Zip/UnZip{ index = 0.0222 value = 0.3231 dict = 1.00 all = 0.3317 } ---------------------------- total value len = 11.631166 GB avg = 0.211 KB (by entry num) total key len = 1.495239 GB avg = 0.027 KB total ukey len = 1.030529 GB avg = 0.015 KB total ukey num = 0.068271346 Billion total entry num = 0.055079075 Billion write speed all = 0.480336514 MB/sec (with seq num) write speed all = 0.464212379 MB/sec (without seq num) 2024/11/23-16:30:39.741492 139957424981568 [compaction_job.cc:1948] [default] [JOB 30694] Generated table #269613: 2883 keys, 991594 bytes, temperature: kWarm 2024/11/23-16:30:39.741540 139957424981568 EVENT_LOG_v1 {"time_micros": 1732350639741513, "cf_name": "default", "job": 30694, "event": "table_file_creation", "file_number": 269613, "file_size": 991594, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4015602092, "largest_seqno": 4109176241, "table_properties": {"data_size": 947376, "index_size": 768, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 57660, "raw_average_key_size": 20, "raw_value_size": 2931919, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 2883, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-UintIndex_IL_256_32-DictZipBlobStore", "creation_time": 1732350639, "oldest_key_time": 0, "file_creation_time": 1732350639, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 269613, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:30:39.750942 139957424981568 [compaction_job.cc:703] job-30694: subcompact[0], size: 0.892974 G, files: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30694/att-00 [269592,269593,269594,269595,269596,269597,269598,269599,269600,269601,269602,269603,269604,269605,269606,269607,269608,269609,269610,269611,269612,269613] 2024/11/23-16:30:39.882676 139957424981568 (Original Log Time 2024/11/23-16:30:02.319701) EVENT_LOG_v1 {"time_micros": 1732350602319669, "job": 30694, "event": "compaction_started", "compaction_reason": "FilesMarkedForCompaction", "files_L2": [269585], "files_L3": [269512, 269513, 269514, 269515, 269516, 269517, 269518, 269519, 269520, 269521, 269522, 269523, 269524, 269525, 269526, 269527, 269528, 269529, 269530, 269531, 269532], "score": 0.996521, "input_data_size": 924684002, "oldest_snapshot_seqno": 4110720451} 2024/11/23-16:30:39.882683 139957424981568 (Original Log Time 2024/11/23-16:30:39.880465) [compaction_job.cc:2022] [default] [JOB 30694] Compacted 1@2 + 21@3 files to L3 => 892974488 bytes 2024/11/23-16:30:39.882684 139957424981568 (Original Log Time 2024/11/23-16:30:39.882603) [compaction_job.cc:1224] [default] compacted to: files[0 0 0 22 0 0 0] max score 0.03, MB/sec: 24.7 rd, 23.9 wr, level 3, files in(1, 21) out(22 +0 blob) MB in(31.2, 850.7 +0.0 blob) out(851.6 +0.0 blob), read-write-amplify(55.6) write-amplify(27.3) OK, records in: 2749938, records dropped: 29027 output_compression: Snappy 2024/11/23-16:30:39.882688 139957424981568 (Original Log Time 2024/11/23-16:30:39.882650) EVENT_LOG_v1 {"time_micros": 1732350639882626, "cf": "default", "job": 30694, "event": "compaction_finished", "compaction_time_micros": 37431244, "compaction_time_cpu_micros": 8088062, "output_level": 3, "num_output_files": 22, "total_output_size": 892974488, "num_input_records": 2749938, "num_output_records": 2720911, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "file_write_nanos": 652334611, "file_range_sync_nanos": 0, "file_fsync_nanos": 16828, "file_prepare_write_nanos": 47720, "lsm_state": [0, 0, 0, 22, 0, 0, 0]} 2024/11/23-16:30:40.016275 139957424981568 DEBG dcompact_worker.cpp:240: HttpPost: 200 OK: url = http://nlb-7zny4kaa1poal01o64.cn-shenzhen.nlb.aliyuncs.com:8443, body = {"instanceId":"nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137","labourId":"","dbId":"d89b4006-2803-486e-b7a2-759bcf348921","dbStarts":1732256054,"starts":1732350602,"executesMs":37713,"compactionJobId":30694,"attempt":0,"compactionInputRawBytes":2851673102,"compactionInputZipBytes":924684002,"compactionOutputRawBytes":0,"compactionOutputZipBytes":892974488,"headers":{"Accept":"*/*","Connection":"close","Host":"aliyun-topling-saas.topling.cn:18443","RemoteIp":"120.24.192.169","X-Forwarded-For":"120.24.192.169","region":"cn-shenzhen","token":"e6474c481bd4415abc537135cc03626b","instance-token":"e6474c481bd4415abc537135cc03626b","provider":"aliyun","CloudMarketInstanceId":"si-59c0ae5c955845588903","MeteringAssit":"","Transfer-Encoding":"chunked","traceparent":"00-fa29c22d1380563a1f596c7c9bdfcec3-fa348e293b2eaadb-00"}}, response = 2024/11/23-16:30:40.016353 139957424981568 INFO dcompact_worker.cpp:1459: finish /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-30694/att-00: olev 3, work 37.713 s, result 5.930 ms, install 2.240 ms, input{raw 2.656 GiB zip 881.847 MiB}