2024/11/23-15:30:23.543922 139957383018048 DEBG dcompact_worker.cpp:2214: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00: fork to child time = 0.027733 sec 2024/11/23-15:30:23.544913 139957383018048 DEBG dcompact_worker.cpp:1013: Beg SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00 2024/11/23-15:30:23.553454 139957383018048 DEBG dcompact_worker.cpp:1033: End SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00 2024/11/23-15:30:23.554740 139957383018048 TRAC dcompact_worker.cpp:1083: INFO_LOG_LEVEL: rpc = INFO_LEVEL, env_var = undefined 2024/11/23-15:30:23.555102 139957383018048 [WARN] [column_family.cc:386] multiple cf_paths/db_paths and level_compaction_dynamic_level_bytes can't be used together 2024/11/23-15:30:23.609805 139957383018048 [version_set.cc:6208] Recovering from manifest file: /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-29360/att-00/MANIFEST-206347 2024/11/23-15:30:23.643175 139957383018048 [version_set.cc:6251] Recovered from manifest file:/worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-29360/att-00/MANIFEST-206347 succeeded,manifest_file_number is 206347, next_file_number is 266669, last_sequence is 4069934738, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 266519 2024/11/23-15:30:23.643193 139957383018048 [version_set.cc:6266] Column family [default] (ID 0), log number is 0 2024/11/23-15:30:23.643376 139957383018048 [version_set.cc:5721] Creating manifest 266669 2024/11/23-15:30:23.677713 139957383018048 DEBG dcompact_worker.cpp:1218: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00: bottommost_level: fake = 1, rpc = 0 2024/11/23-15:30:23.707676 139957383018048 [compaction_job.cc:2437] [default] [JOB 29360] Compacting 1@2 + 21@3 files to L3, score 0.99, subcompactions 1 : 1 2024/11/23-15:30:23.707715 139957383018048 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 21947 Base level 2, inputs: [266648(31MB)], [266578(40MB) 266579(40MB) 266580(40MB) 266581(40MB) 266582(40MB) 266583(40MB) 266584(40MB) 266585(40MB) 266586(40MB) 266587(40MB) 266588(40MB) 266589(40MB) 266590(40MB) 266591(40MB) 266592(40MB) 266593(40MB) 266594(40MB) 266595(40MB) 266596(40MB) 266597(39MB) 266664(40MB)] 2024/11/23-15:30:23.717679 139957383018048 [top_zip_table.cc:59] core git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-15:30:23.717722 139957383018048 [top_zip_table.cc:60] fsa git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-15:30:23.717752 139957383018048 [top_zip_table.cc:61] zbs git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-15:30:23.717761 139957383018048 [top_zip_table.cc:62] topling-zip_table_reader: git_version_hash_info_is: commit a4a382006cb82713acf5b3425835f22711877681 Author: leipeng Date: 2024-04-11 19:44:14 +0800 fixed_len_hole_index.cc: Add env bool FixedLenHoleIndexUseAVX512 for ut & debug 1. FixedLenHoleIndexUseAVX512 is only in unit tests or debug 2. In release mode, use avx512 by compile options(-march=) g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/23-15:30:23.717780 139957383018048 [top_zip_table.cc:64] topling-rocks git_version_hash_info_is: commit feab587e468621ba0204d47b4ffacc52e7c4290d Author: leipeng Date: 2024-03-22 13:35:06 +0800 ToplingZipTableBuilder::Add: immediately return after error This function returns void, and caller does not check builder->status() after calling this function and graceful abandon. So immediately return after error, and return error status in Finish(). g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/23-15:30:24.616232 139957383018048 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266670.sst) /dev/shm/ToplingTemp/Topling-95499-bx5VMl 2024/11/23-15:30:24.969742 139957383018048 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266670.sst): first pass time = 0.35's, 379.736'MB/sec 2024/11/23-15:30:26.051775 139957383018048 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266670.sst): old prealloc_size = 147639500, real_size = 40658640 2024/11/23-15:30:26.051938 139957383018048 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266670.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129430 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.81 raw-val = 0.1316 GB zip-val = 0.0404 GB avg-val =1016.99 avg-zval = 312.08 2024/11/23-15:30:26.052410 139957383018048 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266670.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-15:30:26.324717 139957383018048 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266670.sst): second pass time = 1.08's, 121.754'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.27's, 155.684'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1675.047'MB/sec (index lex order gen) rebuild zvType time = 0.20's, 0.160'MB/sec write SST data time = 0.07's, 606.024'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 48785.090'MB/sec zip my value time = 1.08's, unzip length = 0.132'GB zip my value throughput = 121.754'MB/sec zip pipeline throughput = 150.406'MB/sec entries = 129430 avg-key = 20.00 avg-zkey = 1.81 avg-val = 1016.99 avg-zval = 312.08 usrkeys = 129430 avg-key = 12.00 avg-zkey = 1.81 avg-val = 1023.99 avg-zval = 312.08 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129430 bytes = 485376 } seq expand size = 906010 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0404 GB dict = 1.38 MB all = 0.0425 GB } UnZip/Zip{ index = 6.6470 value = 3.2588 dict = 1.00 all = 3.1587 } Zip/UnZip{ index = 0.1504 value = 0.3069 dict = 1.00 all = 0.3166 } ---------------------------- total value len = 8.981155 GB avg = 0.171 KB (by entry num) total key len = 1.443410 GB avg = 0.028 KB total ukey len = 0.999431 GB avg = 0.015 KB total ukey num = 0.065679865 Billion total entry num = 0.052487594 Billion write speed all = 0.439593347 MB/sec (with seq num) write speed all = 0.421886558 MB/sec (without seq num) 2024/11/23-15:30:26.378864 139957383018048 [compaction_job.cc:1948] [default] [JOB 29360] Generated table #266670: 129430 keys, 42491537 bytes, temperature: kWarm 2024/11/23-15:30:26.378956 139957383018048 EVENT_LOG_v1 {"time_micros": 1732347026378898, "cf_name": "default", "job": 29360, "event": "table_file_creation", "file_number": 266670, "file_size": 42491537, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237877277, "largest_seqno": 4069847783, "table_properties": {"data_size": 40392448, "index_size": 233664, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588600, "raw_average_key_size": 20, "raw_value_size": 131629533, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129430, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732347024, "oldest_key_time": 0, "file_creation_time": 1732347024, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 266670, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-15:30:26.418755 139957383018048 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266671.sst) /dev/shm/ToplingTemp/Topling-95499-3i8u3o 2024/11/23-15:30:26.978006 139957383018048 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266671.sst): first pass time = 0.56's, 240.011'MB/sec 2024/11/23-15:30:27.869455 139957383018048 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266671.sst): old prealloc_size = 147639500, real_size = 40833856 2024/11/23-15:30:27.869582 139957383018048 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266671.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129432 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.76 raw-val = 0.1316 GB zip-val = 0.0406 GB avg-val =1016.98 avg-zval = 313.48 2024/11/23-15:30:27.869783 139957383018048 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266671.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-15:30:28.040195 139957383018048 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266671.sst): second pass time = 0.89's, 147.922'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.17's, 249.924'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2208.055'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.265'MB/sec write SST data time = 0.05's, 877.302'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 36048.735'MB/sec zip my value time = 0.89's, unzip length = 0.132'GB zip my value throughput = 147.922'MB/sec zip pipeline throughput = 147.922'MB/sec entries = 129432 avg-key = 20.00 avg-zkey = 1.76 avg-val = 1016.98 avg-zval = 313.48 usrkeys = 129432 avg-key = 12.00 avg-zkey = 1.76 avg-val = 1023.98 avg-zval = 313.48 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129432 bytes = 485392 } seq expand size = 906024 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0406 GB dict = 1.38 MB all = 0.0427 GB } UnZip/Zip{ index = 6.8362 value = 3.2442 dict = 1.00 all = 3.1457 } Zip/UnZip{ index = 0.1463 value = 0.3082 dict = 1.00 all = 0.3179 } ---------------------------- total value len = 9.113691 GB avg = 0.173 KB (by entry num) total key len = 1.445998 GB avg = 0.027 KB total ukey len = 1.000984 GB avg = 0.015 KB total ukey num = 0.065809297 Billion total entry num = 0.052617026 Billion write speed all = 0.445259204 MB/sec (with seq num) write speed all = 0.427510034 MB/sec (without seq num) 2024/11/23-15:30:28.093320 139957383018048 [compaction_job.cc:1948] [default] [JOB 29360] Generated table #266671: 129432 keys, 42666674 bytes, temperature: kWarm 2024/11/23-15:30:28.093391 139957383018048 EVENT_LOG_v1 {"time_micros": 1732347028093355, "cf_name": "default", "job": 29360, "event": "table_file_creation", "file_number": 266671, "file_size": 42666674, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237868195, "largest_seqno": 4069832419, "table_properties": {"data_size": 40574128, "index_size": 227200, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588640, "raw_average_key_size": 20, "raw_value_size": 131629917, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129432, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732347026, "oldest_key_time": 0, "file_creation_time": 1732347026, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 266671, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-15:30:28.136629 139957383018048 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266672.sst) /dev/shm/ToplingTemp/Topling-95499-zHla6p 2024/11/23-15:30:28.975174 139957383018048 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266672.sst): first pass time = 0.84's, 160.069'MB/sec 2024/11/23-15:30:30.429594 139957383018048 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266672.sst): old prealloc_size = 147639500, real_size = 40642864 2024/11/23-15:30:30.429729 139957383018048 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266672.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129433 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.81 raw-val = 0.1316 GB zip-val = 0.0404 GB avg-val =1016.97 avg-zval = 311.95 2024/11/23-15:30:30.429900 139957383018048 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266672.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-15:30:30.595505 139957383018048 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266672.sst): second pass time = 1.45's, 90.558'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.17's, 256.054'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2373.664'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.274'MB/sec write SST data time = 0.05's, 892.788'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 38403.886'MB/sec zip my value time = 1.45's, unzip length = 0.132'GB zip my value throughput = 90.558'MB/sec zip pipeline throughput = 96.941'MB/sec entries = 129433 avg-key = 20.00 avg-zkey = 1.81 avg-val = 1016.97 avg-zval = 311.95 usrkeys = 129433 avg-key = 12.00 avg-zkey = 1.81 avg-val = 1023.97 avg-zval = 311.95 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129433 bytes = 485392 } seq expand size = 906031 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0404 GB dict = 1.38 MB all = 0.0425 GB } UnZip/Zip{ index = 6.6362 value = 3.2601 dict = 1.00 all = 3.1599 } Zip/UnZip{ index = 0.1507 value = 0.3067 dict = 1.00 all = 0.3165 } ---------------------------- total value len = 9.246227 GB avg = 0.175 KB (by entry num) total key len = 1.448587 GB avg = 0.027 KB total ukey len = 1.002538 GB avg = 0.015 KB total ukey num = 0.065938730 Billion total entry num = 0.052746459 Billion write speed all = 0.450908282 MB/sec (with seq num) write speed all = 0.433117369 MB/sec (without seq num) 2024/11/23-15:30:30.651107 139957383018048 [compaction_job.cc:1948] [default] [JOB 29360] Generated table #266672: 129433 keys, 42475364 bytes, temperature: kWarm 2024/11/23-15:30:30.651191 139957383018048 EVENT_LOG_v1 {"time_micros": 1732347030651145, "cf_name": "default", "job": 29360, "event": "table_file_creation", "file_number": 266672, "file_size": 42475364, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237873554, "largest_seqno": 4069842915, "table_properties": {"data_size": 40376288, "index_size": 234048, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588660, "raw_average_key_size": 20, "raw_value_size": 131630085, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129433, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732347028, "oldest_key_time": 0, "file_creation_time": 1732347028, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 266672, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-15:30:30.730275 139957383018048 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266673.sst) /dev/shm/ToplingTemp/Topling-95499-3v85rp 2024/11/23-15:30:31.409419 139957383018048 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266673.sst): first pass time = 0.68's, 197.643'MB/sec 2024/11/23-15:30:32.261813 139957383018048 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266673.sst): old prealloc_size = 147639500, real_size = 40848016 2024/11/23-15:30:32.261939 139957383018048 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266673.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129434 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.75 raw-val = 0.1316 GB zip-val = 0.0406 GB avg-val =1016.96 avg-zval = 313.59 2024/11/23-15:30:32.262127 139957383018048 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266673.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-15:30:32.439211 139957383018048 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266673.sst): second pass time = 0.85's, 154.558'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.18's, 240.623'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2189.708'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.260'MB/sec write SST data time = 0.05's, 810.160'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 36629.214'MB/sec zip my value time = 0.85's, unzip length = 0.132'GB zip my value throughput = 154.558'MB/sec zip pipeline throughput = 154.558'MB/sec entries = 129434 avg-key = 20.00 avg-zkey = 1.75 avg-val = 1016.96 avg-zval = 313.59 usrkeys = 129434 avg-key = 12.00 avg-zkey = 1.75 avg-val = 1023.96 avg-zval = 313.59 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129434 bytes = 485392 } seq expand size = 906038 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0406 GB dict = 1.38 MB all = 0.0427 GB } UnZip/Zip{ index = 6.8459 value = 3.2430 dict = 1.00 all = 3.1447 } Zip/UnZip{ index = 0.1461 value = 0.3084 dict = 1.00 all = 0.3180 } ---------------------------- total value len = 9.378763 GB avg = 0.177 KB (by entry num) total key len = 1.451176 GB avg = 0.027 KB total ukey len = 1.004091 GB avg = 0.015 KB total ukey num = 0.066068164 Billion total entry num = 0.052875893 Billion write speed all = 0.456569809 MB/sec (with seq num) write speed all = 0.438736624 MB/sec (without seq num) 2024/11/23-15:30:32.491761 139957383018048 [compaction_job.cc:1948] [default] [JOB 29360] Generated table #266673: 129434 keys, 42680481 bytes, temperature: kWarm 2024/11/23-15:30:32.491825 139957383018048 EVENT_LOG_v1 {"time_micros": 1732347032491794, "cf_name": "default", "job": 29360, "event": "table_file_creation", "file_number": 266673, "file_size": 42680481, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237868596, "largest_seqno": 4069846441, "table_properties": {"data_size": 40588608, "index_size": 226880, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588680, "raw_average_key_size": 20, "raw_value_size": 131629298, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129434, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732347030, "oldest_key_time": 0, "file_creation_time": 1732347030, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 266673, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-15:30:32.532275 139957383018048 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266674.sst) /dev/shm/ToplingTemp/Topling-95499-tQAIFp 2024/11/23-15:30:33.329393 139957383018048 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266674.sst): first pass time = 0.80's, 168.389'MB/sec 2024/11/23-15:30:34.742613 139957383018048 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266674.sst): old prealloc_size = 147639500, real_size = 40591824 2024/11/23-15:30:34.742755 139957383018048 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266674.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129429 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.82 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1017.00 avg-zval = 311.55 2024/11/23-15:30:34.742926 139957383018048 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266674.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-15:30:34.915444 139957383018048 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266674.sst): second pass time = 1.40's, 94.014'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.17's, 245.498'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2227.541'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.259'MB/sec write SST data time = 0.05's, 884.604'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 49311.191'MB/sec zip my value time = 1.40's, unzip length = 0.132'GB zip my value throughput = 94.014'MB/sec zip pipeline throughput = 117.670'MB/sec entries = 129429 avg-key = 20.00 avg-zkey = 1.82 avg-val = 1017.00 avg-zval = 311.55 usrkeys = 129429 avg-key = 12.00 avg-zkey = 1.82 avg-val = 1024.00 avg-zval = 311.55 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129429 bytes = 485376 } seq expand size = 906003 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0424 GB } UnZip/Zip{ index = 6.6017 value = 3.2643 dict = 1.00 all = 3.1637 } Zip/UnZip{ index = 0.1515 value = 0.3063 dict = 1.00 all = 0.3161 } ---------------------------- total value len = 9.511298 GB avg = 0.179 KB (by entry num) total key len = 1.453764 GB avg = 0.027 KB total ukey len = 1.005644 GB avg = 0.015 KB total ukey num = 0.066197593 Billion total entry num = 0.053005322 Billion write speed all = 0.462218129 MB/sec (with seq num) write speed all = 0.444343158 MB/sec (without seq num) 2024/11/23-15:30:34.968316 139957383018048 [compaction_job.cc:1948] [default] [JOB 29360] Generated table #266674: 129429 keys, 42424395 bytes, temperature: kWarm 2024/11/23-15:30:34.968383 139957383018048 EVENT_LOG_v1 {"time_micros": 1732347034968348, "cf_name": "default", "job": 29360, "event": "table_file_creation", "file_number": 266674, "file_size": 42424395, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237869923, "largest_seqno": 4069838924, "table_properties": {"data_size": 40324032, "index_size": 235264, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588580, "raw_average_key_size": 20, "raw_value_size": 131629395, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129429, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732347032, "oldest_key_time": 0, "file_creation_time": 1732347032, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 266674, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-15:30:35.005434 139957383018048 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266675.sst) /dev/shm/ToplingTemp/Topling-95499-MHzt0m 2024/11/23-15:30:35.544624 139957383018048 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266675.sst): first pass time = 0.54's, 248.948'MB/sec 2024/11/23-15:30:36.404601 139957383018048 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266675.sst): old prealloc_size = 147639500, real_size = 40806672 2024/11/23-15:30:36.404742 139957383018048 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266675.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129430 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.78 raw-val = 0.1316 GB zip-val = 0.0405 GB avg-val =1016.99 avg-zval = 313.24 2024/11/23-15:30:36.404904 139957383018048 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266675.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-15:30:36.751127 139957383018048 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266675.sst): second pass time = 0.86's, 153.192'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.35's, 123.063'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2316.687'MB/sec (index lex order gen) rebuild zvType time = 0.22's, 0.150'MB/sec write SST data time = 0.13's, 326.341'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 49541.487'MB/sec zip my value time = 0.86's, unzip length = 0.132'GB zip my value throughput = 153.192'MB/sec zip pipeline throughput = 153.192'MB/sec entries = 129430 avg-key = 20.00 avg-zkey = 1.78 avg-val = 1016.99 avg-zval = 313.24 usrkeys = 129430 avg-key = 12.00 avg-zkey = 1.78 avg-val = 1023.99 avg-zval = 313.24 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129430 bytes = 485376 } seq expand size = 906010 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0405 GB dict = 1.38 MB all = 0.0426 GB } UnZip/Zip{ index = 6.7243 value = 3.2467 dict = 1.00 all = 3.1477 } Zip/UnZip{ index = 0.1487 value = 0.3080 dict = 1.00 all = 0.3177 } ---------------------------- total value len = 9.643834 GB avg = 0.181 KB (by entry num) total key len = 1.456353 GB avg = 0.027 KB total ukey len = 1.007197 GB avg = 0.015 KB total ukey num = 0.066327023 Billion total entry num = 0.053134752 Billion write speed all = 0.467877912 MB/sec (with seq num) write speed all = 0.449960681 MB/sec (without seq num) 2024/11/23-15:30:36.816415 139957383018048 [compaction_job.cc:1948] [default] [JOB 29360] Generated table #266675: 129430 keys, 42639485 bytes, temperature: kWarm 2024/11/23-15:30:36.816505 139957383018048 EVENT_LOG_v1 {"time_micros": 1732347036816459, "cf_name": "default", "job": 29360, "event": "table_file_creation", "file_number": 266675, "file_size": 42639485, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237881756, "largest_seqno": 4069834272, "table_properties": {"data_size": 40543168, "index_size": 230976, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588600, "raw_average_key_size": 20, "raw_value_size": 131629615, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129430, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732347034, "oldest_key_time": 0, "file_creation_time": 1732347034, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 266675, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-15:30:36.893821 139957383018048 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266676.sst) /dev/shm/ToplingTemp/Topling-95499-BjiW0l 2024/11/23-15:30:37.587812 139957383018048 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266676.sst): first pass time = 0.69's, 193.416'MB/sec 2024/11/23-15:30:38.472427 139957383018048 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266676.sst): old prealloc_size = 147639500, real_size = 41023776 2024/11/23-15:30:38.472546 139957383018048 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266676.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129427 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.73 raw-val = 0.1316 GB zip-val = 0.0408 GB avg-val =1017.02 avg-zval = 314.98 2024/11/23-15:30:38.472725 139957383018048 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266676.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-15:30:38.634677 139957383018048 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266676.sst): second pass time = 0.88's, 149.004'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 264.170'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2308.441'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.273'MB/sec write SST data time = 0.04's, 983.015'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 33900.859'MB/sec zip my value time = 0.88's, unzip length = 0.132'GB zip my value throughput = 149.004'MB/sec zip pipeline throughput = 149.004'MB/sec entries = 129427 avg-key = 20.00 avg-zkey = 1.73 avg-val = 1017.02 avg-zval = 314.98 usrkeys = 129427 avg-key = 12.00 avg-zkey = 1.73 avg-val = 1024.02 avg-zval = 314.98 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129427 bytes = 485360 } seq expand size = 905989 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0408 GB dict = 1.38 MB all = 0.0429 GB } UnZip/Zip{ index = 6.9395 value = 3.2288 dict = 1.00 all = 3.1318 } Zip/UnZip{ index = 0.1441 value = 0.3097 dict = 1.00 all = 0.3193 } ---------------------------- total value len = 9.776370 GB avg = 0.184 KB (by entry num) total key len = 1.458941 GB avg = 0.027 KB total ukey len = 1.008750 GB avg = 0.015 KB total ukey num = 0.066456450 Billion total entry num = 0.053264179 Billion write speed all = 0.473535873 MB/sec (with seq num) write speed all = 0.455576424 MB/sec (without seq num) 2024/11/23-15:30:38.687086 139957383018048 [compaction_job.cc:1948] [default] [JOB 29360] Generated table #266676: 129427 keys, 42856499 bytes, temperature: kWarm 2024/11/23-15:30:38.687157 139957383018048 EVENT_LOG_v1 {"time_micros": 1732347038687121, "cf_name": "default", "job": 29360, "event": "table_file_creation", "file_number": 266676, "file_size": 42856499, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237880987, "largest_seqno": 4069841979, "table_properties": {"data_size": 40767440, "index_size": 223808, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588540, "raw_average_key_size": 20, "raw_value_size": 131629899, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129427, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732347036, "oldest_key_time": 0, "file_creation_time": 1732347036, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 266676, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-15:30:38.726168 139957383018048 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266677.sst) /dev/shm/ToplingTemp/Topling-95499-gKS2jn 2024/11/23-15:30:39.493147 139957383018048 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266677.sst): first pass time = 0.77's, 175.004'MB/sec 2024/11/23-15:30:40.324236 139957383018048 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266677.sst): old prealloc_size = 147639500, real_size = 40975184 2024/11/23-15:30:40.324353 139957383018048 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266677.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129431 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.71 raw-val = 0.1316 GB zip-val = 0.0407 GB avg-val =1016.98 avg-zval = 314.62 2024/11/23-15:30:40.324508 139957383018048 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266677.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-15:30:40.483545 139957383018048 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266677.sst): second pass time = 0.83's, 158.525'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 268.749'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2295.764'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.275'MB/sec write SST data time = 0.04's, 1033.376'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 48772.005'MB/sec zip my value time = 0.83's, unzip length = 0.132'GB zip my value throughput = 158.525'MB/sec zip pipeline throughput = 158.525'MB/sec entries = 129431 avg-key = 20.00 avg-zkey = 1.71 avg-val = 1016.98 avg-zval = 314.62 usrkeys = 129431 avg-key = 12.00 avg-zkey = 1.71 avg-val = 1023.98 avg-zval = 314.62 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129431 bytes = 485376 } seq expand size = 906017 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0407 GB dict = 1.38 MB all = 0.0428 GB } UnZip/Zip{ index = 7.0323 value = 3.2324 dict = 1.00 all = 3.1353 } Zip/UnZip{ index = 0.1422 value = 0.3094 dict = 1.00 all = 0.3189 } ---------------------------- total value len = 9.908905 GB avg = 0.186 KB (by entry num) total key len = 1.461530 GB avg = 0.027 KB total ukey len = 1.010303 GB avg = 0.015 KB total ukey num = 0.066585881 Billion total entry num = 0.053393610 Billion write speed all = 0.479193615 MB/sec (with seq num) write speed all = 0.461191928 MB/sec (without seq num) 2024/11/23-15:30:40.536471 139957383018048 [compaction_job.cc:1948] [default] [JOB 29360] Generated table #266677: 129431 keys, 42808004 bytes, temperature: kWarm 2024/11/23-15:30:40.536561 139957383018048 EVENT_LOG_v1 {"time_micros": 1732347040536506, "cf_name": "default", "job": 29360, "event": "table_file_creation", "file_number": 266677, "file_size": 42808004, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237868290, "largest_seqno": 4069848183, "table_properties": {"data_size": 40721792, "index_size": 220864, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588620, "raw_average_key_size": 20, "raw_value_size": 131629299, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129431, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732347038, "oldest_key_time": 0, "file_creation_time": 1732347038, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 266677, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-15:30:40.572757 139957383018048 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266678.sst) /dev/shm/ToplingTemp/Topling-95499-xLcaEn 2024/11/23-15:30:41.146391 139957383018048 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266678.sst): first pass time = 0.57's, 233.994'MB/sec 2024/11/23-15:30:41.963774 139957383018048 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266678.sst): old prealloc_size = 147639500, real_size = 40693440 2024/11/23-15:30:41.963895 139957383018048 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266678.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129433 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.80 raw-val = 0.1316 GB zip-val = 0.0404 GB avg-val =1016.97 avg-zval = 312.35 2024/11/23-15:30:41.964075 139957383018048 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266678.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-15:30:42.136650 139957383018048 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266678.sst): second pass time = 0.82's, 161.179'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.17's, 246.034'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2318.831'MB/sec (index lex order gen) rebuild zvType time = 0.13's, 0.257'MB/sec write SST data time = 0.05's, 908.398'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 49645.571'MB/sec zip my value time = 0.82's, unzip length = 0.132'GB zip my value throughput = 161.179'MB/sec zip pipeline throughput = 161.179'MB/sec entries = 129433 avg-key = 20.00 avg-zkey = 1.80 avg-val = 1016.97 avg-zval = 312.35 usrkeys = 129433 avg-key = 12.00 avg-zkey = 1.80 avg-val = 1023.97 avg-zval = 312.35 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129433 bytes = 485392 } seq expand size = 906031 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0404 GB dict = 1.38 MB all = 0.0425 GB } UnZip/Zip{ index = 6.6746 value = 3.2559 dict = 1.00 all = 3.1561 } Zip/UnZip{ index = 0.1498 value = 0.3071 dict = 1.00 all = 0.3168 } ---------------------------- total value len = 10.041441 GB avg = 0.188 KB (by entry num) total key len = 1.464119 GB avg = 0.027 KB total ukey len = 1.011857 GB avg = 0.015 KB total ukey num = 0.066715314 Billion total entry num = 0.053523043 Billion write speed all = 0.484854494 MB/sec (with seq num) write speed all = 0.466810425 MB/sec (without seq num) 2024/11/23-15:30:42.188219 139957383018048 [compaction_job.cc:1948] [default] [JOB 29360] Generated table #266678: 129433 keys, 42526533 bytes, temperature: kWarm 2024/11/23-15:30:42.188289 139957383018048 EVENT_LOG_v1 {"time_micros": 1732347042188252, "cf_name": "default", "job": 29360, "event": "table_file_creation", "file_number": 266678, "file_size": 42526533, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237874127, "largest_seqno": 4069848184, "table_properties": {"data_size": 40428208, "index_size": 232704, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588660, "raw_average_key_size": 20, "raw_value_size": 131629665, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129433, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732347040, "oldest_key_time": 0, "file_creation_time": 1732347040, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 266678, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-15:30:42.229158 139957383018048 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266679.sst) /dev/shm/ToplingTemp/Topling-95499-i8yrao 2024/11/23-15:30:42.886463 139957383018048 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266679.sst): first pass time = 0.66's, 204.209'MB/sec 2024/11/23-15:30:43.750117 139957383018048 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266679.sst): old prealloc_size = 147639500, real_size = 40598112 2024/11/23-15:30:43.750242 139957383018048 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266679.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129431 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.82 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1016.99 avg-zval = 311.60 2024/11/23-15:30:43.750407 139957383018048 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266679.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-15:30:43.943722 139957383018048 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266679.sst): second pass time = 0.86's, 152.580'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.19's, 219.175'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2275.300'MB/sec (index lex order gen) rebuild zvType time = 0.14's, 0.229'MB/sec write SST data time = 0.05's, 809.530'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 46839.719'MB/sec zip my value time = 0.86's, unzip length = 0.132'GB zip my value throughput = 152.580'MB/sec zip pipeline throughput = 152.580'MB/sec entries = 129431 avg-key = 20.00 avg-zkey = 1.82 avg-val = 1016.99 avg-zval = 311.60 usrkeys = 129431 avg-key = 12.00 avg-zkey = 1.82 avg-val = 1023.99 avg-zval = 311.60 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129431 bytes = 485376 } seq expand size = 906017 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0424 GB } UnZip/Zip{ index = 6.6036 value = 3.2638 dict = 1.00 all = 3.1632 } Zip/UnZip{ index = 0.1514 value = 0.3064 dict = 1.00 all = 0.3161 } ---------------------------- total value len = 10.173977 GB avg = 0.190 KB (by entry num) total key len = 1.466707 GB avg = 0.027 KB total ukey len = 1.013410 GB avg = 0.015 KB total ukey num = 0.066844745 Billion total entry num = 0.053652474 Billion write speed all = 0.490511416 MB/sec (with seq num) write speed all = 0.472425090 MB/sec (without seq num) 2024/11/23-15:30:44.001052 139957383018048 [compaction_job.cc:1948] [default] [JOB 29360] Generated table #266679: 129431 keys, 42430747 bytes, temperature: kWarm 2024/11/23-15:30:44.001120 139957383018048 EVENT_LOG_v1 {"time_micros": 1732347044001087, "cf_name": "default", "job": 29360, "event": "table_file_creation", "file_number": 266679, "file_size": 42430747, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237873605, "largest_seqno": 4069845833, "table_properties": {"data_size": 40330384, "index_size": 235200, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588620, "raw_average_key_size": 20, "raw_value_size": 131630095, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129431, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732347042, "oldest_key_time": 0, "file_creation_time": 1732347042, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 266679, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-15:30:44.043474 139957383018048 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266680.sst) /dev/shm/ToplingTemp/Topling-95499-55Qd6p 2024/11/23-15:30:44.783217 139957383018048 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266680.sst): first pass time = 0.74's, 181.448'MB/sec 2024/11/23-15:30:45.625193 139957383018048 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266680.sst): old prealloc_size = 147639500, real_size = 40849168 2024/11/23-15:30:45.625332 139957383018048 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266680.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129432 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.78 raw-val = 0.1316 GB zip-val = 0.0406 GB avg-val =1016.98 avg-zval = 313.58 2024/11/23-15:30:45.625496 139957383018048 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266680.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-15:30:45.787062 139957383018048 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266680.sst): second pass time = 0.84's, 156.567'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 263.727'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2133.670'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.276'MB/sec write SST data time = 0.04's, 960.919'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 47254.663'MB/sec zip my value time = 0.84's, unzip length = 0.132'GB zip my value throughput = 156.567'MB/sec zip pipeline throughput = 156.567'MB/sec entries = 129432 avg-key = 20.00 avg-zkey = 1.78 avg-val = 1016.98 avg-zval = 313.58 usrkeys = 129432 avg-key = 12.00 avg-zkey = 1.78 avg-val = 1023.98 avg-zval = 313.58 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129432 bytes = 485392 } seq expand size = 906024 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0406 GB dict = 1.38 MB all = 0.0427 GB } UnZip/Zip{ index = 6.7544 value = 3.2432 dict = 1.00 all = 3.1446 } Zip/UnZip{ index = 0.1481 value = 0.3083 dict = 1.00 all = 0.3180 } ---------------------------- total value len = 10.306513 GB avg = 0.192 KB (by entry num) total key len = 1.469296 GB avg = 0.027 KB total ukey len = 1.014963 GB avg = 0.015 KB total ukey num = 0.066974177 Billion total entry num = 0.053781906 Billion write speed all = 0.496166705 MB/sec (with seq num) write speed all = 0.478038156 MB/sec (without seq num) 2024/11/23-15:30:45.841101 139957383018048 [compaction_job.cc:1948] [default] [JOB 29360] Generated table #266680: 129432 keys, 42682259 bytes, temperature: kWarm 2024/11/23-15:30:45.841167 139957383018048 EVENT_LOG_v1 {"time_micros": 1732347045841133, "cf_name": "default", "job": 29360, "event": "table_file_creation", "file_number": 266680, "file_size": 42682259, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237872082, "largest_seqno": 4069842513, "table_properties": {"data_size": 40586688, "index_size": 229952, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588640, "raw_average_key_size": 20, "raw_value_size": 131629720, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129432, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732347044, "oldest_key_time": 0, "file_creation_time": 1732347044, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 266680, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-15:30:45.882173 139957383018048 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266681.sst) /dev/shm/ToplingTemp/Topling-95499-h0vtSl 2024/11/23-15:30:46.474373 139957383018048 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266681.sst): first pass time = 0.59's, 226.657'MB/sec 2024/11/23-15:30:47.403059 139957383018048 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266681.sst): old prealloc_size = 147639500, real_size = 40910560 2024/11/23-15:30:47.403202 139957383018048 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266681.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129425 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.76 raw-val = 0.1316 GB zip-val = 0.0406 GB avg-val =1017.03 avg-zval = 314.08 2024/11/23-15:30:47.403402 139957383018048 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266681.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-15:30:47.581093 139957383018048 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266681.sst): second pass time = 0.93's, 141.855'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.18's, 240.091'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1872.205'MB/sec (index lex order gen) rebuild zvType time = 0.13's, 0.246'MB/sec write SST data time = 0.05's, 920.962'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 47253.531'MB/sec zip my value time = 0.93's, unzip length = 0.132'GB zip my value throughput = 141.855'MB/sec zip pipeline throughput = 157.888'MB/sec entries = 129425 avg-key = 20.00 avg-zkey = 1.76 avg-val = 1017.03 avg-zval = 314.08 usrkeys = 129425 avg-key = 12.00 avg-zkey = 1.76 avg-val = 1024.03 avg-zval = 314.08 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129425 bytes = 485360 } seq expand size = 905975 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0406 GB dict = 1.38 MB all = 0.0427 GB } UnZip/Zip{ index = 6.8071 value = 3.2381 dict = 1.00 all = 3.1401 } Zip/UnZip{ index = 0.1469 value = 0.3088 dict = 1.00 all = 0.3185 } ---------------------------- total value len = 10.439048 GB avg = 0.194 KB (by entry num) total key len = 1.471884 GB avg = 0.027 KB total ukey len = 1.016516 GB avg = 0.015 KB total ukey num = 0.067103602 Billion total entry num = 0.053911331 Billion write speed all = 0.501822134 MB/sec (with seq num) write speed all = 0.483651332 MB/sec (without seq num) 2024/11/23-15:30:47.634059 139957383018048 [compaction_job.cc:1948] [default] [JOB 29360] Generated table #266681: 129425 keys, 42743727 bytes, temperature: kWarm 2024/11/23-15:30:47.634128 139957383018048 EVENT_LOG_v1 {"time_micros": 1732347047634093, "cf_name": "default", "job": 29360, "event": "table_file_creation", "file_number": 266681, "file_size": 42743727, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237871365, "largest_seqno": 4069842647, "table_properties": {"data_size": 40649872, "index_size": 228160, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588500, "raw_average_key_size": 20, "raw_value_size": 131629348, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129425, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732347045, "oldest_key_time": 0, "file_creation_time": 1732347045, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 266681, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-15:30:47.672408 139957383018048 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266682.sst) /dev/shm/ToplingTemp/Topling-95499-JAZMAn 2024/11/23-15:30:48.401335 139957383018048 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266682.sst): first pass time = 0.73's, 184.140'MB/sec 2024/11/23-15:30:49.220557 139957383018048 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266682.sst): old prealloc_size = 147639500, real_size = 40550992 2024/11/23-15:30:49.220705 139957383018048 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266682.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129429 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.76 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1017.00 avg-zval = 311.29 2024/11/23-15:30:49.220869 139957383018048 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266682.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-15:30:49.384833 139957383018048 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266682.sst): second pass time = 0.82's, 160.822'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 256.970'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1959.206'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.275'MB/sec write SST data time = 0.05's, 911.237'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 45107.111'MB/sec zip my value time = 0.82's, unzip length = 0.132'GB zip my value throughput = 160.822'MB/sec zip pipeline throughput = 160.822'MB/sec entries = 129429 avg-key = 20.00 avg-zkey = 1.76 avg-val = 1017.00 avg-zval = 311.29 usrkeys = 129429 avg-key = 12.00 avg-zkey = 1.76 avg-val = 1021.17 avg-zval = 311.29 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 77036 bytes = 288896 } seq expand size = 539252 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0422 GB } UnZip/Zip{ index = 6.8054 value = 3.2670 dict = 1.00 all = 3.1799 } Zip/UnZip{ index = 0.1469 value = 0.3061 dict = 1.00 all = 0.3145 } ---------------------------- total value len = 10.571216 GB avg = 0.196 KB (by entry num) total key len = 1.474473 GB avg = 0.027 KB total ukey len = 1.018069 GB avg = 0.015 KB total ukey num = 0.067233031 Billion total entry num = 0.054040760 Billion write speed all = 0.507461058 MB/sec (with seq num) write speed all = 0.489248016 MB/sec (without seq num) 2024/11/23-15:30:49.438458 139957383018048 [compaction_job.cc:1948] [default] [JOB 29360] Generated table #266682: 129429 keys, 42207905 bytes, temperature: kWarm 2024/11/23-15:30:49.438527 139957383018048 EVENT_LOG_v1 {"time_micros": 1732347049438492, "cf_name": "default", "job": 29360, "event": "table_file_creation", "file_number": 266682, "file_size": 42207905, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4069844124, "table_properties": {"data_size": 40290240, "index_size": 228224, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588580, "raw_average_key_size": 20, "raw_value_size": 131629408, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129429, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732347047, "oldest_key_time": 0, "file_creation_time": 1732347047, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 266682, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-15:30:49.476685 139957383018048 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266683.sst) /dev/shm/ToplingTemp/Topling-95499-UpOH0m 2024/11/23-15:30:50.148604 139957383018048 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266683.sst): first pass time = 0.67's, 199.765'MB/sec 2024/11/23-15:30:51.114352 139957383018048 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266683.sst): old prealloc_size = 147639500, real_size = 40847728 2024/11/23-15:30:51.114461 139957383018048 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266683.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129431 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.70 raw-val = 0.1316 GB zip-val = 0.0406 GB avg-val =1016.98 avg-zval = 313.64 2024/11/23-15:30:51.114573 139957383018048 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266683.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-15:30:51.274050 139957383018048 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266683.sst): second pass time = 0.96's, 136.548'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 266.242'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2423.672'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.276'MB/sec write SST data time = 0.04's, 1005.274'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 48095.286'MB/sec zip my value time = 0.96's, unzip length = 0.132'GB zip my value throughput = 136.548'MB/sec zip pipeline throughput = 136.548'MB/sec entries = 129431 avg-key = 20.00 avg-zkey = 1.70 avg-val = 1016.98 avg-zval = 313.64 usrkeys = 129431 avg-key = 12.00 avg-zkey = 1.70 avg-val = 1021.25 avg-zval = 313.64 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 78864 bytes = 295760 } seq expand size = 552048 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0406 GB dict = 1.38 MB all = 0.0425 GB } UnZip/Zip{ index = 7.0465 value = 3.2425 dict = 1.00 all = 3.1572 } Zip/UnZip{ index = 0.1419 value = 0.3084 dict = 1.00 all = 0.3167 } ---------------------------- total value len = 10.703398 GB avg = 0.198 KB (by entry num) total key len = 1.477062 GB avg = 0.027 KB total ukey len = 1.019622 GB avg = 0.015 KB total ukey num = 0.067362462 Billion total entry num = 0.054170191 Billion write speed all = 0.513097805 MB/sec (with seq num) write speed all = 0.494842595 MB/sec (without seq num) 2024/11/23-15:30:51.326064 139957383018048 [compaction_job.cc:1948] [default] [JOB 29360] Generated table #266683: 129431 keys, 42511642 bytes, temperature: kWarm 2024/11/23-15:30:51.326133 139957383018048 EVENT_LOG_v1 {"time_micros": 1732347051326098, "cf_name": "default", "job": 29360, "event": "table_file_creation", "file_number": 266683, "file_size": 42511642, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4069840454, "table_properties": {"data_size": 40594784, "index_size": 220416, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588620, "raw_average_key_size": 20, "raw_value_size": 131629118, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129431, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732347049, "oldest_key_time": 0, "file_creation_time": 1732347049, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 266683, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-15:30:51.367910 139957383018048 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266684.sst) /dev/shm/ToplingTemp/Topling-95499-Aqvr6o 2024/11/23-15:30:52.000146 139957383018048 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266684.sst): first pass time = 0.63's, 212.304'MB/sec 2024/11/23-15:30:52.823635 139957383018048 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266684.sst): old prealloc_size = 147639500, real_size = 40741152 2024/11/23-15:30:52.823779 139957383018048 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266684.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129427 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.73 raw-val = 0.1316 GB zip-val = 0.0405 GB avg-val =1017.02 avg-zval = 312.80 2024/11/23-15:30:52.823941 139957383018048 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266684.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-15:30:53.002555 139957383018048 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266684.sst): second pass time = 0.82's, 159.996'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.18's, 236.985'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1878.836'MB/sec (index lex order gen) rebuild zvType time = 0.13's, 0.250'MB/sec write SST data time = 0.05's, 856.311'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 31656.993'MB/sec zip my value time = 0.82's, unzip length = 0.132'GB zip my value throughput = 159.996'MB/sec zip pipeline throughput = 159.996'MB/sec entries = 129427 avg-key = 20.00 avg-zkey = 1.73 avg-val = 1017.02 avg-zval = 312.80 usrkeys = 129427 avg-key = 12.00 avg-zkey = 1.73 avg-val = 1021.24 avg-zval = 312.80 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 78069 bytes = 292768 } seq expand size = 546483 multi value expand size = 0 cnt WriteAppend = 11 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0405 GB dict = 1.38 MB all = 0.0424 GB } UnZip/Zip{ index = 6.9257 value = 3.2514 dict = 1.00 all = 3.1654 } Zip/UnZip{ index = 0.1444 value = 0.3076 dict = 1.00 all = 0.3159 } ---------------------------- total value len = 10.835573 GB avg = 0.200 KB (by entry num) total key len = 1.479650 GB avg = 0.027 KB total ukey len = 1.021175 GB avg = 0.015 KB total ukey num = 0.067491889 Billion total entry num = 0.054299618 Billion write speed all = 0.518736939 MB/sec (with seq num) write speed all = 0.500439444 MB/sec (without seq num) 2024/11/23-15:30:53.055169 139957383018048 [compaction_job.cc:1948] [default] [JOB 29360] Generated table #266684: 129427 keys, 42401359 bytes, temperature: kWarm 2024/11/23-15:30:53.055236 139957383018048 EVENT_LOG_v1 {"time_micros": 1732347053055204, "cf_name": "default", "job": 29360, "event": "table_file_creation", "file_number": 266684, "file_size": 42401359, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4069835039, "table_properties": {"data_size": 40484368, "index_size": 224256, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588540, "raw_average_key_size": 20, "raw_value_size": 131629354, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129427, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732347051, "oldest_key_time": 0, "file_creation_time": 1732347051, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 266684, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-15:30:53.095854 139957383018048 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266685.sst) /dev/shm/ToplingTemp/Topling-95499-VhnFbm 2024/11/23-15:30:53.889759 139957383018048 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266685.sst): first pass time = 0.79's, 169.070'MB/sec 2024/11/23-15:30:54.802011 139957383018048 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266685.sst): old prealloc_size = 147639500, real_size = 41071472 2024/11/23-15:30:54.802134 139957383018048 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266685.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129426 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.72 raw-val = 0.1316 GB zip-val = 0.0408 GB avg-val =1017.03 avg-zval = 315.36 2024/11/23-15:30:54.802293 139957383018048 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266685.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-15:30:55.000734 139957383018048 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266685.sst): second pass time = 0.91's, 144.400'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.20's, 215.860'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2215.620'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.272'MB/sec write SST data time = 0.08's, 538.350'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 42638.744'MB/sec zip my value time = 0.91's, unzip length = 0.132'GB zip my value throughput = 144.400'MB/sec zip pipeline throughput = 144.400'MB/sec entries = 129426 avg-key = 20.00 avg-zkey = 1.72 avg-val = 1017.03 avg-zval = 315.36 usrkeys = 129426 avg-key = 12.00 avg-zkey = 1.72 avg-val = 1023.60 avg-zval = 315.36 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 121500 bytes = 455632 } seq expand size = 850500 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0408 GB dict = 1.38 MB all = 0.0429 GB } UnZip/Zip{ index = 6.9794 value = 3.2249 dict = 1.00 all = 3.1290 } Zip/UnZip{ index = 0.1433 value = 0.3101 dict = 1.00 all = 0.3196 } ---------------------------- total value len = 10.968054 GB avg = 0.202 KB (by entry num) total key len = 1.482239 GB avg = 0.027 KB total ukey len = 1.022729 GB avg = 0.015 KB total ukey num = 0.067621315 Billion total entry num = 0.054429044 Billion write speed all = 0.524382116 MB/sec (with seq num) write speed all = 0.506042552 MB/sec (without seq num) 2024/11/23-15:30:55.012460 139957383018048 [compaction_job.cc:1948] [default] [JOB 29360] Generated table #266685: 129426 keys, 42894798 bytes, temperature: kWarm 2024/11/23-15:30:55.012517 139957383018048 EVENT_LOG_v1 {"time_micros": 1732347055012486, "cf_name": "default", "job": 29360, "event": "table_file_creation", "file_number": 266685, "file_size": 42894798, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4069784196, "table_properties": {"data_size": 40816416, "index_size": 222528, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588520, "raw_average_key_size": 20, "raw_value_size": 131629742, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129426, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732347053, "oldest_key_time": 0, "file_creation_time": 1732347053, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 266685, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-15:30:55.050505 139957383018048 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266686.sst) /dev/shm/ToplingTemp/Topling-95499-f3JQnq 2024/11/23-15:30:55.702865 139957383018048 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266686.sst): first pass time = 0.65's, 205.753'MB/sec 2024/11/23-15:30:56.493195 139957383018048 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266686.sst): old prealloc_size = 147639500, real_size = 40548384 2024/11/23-15:30:56.493321 139957383018048 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266686.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129429 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.76 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1017.01 avg-zval = 311.28 2024/11/23-15:30:56.493435 139957383018048 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266686.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-15:30:56.657837 139957383018048 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266686.sst): second pass time = 0.79's, 166.705'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 256.146'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2188.350'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.271'MB/sec write SST data time = 0.05's, 931.884'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 33547.161'MB/sec zip my value time = 0.79's, unzip length = 0.132'GB zip my value throughput = 166.705'MB/sec zip pipeline throughput = 166.705'MB/sec entries = 129429 avg-key = 20.00 avg-zkey = 1.76 avg-val = 1017.01 avg-zval = 311.28 usrkeys = 129429 avg-key = 12.00 avg-zkey = 1.76 avg-val = 1020.62 avg-zval = 311.28 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 66846 bytes = 250688 } seq expand size = 467922 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0422 GB } UnZip/Zip{ index = 6.8245 value = 3.2672 dict = 1.00 all = 3.1831 } Zip/UnZip{ index = 0.1465 value = 0.3061 dict = 1.00 all = 0.3142 } ---------------------------- total value len = 11.100152 GB avg = 0.203 KB (by entry num) total key len = 1.484827 GB avg = 0.027 KB total ukey len = 1.024282 GB avg = 0.015 KB total ukey num = 0.067750744 Billion total entry num = 0.054558473 Billion write speed all = 0.530017862 MB/sec (with seq num) write speed all = 0.511635970 MB/sec (without seq num) 2024/11/23-15:30:56.710881 139957383018048 [compaction_job.cc:1948] [default] [JOB 29360] Generated table #266686: 129429 keys, 42166584 bytes, temperature: kWarm 2024/11/23-15:30:56.710950 139957383018048 EVENT_LOG_v1 {"time_micros": 1732347056710916, "cf_name": "default", "job": 29360, "event": "table_file_creation", "file_number": 266686, "file_size": 42166584, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4069834793, "table_properties": {"data_size": 40288272, "index_size": 227584, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588580, "raw_average_key_size": 20, "raw_value_size": 131630091, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129429, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732347055, "oldest_key_time": 0, "file_creation_time": 1732347055, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 266686, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-15:30:56.751896 139957383018048 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266687.sst) /dev/shm/ToplingTemp/Topling-95499-AYClWm 2024/11/23-15:30:57.499933 139957383018048 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266687.sst): first pass time = 0.75's, 179.437'MB/sec 2024/11/23-15:30:58.427260 139957383018048 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266687.sst): old prealloc_size = 147639500, real_size = 40621568 2024/11/23-15:30:58.427404 139957383018048 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266687.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129428 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.73 raw-val = 0.1316 GB zip-val = 0.0404 GB avg-val =1017.01 avg-zval = 311.87 2024/11/23-15:30:58.427501 139957383018048 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266687.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-15:30:58.591211 139957383018048 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266687.sst): second pass time = 0.93's, 142.065'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 257.064'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1976.411'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.272'MB/sec write SST data time = 0.04's, 940.765'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.377'MB, throughput = 46807.830'MB/sec zip my value time = 0.93's, unzip length = 0.132'GB zip my value throughput = 142.065'MB/sec zip pipeline throughput = 142.065'MB/sec entries = 129428 avg-key = 20.00 avg-zkey = 1.73 avg-val = 1017.01 avg-zval = 311.87 usrkeys = 129428 avg-key = 12.00 avg-zkey = 1.73 avg-val = 1019.20 avg-zval = 311.87 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 40447 bytes = 151696 } seq expand size = 283129 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0404 GB dict = 1.38 MB all = 0.0421 GB } UnZip/Zip{ index = 6.9376 value = 3.2610 dict = 1.00 all = 3.1850 } Zip/UnZip{ index = 0.1441 value = 0.3067 dict = 1.00 all = 0.3140 } ---------------------------- total value len = 11.232064 GB avg = 0.205 KB (by entry num) total key len = 1.487416 GB avg = 0.027 KB total ukey len = 1.025835 GB avg = 0.015 KB total ukey num = 0.067880172 Billion total entry num = 0.054687901 Billion write speed all = 0.535638778 MB/sec (with seq num) write speed all = 0.517214780 MB/sec (without seq num) 2024/11/23-15:30:58.643894 139957383018048 [compaction_job.cc:1948] [default] [JOB 29360] Generated table #266687: 129428 keys, 42140357 bytes, temperature: kWarm 2024/11/23-15:30:58.643968 139957383018048 EVENT_LOG_v1 {"time_micros": 1732347058643932, "cf_name": "default", "job": 29360, "event": "table_file_creation", "file_number": 266687, "file_size": 42140357, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4069845876, "table_properties": {"data_size": 40365168, "index_size": 223872, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588560, "raw_average_key_size": 20, "raw_value_size": 131629430, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129428, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732347056, "oldest_key_time": 0, "file_creation_time": 1732347056, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 266687, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-15:30:58.685152 139957383018048 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266688.sst) /dev/shm/ToplingTemp/Topling-95499-izr06n 2024/11/23-15:30:59.418249 139957383018048 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266688.sst): first pass time = 0.73's, 183.092'MB/sec 2024/11/23-15:31:00.197727 139957383018048 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266688.sst): old prealloc_size = 147639500, real_size = 40476064 2024/11/23-15:31:00.197855 139957383018048 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266688.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129431 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.73 raw-val = 0.1316 GB zip-val = 0.0402 GB avg-val =1016.99 avg-zval = 310.75 2024/11/23-15:31:00.197946 139957383018048 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266688.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-15:31:00.362087 139957383018048 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266688.sst): second pass time = 0.78's, 169.029'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 255.449'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2161.568'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.274'MB/sec write SST data time = 0.05's, 911.457'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 36716.482'MB/sec zip my value time = 0.78's, unzip length = 0.132'GB zip my value throughput = 169.029'MB/sec zip pipeline throughput = 169.029'MB/sec entries = 129431 avg-key = 20.00 avg-zkey = 1.73 avg-val = 1016.99 avg-zval = 310.75 usrkeys = 129431 avg-key = 12.00 avg-zkey = 1.73 avg-val = 1018.96 avg-zval = 310.75 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 36524 bytes = 136976 } seq expand size = 255668 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0402 GB dict = 1.38 MB all = 0.0420 GB } UnZip/Zip{ index = 6.9517 value = 3.2727 dict = 1.00 all = 3.1972 } Zip/UnZip{ index = 0.1439 value = 0.3056 dict = 1.00 all = 0.3128 } ---------------------------- total value len = 11.363950 GB avg = 0.207 KB (by entry num) total key len = 1.490004 GB avg = 0.027 KB total ukey len = 1.027388 GB avg = 0.015 KB total ukey num = 0.068009603 Billion total entry num = 0.054817332 Billion write speed all = 0.541261336 MB/sec (with seq num) write speed all = 0.522795110 MB/sec (without seq num) 2024/11/23-15:31:00.414534 139957383018048 [compaction_job.cc:1948] [default] [JOB 29360] Generated table #266688: 129431 keys, 41980473 bytes, temperature: kWarm 2024/11/23-15:31:00.414608 139957383018048 EVENT_LOG_v1 {"time_micros": 1732347060414572, "cf_name": "default", "job": 29360, "event": "table_file_creation", "file_number": 266688, "file_size": 41980473, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4069843595, "table_properties": {"data_size": 40220112, "index_size": 223424, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588620, "raw_average_key_size": 20, "raw_value_size": 131629589, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129431, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732347058, "oldest_key_time": 0, "file_creation_time": 1732347058, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 266688, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-15:31:00.451145 139957383018048 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266689.sst) /dev/shm/ToplingTemp/Topling-95499-xgycIp 2024/11/23-15:31:01.107691 139957383018048 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266689.sst): first pass time = 0.66's, 204.446'MB/sec 2024/11/23-15:31:02.042016 139957383018048 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266689.sst): old prealloc_size = 147639500, real_size = 40455696 2024/11/23-15:31:02.042142 139957383018048 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266689.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129429 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.72 raw-val = 0.1316 GB zip-val = 0.0402 GB avg-val =1017.00 avg-zval = 310.60 2024/11/23-15:31:02.042228 139957383018048 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266689.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-15:31:02.205916 139957383018048 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266689.sst): second pass time = 0.93's, 140.997'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 255.795'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2270.385'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.271'MB/sec write SST data time = 0.04's, 939.759'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 39349.171'MB/sec zip my value time = 0.93's, unzip length = 0.132'GB zip my value throughput = 140.997'MB/sec zip pipeline throughput = 143.276'MB/sec entries = 129429 avg-key = 20.00 avg-zkey = 1.72 avg-val = 1017.00 avg-zval = 310.60 usrkeys = 129429 avg-key = 12.00 avg-zkey = 1.72 avg-val = 1018.46 avg-zval = 310.60 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 26872 bytes = 100784 } seq expand size = 188104 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0402 GB dict = 1.38 MB all = 0.0419 GB } UnZip/Zip{ index = 6.9936 value = 3.2743 dict = 1.00 all = 3.2014 } Zip/UnZip{ index = 0.1430 value = 0.3054 dict = 1.00 all = 0.3124 } ---------------------------- total value len = 11.495768 GB avg = 0.209 KB (by entry num) total key len = 1.492593 GB avg = 0.027 KB total ukey len = 1.028941 GB avg = 0.015 KB total ukey num = 0.068139032 Billion total entry num = 0.054946761 Billion write speed all = 0.546878543 MB/sec (with seq num) write speed all = 0.528370154 MB/sec (without seq num) 2024/11/23-15:31:02.257853 139957383018048 [compaction_job.cc:1948] [default] [JOB 29360] Generated table #266689: 129429 keys, 41924301 bytes, temperature: kWarm 2024/11/23-15:31:02.257925 139957383018048 EVENT_LOG_v1 {"time_micros": 1732347062257890, "cf_name": "default", "job": 29360, "event": "table_file_creation", "file_number": 266689, "file_size": 41924301, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4069796521, "table_properties": {"data_size": 40201088, "index_size": 222080, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588580, "raw_average_key_size": 20, "raw_value_size": 131629929, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129429, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732347060, "oldest_key_time": 0, "file_creation_time": 1732347060, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 266689, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-15:31:02.303558 139957383018048 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266690.sst) /dev/shm/ToplingTemp/Topling-95499-ilAdqp 2024/11/23-15:31:03.050457 139957383018048 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266690.sst): first pass time = 0.75's, 179.711'MB/sec 2024/11/23-15:31:03.885220 139957383018048 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266690.sst): old prealloc_size = 147639500, real_size = 40943936 2024/11/23-15:31:03.885352 139957383018048 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266690.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129429 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.70 raw-val = 0.1316 GB zip-val = 0.0407 GB avg-val =1017.00 avg-zval = 314.39 2024/11/23-15:31:03.885505 139957383018048 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266690.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-15:31:04.050790 139957383018048 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266690.sst): second pass time = 0.83's, 157.816'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.17's, 258.111'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2031.643'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.271'MB/sec write SST data time = 0.05's, 932.032'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 42563.633'MB/sec zip my value time = 0.83's, unzip length = 0.132'GB zip my value throughput = 157.816'MB/sec zip pipeline throughput = 157.816'MB/sec entries = 129429 avg-key = 20.00 avg-zkey = 1.70 avg-val = 1017.00 avg-zval = 314.39 usrkeys = 129429 avg-key = 12.00 avg-zkey = 1.70 avg-val = 1023.03 avg-zval = 314.39 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 111510 bytes = 418176 } seq expand size = 780570 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0407 GB dict = 1.38 MB all = 0.0427 GB } UnZip/Zip{ index = 7.0731 value = 3.2348 dict = 1.00 all = 3.1411 } Zip/UnZip{ index = 0.1414 value = 0.3091 dict = 1.00 all = 0.3184 } ---------------------------- total value len = 11.628178 GB avg = 0.211 KB (by entry num) total key len = 1.495182 GB avg = 0.027 KB total ukey len = 1.030494 GB avg = 0.015 KB total ukey num = 0.068268461 Billion total entry num = 0.055076190 Billion write speed all = 0.552519780 MB/sec (with seq num) write speed all = 0.533969235 MB/sec (without seq num) 2024/11/23-15:31:04.104194 139957383018048 [compaction_job.cc:1948] [default] [JOB 29360] Generated table #266690: 129429 keys, 42730060 bytes, temperature: kWarm 2024/11/23-15:31:04.104260 139957383018048 EVENT_LOG_v1 {"time_micros": 1732347064104225, "cf_name": "default", "job": 29360, "event": "table_file_creation", "file_number": 266690, "file_size": 42730060, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4069848235, "table_properties": {"data_size": 40691824, "index_size": 219584, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588580, "raw_average_key_size": 20, "raw_value_size": 131629517, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129429, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732347062, "oldest_key_time": 0, "file_creation_time": 1732347062, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 266690, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-15:31:04.142833 139957383018048 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266691.sst) /dev/shm/ToplingTemp/Topling-95499-cd3Nnq 2024/11/23-15:31:04.152094 139957383018048 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266691.sst): first pass time = 0.01's, 375.146'MB/sec 2024/11/23-15:31:04.184500 139957383018048 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266691.sst): old prealloc_size = 147639500, real_size = 1095472 2024/11/23-15:31:04.184547 139957383018048 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266691.sst): index type = UintIndex_IL_256_32 , store type = DictZipBlobStore usrkeys = 3336 prefix = 4 raw-key = 0.0000 GB zip-key = 0.0000 GB avg-key = 8.00 avg-zkey = 0.24 raw-val = 0.0034 GB zip-val = 0.0011 GB avg-val =1017.00 avg-zval = 327.83 2024/11/23-15:31:04.191150 139957383018048 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00/266691.sst): second pass time = 0.03's, 106.536'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.01's, 172.893'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 30.538'MB/sec (index lex order gen) rebuild zvType time = 0.01's, 0.160'MB/sec write SST data time = 0.00's, 816.554'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.039'MB, throughput = 1890.816'MB/sec zip my value time = 0.03's, unzip length = 0.003'GB zip my value throughput = 106.536'MB/sec zip pipeline throughput = 106.536'MB/sec entries = 3336 avg-key = 20.00 avg-zkey = 0.25 avg-val = 1017.00 avg-zval = 327.83 usrkeys = 3336 avg-key = 12.00 avg-zkey = 0.25 avg-val = 1024.00 avg-zval = 327.83 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 3336 bytes = 12528 } seq expand size = 23352 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0000 GB value = 0.0034 GB dict = 0.04 MB all = 0.0035 GB } __ZipSize{ index = 0.0000 GB value = 0.0011 GB dict = 0.04 MB all = 0.0011 GB } UnZip/Zip{ index = 48.1154 value = 3.1022 dict = 1.00 all = 3.0167 } Zip/UnZip{ index = 0.0208 value = 0.3223 dict = 1.00 all = 0.3315 } ---------------------------- total value len = 11.631594 GB avg = 0.211 KB (by entry num) total key len = 1.495248 GB avg = 0.027 KB total ukey len = 1.030534 GB avg = 0.015 KB total ukey num = 0.068271797 Billion total entry num = 0.055079526 Billion write speed all = 0.552663146 MB/sec (with seq num) write speed all = 0.534111586 MB/sec (without seq num) 2024/11/23-15:31:04.199461 139957383018048 [compaction_job.cc:1948] [default] [JOB 29360] Generated table #266691: 3336 keys, 1146762 bytes, temperature: kWarm 2024/11/23-15:31:04.199523 139957383018048 EVENT_LOG_v1 {"time_micros": 1732347064199482, "cf_name": "default", "job": 29360, "event": "table_file_creation", "file_number": 266691, "file_size": 1146762, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3375235068, "largest_seqno": 4069847973, "table_properties": {"data_size": 1093632, "index_size": 832, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 66720, "raw_average_key_size": 20, "raw_value_size": 3392701, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 3336, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-UintIndex_IL_256_32-DictZipBlobStore", "creation_time": 1732347064, "oldest_key_time": 0, "file_creation_time": 1732347064, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 266691, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-15:31:04.208840 139957383018048 [compaction_job.cc:703] job-29360: subcompact[0], size: 0.893530 G, files: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29360/att-00 [266670,266671,266672,266673,266674,266675,266676,266677,266678,266679,266680,266681,266682,266683,266684,266685,266686,266687,266688,266689,266690,266691] 2024/11/23-15:31:04.342249 139957383018048 (Original Log Time 2024/11/23-15:30:23.707808) EVENT_LOG_v1 {"time_micros": 1732347023707741, "job": 29360, "event": "compaction_started", "compaction_reason": "FilesMarkedForCompaction", "files_L2": [266648], "files_L3": [266578, 266579, 266580, 266581, 266582, 266583, 266584, 266585, 266586, 266587, 266588, 266589, 266590, 266591, 266592, 266593, 266594, 266595, 266596, 266597, 266664], "score": 0.992886, "input_data_size": 925060225, "oldest_snapshot_seqno": 4069934519} 2024/11/23-15:31:04.342255 139957383018048 (Original Log Time 2024/11/23-15:31:04.340058) [compaction_job.cc:2022] [default] [JOB 29360] Compacted 1@2 + 21@3 files to L3 => 893529946 bytes 2024/11/23-15:31:04.342256 139957383018048 (Original Log Time 2024/11/23-15:31:04.342175) [compaction_job.cc:1224] [default] compacted to: files[0 0 0 22 0 0 0] max score 0.03, MB/sec: 22.8 rd, 22.1 wr, level 3, files in(1, 21) out(22 +0 blob) MB in(31.2, 851.0 +0.0 blob) out(852.1 +0.0 blob), read-write-amplify(55.6) write-amplify(27.3) OK, records in: 2749930, records dropped: 28568 output_compression: Snappy 2024/11/23-15:31:04.342260 139957383018048 (Original Log Time 2024/11/23-15:31:04.342222) EVENT_LOG_v1 {"time_micros": 1732347064342199, "cf": "default", "job": 29360, "event": "compaction_finished", "compaction_time_micros": 40501036, "compaction_time_cpu_micros": 8209824, "output_level": 3, "num_output_files": 22, "total_output_size": 893529946, "num_input_records": 2749930, "num_output_records": 2721362, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "file_write_nanos": 726315317, "file_range_sync_nanos": 0, "file_fsync_nanos": 16499, "file_prepare_write_nanos": 47116, "lsm_state": [0, 0, 0, 22, 0, 0, 0]} 2024/11/23-15:31:04.476688 139957383018048 DEBG dcompact_worker.cpp:240: HttpPost: 200 OK: url = http://nlb-7zny4kaa1poal01o64.cn-shenzhen.nlb.aliyuncs.com:8443, body = {"instanceId":"nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137","labourId":"","dbId":"d89b4006-2803-486e-b7a2-759bcf348921","dbStarts":1732256054,"starts":1732347023,"executesMs":40788,"compactionJobId":29360,"attempt":0,"compactionInputRawBytes":2851666343,"compactionInputZipBytes":925060225,"compactionOutputRawBytes":0,"compactionOutputZipBytes":893529946,"headers":{"Accept":"*/*","Connection":"close","Host":"aliyun-topling-saas.topling.cn:18443","RemoteIp":"120.24.192.169","X-Forwarded-For":"120.24.192.169","region":"cn-shenzhen","token":"e6474c481bd4415abc537135cc03626b","instance-token":"e6474c481bd4415abc537135cc03626b","provider":"aliyun","CloudMarketInstanceId":"si-59c0ae5c955845588903","MeteringAssit":"","Transfer-Encoding":"chunked","traceparent":"00-aa0d9f86fee08adb359c061375d0e76c-78f17e9b242a79c3-00"}}, response = 2024/11/23-15:31:04.476786 139957383018048 INFO dcompact_worker.cpp:1459: finish /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-29360/att-00: olev 3, work 40.788 s, result 7.758 ms, install 2.219 ms, input{raw 2.656 GiB zip 882.206 MiB}