2024/11/23-16:55:29.435733 139957357839936 DEBG dcompact_worker.cpp:2214: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00: fork to child time = 0.007974 sec 2024/11/23-16:55:29.436647 139957357839936 DEBG dcompact_worker.cpp:1013: Beg SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00 2024/11/23-16:55:29.444616 139957357839936 DEBG dcompact_worker.cpp:1033: End SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00 2024/11/23-16:55:29.445538 139957357839936 TRAC dcompact_worker.cpp:1083: INFO_LOG_LEVEL: rpc = INFO_LEVEL, env_var = undefined 2024/11/23-16:55:29.445790 139957357839936 [WARN] [column_family.cc:386] multiple cf_paths/db_paths and level_compaction_dynamic_level_bytes can't be used together 2024/11/23-16:55:29.495240 139957357839936 [version_set.cc:6208] Recovering from manifest file: /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-31235/att-00/MANIFEST-206347 2024/11/23-16:55:29.510820 139957357839936 [version_set.cc:6251] Recovered from manifest file:/worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-31235/att-00/MANIFEST-206347 succeeded,manifest_file_number is 206347, next_file_number is 270794, last_sequence is 4127247361, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 270746 2024/11/23-16:55:29.510826 139957357839936 [version_set.cc:6266] Column family [default] (ID 0), log number is 0 2024/11/23-16:55:29.510953 139957357839936 [version_set.cc:5721] Creating manifest 270794 2024/11/23-16:55:29.544242 139957357839936 DEBG dcompact_worker.cpp:1218: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00: bottommost_level: fake = 1, rpc = 0 2024/11/23-16:55:29.571263 139957357839936 [compaction_job.cc:2437] [default] [JOB 31235] Compacting 1@2 + 21@3 files to L3, score 1.00, subcompactions 1 : 1 2024/11/23-16:55:29.571280 139957357839936 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 23363 Base level 2, inputs: [270792(31MB)], [270724(40MB) 270725(40MB) 270726(40MB) 270727(40MB) 270728(40MB) 270729(40MB) 270730(40MB) 270731(40MB) 270732(40MB) 270733(40MB) 270734(40MB) 270735(40MB) 270736(40MB) 270737(40MB) 270738(40MB) 270739(40MB) 270740(40MB) 270741(40MB) 270742(40MB) 270743(39MB) 270744(40MB)] 2024/11/23-16:55:29.578505 139957357839936 [top_zip_table.cc:59] core git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-16:55:29.578535 139957357839936 [top_zip_table.cc:60] fsa git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-16:55:29.578555 139957357839936 [top_zip_table.cc:61] zbs git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-16:55:29.578560 139957357839936 [top_zip_table.cc:62] topling-zip_table_reader: git_version_hash_info_is: commit a4a382006cb82713acf5b3425835f22711877681 Author: leipeng Date: 2024-04-11 19:44:14 +0800 fixed_len_hole_index.cc: Add env bool FixedLenHoleIndexUseAVX512 for ut & debug 1. FixedLenHoleIndexUseAVX512 is only in unit tests or debug 2. In release mode, use avx512 by compile options(-march=) g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/23-16:55:29.578572 139957357839936 [top_zip_table.cc:64] topling-rocks git_version_hash_info_is: commit feab587e468621ba0204d47b4ffacc52e7c4290d Author: leipeng Date: 2024-03-22 13:35:06 +0800 ToplingZipTableBuilder::Add: immediately return after error This function returns void, and caller does not check builder->status() after calling this function and graceful abandon. So immediately return after error, and return error status in Finish(). g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/23-16:55:30.214559 139957357839936 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270795.sst) /dev/shm/ToplingTemp/Topling-122685-zAbG35 2024/11/23-16:55:30.394595 139957357839936 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270795.sst): first pass time = 0.18's, 745.672'MB/sec 2024/11/23-16:55:31.810746 139957357839936 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270795.sst): old prealloc_size = 147639500, real_size = 40611376 2024/11/23-16:55:31.810878 139957357839936 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270795.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129430 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.81 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1016.99 avg-zval = 311.71 2024/11/23-16:55:31.811081 139957357839936 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270795.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:55:31.980008 139957357839936 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270795.sst): second pass time = 1.41's, 93.070'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.17's, 250.809'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2015.492'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.272'MB/sec write SST data time = 0.05's, 846.358'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 42365.638'MB/sec zip my value time = 1.41's, unzip length = 0.132'GB zip my value throughput = 93.070'MB/sec zip pipeline throughput = 184.985'MB/sec entries = 129430 avg-key = 20.00 avg-zkey = 1.81 avg-val = 1016.99 avg-zval = 311.71 usrkeys = 129430 avg-key = 12.00 avg-zkey = 1.81 avg-val = 1023.99 avg-zval = 311.71 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129430 bytes = 485376 } seq expand size = 906010 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0424 GB } UnZip/Zip{ index = 6.6470 value = 3.2626 dict = 1.00 all = 3.1622 } Zip/UnZip{ index = 0.1504 value = 0.3065 dict = 1.00 all = 0.3162 } ---------------------------- total value len = 8.981155 GB avg = 0.171 KB (by entry num) total key len = 1.443410 GB avg = 0.028 KB total ukey len = 0.999431 GB avg = 0.015 KB total ukey num = 0.065679865 Billion total entry num = 0.052487594 Billion write speed all = 0.361715811 MB/sec (with seq num) write speed all = 0.347145923 MB/sec (without seq num) 2024/11/23-16:55:32.061521 139957357839936 [compaction_job.cc:1948] [default] [JOB 31235] Generated table #270795: 129430 keys, 42444075 bytes, temperature: kWarm 2024/11/23-16:55:32.061594 139957357839936 EVENT_LOG_v1 {"time_micros": 1732352132061546, "cf_name": "default", "job": 31235, "event": "table_file_creation", "file_number": 270795, "file_size": 42444075, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237877277, "largest_seqno": 4127221677, "table_properties": {"data_size": 40345184, "index_size": 233664, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588600, "raw_average_key_size": 20, "raw_value_size": 131629309, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129430, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732352130, "oldest_key_time": 0, "file_creation_time": 1732352130, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 270795, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:55:32.120079 139957357839936 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270796.sst) /dev/shm/ToplingTemp/Topling-122685-zq1Xt3 2024/11/23-16:55:32.757004 139957357839936 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270796.sst): first pass time = 0.64's, 210.740'MB/sec 2024/11/23-16:55:34.720578 139957357839936 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270796.sst): old prealloc_size = 147639500, real_size = 40862032 2024/11/23-16:55:34.720734 139957357839936 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270796.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129433 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.74 raw-val = 0.1316 GB zip-val = 0.0406 GB avg-val =1016.97 avg-zval = 313.71 2024/11/23-16:55:34.720924 139957357839936 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270796.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:55:35.084540 139957357839936 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270796.sst): second pass time = 1.95's, 67.366'MB/sec, value only(98.1% of KV) wait indexing time = 0.01's, remap KeyValue time = 0.36's, 117.322'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1756.046'MB/sec (index lex order gen) rebuild zvType time = 0.22's, 0.148'MB/sec write SST data time = 0.15's, 293.376'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 46904.310'MB/sec zip my value time = 1.95's, unzip length = 0.132'GB zip my value throughput = 67.366'MB/sec zip pipeline throughput = 127.737'MB/sec entries = 129433 avg-key = 20.00 avg-zkey = 1.74 avg-val = 1016.97 avg-zval = 313.71 usrkeys = 129433 avg-key = 12.00 avg-zkey = 1.74 avg-val = 1023.97 avg-zval = 313.71 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129433 bytes = 485392 } seq expand size = 906031 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0406 GB dict = 1.38 MB all = 0.0427 GB } UnZip/Zip{ index = 6.8867 value = 3.2418 dict = 1.00 all = 3.1437 } Zip/UnZip{ index = 0.1452 value = 0.3085 dict = 1.00 all = 0.3181 } ---------------------------- total value len = 9.113690 GB avg = 0.173 KB (by entry num) total key len = 1.445998 GB avg = 0.027 KB total ukey len = 1.000984 GB avg = 0.015 KB total ukey num = 0.065809298 Billion total entry num = 0.052617027 Billion write speed all = 0.366364931 MB/sec (with seq num) write speed all = 0.351760687 MB/sec (without seq num) 2024/11/23-16:55:35.150462 139957357839936 [compaction_job.cc:1948] [default] [JOB 31235] Generated table #270796: 129433 keys, 42694660 bytes, temperature: kWarm 2024/11/23-16:55:35.150553 139957357839936 EVENT_LOG_v1 {"time_micros": 1732352135150503, "cf_name": "default", "job": 31235, "event": "table_file_creation", "file_number": 270796, "file_size": 42694660, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237868195, "largest_seqno": 4127217116, "table_properties": {"data_size": 40603968, "index_size": 225536, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588660, "raw_average_key_size": 20, "raw_value_size": 131629227, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129433, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732352132, "oldest_key_time": 0, "file_creation_time": 1732352132, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 270796, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:55:35.221865 139957357839936 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270797.sst) /dev/shm/ToplingTemp/Topling-122685-7xAjA4 2024/11/23-16:55:35.912896 139957357839936 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270797.sst): first pass time = 0.69's, 194.243'MB/sec 2024/11/23-16:55:36.905121 139957357839936 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270797.sst): old prealloc_size = 147639500, real_size = 40585616 2024/11/23-16:55:36.905271 139957357839936 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270797.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129433 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.81 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1016.97 avg-zval = 311.50 2024/11/23-16:55:36.905465 139957357839936 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270797.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:55:37.114760 139957357839936 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270797.sst): second pass time = 0.99's, 132.771'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.21's, 202.354'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1824.055'MB/sec (index lex order gen) rebuild zvType time = 0.16's, 0.203'MB/sec write SST data time = 0.05's, 846.774'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 41301.049'MB/sec zip my value time = 0.99's, unzip length = 0.132'GB zip my value throughput = 132.771'MB/sec zip pipeline throughput = 132.771'MB/sec entries = 129433 avg-key = 20.00 avg-zkey = 1.81 avg-val = 1016.97 avg-zval = 311.50 usrkeys = 129433 avg-key = 12.00 avg-zkey = 1.81 avg-val = 1023.97 avg-zval = 311.50 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129433 bytes = 485392 } seq expand size = 906031 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0424 GB } UnZip/Zip{ index = 6.6344 value = 3.2647 dict = 1.00 all = 3.1642 } Zip/UnZip{ index = 0.1507 value = 0.3063 dict = 1.00 all = 0.3160 } ---------------------------- total value len = 9.246226 GB avg = 0.175 KB (by entry num) total key len = 1.448587 GB avg = 0.027 KB total ukey len = 1.002538 GB avg = 0.015 KB total ukey num = 0.065938731 Billion total entry num = 0.052746460 Billion write speed all = 0.371026888 MB/sec (with seq num) write speed all = 0.356387751 MB/sec (without seq num) 2024/11/23-16:55:37.167989 139957357839936 [compaction_job.cc:1948] [default] [JOB 31235] Generated table #270797: 129433 keys, 42418186 bytes, temperature: kWarm 2024/11/23-16:55:37.168054 139957357839936 EVENT_LOG_v1 {"time_micros": 1732352137168021, "cf_name": "default", "job": 31235, "event": "table_file_creation", "file_number": 270797, "file_size": 42418186, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237873554, "largest_seqno": 4127226248, "table_properties": {"data_size": 40318976, "index_size": 234112, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588660, "raw_average_key_size": 20, "raw_value_size": 131629597, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129433, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732352135, "oldest_key_time": 0, "file_creation_time": 1732352135, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 270797, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:55:37.210861 139957357839936 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270798.sst) /dev/shm/ToplingTemp/Topling-122685-N4JUH5 2024/11/23-16:55:37.767155 139957357839936 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270798.sst): first pass time = 0.56's, 241.292'MB/sec 2024/11/23-16:55:38.820916 139957357839936 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270798.sst): old prealloc_size = 147639500, real_size = 40870368 2024/11/23-16:55:38.821092 139957357839936 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270798.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129433 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.74 raw-val = 0.1316 GB zip-val = 0.0406 GB avg-val =1016.97 avg-zval = 313.77 2024/11/23-16:55:38.821284 139957357839936 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270798.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:55:39.193036 139957357839936 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270798.sst): second pass time = 1.05's, 125.002'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.37's, 114.769'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1553.415'MB/sec (index lex order gen) rebuild zvType time = 0.30's, 0.107'MB/sec write SST data time = 0.07's, 616.474'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 38648.446'MB/sec zip my value time = 1.05's, unzip length = 0.132'GB zip my value throughput = 125.002'MB/sec zip pipeline throughput = 157.133'MB/sec entries = 129433 avg-key = 20.00 avg-zkey = 1.74 avg-val = 1016.97 avg-zval = 313.77 usrkeys = 129433 avg-key = 12.00 avg-zkey = 1.74 avg-val = 1023.97 avg-zval = 313.77 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129433 bytes = 485392 } seq expand size = 906031 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0406 GB dict = 1.38 MB all = 0.0427 GB } UnZip/Zip{ index = 6.8984 value = 3.2411 dict = 1.00 all = 3.1430 } Zip/UnZip{ index = 0.1450 value = 0.3085 dict = 1.00 all = 0.3182 } ---------------------------- total value len = 9.378761 GB avg = 0.177 KB (by entry num) total key len = 1.451176 GB avg = 0.027 KB total ukey len = 1.004091 GB avg = 0.015 KB total ukey num = 0.066068164 Billion total entry num = 0.052875893 Billion write speed all = 0.375687556 MB/sec (with seq num) write speed all = 0.361013553 MB/sec (without seq num) 2024/11/23-16:55:39.251649 139957357839936 [compaction_job.cc:1948] [default] [JOB 31235] Generated table #270798: 129433 keys, 42703168 bytes, temperature: kWarm 2024/11/23-16:55:39.251733 139957357839936 EVENT_LOG_v1 {"time_micros": 1732352139251683, "cf_name": "default", "job": 31235, "event": "table_file_creation", "file_number": 270798, "file_size": 42703168, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237868596, "largest_seqno": 4127225977, "table_properties": {"data_size": 40612688, "index_size": 225152, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588660, "raw_average_key_size": 20, "raw_value_size": 131629349, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129433, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732352137, "oldest_key_time": 0, "file_creation_time": 1732352137, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 270798, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:55:39.324754 139957357839936 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270799.sst) /dev/shm/ToplingTemp/Topling-122685-yxDre3 2024/11/23-16:55:40.077394 139957357839936 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270799.sst): first pass time = 0.75's, 178.349'MB/sec 2024/11/23-16:55:41.316197 139957357839936 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270799.sst): old prealloc_size = 147639500, real_size = 40584192 2024/11/23-16:55:41.316341 139957357839936 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270799.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129431 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.81 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1016.99 avg-zval = 311.50 2024/11/23-16:55:41.316525 139957357839936 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270799.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:55:41.504194 139957357839936 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270799.sst): second pass time = 1.24's, 106.325'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.19's, 225.645'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1972.292'MB/sec (index lex order gen) rebuild zvType time = 0.13's, 0.250'MB/sec write SST data time = 0.06's, 725.179'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 42630.968'MB/sec zip my value time = 1.24's, unzip length = 0.132'GB zip my value throughput = 106.325'MB/sec zip pipeline throughput = 115.300'MB/sec entries = 129431 avg-key = 20.00 avg-zkey = 1.81 avg-val = 1016.99 avg-zval = 311.50 usrkeys = 129431 avg-key = 12.00 avg-zkey = 1.81 avg-val = 1023.99 avg-zval = 311.50 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129431 bytes = 485376 } seq expand size = 906017 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0424 GB } UnZip/Zip{ index = 6.6361 value = 3.2648 dict = 1.00 all = 3.1643 } Zip/UnZip{ index = 0.1507 value = 0.3063 dict = 1.00 all = 0.3160 } ---------------------------- total value len = 9.511297 GB avg = 0.179 KB (by entry num) total key len = 1.453764 GB avg = 0.027 KB total ukey len = 1.005644 GB avg = 0.015 KB total ukey num = 0.066197595 Billion total entry num = 0.053005324 Billion write speed all = 0.380344486 MB/sec (with seq num) write speed all = 0.365635744 MB/sec (without seq num) 2024/11/23-16:55:41.561330 139957357839936 [compaction_job.cc:1948] [default] [JOB 31235] Generated table #270799: 129431 keys, 42416680 bytes, temperature: kWarm 2024/11/23-16:55:41.561405 139957357839936 EVENT_LOG_v1 {"time_micros": 1732352141561365, "cf_name": "default", "job": 31235, "event": "table_file_creation", "file_number": 270799, "file_size": 42416680, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237869923, "largest_seqno": 4127228080, "table_properties": {"data_size": 40317616, "index_size": 234048, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588620, "raw_average_key_size": 20, "raw_value_size": 131629652, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129431, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732352139, "oldest_key_time": 0, "file_creation_time": 1732352139, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 270799, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:55:41.602179 139957357839936 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270800.sst) /dev/shm/ToplingTemp/Topling-122685-EQ9ma5 2024/11/23-16:55:42.387316 139957357839936 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270800.sst): first pass time = 0.79's, 170.963'MB/sec 2024/11/23-16:55:43.288722 139957357839936 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270800.sst): old prealloc_size = 147639500, real_size = 40584240 2024/11/23-16:55:43.288849 139957357839936 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270800.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129430 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.81 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1016.99 avg-zval = 311.50 2024/11/23-16:55:43.289028 139957357839936 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270800.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:55:43.456431 139957357839936 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270800.sst): second pass time = 0.90's, 146.262'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.17's, 252.963'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2217.978'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.269'MB/sec write SST data time = 0.05's, 900.174'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 35392.439'MB/sec zip my value time = 0.90's, unzip length = 0.132'GB zip my value throughput = 146.262'MB/sec zip pipeline throughput = 146.262'MB/sec entries = 129430 avg-key = 20.00 avg-zkey = 1.81 avg-val = 1016.99 avg-zval = 311.50 usrkeys = 129430 avg-key = 12.00 avg-zkey = 1.81 avg-val = 1023.99 avg-zval = 311.50 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129430 bytes = 485376 } seq expand size = 906010 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0424 GB } UnZip/Zip{ index = 6.6343 value = 3.2648 dict = 1.00 all = 3.1642 } Zip/UnZip{ index = 0.1507 value = 0.3063 dict = 1.00 all = 0.3160 } ---------------------------- total value len = 9.643832 GB avg = 0.181 KB (by entry num) total key len = 1.456353 GB avg = 0.027 KB total ukey len = 1.007197 GB avg = 0.015 KB total ukey num = 0.066327025 Billion total entry num = 0.053134754 Billion write speed all = 0.385005449 MB/sec (with seq num) write speed all = 0.370261789 MB/sec (without seq num) 2024/11/23-16:55:43.508745 139957357839936 [compaction_job.cc:1948] [default] [JOB 31235] Generated table #270800: 129430 keys, 42417079 bytes, temperature: kWarm 2024/11/23-16:55:43.508806 139957357839936 EVENT_LOG_v1 {"time_micros": 1732352143508775, "cf_name": "default", "job": 31235, "event": "table_file_creation", "file_number": 270800, "file_size": 42417079, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237881756, "largest_seqno": 4127213060, "table_properties": {"data_size": 40317600, "index_size": 234112, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588600, "raw_average_key_size": 20, "raw_value_size": 131629260, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129430, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732352141, "oldest_key_time": 0, "file_creation_time": 1732352141, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 270800, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:55:43.546003 139957357839936 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270801.sst) /dev/shm/ToplingTemp/Topling-122685-ZkAp44 2024/11/23-16:55:44.259744 139957357839936 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270801.sst): first pass time = 0.71's, 188.059'MB/sec 2024/11/23-16:55:46.252646 139957357839936 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270801.sst): old prealloc_size = 147639500, real_size = 41077168 2024/11/23-16:55:46.252784 139957357839936 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270801.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129428 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.72 raw-val = 0.1316 GB zip-val = 0.0408 GB avg-val =1017.01 avg-zval = 315.40 2024/11/23-16:55:46.252958 139957357839936 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270801.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:55:46.447021 139957357839936 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270801.sst): second pass time = 1.99's, 66.102'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.19's, 220.799'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1924.816'MB/sec (index lex order gen) rebuild zvType time = 0.15's, 0.222'MB/sec write SST data time = 0.05's, 890.050'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 41484.709'MB/sec zip my value time = 1.99's, unzip length = 0.132'GB zip my value throughput = 66.102'MB/sec zip pipeline throughput = 121.729'MB/sec entries = 129428 avg-key = 20.00 avg-zkey = 1.72 avg-val = 1017.01 avg-zval = 315.40 usrkeys = 129428 avg-key = 12.00 avg-zkey = 1.72 avg-val = 1024.01 avg-zval = 315.40 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129428 bytes = 485376 } seq expand size = 905996 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0408 GB dict = 1.38 MB all = 0.0429 GB } UnZip/Zip{ index = 6.9795 value = 3.2245 dict = 1.00 all = 3.1279 } Zip/UnZip{ index = 0.1433 value = 0.3101 dict = 1.00 all = 0.3197 } ---------------------------- total value len = 9.776368 GB avg = 0.184 KB (by entry num) total key len = 1.458941 GB avg = 0.027 KB total ukey len = 1.008750 GB avg = 0.015 KB total ukey num = 0.066456453 Billion total entry num = 0.053264182 Billion write speed all = 0.389651747 MB/sec (with seq num) write speed all = 0.374873706 MB/sec (without seq num) 2024/11/23-16:55:46.562180 139957357839936 [compaction_job.cc:1948] [default] [JOB 31235] Generated table #270801: 129428 keys, 42910172 bytes, temperature: kWarm 2024/11/23-16:55:46.562240 139957357839936 EVENT_LOG_v1 {"time_micros": 1732352146562206, "cf_name": "default", "job": 31235, "event": "table_file_creation", "file_number": 270801, "file_size": 42910172, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237882779, "largest_seqno": 4127228081, "table_properties": {"data_size": 40822112, "index_size": 222528, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588560, "raw_average_key_size": 20, "raw_value_size": 131629254, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129428, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732352143, "oldest_key_time": 0, "file_creation_time": 1732352143, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 270801, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:55:46.606120 139957357839936 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270802.sst) /dev/shm/ToplingTemp/Topling-122685-2K5Hv5 2024/11/23-16:55:47.249237 139957357839936 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270802.sst): first pass time = 0.64's, 208.709'MB/sec 2024/11/23-16:55:48.332617 139957357839936 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270802.sst): old prealloc_size = 147639500, real_size = 40924480 2024/11/23-16:55:48.332738 139957357839936 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270802.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129430 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.73 raw-val = 0.1316 GB zip-val = 0.0407 GB avg-val =1016.99 avg-zval = 314.21 2024/11/23-16:55:48.332897 139957357839936 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270802.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:55:48.499139 139957357839936 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270802.sst): second pass time = 1.08's, 121.597'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.17's, 256.802'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2286.275'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.268'MB/sec write SST data time = 0.05's, 934.633'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 48832.063'MB/sec zip my value time = 1.08's, unzip length = 0.132'GB zip my value throughput = 121.597'MB/sec zip pipeline throughput = 121.597'MB/sec entries = 129430 avg-key = 20.00 avg-zkey = 1.73 avg-val = 1016.99 avg-zval = 314.21 usrkeys = 129430 avg-key = 12.00 avg-zkey = 1.73 avg-val = 1023.99 avg-zval = 314.21 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129430 bytes = 485376 } seq expand size = 906010 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0407 GB dict = 1.38 MB all = 0.0428 GB } UnZip/Zip{ index = 6.9476 value = 3.2366 dict = 1.00 all = 3.1391 } Zip/UnZip{ index = 0.1439 value = 0.3090 dict = 1.00 all = 0.3186 } ---------------------------- total value len = 9.908903 GB avg = 0.186 KB (by entry num) total key len = 1.461530 GB avg = 0.027 KB total ukey len = 1.010303 GB avg = 0.015 KB total ukey num = 0.066585883 Billion total entry num = 0.053393612 Billion write speed all = 0.394309912 MB/sec (with seq num) write speed all = 0.379497016 MB/sec (without seq num) 2024/11/23-16:55:48.553110 139957357839936 [compaction_job.cc:1948] [default] [JOB 31235] Generated table #270802: 129430 keys, 42756962 bytes, temperature: kWarm 2024/11/23-16:55:48.553180 139957357839936 EVENT_LOG_v1 {"time_micros": 1732352148553144, "cf_name": "default", "job": 31235, "event": "table_file_creation", "file_number": 270802, "file_size": 42756962, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237868290, "largest_seqno": 4127228510, "table_properties": {"data_size": 40668400, "index_size": 223552, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588600, "raw_average_key_size": 20, "raw_value_size": 131629188, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129430, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732352146, "oldest_key_time": 0, "file_creation_time": 1732352146, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 270802, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:55:48.591937 139957357839936 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270803.sst) /dev/shm/ToplingTemp/Topling-122685-q8Bdg2 2024/11/23-16:55:49.289914 139957357839936 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270803.sst): first pass time = 0.70's, 192.311'MB/sec 2024/11/23-16:55:50.216365 139957357839936 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270803.sst): old prealloc_size = 147639500, real_size = 40921936 2024/11/23-16:55:50.216540 139957357839936 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270803.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129432 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.74 raw-val = 0.1316 GB zip-val = 0.0407 GB avg-val =1016.98 avg-zval = 314.18 2024/11/23-16:55:50.216720 139957357839936 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270803.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:55:50.494035 139957357839936 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270803.sst): second pass time = 0.93's, 142.206'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.28's, 153.994'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1465.019'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.141'MB/sec write SST data time = 0.05's, 888.559'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.379'MB, throughput = 44850.273'MB/sec zip my value time = 0.93's, unzip length = 0.132'GB zip my value throughput = 142.206'MB/sec zip pipeline throughput = 148.299'MB/sec entries = 129432 avg-key = 20.00 avg-zkey = 1.74 avg-val = 1016.98 avg-zval = 314.18 usrkeys = 129432 avg-key = 12.00 avg-zkey = 1.74 avg-val = 1023.98 avg-zval = 314.18 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129432 bytes = 485392 } seq expand size = 906024 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0407 GB dict = 1.38 MB all = 0.0428 GB } UnZip/Zip{ index = 6.9023 value = 3.2370 dict = 1.00 all = 3.1392 } Zip/UnZip{ index = 0.1449 value = 0.3089 dict = 1.00 all = 0.3185 } ---------------------------- total value len = 10.041439 GB avg = 0.188 KB (by entry num) total key len = 1.464119 GB avg = 0.027 KB total ukey len = 1.011857 GB avg = 0.015 KB total ukey num = 0.066715315 Billion total entry num = 0.053523044 Billion write speed all = 0.398968240 MB/sec (with seq num) write speed all = 0.384120463 MB/sec (without seq num) 2024/11/23-16:55:50.546343 139957357839936 [compaction_job.cc:1948] [default] [JOB 31235] Generated table #270803: 129432 keys, 42755221 bytes, temperature: kWarm 2024/11/23-16:55:50.546399 139957357839936 EVENT_LOG_v1 {"time_micros": 1732352150546368, "cf_name": "default", "job": 31235, "event": "table_file_creation", "file_number": 270803, "file_size": 42755221, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237874127, "largest_seqno": 4127228517, "table_properties": {"data_size": 40664384, "index_size": 225024, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588640, "raw_average_key_size": 20, "raw_value_size": 131630113, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129432, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732352148, "oldest_key_time": 0, "file_creation_time": 1732352148, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 270803, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:55:50.584715 139957357839936 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270804.sst) /dev/shm/ToplingTemp/Topling-122685-0ImLJ3 2024/11/23-16:55:51.107491 139957357839936 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270804.sst): first pass time = 0.52's, 256.759'MB/sec 2024/11/23-16:55:52.069914 139957357839936 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270804.sst): old prealloc_size = 147639500, real_size = 40584336 2024/11/23-16:55:52.070048 139957357839936 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270804.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129431 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.81 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1016.99 avg-zval = 311.50 2024/11/23-16:55:52.070200 139957357839936 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270804.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:55:52.233172 139957357839936 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270804.sst): second pass time = 0.96's, 136.872'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 259.861'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1971.777'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.271'MB/sec write SST data time = 0.04's, 967.003'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.379'MB, throughput = 47144.616'MB/sec zip my value time = 0.96's, unzip length = 0.132'GB zip my value throughput = 136.872'MB/sec zip pipeline throughput = 136.872'MB/sec entries = 129431 avg-key = 20.00 avg-zkey = 1.81 avg-val = 1016.99 avg-zval = 311.50 usrkeys = 129431 avg-key = 12.00 avg-zkey = 1.81 avg-val = 1023.99 avg-zval = 311.50 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129431 bytes = 485376 } seq expand size = 906017 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0424 GB } UnZip/Zip{ index = 6.6361 value = 3.2648 dict = 1.00 all = 3.1642 } Zip/UnZip{ index = 0.1507 value = 0.3063 dict = 1.00 all = 0.3160 } ---------------------------- total value len = 10.173975 GB avg = 0.190 KB (by entry num) total key len = 1.466707 GB avg = 0.027 KB total ukey len = 1.013410 GB avg = 0.015 KB total ukey num = 0.066844746 Billion total entry num = 0.053652475 Billion write speed all = 0.403629488 MB/sec (with seq num) write speed all = 0.388746703 MB/sec (without seq num) 2024/11/23-16:55:52.286489 139957357839936 [compaction_job.cc:1948] [default] [JOB 31235] Generated table #270804: 129431 keys, 42417753 bytes, temperature: kWarm 2024/11/23-16:55:52.286556 139957357839936 EVENT_LOG_v1 {"time_micros": 1732352152286522, "cf_name": "default", "job": 31235, "event": "table_file_creation", "file_number": 270804, "file_size": 42417753, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237873877, "largest_seqno": 4127228317, "table_properties": {"data_size": 40317760, "index_size": 234048, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588620, "raw_average_key_size": 20, "raw_value_size": 131629698, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129431, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732352150, "oldest_key_time": 0, "file_creation_time": 1732352150, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 270804, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:55:52.362508 139957357839936 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270805.sst) /dev/shm/ToplingTemp/Topling-122685-n6BL31 2024/11/23-16:55:53.015724 139957357839936 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270805.sst): first pass time = 0.65's, 205.488'MB/sec 2024/11/23-16:55:53.923371 139957357839936 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270805.sst): old prealloc_size = 147639500, real_size = 40578512 2024/11/23-16:55:53.923513 139957357839936 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270805.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129430 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.81 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1017.00 avg-zval = 311.46 2024/11/23-16:55:53.923667 139957357839936 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270805.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:55:54.197799 139957357839936 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270805.sst): second pass time = 0.91's, 145.268'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.27's, 154.569'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1934.922'MB/sec (index lex order gen) rebuild zvType time = 0.17's, 0.186'MB/sec write SST data time = 0.10's, 423.604'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.379'MB, throughput = 40490.352'MB/sec zip my value time = 0.91's, unzip length = 0.132'GB zip my value throughput = 145.268'MB/sec zip pipeline throughput = 163.377'MB/sec entries = 129430 avg-key = 20.00 avg-zkey = 1.81 avg-val = 1017.00 avg-zval = 311.46 usrkeys = 129430 avg-key = 12.00 avg-zkey = 1.81 avg-val = 1024.00 avg-zval = 311.46 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129430 bytes = 485376 } seq expand size = 906010 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0424 GB } UnZip/Zip{ index = 6.6343 value = 3.2653 dict = 1.00 all = 3.1646 } Zip/UnZip{ index = 0.1507 value = 0.3063 dict = 1.00 all = 0.3160 } ---------------------------- total value len = 10.306511 GB avg = 0.192 KB (by entry num) total key len = 1.469296 GB avg = 0.027 KB total ukey len = 1.014963 GB avg = 0.015 KB total ukey num = 0.066974176 Billion total entry num = 0.053781905 Billion write speed all = 0.408286996 MB/sec (with seq num) write speed all = 0.393369324 MB/sec (without seq num) 2024/11/23-16:55:54.253280 139957357839936 [compaction_job.cc:1948] [default] [JOB 31235] Generated table #270805: 129430 keys, 42411935 bytes, temperature: kWarm 2024/11/23-16:55:54.253367 139957357839936 EVENT_LOG_v1 {"time_micros": 1732352154253321, "cf_name": "default", "job": 31235, "event": "table_file_creation", "file_number": 270805, "file_size": 42411935, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237872082, "largest_seqno": 4127228518, "table_properties": {"data_size": 40311872, "index_size": 234112, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588600, "raw_average_key_size": 20, "raw_value_size": 131630130, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129430, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732352152, "oldest_key_time": 0, "file_creation_time": 1732352152, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 270805, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:55:54.305082 139957357839936 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270806.sst) /dev/shm/ToplingTemp/Topling-122685-Kwf4u5 2024/11/23-16:55:55.014154 139957357839936 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270806.sst): first pass time = 0.71's, 189.299'MB/sec 2024/11/23-16:55:55.844602 139957357839936 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270806.sst): old prealloc_size = 147639500, real_size = 41046912 2024/11/23-16:55:55.844725 139957357839936 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270806.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129431 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.73 raw-val = 0.1316 GB zip-val = 0.0408 GB avg-val =1016.98 avg-zval = 315.16 2024/11/23-16:55:55.844884 139957357839936 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270806.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:55:56.010861 139957357839936 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270806.sst): second pass time = 0.83's, 158.644'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.17's, 257.926'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2198.951'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.265'MB/sec write SST data time = 0.04's, 977.315'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 47766.009'MB/sec zip my value time = 0.83's, unzip length = 0.132'GB zip my value throughput = 158.644'MB/sec zip pipeline throughput = 158.644'MB/sec entries = 129431 avg-key = 20.00 avg-zkey = 1.73 avg-val = 1016.98 avg-zval = 315.16 usrkeys = 129431 avg-key = 12.00 avg-zkey = 1.73 avg-val = 1023.98 avg-zval = 315.16 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129431 bytes = 485376 } seq expand size = 906017 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0408 GB dict = 1.38 MB all = 0.0429 GB } UnZip/Zip{ index = 6.9477 value = 3.2269 dict = 1.00 all = 3.1301 } Zip/UnZip{ index = 0.1439 value = 0.3099 dict = 1.00 all = 0.3195 } ---------------------------- total value len = 10.439046 GB avg = 0.194 KB (by entry num) total key len = 1.471885 GB avg = 0.027 KB total ukey len = 1.016516 GB avg = 0.015 KB total ukey num = 0.067103607 Billion total entry num = 0.053911336 Billion write speed all = 0.412946006 MB/sec (with seq num) write speed all = 0.397993374 MB/sec (without seq num) 2024/11/23-16:55:56.064388 139957357839936 [compaction_job.cc:1948] [default] [JOB 31235] Generated table #270806: 129431 keys, 42879410 bytes, temperature: kWarm 2024/11/23-16:55:56.064468 139957357839936 EVENT_LOG_v1 {"time_micros": 1732352156064421, "cf_name": "default", "job": 31235, "event": "table_file_creation", "file_number": 270806, "file_size": 42879410, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237888398, "largest_seqno": 4127202684, "table_properties": {"data_size": 40790832, "index_size": 223552, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588620, "raw_average_key_size": 20, "raw_value_size": 131629162, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129431, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732352154, "oldest_key_time": 0, "file_creation_time": 1732352154, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 270806, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:55:56.103148 139957357839936 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270807.sst) /dev/shm/ToplingTemp/Topling-122685-iUpNQ1 2024/11/23-16:55:56.760323 139957357839936 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270807.sst): first pass time = 0.66's, 204.247'MB/sec 2024/11/23-16:55:57.560756 139957357839936 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270807.sst): old prealloc_size = 147639500, real_size = 40654656 2024/11/23-16:55:57.560914 139957357839936 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270807.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129424 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.80 raw-val = 0.1316 GB zip-val = 0.0404 GB avg-val =1017.04 avg-zval = 312.07 2024/11/23-16:55:57.561338 139957357839936 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270807.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:55:57.779011 139957357839936 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270807.sst): second pass time = 0.80's, 164.631'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.22's, 194.690'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1726.463'MB/sec (index lex order gen) rebuild zvType time = 0.17's, 0.189'MB/sec write SST data time = 0.05's, 914.426'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 49127.616'MB/sec zip my value time = 0.80's, unzip length = 0.132'GB zip my value throughput = 164.631'MB/sec zip pipeline throughput = 174.142'MB/sec entries = 129424 avg-key = 20.00 avg-zkey = 1.80 avg-val = 1017.04 avg-zval = 312.07 usrkeys = 129424 avg-key = 12.00 avg-zkey = 1.80 avg-val = 1024.04 avg-zval = 312.07 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129424 bytes = 485360 } seq expand size = 905968 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0404 GB dict = 1.38 MB all = 0.0425 GB } UnZip/Zip{ index = 6.6631 value = 3.2591 dict = 1.00 all = 3.1590 } Zip/UnZip{ index = 0.1501 value = 0.3068 dict = 1.00 all = 0.3166 } ---------------------------- total value len = 10.571582 GB avg = 0.196 KB (by entry num) total key len = 1.474473 GB avg = 0.027 KB total ukey len = 1.018069 GB avg = 0.015 KB total ukey num = 0.067233031 Billion total entry num = 0.054040760 Billion write speed all = 0.417605101 MB/sec (with seq num) write speed all = 0.402617491 MB/sec (without seq num) 2024/11/23-16:55:57.830331 139957357839936 [compaction_job.cc:1948] [default] [JOB 31235] Generated table #270807: 129424 keys, 42487159 bytes, temperature: kWarm 2024/11/23-16:55:57.830399 139957357839936 EVENT_LOG_v1 {"time_micros": 1732352157830364, "cf_name": "default", "job": 31235, "event": "table_file_creation", "file_number": 270807, "file_size": 42487159, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237871365, "largest_seqno": 4127216946, "table_properties": {"data_size": 40389040, "index_size": 233088, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588480, "raw_average_key_size": 20, "raw_value_size": 131629917, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129424, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732352156, "oldest_key_time": 0, "file_creation_time": 1732352156, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 270807, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:55:57.871896 139957357839936 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270808.sst) /dev/shm/ToplingTemp/Topling-122685-yRb0k2 2024/11/23-16:55:58.489239 139957357839936 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270808.sst): first pass time = 0.62's, 217.425'MB/sec 2024/11/23-16:55:59.285704 139957357839936 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270808.sst): old prealloc_size = 147639500, real_size = 40492912 2024/11/23-16:55:59.285833 139957357839936 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270808.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129430 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.73 raw-val = 0.1316 GB zip-val = 0.0402 GB avg-val =1017.00 avg-zval = 310.88 2024/11/23-16:55:59.285952 139957357839936 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270808.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:55:59.451755 139957357839936 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270808.sst): second pass time = 0.80's, 165.421'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.17's, 253.108'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1969.283'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.270'MB/sec write SST data time = 0.05's, 912.184'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 44981.098'MB/sec zip my value time = 0.80's, unzip length = 0.132'GB zip my value throughput = 165.421'MB/sec zip pipeline throughput = 165.421'MB/sec entries = 129430 avg-key = 20.00 avg-zkey = 1.73 avg-val = 1017.00 avg-zval = 310.88 usrkeys = 129430 avg-key = 12.00 avg-zkey = 1.73 avg-val = 1019.35 avg-zval = 310.88 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 43452 bytes = 162960 } seq expand size = 304164 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0402 GB dict = 1.38 MB all = 0.0420 GB } UnZip/Zip{ index = 6.9536 value = 3.2714 dict = 1.00 all = 3.1939 } Zip/UnZip{ index = 0.1438 value = 0.3057 dict = 1.00 all = 0.3131 } ---------------------------- total value len = 10.703516 GB avg = 0.198 KB (by entry num) total key len = 1.477062 GB avg = 0.027 KB total ukey len = 1.019622 GB avg = 0.015 KB total ukey num = 0.067362461 Billion total entry num = 0.054170190 Billion write speed all = 0.422244164 MB/sec (with seq num) write speed all = 0.407221529 MB/sec (without seq num) 2024/11/23-16:55:59.504240 139957357839936 [compaction_job.cc:1948] [default] [JOB 31235] Generated table #270808: 129430 keys, 42023428 bytes, temperature: kWarm 2024/11/23-16:55:59.504312 139957357839936 EVENT_LOG_v1 {"time_micros": 1732352159504275, "cf_name": "default", "job": 31235, "event": "table_file_creation", "file_number": 270808, "file_size": 42023428, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4127228093, "table_properties": {"data_size": 40237024, "index_size": 223360, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588600, "raw_average_key_size": 20, "raw_value_size": 131629939, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129430, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732352157, "oldest_key_time": 0, "file_creation_time": 1732352157, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 270808, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:55:59.542577 139957357839936 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270809.sst) /dev/shm/ToplingTemp/Topling-122685-rxq2N4 2024/11/23-16:56:00.053536 139957357839936 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270809.sst): first pass time = 0.51's, 262.699'MB/sec 2024/11/23-16:56:00.888326 139957357839936 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270809.sst): old prealloc_size = 147639500, real_size = 41046672 2024/11/23-16:56:00.888443 139957357839936 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270809.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129432 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.70 raw-val = 0.1316 GB zip-val = 0.0408 GB avg-val =1016.98 avg-zval = 315.17 2024/11/23-16:56:00.888596 139957357839936 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270809.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:56:01.124271 139957357839936 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270809.sst): second pass time = 0.83's, 157.942'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.24's, 181.591'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2151.975'MB/sec (index lex order gen) rebuild zvType time = 0.17's, 0.187'MB/sec write SST data time = 0.06's, 682.428'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 45152.351'MB/sec zip my value time = 0.83's, unzip length = 0.132'GB zip my value throughput = 157.942'MB/sec zip pipeline throughput = 157.942'MB/sec entries = 129432 avg-key = 20.00 avg-zkey = 1.70 avg-val = 1016.98 avg-zval = 315.17 usrkeys = 129432 avg-key = 12.00 avg-zkey = 1.70 avg-val = 1023.08 avg-zval = 315.17 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 112863 bytes = 423248 } seq expand size = 790041 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0408 GB dict = 1.38 MB all = 0.0428 GB } UnZip/Zip{ index = 7.0466 value = 3.2267 dict = 1.00 all = 3.1332 } Zip/UnZip{ index = 0.1419 value = 0.3099 dict = 1.00 all = 0.3192 } ---------------------------- total value len = 10.835935 GB avg = 0.200 KB (by entry num) total key len = 1.479650 GB avg = 0.027 KB total ukey len = 1.021176 GB avg = 0.015 KB total ukey num = 0.067491893 Billion total entry num = 0.054299622 Billion write speed all = 0.426899511 MB/sec (with seq num) write speed all = 0.411841855 MB/sec (without seq num) 2024/11/23-16:56:01.178651 139957357839936 [compaction_job.cc:1948] [default] [JOB 31235] Generated table #270809: 129432 keys, 42837407 bytes, temperature: kWarm 2024/11/23-16:56:01.178746 139957357839936 EVENT_LOG_v1 {"time_micros": 1732352161178696, "cf_name": "default", "job": 31235, "event": "table_file_creation", "file_number": 270809, "file_size": 42837407, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4127217626, "table_properties": {"data_size": 40793728, "index_size": 220416, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588640, "raw_average_key_size": 20, "raw_value_size": 131629209, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129432, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732352159, "oldest_key_time": 0, "file_creation_time": 1732352159, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 270809, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:56:01.236233 139957357839936 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270810.sst) /dev/shm/ToplingTemp/Topling-122685-U3soG5 2024/11/23-16:56:01.926238 139957357839936 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270810.sst): first pass time = 0.69's, 194.533'MB/sec 2024/11/23-16:56:02.726789 139957357839936 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270810.sst): old prealloc_size = 147639500, real_size = 40637728 2024/11/23-16:56:02.726905 139957357839936 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270810.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129429 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.75 raw-val = 0.1316 GB zip-val = 0.0404 GB avg-val =1017.01 avg-zval = 311.98 2024/11/23-16:56:02.727036 139957357839936 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270810.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:56:02.889752 139957357839936 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270810.sst): second pass time = 0.80's, 164.769'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 259.603'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2400.568'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.272'MB/sec write SST data time = 0.04's, 961.798'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 42218.591'MB/sec zip my value time = 0.80's, unzip length = 0.132'GB zip my value throughput = 164.769'MB/sec zip pipeline throughput = 164.769'MB/sec entries = 129429 avg-key = 20.00 avg-zkey = 1.75 avg-val = 1017.01 avg-zval = 311.98 usrkeys = 129429 avg-key = 12.00 avg-zkey = 1.75 avg-val = 1021.24 avg-zval = 311.98 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 78264 bytes = 293504 } seq expand size = 547848 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0404 GB dict = 1.38 MB all = 0.0423 GB } UnZip/Zip{ index = 6.8573 value = 3.2599 dict = 1.00 all = 3.1731 } Zip/UnZip{ index = 0.1458 value = 0.3068 dict = 1.00 all = 0.3152 } ---------------------------- total value len = 10.968113 GB avg = 0.202 KB (by entry num) total key len = 1.482239 GB avg = 0.027 KB total ukey len = 1.022729 GB avg = 0.015 KB total ukey num = 0.067621322 Billion total entry num = 0.054429051 Billion write speed all = 0.431544560 MB/sec (with seq num) write speed all = 0.416451936 MB/sec (without seq num) 2024/11/23-16:56:02.944823 139957357839936 [compaction_job.cc:1948] [default] [JOB 31235] Generated table #270810: 129429 keys, 42299332 bytes, temperature: kWarm 2024/11/23-16:56:02.944897 139957357839936 EVENT_LOG_v1 {"time_micros": 1732352162944859, "cf_name": "default", "job": 31235, "event": "table_file_creation", "file_number": 270810, "file_size": 42299332, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4127219860, "table_properties": {"data_size": 40378704, "index_size": 226496, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588580, "raw_average_key_size": 20, "raw_value_size": 131630058, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129429, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732352161, "oldest_key_time": 0, "file_creation_time": 1732352161, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 270810, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:56:02.981308 139957357839936 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270811.sst) /dev/shm/ToplingTemp/Topling-122685-sDetk3 2024/11/23-16:56:03.529225 139957357839936 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270811.sst): first pass time = 0.55's, 244.977'MB/sec 2024/11/23-16:56:04.361872 139957357839936 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270811.sst): old prealloc_size = 147639500, real_size = 41020880 2024/11/23-16:56:04.362030 139957357839936 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270811.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129425 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.73 raw-val = 0.1316 GB zip-val = 0.0408 GB avg-val =1017.03 avg-zval = 314.97 2024/11/23-16:56:04.362208 139957357839936 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270811.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:56:04.566369 139957357839936 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270811.sst): second pass time = 0.83's, 158.236'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.20's, 209.544'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1679.862'MB/sec (index lex order gen) rebuild zvType time = 0.14's, 0.238'MB/sec write SST data time = 0.07's, 628.862'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 46285.311'MB/sec zip my value time = 0.83's, unzip length = 0.132'GB zip my value throughput = 158.236'MB/sec zip pipeline throughput = 158.236'MB/sec entries = 129425 avg-key = 20.00 avg-zkey = 1.73 avg-val = 1017.03 avg-zval = 314.97 usrkeys = 129425 avg-key = 12.00 avg-zkey = 1.73 avg-val = 1023.58 avg-zval = 314.97 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 121076 bytes = 454048 } seq expand size = 847532 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0408 GB dict = 1.38 MB all = 0.0428 GB } UnZip/Zip{ index = 6.9394 value = 3.2290 dict = 1.00 all = 3.1328 } Zip/UnZip{ index = 0.1441 value = 0.3097 dict = 1.00 all = 0.3192 } ---------------------------- total value len = 11.100590 GB avg = 0.203 KB (by entry num) total key len = 1.484827 GB avg = 0.027 KB total ukey len = 1.024282 GB avg = 0.015 KB total ukey num = 0.067750747 Billion total entry num = 0.054558476 Billion write speed all = 0.436200750 MB/sec (with seq num) write speed all = 0.421073116 MB/sec (without seq num) 2024/11/23-16:56:04.627490 139957357839936 [compaction_job.cc:1948] [default] [JOB 31235] Generated table #270811: 129425 keys, 42842727 bytes, temperature: kWarm 2024/11/23-16:56:04.627584 139957357839936 EVENT_LOG_v1 {"time_micros": 1732352164627535, "cf_name": "default", "job": 31235, "event": "table_file_creation", "file_number": 270811, "file_size": 42842727, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4127211528, "table_properties": {"data_size": 40764544, "index_size": 223808, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588500, "raw_average_key_size": 20, "raw_value_size": 131629508, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129425, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732352162, "oldest_key_time": 0, "file_creation_time": 1732352162, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 270811, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:56:04.679135 139957357839936 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270812.sst) /dev/shm/ToplingTemp/Topling-122685-kgxh64 2024/11/23-16:56:05.410332 139957357839936 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270812.sst): first pass time = 0.73's, 183.574'MB/sec 2024/11/23-16:56:06.189240 139957357839936 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270812.sst): old prealloc_size = 147639500, real_size = 40529616 2024/11/23-16:56:06.189360 139957357839936 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270812.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129430 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.75 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1016.99 avg-zval = 311.14 2024/11/23-16:56:06.189482 139957357839936 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270812.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:56:06.352011 139957357839936 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270812.sst): second pass time = 0.78's, 169.293'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 258.903'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2300.834'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.273'MB/sec write SST data time = 0.04's, 956.548'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 47645.446'MB/sec zip my value time = 0.78's, unzip length = 0.132'GB zip my value throughput = 169.293'MB/sec zip pipeline throughput = 169.293'MB/sec entries = 129430 avg-key = 20.00 avg-zkey = 1.75 avg-val = 1016.99 avg-zval = 311.14 usrkeys = 129430 avg-key = 12.00 avg-zkey = 1.75 avg-val = 1020.41 avg-zval = 311.14 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 63164 bytes = 236880 } seq expand size = 442148 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0421 GB } UnZip/Zip{ index = 6.8593 value = 3.2686 dict = 1.00 all = 3.1855 } Zip/UnZip{ index = 0.1458 value = 0.3059 dict = 1.00 all = 0.3139 } ---------------------------- total value len = 11.232662 GB avg = 0.205 KB (by entry num) total key len = 1.487416 GB avg = 0.027 KB total ukey len = 1.025835 GB avg = 0.015 KB total ukey num = 0.067880177 Billion total entry num = 0.054687906 Billion write speed all = 0.440840687 MB/sec (with seq num) write speed all = 0.425678104 MB/sec (without seq num) 2024/11/23-16:56:06.408131 139957357839936 [compaction_job.cc:1948] [default] [JOB 31235] Generated table #270812: 129430 keys, 42133970 bytes, temperature: kWarm 2024/11/23-16:56:06.408200 139957357839936 EVENT_LOG_v1 {"time_micros": 1732352166408165, "cf_name": "default", "job": 31235, "event": "table_file_creation", "file_number": 270812, "file_size": 42133970, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4127226766, "table_properties": {"data_size": 40270656, "index_size": 226432, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588600, "raw_average_key_size": 20, "raw_value_size": 131629537, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129430, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732352164, "oldest_key_time": 0, "file_creation_time": 1732352164, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 270812, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:56:06.455298 139957357839936 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270813.sst) /dev/shm/ToplingTemp/Topling-122685-UEOWw3 2024/11/23-16:56:07.053443 139957357839936 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270813.sst): first pass time = 0.60's, 224.408'MB/sec 2024/11/23-16:56:07.849401 139957357839936 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270813.sst): old prealloc_size = 147639500, real_size = 40605840 2024/11/23-16:56:07.849536 139957357839936 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270813.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129427 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.72 raw-val = 0.1316 GB zip-val = 0.0404 GB avg-val =1017.02 avg-zval = 311.76 2024/11/23-16:56:07.849642 139957357839936 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270813.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:56:08.013104 139957357839936 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270813.sst): second pass time = 0.80's, 165.514'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 257.263'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1991.719'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.272'MB/sec write SST data time = 0.04's, 941.114'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 47332.383'MB/sec zip my value time = 0.80's, unzip length = 0.132'GB zip my value throughput = 165.514'MB/sec zip pipeline throughput = 165.514'MB/sec entries = 129427 avg-key = 20.00 avg-zkey = 1.72 avg-val = 1017.02 avg-zval = 311.76 usrkeys = 129427 avg-key = 12.00 avg-zkey = 1.72 avg-val = 1018.95 avg-zval = 311.76 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 35767 bytes = 134144 } seq expand size = 250369 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0404 GB dict = 1.38 MB all = 0.0421 GB } UnZip/Zip{ index = 6.9734 value = 3.2621 dict = 1.00 all = 3.1875 } Zip/UnZip{ index = 0.1434 value = 0.3065 dict = 1.00 all = 0.3137 } ---------------------------- total value len = 11.364542 GB avg = 0.207 KB (by entry num) total key len = 1.490004 GB avg = 0.027 KB total ukey len = 1.027388 GB avg = 0.015 KB total ukey num = 0.068009604 Billion total entry num = 0.054817333 Billion write speed all = 0.445475328 MB/sec (with seq num) write speed all = 0.430277736 MB/sec (without seq num) 2024/11/23-16:56:08.071659 139957357839936 [compaction_job.cc:1948] [default] [JOB 31235] Generated table #270813: 129427 keys, 42107698 bytes, temperature: kWarm 2024/11/23-16:56:08.071749 139957357839936 EVENT_LOG_v1 {"time_micros": 1732352168071699, "cf_name": "default", "job": 31235, "event": "table_file_creation", "file_number": 270813, "file_size": 42107698, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4127221422, "table_properties": {"data_size": 40350592, "index_size": 222720, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588540, "raw_average_key_size": 20, "raw_value_size": 131629651, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129427, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732352166, "oldest_key_time": 0, "file_creation_time": 1732352166, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 270813, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:56:08.128765 139957357839936 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270814.sst) /dev/shm/ToplingTemp/Topling-122685-N5JNN5 2024/11/23-16:56:08.640793 139957357839936 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270814.sst): first pass time = 0.51's, 262.158'MB/sec 2024/11/23-16:56:09.440066 139957357839936 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270814.sst): old prealloc_size = 147639500, real_size = 40459024 2024/11/23-16:56:09.440236 139957357839936 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270814.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129431 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.72 raw-val = 0.1316 GB zip-val = 0.0402 GB avg-val =1016.98 avg-zval = 310.62 2024/11/23-16:56:09.440343 139957357839936 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270814.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:56:09.621801 139957357839936 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270814.sst): second pass time = 0.80's, 165.073'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.18's, 230.779'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1521.033'MB/sec (index lex order gen) rebuild zvType time = 0.14's, 0.239'MB/sec write SST data time = 0.05's, 906.029'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 45142.740'MB/sec zip my value time = 0.80's, unzip length = 0.132'GB zip my value throughput = 165.073'MB/sec zip pipeline throughput = 165.073'MB/sec entries = 129431 avg-key = 20.00 avg-zkey = 1.72 avg-val = 1016.98 avg-zval = 310.62 usrkeys = 129431 avg-key = 12.00 avg-zkey = 1.72 avg-val = 1018.57 avg-zval = 310.62 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 29371 bytes = 110160 } seq expand size = 205597 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0402 GB dict = 1.38 MB all = 0.0419 GB } UnZip/Zip{ index = 6.9938 value = 3.2740 dict = 1.00 all = 3.2005 } Zip/UnZip{ index = 0.1430 value = 0.3054 dict = 1.00 all = 0.3125 } ---------------------------- total value len = 11.496377 GB avg = 0.209 KB (by entry num) total key len = 1.492593 GB avg = 0.027 KB total ukey len = 1.028941 GB avg = 0.015 KB total ukey num = 0.068139035 Billion total entry num = 0.054946764 Billion write speed all = 0.450108689 MB/sec (with seq num) write speed all = 0.434876062 MB/sec (without seq num) 2024/11/23-16:56:09.674755 139957357839936 [compaction_job.cc:1948] [default] [JOB 31235] Generated table #270814: 129431 keys, 41936784 bytes, temperature: kWarm 2024/11/23-16:56:09.674852 139957357839936 EVENT_LOG_v1 {"time_micros": 1732352169674799, "cf_name": "default", "job": 31235, "event": "table_file_creation", "file_number": 270814, "file_size": 41936784, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4127219500, "table_properties": {"data_size": 40204416, "index_size": 222080, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588620, "raw_average_key_size": 20, "raw_value_size": 131629194, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129431, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732352168, "oldest_key_time": 0, "file_creation_time": 1732352168, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 270814, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:56:09.730079 139957357839936 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270815.sst) /dev/shm/ToplingTemp/Topling-122685-IuVoW2 2024/11/23-16:56:10.288863 139957357839936 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270815.sst): first pass time = 0.56's, 240.218'MB/sec 2024/11/23-16:56:11.091634 139957357839936 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270815.sst): old prealloc_size = 147639500, real_size = 40468592 2024/11/23-16:56:11.091758 139957357839936 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270815.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129427 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.72 raw-val = 0.1316 GB zip-val = 0.0402 GB avg-val =1017.02 avg-zval = 310.71 2024/11/23-16:56:11.091839 139957357839936 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270815.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:56:11.250030 139957357839936 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270815.sst): second pass time = 0.80's, 164.112'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 264.882'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2187.183'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.278'MB/sec write SST data time = 0.04's, 997.991'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 42333.835'MB/sec zip my value time = 0.80's, unzip length = 0.132'GB zip my value throughput = 164.112'MB/sec zip pipeline throughput = 164.112'MB/sec entries = 129427 avg-key = 20.00 avg-zkey = 1.72 avg-val = 1017.02 avg-zval = 310.71 usrkeys = 129427 avg-key = 12.00 avg-zkey = 1.72 avg-val = 1018.64 avg-zval = 310.71 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 29984 bytes = 112448 } seq expand size = 209888 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0402 GB dict = 1.38 MB all = 0.0419 GB } UnZip/Zip{ index = 6.9935 value = 3.2732 dict = 1.00 all = 3.1996 } Zip/UnZip{ index = 0.1430 value = 0.3055 dict = 1.00 all = 0.3125 } ---------------------------- total value len = 11.628216 GB avg = 0.211 KB (by entry num) total key len = 1.495182 GB avg = 0.027 KB total ukey len = 1.030494 GB avg = 0.015 KB total ukey num = 0.068268462 Billion total entry num = 0.055076191 Billion write speed all = 0.454741373 MB/sec (with seq num) write speed all = 0.439473727 MB/sec (without seq num) 2024/11/23-16:56:11.301814 139957357839936 [compaction_job.cc:1948] [default] [JOB 31235] Generated table #270815: 129427 keys, 41948929 bytes, temperature: kWarm 2024/11/23-16:56:11.301888 139957357839936 EVENT_LOG_v1 {"time_micros": 1732352171301852, "cf_name": "default", "job": 31235, "event": "table_file_creation", "file_number": 270815, "file_size": 41948929, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4127226866, "table_properties": {"data_size": 40213984, "index_size": 222080, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588540, "raw_average_key_size": 20, "raw_value_size": 131629250, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129427, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732352169, "oldest_key_time": 0, "file_creation_time": 1732352169, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 270815, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:56:11.338776 139957357839936 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270816.sst) /dev/shm/ToplingTemp/Topling-122685-Ol5gf5 2024/11/23-16:56:11.350315 139957357839936 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270816.sst): first pass time = 0.01's, 249.557'MB/sec 2024/11/23-16:56:11.379865 139957357839936 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270816.sst): old prealloc_size = 147639500, real_size = 911408 2024/11/23-16:56:11.379898 139957357839936 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270816.sst): index type = UintIndex_IL_256_32 , store type = DictZipBlobStore usrkeys = 2769 prefix = 4 raw-key = 0.0000 GB zip-key = 0.0000 GB avg-key = 8.00 avg-zkey = 0.26 raw-val = 0.0028 GB zip-val = 0.0009 GB avg-val =1017.01 avg-zval = 328.58 2024/11/23-16:56:11.383011 139957357839936 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00/270816.sst): second pass time = 0.03's, 96.721'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.00's, 306.511'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 37.993'MB/sec (index lex order gen) rebuild zvType time = 0.00's, 0.312'MB/sec write SST data time = 0.00's, 1093.225'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.033'MB, throughput = 1313.864'MB/sec zip my value time = 0.03's, unzip length = 0.003'GB zip my value throughput = 96.721'MB/sec zip pipeline throughput = 96.721'MB/sec entries = 2769 avg-key = 20.00 avg-zkey = 0.28 avg-val = 1017.01 avg-zval = 328.58 usrkeys = 2769 avg-key = 12.00 avg-zkey = 0.28 avg-val = 1024.01 avg-zval = 328.58 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 2769 bytes = 9360 } seq expand size = 19383 multi value expand size = 0 cnt WriteAppend = 11 UnZipSize{ index = 0.0000 GB value = 0.0028 GB dict = 0.03 MB all = 0.0029 GB } __ZipSize{ index = 0.0000 GB value = 0.0009 GB dict = 0.03 MB all = 0.0010 GB } UnZip/Zip{ index = 43.2656 value = 3.0952 dict = 1.00 all = 3.0108 } Zip/UnZip{ index = 0.0231 value = 0.3231 dict = 1.00 all = 0.3321 } ---------------------------- total value len = 11.631051 GB avg = 0.211 KB (by entry num) total key len = 1.495237 GB avg = 0.027 KB total ukey len = 1.030528 GB avg = 0.015 KB total ukey num = 0.068271231 Billion total entry num = 0.055078960 Billion write speed all = 0.454839449 MB/sec (with seq num) write speed all = 0.439571107 MB/sec (without seq num) 2024/11/23-16:56:11.391304 139957357839936 [compaction_job.cc:1948] [default] [JOB 31235] Generated table #270816: 2769 keys, 953725 bytes, temperature: kWarm 2024/11/23-16:56:11.391350 139957357839936 EVENT_LOG_v1 {"time_micros": 1732352171391323, "cf_name": "default", "job": 31235, "event": "table_file_creation", "file_number": 270816, "file_size": 953725, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4017708424, "largest_seqno": 4127228318, "table_properties": {"data_size": 909840, "index_size": 768, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 55380, "raw_average_key_size": 20, "raw_value_size": 2816112, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 2769, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-UintIndex_IL_256_32-DictZipBlobStore", "creation_time": 1732352171, "oldest_key_time": 0, "file_creation_time": 1732352171, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 270816, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:56:11.400235 139957357839936 [compaction_job.cc:703] job-31235: subcompact[0], size: 0.892796 G, files: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31235/att-00 [270795,270796,270797,270798,270799,270800,270801,270802,270803,270804,270805,270806,270807,270808,270809,270810,270811,270812,270813,270814,270815,270816] 2024/11/23-16:56:11.530123 139957357839936 (Original Log Time 2024/11/23-16:55:29.571337) EVENT_LOG_v1 {"time_micros": 1732352129571294, "job": 31235, "event": "compaction_started", "compaction_reason": "FilesMarkedForCompaction", "files_L2": [270792], "files_L3": [270724, 270725, 270726, 270727, 270728, 270729, 270730, 270731, 270732, 270733, 270734, 270735, 270736, 270737, 270738, 270739, 270740, 270741, 270742, 270743, 270744], "score": 0.999499, "input_data_size": 924588255, "oldest_snapshot_seqno": 4127247131} 2024/11/23-16:56:11.530127 139957357839936 (Original Log Time 2024/11/23-16:56:11.528300) [compaction_job.cc:2022] [default] [JOB 31235] Compacted 1@2 + 21@3 files to L3 => 892796460 bytes 2024/11/23-16:56:11.530128 139957357839936 (Original Log Time 2024/11/23-16:56:11.530053) [compaction_job.cc:1224] [default] compacted to: files[0 0 0 22 0 0 0] max score 0.03, MB/sec: 22.1 rd, 21.3 wr, level 3, files in(1, 21) out(22 +0 blob) MB in(31.2, 850.6 +0.0 blob) out(851.4 +0.0 blob), read-write-amplify(55.6) write-amplify(27.3) OK, records in: 2749940, records dropped: 29144 output_compression: Snappy 2024/11/23-16:56:11.530132 139957357839936 (Original Log Time 2024/11/23-16:56:11.530098) EVENT_LOG_v1 {"time_micros": 1732352171530076, "cf": "default", "job": 31235, "event": "compaction_finished", "compaction_time_micros": 41828902, "compaction_time_cpu_micros": 8547595, "output_level": 3, "num_output_files": 22, "total_output_size": 892796460, "num_input_records": 2749940, "num_output_records": 2720796, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "file_write_nanos": 780949238, "file_range_sync_nanos": 0, "file_fsync_nanos": 17687, "file_prepare_write_nanos": 54176, "lsm_state": [0, 0, 0, 22, 0, 0, 0]} 2024/11/23-16:56:11.667843 139957357839936 DEBG dcompact_worker.cpp:240: HttpPost: 200 OK: url = http://nlb-7zny4kaa1poal01o64.cn-shenzhen.nlb.aliyuncs.com:8443, body = {"instanceId":"nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137","labourId":"","dbId":"d89b4006-2803-486e-b7a2-759bcf348921","dbStarts":1732256054,"starts":1732352129,"executesMs":42086,"compactionJobId":31235,"attempt":0,"compactionInputRawBytes":2851673967,"compactionInputZipBytes":924588255,"compactionOutputRawBytes":0,"compactionOutputZipBytes":892796460,"headers":{"Accept":"*/*","Connection":"close","Host":"aliyun-topling-saas.topling.cn:18443","RemoteIp":"120.24.192.169","X-Forwarded-For":"120.24.192.169","region":"cn-shenzhen","token":"e6474c481bd4415abc537135cc03626b","instance-token":"e6474c481bd4415abc537135cc03626b","provider":"aliyun","CloudMarketInstanceId":"si-59c0ae5c955845588903","MeteringAssit":"","Transfer-Encoding":"chunked","traceparent":"00-fe3d6e5ccb30a551aab1c751522aae46-56c8075279b4ffa1-00"}}, response = 2024/11/23-16:56:11.667956 139957357839936 INFO dcompact_worker.cpp:1459: finish /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-31235/att-00: olev 3, work 42.086 s, result 5.924 ms, install 1.848 ms, input{raw 2.656 GiB zip 881.756 MiB}