2024/11/23-16:53:27.191780 139957273912896 DEBG dcompact_worker.cpp:2214: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00: fork to child time = 0.007813 sec 2024/11/23-16:53:27.192535 139957273912896 DEBG dcompact_worker.cpp:1013: Beg SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00 2024/11/23-16:53:27.199915 139957273912896 DEBG dcompact_worker.cpp:1033: End SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00 2024/11/23-16:53:27.200849 139957273912896 TRAC dcompact_worker.cpp:1083: INFO_LOG_LEVEL: rpc = INFO_LEVEL, env_var = undefined 2024/11/23-16:53:27.201119 139957273912896 [WARN] [column_family.cc:386] multiple cf_paths/db_paths and level_compaction_dynamic_level_bytes can't be used together 2024/11/23-16:53:27.253569 139957273912896 [version_set.cc:6208] Recovering from manifest file: /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-31220/att-00/MANIFEST-206347 2024/11/23-16:53:27.307062 139957273912896 [version_set.cc:6251] Recovered from manifest file:/worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-31220/att-00/MANIFEST-206347 succeeded,manifest_file_number is 206347, next_file_number is 270721, last_sequence is 4125942820, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 270556 2024/11/23-16:53:27.307079 139957273912896 [version_set.cc:6266] Column family [default] (ID 0), log number is 0 2024/11/23-16:53:27.307226 139957273912896 [version_set.cc:5721] Creating manifest 270721 2024/11/23-16:53:27.341635 139957273912896 DEBG dcompact_worker.cpp:1218: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00: bottommost_level: fake = 1, rpc = 0 2024/11/23-16:53:27.362161 139957273912896 [compaction_job.cc:2437] [default] [JOB 31220] Compacting 1@2 + 22@3 files to L3, score 1.00, subcompactions 1 : 1 2024/11/23-16:53:27.362177 139957273912896 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 23352 Base level 2, inputs: [270695(27MB)], [270711(37MB) 270712(2689KB) 270638(39MB) 270639(36MB) 270640(36MB) 270641(33MB) 270642(33MB) 270643(33MB) 270644(34MB) 270645(38MB) 270646(35MB) 270647(34MB) 270648(34MB) 270649(35MB) 270650(35MB) 270651(36MB) 270652(34MB) 270653(35MB) 270654(35MB) 270655(37MB) 270656(37MB) 270716(37MB)] 2024/11/23-16:53:27.368860 139957273912896 [top_zip_table.cc:59] core git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-16:53:27.368889 139957273912896 [top_zip_table.cc:60] fsa git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-16:53:27.368909 139957273912896 [top_zip_table.cc:61] zbs git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-16:53:27.368915 139957273912896 [top_zip_table.cc:62] topling-zip_table_reader: git_version_hash_info_is: commit a4a382006cb82713acf5b3425835f22711877681 Author: leipeng Date: 2024-04-11 19:44:14 +0800 fixed_len_hole_index.cc: Add env bool FixedLenHoleIndexUseAVX512 for ut & debug 1. FixedLenHoleIndexUseAVX512 is only in unit tests or debug 2. In release mode, use avx512 by compile options(-march=) g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/23-16:53:27.368926 139957273912896 [top_zip_table.cc:64] topling-rocks git_version_hash_info_is: commit feab587e468621ba0204d47b4ffacc52e7c4290d Author: leipeng Date: 2024-03-22 13:35:06 +0800 ToplingZipTableBuilder::Add: immediately return after error This function returns void, and caller does not check builder->status() after calling this function and graceful abandon. So immediately return after error, and return error status in Finish(). g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/23-16:53:27.960860 139957273912896 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270722.sst) /dev/shm/ToplingTemp/Topling-122403-hw7dJH 2024/11/23-16:53:28.739174 139957273912896 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270722.sst): first pass time = 0.78's, 172.457'MB/sec 2024/11/23-16:53:30.130003 139957273912896 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270722.sst): old prealloc_size = 147639500, real_size = 35568560 2024/11/23-16:53:30.130686 139957273912896 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270722.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 929141 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0336 GB avg-val = 116.45 avg-zval = 36.13 2024/11/23-16:53:30.131552 139957273912896 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270722.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:53:31.194394 139957273912896 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270722.sst): second pass time = 1.39's, 77.896'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.06's, 37.164'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2665.947'MB/sec (index lex order gen) rebuild zvType time = 0.91's, 0.255'MB/sec write SST data time = 0.15's, 259.691'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 35775.679'MB/sec zip my value time = 1.39's, unzip length = 0.108'GB zip my value throughput = 77.896'MB/sec zip pipeline throughput = 77.896'MB/sec entries = 929141 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.45 avg-zval = 36.13 usrkeys = 929141 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.45 avg-zval = 36.13 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 929141 bytes = 3135872 } seq expand size = 6503987 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0336 GB dict = 1.08 MB all = 0.0396 GB } UnZip/Zip{ index = 10.5137 value = 3.2233 dict = 1.00 all = 3.3930 } Zip/UnZip{ index = 0.0951 value = 0.3102 dict = 1.00 all = 0.2947 } ---------------------------- total value len = 8.963326 GB avg = 0.168 KB (by entry num) total key len = 1.466837 GB avg = 0.028 KB total ukey len = 1.016461 GB avg = 0.015 KB total ukey num = 0.066479576 Billion total entry num = 0.053287305 Billion write speed all = 0.363433222 MB/sec (with seq num) write speed all = 0.348579090 MB/sec (without seq num) 2024/11/23-16:53:31.245099 139957273912896 [compaction_job.cc:1948] [default] [JOB 31220] Generated table #270722: 929141 keys, 39557420 bytes, temperature: kWarm 2024/11/23-16:53:31.245193 139957273912896 EVENT_LOG_v1 {"time_micros": 1732352011245137, "cf_name": "default", "job": 31220, "event": "table_file_creation", "file_number": 270722, "file_size": 39557420, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4051668904, "largest_seqno": 4125725625, "table_properties": {"data_size": 33568608, "index_size": 1767488, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26015948, "raw_average_key_size": 28, "raw_value_size": 108201862, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 929141, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732352007, "oldest_key_time": 0, "file_creation_time": 1732352007, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 270722, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:53:31.281702 139957273912896 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270723.sst) /dev/shm/ToplingTemp/Topling-122403-2tJXkK 2024/11/23-16:53:32.495318 139957273912896 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270723.sst): first pass time = 1.21's, 110.597'MB/sec 2024/11/23-16:53:34.087266 139957273912896 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270723.sst): old prealloc_size = 147639500, real_size = 36587600 2024/11/23-16:53:34.087922 139957273912896 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270723.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 928911 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0346 GB avg-val = 116.49 avg-zval = 37.24 2024/11/23-16:53:34.088835 139957273912896 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270723.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:53:35.009076 139957273912896 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270723.sst): second pass time = 1.59's, 68.012'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.92's, 44.400'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2781.220'MB/sec (index lex order gen) rebuild zvType time = 0.77's, 0.302'MB/sec write SST data time = 0.15's, 269.206'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 32489.148'MB/sec zip my value time = 1.59's, unzip length = 0.108'GB zip my value throughput = 68.012'MB/sec zip pipeline throughput = 68.012'MB/sec entries = 928911 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.49 avg-zval = 37.24 usrkeys = 928911 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.49 avg-zval = 37.24 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 928911 bytes = 3483424 } seq expand size = 6502377 multi value expand size = 0 cnt WriteAppend = 15 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0346 GB dict = 1.08 MB all = 0.0409 GB } UnZip/Zip{ index = 10.5141 value = 3.1285 dict = 1.00 all = 3.2794 } Zip/UnZip{ index = 0.0951 value = 0.3196 dict = 1.00 all = 0.3049 } ---------------------------- total value len = 9.078036 GB avg = 0.167 KB (by entry num) total key len = 1.492847 GB avg = 0.028 KB total ukey len = 1.035039 GB avg = 0.015 KB total ukey num = 0.067408487 Billion total entry num = 0.054216216 Billion write speed all = 0.368287587 MB/sec (with seq num) write speed all = 0.353176524 MB/sec (without seq num) 2024/11/23-16:53:35.059603 139957273912896 [compaction_job.cc:1948] [default] [JOB 31220] Generated table #270723: 928911 keys, 40927658 bytes, temperature: kWarm 2024/11/23-16:53:35.059672 139957273912896 EVENT_LOG_v1 {"time_micros": 1732352015059636, "cf_name": "default", "job": 31220, "event": "table_file_creation", "file_number": 270723, "file_size": 40927658, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3583362754, "largest_seqno": 4125725733, "table_properties": {"data_size": 34588224, "index_size": 1766976, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26009508, "raw_average_key_size": 28, "raw_value_size": 108208338, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 928911, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732352011, "oldest_key_time": 0, "file_creation_time": 1732352011, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 270723, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:53:35.095239 139957273912896 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270724.sst) /dev/shm/ToplingTemp/Topling-122403-ubJwxJ 2024/11/23-16:53:36.200302 139957273912896 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270724.sst): first pass time = 1.11's, 121.462'MB/sec 2024/11/23-16:53:37.821223 139957273912896 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270724.sst): old prealloc_size = 147639500, real_size = 36325216 2024/11/23-16:53:37.821785 139957273912896 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270724.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 932707 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1081 GB zip-val = 0.0343 GB avg-val = 115.90 avg-zval = 36.79 2024/11/23-16:53:37.822316 139957273912896 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270724.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:53:38.619705 139957273912896 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270724.sst): second pass time = 1.62's, 66.726'MB/sec, value only(80.5% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.80's, 48.909'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3250.124'MB/sec (index lex order gen) rebuild zvType time = 0.67's, 0.348'MB/sec write SST data time = 0.13's, 307.132'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 27543.025'MB/sec zip my value time = 1.62's, unzip length = 0.108'GB zip my value throughput = 66.726'MB/sec zip pipeline throughput = 66.726'MB/sec entries = 932707 avg-key = 28.00 avg-zkey = 1.90 avg-val = 115.90 avg-zval = 36.79 usrkeys = 932707 avg-key = 20.00 avg-zkey = 1.90 avg-val = 119.60 avg-zval = 36.79 TagRS{ kinds = RS_Key0_TagN bytes = 145840 } TagArray{ size = 493276 bytes = 1726480 } seq expand size = 3452932 multi value expand size = 0 cnt WriteAppend = 16 UnZipSize{ index = 0.0187 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0343 GB dict = 1.08 MB all = 0.0391 GB } UnZip/Zip{ index = 10.5148 value = 3.1500 dict = 1.00 all = 3.4369 } Zip/UnZip{ index = 0.0951 value = 0.3175 dict = 1.00 all = 0.2910 } ---------------------------- total value len = 9.189591 GB avg = 0.167 KB (by entry num) total key len = 1.518962 GB avg = 0.028 KB total ukey len = 1.053693 GB avg = 0.015 KB total ukey num = 0.068341194 Billion total entry num = 0.055148923 Billion write speed all = 0.373037083 MB/sec (with seq num) write speed all = 0.357667991 MB/sec (without seq num) 2024/11/23-16:53:38.666916 139957273912896 [compaction_job.cc:1948] [default] [JOB 31220] Generated table #270724: 932707 keys, 39052129 bytes, temperature: kWarm 2024/11/23-16:53:38.666994 139957273912896 EVENT_LOG_v1 {"time_micros": 1732352018666948, "cf_name": "default", "job": 31220, "event": "table_file_creation", "file_number": 270724, "file_size": 39052129, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4012776165, "table_properties": {"data_size": 34317776, "index_size": 1774080, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26115796, "raw_average_key_size": 28, "raw_value_size": 108101994, "raw_average_value_size": 115, "num_data_blocks": 1, "num_entries": 932707, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732352015, "oldest_key_time": 0, "file_creation_time": 1732352015, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 270724, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:53:38.711726 139957273912896 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270725.sst) /dev/shm/ToplingTemp/Topling-122403-lDu0KJ 2024/11/23-16:53:39.828172 139957273912896 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270725.sst): first pass time = 1.12's, 120.224'MB/sec 2024/11/23-16:53:41.696508 139957273912896 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270725.sst): old prealloc_size = 147639500, real_size = 35478864 2024/11/23-16:53:41.697142 139957273912896 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270725.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 1080418 prefix = 4 raw-key = 0.0173 GB zip-key = 0.0021 GB avg-key = 16.00 avg-zkey = 1.93 raw-val = 0.1040 GB zip-val = 0.0331 GB avg-val = 96.23 avg-zval = 30.66 2024/11/23-16:53:41.697384 139957273912896 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270725.sst: sumWaitingMem = 0.003 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0028 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:53:42.411999 139957273912896 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270725.sst): second pass time = 1.87's, 55.670'MB/sec, value only(77.5% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.72's, 51.523'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3392.507'MB/sec (index lex order gen) rebuild zvType time = 0.57's, 0.473'MB/sec write SST data time = 0.14's, 256.743'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.029'MB, throughput = 34523.865'MB/sec zip my value time = 1.87's, unzip length = 0.104'GB zip my value throughput = 55.670'MB/sec zip pipeline throughput = 126.153'MB/sec entries = 1080418 avg-key = 28.00 avg-zkey = 1.93 avg-val = 96.23 avg-zval = 30.66 usrkeys = 1080418 avg-key = 20.00 avg-zkey = 1.93 avg-val = 97.08 avg-zval = 30.66 TagRS{ kinds = RS_Key0_TagN bytes = 168920 } TagArray{ size = 131446 bytes = 443648 } seq expand size = 920122 multi value expand size = 0 cnt WriteAppend = 15 UnZipSize{ index = 0.0216 GB value = 0.1040 GB dict = 1.03 MB all = 0.1342 GB } __ZipSize{ index = 0.0021 GB value = 0.0331 GB dict = 1.03 MB all = 0.0369 GB } UnZip/Zip{ index = 10.3794 value = 3.1384 dict = 1.00 all = 3.6411 } Zip/UnZip{ index = 0.0963 value = 0.3186 dict = 1.00 all = 0.2746 } ---------------------------- total value len = 9.294477 GB avg = 0.165 KB (by entry num) total key len = 1.549214 GB avg = 0.028 KB total ukey len = 1.075302 GB avg = 0.015 KB total ukey num = 0.069421612 Billion total entry num = 0.056229341 Billion write speed all = 0.377694773 MB/sec (with seq num) write speed all = 0.362026657 MB/sec (without seq num) 2024/11/23-16:53:42.462846 139957273912896 [compaction_job.cc:1948] [default] [JOB 31220] Generated table #270725: 1080418 keys, 36861595 bytes, temperature: kWarm 2024/11/23-16:53:42.462934 139957273912896 EVENT_LOG_v1 {"time_micros": 1732352022462886, "cf_name": "default", "job": 31220, "event": "table_file_creation", "file_number": 270725, "file_size": 36861595, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3406695979, "table_properties": {"data_size": 33126720, "index_size": 2081856, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 30251704, "raw_average_key_size": 28, "raw_value_size": 103966029, "raw_average_value_size": 96, "num_data_blocks": 1, "num_entries": 1080418, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732352018, "oldest_key_time": 0, "file_creation_time": 1732352018, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 270725, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:53:42.540070 139957273912896 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270726.sst) /dev/shm/ToplingTemp/Topling-122403-9U2FhM 2024/11/23-16:53:43.523939 139957273912896 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270726.sst): first pass time = 0.98's, 136.426'MB/sec 2024/11/23-16:53:45.288051 139957273912896 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270726.sst): old prealloc_size = 147639500, real_size = 30221792 2024/11/23-16:53:45.288610 139957273912896 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270726.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 930627 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1082 GB zip-val = 0.0282 GB avg-val = 116.22 avg-zval = 30.31 2024/11/23-16:53:45.289453 139957273912896 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270726.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:53:46.261159 139957273912896 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270726.sst): second pass time = 1.76's, 61.339'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.97's, 35.518'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3314.689'MB/sec (index lex order gen) rebuild zvType time = 0.74's, 0.316'MB/sec write SST data time = 0.24's, 145.788'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 20230.657'MB/sec zip my value time = 1.76's, unzip length = 0.108'GB zip my value throughput = 61.339'MB/sec zip pipeline throughput = 123.387'MB/sec entries = 930627 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.22 avg-zval = 30.31 usrkeys = 930627 avg-key = 20.00 avg-zkey = 1.91 avg-val = 123.22 avg-zval = 30.31 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 930627 bytes = 3489872 } seq expand size = 6514389 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0282 GB dict = 1.08 MB all = 0.0346 GB } UnZip/Zip{ index = 10.4469 value = 3.8345 dict = 1.00 all = 3.8835 } Zip/UnZip{ index = 0.0957 value = 0.2608 dict = 1.00 all = 0.2575 } ---------------------------- total value len = 9.409152 GB avg = 0.165 KB (by entry num) total key len = 1.575272 GB avg = 0.028 KB total ukey len = 1.093914 GB avg = 0.016 KB total ukey num = 0.070352239 Billion total entry num = 0.057159968 Billion write speed all = 0.382545307 MB/sec (with seq num) write speed all = 0.366620009 MB/sec (without seq num) 2024/11/23-16:53:46.311861 139957273912896 [compaction_job.cc:1948] [default] [JOB 31220] Generated table #270726: 930627 keys, 34561254 bytes, temperature: kWarm 2024/11/23-16:53:46.311950 139957273912896 EVENT_LOG_v1 {"time_micros": 1732352026311903, "cf_name": "default", "job": 31220, "event": "table_file_creation", "file_number": 270726, "file_size": 34561254, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3406695980, "largest_seqno": 4012775885, "table_properties": {"data_size": 28207312, "index_size": 1781632, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26057556, "raw_average_key_size": 28, "raw_value_size": 108160302, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 930627, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732352022, "oldest_key_time": 0, "file_creation_time": 1732352022, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 270726, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:53:46.383738 139957273912896 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270727.sst) /dev/shm/ToplingTemp/Topling-122403-aDpAxK 2024/11/23-16:53:47.416177 139957273912896 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270727.sst): first pass time = 1.03's, 130.007'MB/sec 2024/11/23-16:53:48.917322 139957273912896 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270727.sst): old prealloc_size = 147639500, real_size = 30724736 2024/11/23-16:53:48.917861 139957273912896 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270727.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 930646 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0287 GB avg-val = 116.22 avg-zval = 30.86 2024/11/23-16:53:48.918714 139957273912896 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270727.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:53:49.903932 139957273912896 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270727.sst): second pass time = 1.50's, 72.091'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.99's, 35.426'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3402.331'MB/sec (index lex order gen) rebuild zvType time = 0.75's, 0.310'MB/sec write SST data time = 0.23's, 149.043'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 27329.971'MB/sec zip my value time = 1.50's, unzip length = 0.108'GB zip my value throughput = 72.091'MB/sec zip pipeline throughput = 82.471'MB/sec entries = 930646 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.22 avg-zval = 30.86 usrkeys = 930646 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.22 avg-zval = 30.86 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 930646 bytes = 3373600 } seq expand size = 6514522 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0287 GB dict = 1.08 MB all = 0.0349 GB } UnZip/Zip{ index = 10.5121 value = 3.7658 dict = 1.00 all = 3.8403 } Zip/UnZip{ index = 0.0951 value = 0.2655 dict = 1.00 all = 0.2604 } ---------------------------- total value len = 9.523826 GB avg = 0.164 KB (by entry num) total key len = 1.601330 GB avg = 0.028 KB total ukey len = 1.112527 GB avg = 0.016 KB total ukey num = 0.071282885 Billion total entry num = 0.058090614 Billion write speed all = 0.387397325 MB/sec (with seq num) write speed all = 0.371214793 MB/sec (without seq num) 2024/11/23-16:53:49.953721 139957273912896 [compaction_job.cc:1948] [default] [JOB 31220] Generated table #270727: 930646 keys, 34949890 bytes, temperature: kWarm 2024/11/23-16:53:49.953813 139957273912896 EVENT_LOG_v1 {"time_micros": 1732352029953764, "cf_name": "default", "job": 31220, "event": "table_file_creation", "file_number": 270727, "file_size": 34949890, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3487497056, "largest_seqno": 4012775902, "table_properties": {"data_size": 28721264, "index_size": 1770624, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26058088, "raw_average_key_size": 28, "raw_value_size": 108159664, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 930646, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732352026, "oldest_key_time": 0, "file_creation_time": 1732352026, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 270727, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:53:50.011208 139957273912896 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270728.sst) /dev/shm/ToplingTemp/Topling-122403-iM9bvL 2024/11/23-16:53:51.053752 139957273912896 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270728.sst): first pass time = 1.04's, 128.747'MB/sec 2024/11/23-16:53:52.535574 139957273912896 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270728.sst): old prealloc_size = 147639500, real_size = 30753264 2024/11/23-16:53:52.536164 139957273912896 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270728.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 932240 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1081 GB zip-val = 0.0287 GB avg-val = 115.97 avg-zval = 30.84 2024/11/23-16:53:52.536944 139957273912896 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270728.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:53:53.548187 139957273912896 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270728.sst): second pass time = 1.48's, 73.025'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.01's, 34.434'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3114.716'MB/sec (index lex order gen) rebuild zvType time = 0.78's, 0.299'MB/sec write SST data time = 0.23's, 150.100'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 33030.916'MB/sec zip my value time = 1.48's, unzip length = 0.108'GB zip my value throughput = 73.025'MB/sec zip pipeline throughput = 76.834'MB/sec entries = 932240 avg-key = 28.00 avg-zkey = 1.90 avg-val = 115.97 avg-zval = 30.84 usrkeys = 932240 avg-key = 20.00 avg-zkey = 1.90 avg-val = 122.97 avg-zval = 30.84 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 932240 bytes = 3262848 } seq expand size = 6525680 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0287 GB dict = 1.08 MB all = 0.0349 GB } UnZip/Zip{ index = 10.5130 value = 3.7610 dict = 1.00 all = 3.8494 } Zip/UnZip{ index = 0.0951 value = 0.2659 dict = 1.00 all = 0.2598 } ---------------------------- total value len = 9.638467 GB avg = 0.163 KB (by entry num) total key len = 1.627432 GB avg = 0.028 KB total ukey len = 1.131172 GB avg = 0.016 KB total ukey num = 0.072215125 Billion total entry num = 0.059022854 Billion write speed all = 0.392248481 MB/sec (with seq num) write speed all = 0.375808338 MB/sec (without seq num) 2024/11/23-16:53:53.596637 139957273912896 [compaction_job.cc:1948] [default] [JOB 31220] Generated table #270728: 932240 keys, 34866974 bytes, temperature: kWarm 2024/11/23-16:53:53.596727 139957273912896 EVENT_LOG_v1 {"time_micros": 1732352033596680, "cf_name": "default", "job": 31220, "event": "table_file_creation", "file_number": 270728, "file_size": 34866974, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3807172320, "largest_seqno": 4012775918, "table_properties": {"data_size": 28746528, "index_size": 1773504, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26102720, "raw_average_key_size": 28, "raw_value_size": 108115060, "raw_average_value_size": 115, "num_data_blocks": 1, "num_entries": 932240, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732352029, "oldest_key_time": 0, "file_creation_time": 1732352029, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 270728, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:53:53.668650 139957273912896 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270729.sst) /dev/shm/ToplingTemp/Topling-122403-M02doK 2024/11/23-16:53:54.618288 139957273912896 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270729.sst): first pass time = 0.95's, 141.342'MB/sec 2024/11/23-16:53:56.116947 139957273912896 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270729.sst): old prealloc_size = 147639500, real_size = 31590624 2024/11/23-16:53:56.117567 139957273912896 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270729.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 925076 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1083 GB zip-val = 0.0296 GB avg-val = 117.09 avg-zval = 31.98 2024/11/23-16:53:56.118396 139957273912896 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270729.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:53:56.934007 139957273912896 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270729.sst): second pass time = 1.50's, 72.309'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.82's, 43.958'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3050.364'MB/sec (index lex order gen) rebuild zvType time = 0.69's, 0.335'MB/sec write SST data time = 0.13's, 285.708'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 39215.397'MB/sec zip my value time = 1.50's, unzip length = 0.108'GB zip my value throughput = 72.309'MB/sec zip pipeline throughput = 72.309'MB/sec entries = 925076 avg-key = 28.00 avg-zkey = 1.91 avg-val = 117.09 avg-zval = 31.98 usrkeys = 925076 avg-key = 20.00 avg-zkey = 1.91 avg-val = 124.09 avg-zval = 31.98 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 925076 bytes = 3469056 } seq expand size = 6475532 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0296 GB dict = 1.08 MB all = 0.0359 GB } UnZip/Zip{ index = 10.4454 value = 3.6608 dict = 1.00 all = 3.7371 } Zip/UnZip{ index = 0.0957 value = 0.2732 dict = 1.00 all = 0.2676 } ---------------------------- total value len = 9.753258 GB avg = 0.163 KB (by entry num) total key len = 1.653335 GB avg = 0.028 KB total ukey len = 1.149673 GB avg = 0.016 KB total ukey num = 0.073140201 Billion total entry num = 0.059947930 Billion write speed all = 0.397100233 MB/sec (with seq num) write speed all = 0.380404388 MB/sec (without seq num) 2024/11/23-16:53:56.979227 139957273912896 [compaction_job.cc:1948] [default] [JOB 31220] Generated table #270729: 925076 keys, 35915150 bytes, temperature: kWarm 2024/11/23-16:53:56.979665 139957273912896 EVENT_LOG_v1 {"time_micros": 1732352036979259, "cf_name": "default", "job": 31220, "event": "table_file_creation", "file_number": 270729, "file_size": 35915150, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3273701103, "largest_seqno": 4012775935, "table_properties": {"data_size": 29587920, "index_size": 1771264, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25902128, "raw_average_key_size": 28, "raw_value_size": 108315624, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 925076, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732352033, "oldest_key_time": 0, "file_creation_time": 1732352033, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 270729, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:53:57.016747 139957273912896 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270730.sst) /dev/shm/ToplingTemp/Topling-122403-kjPg0J 2024/11/23-16:53:57.961257 139957273912896 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270730.sst): first pass time = 0.94's, 142.108'MB/sec 2024/11/23-16:53:59.329330 139957273912896 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270730.sst): old prealloc_size = 147639500, real_size = 36019216 2024/11/23-16:53:59.329885 139957273912896 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270730.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 925167 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1083 GB zip-val = 0.0340 GB avg-val = 117.07 avg-zval = 36.77 2024/11/23-16:53:59.330700 139957273912896 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270730.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:54:00.165778 139957273912896 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270730.sst): second pass time = 1.37's, 79.221'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.84's, 48.095'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3318.119'MB/sec (index lex order gen) rebuild zvType time = 0.71's, 0.326'MB/sec write SST data time = 0.13's, 317.285'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 35507.737'MB/sec zip my value time = 1.37's, unzip length = 0.108'GB zip my value throughput = 79.221'MB/sec zip pipeline throughput = 79.221'MB/sec entries = 925167 avg-key = 28.00 avg-zkey = 1.92 avg-val = 117.07 avg-zval = 36.77 usrkeys = 925167 avg-key = 20.00 avg-zkey = 1.92 avg-val = 124.07 avg-zval = 36.77 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 925167 bytes = 3353744 } seq expand size = 6476169 multi value expand size = 0 cnt WriteAppend = 15 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0340 GB dict = 1.08 MB all = 0.0402 GB } UnZip/Zip{ index = 10.4434 value = 3.1842 dict = 1.00 all = 3.3364 } Zip/UnZip{ index = 0.0958 value = 0.3141 dict = 1.00 all = 0.2997 } ---------------------------- total value len = 9.868047 GB avg = 0.162 KB (by entry num) total key len = 1.679239 GB avg = 0.028 KB total ukey len = 1.168177 GB avg = 0.016 KB total ukey num = 0.074065368 Billion total entry num = 0.060873097 Billion write speed all = 0.401953018 MB/sec (with seq num) write speed all = 0.385001417 MB/sec (without seq num) 2024/11/23-16:54:00.215557 139957273912896 [compaction_job.cc:1948] [default] [JOB 31220] Generated table #270730: 925167 keys, 40228292 bytes, temperature: kWarm 2024/11/23-16:54:00.215627 139957273912896 EVENT_LOG_v1 {"time_micros": 1732352040215591, "cf_name": "default", "job": 31220, "event": "table_file_creation", "file_number": 270730, "file_size": 40228292, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3514720078, "largest_seqno": 4012775967, "table_properties": {"data_size": 34015936, "index_size": 1771776, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25904676, "raw_average_key_size": 28, "raw_value_size": 108313086, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 925167, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732352037, "oldest_key_time": 0, "file_creation_time": 1732352037, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 270730, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:54:00.259762 139957273912896 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270731.sst) /dev/shm/ToplingTemp/Topling-122403-2uZrkI 2024/11/23-16:54:01.282525 139957273912896 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270731.sst): first pass time = 1.02's, 131.236'MB/sec 2024/11/23-16:54:02.594619 139957273912896 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270731.sst): old prealloc_size = 147639500, real_size = 33026528 2024/11/23-16:54:02.595181 139957273912896 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270731.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 928394 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0310 GB avg-val = 116.57 avg-zval = 33.42 2024/11/23-16:54:02.596045 139957273912896 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270731.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:54:03.447533 139957273912896 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270731.sst): second pass time = 1.31's, 82.533'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.85's, 43.805'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3271.645'MB/sec (index lex order gen) rebuild zvType time = 0.73's, 0.320'MB/sec write SST data time = 0.13's, 295.317'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 34027.295'MB/sec zip my value time = 1.31's, unzip length = 0.108'GB zip my value throughput = 82.533'MB/sec zip pipeline throughput = 82.533'MB/sec entries = 928394 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.57 avg-zval = 33.42 usrkeys = 928394 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.57 avg-zval = 33.42 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 928394 bytes = 3481488 } seq expand size = 6498758 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0310 GB dict = 1.08 MB all = 0.0374 GB } UnZip/Zip{ index = 10.5144 value = 3.4879 dict = 1.00 all = 3.5924 } Zip/UnZip{ index = 0.0951 value = 0.2867 dict = 1.00 all = 0.2784 } ---------------------------- total value len = 9.982769 GB avg = 0.162 KB (by entry num) total key len = 1.705234 GB avg = 0.028 KB total ukey len = 1.186745 GB avg = 0.016 KB total ukey num = 0.074993762 Billion total entry num = 0.061801491 Billion write speed all = 0.406804792 MB/sec (with seq num) write speed all = 0.389596622 MB/sec (without seq num) 2024/11/23-16:54:03.492508 139957273912896 [compaction_job.cc:1948] [default] [JOB 31220] Generated table #270731: 928394 keys, 37361362 bytes, temperature: kWarm 2024/11/23-16:54:03.492580 139957273912896 EVENT_LOG_v1 {"time_micros": 1732352043492542, "cf_name": "default", "job": 31220, "event": "table_file_creation", "file_number": 270731, "file_size": 37361362, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3369353416, "largest_seqno": 4012776021, "table_properties": {"data_size": 31028304, "index_size": 1765952, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25995032, "raw_average_key_size": 28, "raw_value_size": 108222752, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 928394, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732352040, "oldest_key_time": 0, "file_creation_time": 1732352040, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 270731, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:54:03.530297 139957273912896 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270732.sst) /dev/shm/ToplingTemp/Topling-122403-PoF6UK 2024/11/23-16:54:04.544647 139957273912896 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270732.sst): first pass time = 1.01's, 132.324'MB/sec 2024/11/23-16:54:05.864026 139957273912896 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270732.sst): old prealloc_size = 147639500, real_size = 32917968 2024/11/23-16:54:05.864557 139957273912896 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270732.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 930517 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.93 raw-val = 0.1082 GB zip-val = 0.0309 GB avg-val = 116.24 avg-zval = 33.20 2024/11/23-16:54:05.865258 139957273912896 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270732.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:54:06.687828 139957273912896 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270732.sst): second pass time = 1.32's, 82.031'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.82's, 44.578'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3512.150'MB/sec (index lex order gen) rebuild zvType time = 0.70's, 0.334'MB/sec write SST data time = 0.13's, 287.988'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 34757.663'MB/sec zip my value time = 1.32's, unzip length = 0.108'GB zip my value throughput = 82.031'MB/sec zip pipeline throughput = 82.031'MB/sec entries = 930517 avg-key = 28.00 avg-zkey = 1.93 avg-val = 116.24 avg-zval = 33.20 usrkeys = 930517 avg-key = 20.00 avg-zkey = 1.93 avg-val = 121.86 avg-zval = 33.20 TagRS{ kinds = RS_Key0_TagN bytes = 145480 } TagArray{ size = 747520 bytes = 2803216 } seq expand size = 5232640 multi value expand size = 0 cnt WriteAppend = 18 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0309 GB dict = 1.08 MB all = 0.0367 GB } UnZip/Zip{ index = 10.3782 value = 3.5013 dict = 1.00 all = 3.6550 } Zip/UnZip{ index = 0.0964 value = 0.2856 dict = 1.00 all = 0.2736 } ---------------------------- total value len = 10.096165 GB avg = 0.161 KB (by entry num) total key len = 1.731289 GB avg = 0.028 KB total ukey len = 1.205355 GB avg = 0.016 KB total ukey num = 0.075924279 Billion total entry num = 0.062732008 Billion write speed all = 0.411611988 MB/sec (with seq num) write speed all = 0.394146692 MB/sec (without seq num) 2024/11/23-16:54:06.734515 139957273912896 [compaction_job.cc:1948] [default] [JOB 31220] Generated table #270732: 930517 keys, 36722026 bytes, temperature: kWarm 2024/11/23-16:54:06.734585 139957273912896 EVENT_LOG_v1 {"time_micros": 1732352046734549, "cf_name": "default", "job": 31220, "event": "table_file_creation", "file_number": 270732, "file_size": 36722026, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4012776210, "table_properties": {"data_size": 30891968, "index_size": 1793216, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26054476, "raw_average_key_size": 28, "raw_value_size": 108163302, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 930517, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732352043, "oldest_key_time": 0, "file_creation_time": 1732352043, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 270732, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:54:06.776508 139957273912896 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270733.sst) /dev/shm/ToplingTemp/Topling-122403-dqH6uK 2024/11/23-16:54:07.685067 139957273912896 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270733.sst): first pass time = 0.91's, 147.732'MB/sec 2024/11/23-16:54:08.974156 139957273912896 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270733.sst): old prealloc_size = 147639500, real_size = 31017456 2024/11/23-16:54:08.974744 139957273912896 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270733.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 932430 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1081 GB zip-val = 0.0290 GB avg-val = 115.94 avg-zval = 31.10 2024/11/23-16:54:08.975551 139957273912896 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270733.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:54:09.810998 139957273912896 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270733.sst): second pass time = 1.29's, 83.917'MB/sec, value only(80.5% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.84's, 42.122'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3172.595'MB/sec (index lex order gen) rebuild zvType time = 0.71's, 0.328'MB/sec write SST data time = 0.13's, 280.043'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 35619.177'MB/sec zip my value time = 1.29's, unzip length = 0.108'GB zip my value throughput = 83.917'MB/sec zip pipeline throughput = 83.917'MB/sec entries = 932430 avg-key = 28.00 avg-zkey = 1.91 avg-val = 115.94 avg-zval = 31.10 usrkeys = 932430 avg-key = 20.00 avg-zkey = 1.91 avg-val = 122.94 avg-zval = 31.10 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 932430 bytes = 3380080 } seq expand size = 6527010 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0186 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0290 GB dict = 1.08 MB all = 0.0352 GB } UnZip/Zip{ index = 10.4439 value = 3.7281 dict = 1.00 all = 3.8078 } Zip/UnZip{ index = 0.0957 value = 0.2682 dict = 1.00 all = 0.2626 } ---------------------------- total value len = 10.210802 GB avg = 0.160 KB (by entry num) total key len = 1.757397 GB avg = 0.028 KB total ukey len = 1.224003 GB avg = 0.016 KB total ukey num = 0.076856709 Billion total entry num = 0.063664438 Billion write speed all = 0.416464838 MB/sec (with seq num) write speed all = 0.398741870 MB/sec (without seq num) 2024/11/23-16:54:09.855149 139957273912896 [compaction_job.cc:1948] [default] [JOB 31220] Generated table #270733: 932430 keys, 35248306 bytes, temperature: kWarm 2024/11/23-16:54:09.855224 139957273912896 EVENT_LOG_v1 {"time_micros": 1732352049855184, "cf_name": "default", "job": 31220, "event": "table_file_creation", "file_number": 270733, "file_size": 35248306, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3480997236, "largest_seqno": 4012776228, "table_properties": {"data_size": 28998560, "index_size": 1785600, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26108040, "raw_average_key_size": 28, "raw_value_size": 108109720, "raw_average_value_size": 115, "num_data_blocks": 1, "num_entries": 932430, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732352046, "oldest_key_time": 0, "file_creation_time": 1732352046, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 270733, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:54:09.896613 139957273912896 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270734.sst) /dev/shm/ToplingTemp/Topling-122403-GG968K 2024/11/23-16:54:10.788164 139957273912896 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270734.sst): first pass time = 0.89's, 150.550'MB/sec 2024/11/23-16:54:12.101662 139957273912896 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270734.sst): old prealloc_size = 147639500, real_size = 32544176 2024/11/23-16:54:12.102237 139957273912896 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270734.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 932059 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1081 GB zip-val = 0.0305 GB avg-val = 116.00 avg-zval = 32.75 2024/11/23-16:54:12.103075 139957273912896 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270734.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:54:12.959563 139957273912896 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270734.sst): second pass time = 1.31's, 82.361'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.86's, 42.866'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3233.536'MB/sec (index lex order gen) rebuild zvType time = 0.73's, 0.320'MB/sec write SST data time = 0.13's, 286.769'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 32344.544'MB/sec zip my value time = 1.31's, unzip length = 0.108'GB zip my value throughput = 82.361'MB/sec zip pipeline throughput = 82.361'MB/sec entries = 932059 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.00 avg-zval = 32.75 usrkeys = 932059 avg-key = 20.00 avg-zkey = 1.91 avg-val = 123.00 avg-zval = 32.75 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 932059 bytes = 3378736 } seq expand size = 6524413 multi value expand size = 0 cnt WriteAppend = 15 UnZipSize{ index = 0.0186 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0305 GB dict = 1.08 MB all = 0.0368 GB } UnZip/Zip{ index = 10.4453 value = 3.5419 dict = 1.00 all = 3.6498 } Zip/UnZip{ index = 0.0957 value = 0.2823 dict = 1.00 all = 0.2740 } ---------------------------- total value len = 10.325446 GB avg = 0.160 KB (by entry num) total key len = 1.783494 GB avg = 0.028 KB total ukey len = 1.242645 GB avg = 0.016 KB total ukey num = 0.077788768 Billion total entry num = 0.064596497 Billion write speed all = 0.421316172 MB/sec (with seq num) write speed all = 0.403335706 MB/sec (without seq num) 2024/11/23-16:54:13.005527 139957273912896 [compaction_job.cc:1948] [default] [JOB 31220] Generated table #270734: 932059 keys, 36773836 bytes, temperature: kWarm 2024/11/23-16:54:13.005598 139957273912896 EVENT_LOG_v1 {"time_micros": 1732352053005561, "cf_name": "default", "job": 31220, "event": "table_file_creation", "file_number": 270734, "file_size": 36773836, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3519443190, "largest_seqno": 4012776268, "table_properties": {"data_size": 30526368, "index_size": 1784640, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26097652, "raw_average_key_size": 28, "raw_value_size": 108120154, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 932059, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732352049, "oldest_key_time": 0, "file_creation_time": 1732352049, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 270734, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:54:13.042220 139957273912896 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270735.sst) /dev/shm/ToplingTemp/Topling-122403-LGMefM 2024/11/23-16:54:14.071942 139957273912896 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270735.sst): first pass time = 1.03's, 130.349'MB/sec 2024/11/23-16:54:15.408854 139957273912896 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270735.sst): old prealloc_size = 147639500, real_size = 33820304 2024/11/23-16:54:15.409393 139957273912896 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270735.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 922525 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1084 GB zip-val = 0.0318 GB avg-val = 117.49 avg-zval = 34.50 2024/11/23-16:54:15.410219 139957273912896 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270735.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:54:16.255053 139957273912896 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270735.sst): second pass time = 1.34's, 81.147'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.85's, 45.072'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3417.338'MB/sec (index lex order gen) rebuild zvType time = 0.72's, 0.321'MB/sec write SST data time = 0.13's, 300.373'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.083'MB, throughput = 32335.492'MB/sec zip my value time = 1.34's, unzip length = 0.108'GB zip my value throughput = 81.147'MB/sec zip pipeline throughput = 81.147'MB/sec entries = 922525 avg-key = 28.00 avg-zkey = 1.92 avg-val = 117.49 avg-zval = 34.50 usrkeys = 922525 avg-key = 20.00 avg-zkey = 1.92 avg-val = 124.49 avg-zval = 34.50 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 922525 bytes = 3459488 } seq expand size = 6457675 multi value expand size = 0 cnt WriteAppend = 15 UnZipSize{ index = 0.0185 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0318 GB dict = 1.08 MB all = 0.0381 GB } UnZip/Zip{ index = 10.4430 value = 3.4060 dict = 1.00 all = 3.5192 } Zip/UnZip{ index = 0.0958 value = 0.2936 dict = 1.00 all = 0.2842 } ---------------------------- total value len = 10.440291 GB avg = 0.159 KB (by entry num) total key len = 1.809325 GB avg = 0.028 KB total ukey len = 1.261095 GB avg = 0.016 KB total ukey num = 0.078711293 Billion total entry num = 0.065519022 Billion write speed all = 0.426161942 MB/sec (with seq num) write speed all = 0.407926782 MB/sec (without seq num) 2024/11/23-16:54:16.303466 139957273912896 [compaction_job.cc:1948] [default] [JOB 31220] Generated table #270735: 922525 keys, 38138328 bytes, temperature: kWarm 2024/11/23-16:54:16.303534 139957273912896 EVENT_LOG_v1 {"time_micros": 1732352056303499, "cf_name": "default", "job": 31220, "event": "table_file_creation", "file_number": 270735, "file_size": 38138328, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3411274482, "largest_seqno": 4012776300, "table_properties": {"data_size": 31822720, "index_size": 1766784, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25830700, "raw_average_key_size": 28, "raw_value_size": 108387078, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 922525, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732352053, "oldest_key_time": 0, "file_creation_time": 1732352053, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 270735, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:54:16.338300 139957273912896 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270736.sst) /dev/shm/ToplingTemp/Topling-122403-Kqu85I 2024/11/23-16:54:17.376824 139957273912896 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270736.sst): first pass time = 1.04's, 129.243'MB/sec 2024/11/23-16:54:18.700037 139957273912896 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270736.sst): old prealloc_size = 147639500, real_size = 33638704 2024/11/23-16:54:18.700586 139957273912896 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270736.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 932649 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1081 GB zip-val = 0.0316 GB avg-val = 115.91 avg-zval = 33.92 2024/11/23-16:54:18.701400 139957273912896 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270736.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:54:19.549416 139957273912896 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270736.sst): second pass time = 1.32's, 81.750'MB/sec, value only(80.5% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.85's, 44.586'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3384.557'MB/sec (index lex order gen) rebuild zvType time = 0.72's, 0.323'MB/sec write SST data time = 0.13's, 298.794'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.077'MB, throughput = 28263.890'MB/sec zip my value time = 1.32's, unzip length = 0.108'GB zip my value throughput = 81.750'MB/sec zip pipeline throughput = 81.750'MB/sec entries = 932649 avg-key = 28.00 avg-zkey = 1.90 avg-val = 115.91 avg-zval = 33.92 usrkeys = 932649 avg-key = 20.00 avg-zkey = 1.90 avg-val = 122.91 avg-zval = 33.92 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 932649 bytes = 3380864 } seq expand size = 6528543 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0187 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0316 GB dict = 1.08 MB all = 0.0379 GB } UnZip/Zip{ index = 10.5142 value = 3.4176 dict = 1.00 all = 3.5442 } Zip/UnZip{ index = 0.0951 value = 0.2926 dict = 1.00 all = 0.2822 } ---------------------------- total value len = 10.554923 GB avg = 0.159 KB (by entry num) total key len = 1.835439 GB avg = 0.028 KB total ukey len = 1.279748 GB avg = 0.016 KB total ukey num = 0.079643942 Billion total entry num = 0.066451671 Billion write speed all = 0.431009081 MB/sec (with seq num) write speed all = 0.412516467 MB/sec (without seq num) 2024/11/23-16:54:19.596668 139957273912896 [compaction_job.cc:1948] [default] [JOB 31220] Generated table #270736: 932649 keys, 37869748 bytes, temperature: kWarm 2024/11/23-16:54:19.596738 139957273912896 EVENT_LOG_v1 {"time_micros": 1732352059596702, "cf_name": "default", "job": 31220, "event": "table_file_creation", "file_number": 270736, "file_size": 37869748, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3525889795, "largest_seqno": 4012776316, "table_properties": {"data_size": 31631264, "index_size": 1774080, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26114172, "raw_average_key_size": 28, "raw_value_size": 108103558, "raw_average_value_size": 115, "num_data_blocks": 1, "num_entries": 932649, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732352056, "oldest_key_time": 0, "file_creation_time": 1732352056, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 270736, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:54:19.635593 139957273912896 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270737.sst) /dev/shm/ToplingTemp/Topling-122403-QpVwqK 2024/11/23-16:54:20.642721 139957273912896 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270737.sst): first pass time = 1.01's, 133.275'MB/sec 2024/11/23-16:54:21.960844 139957273912896 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270737.sst): old prealloc_size = 147639500, real_size = 32650896 2024/11/23-16:54:21.961398 139957273912896 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270737.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 926404 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0307 GB avg-val = 116.88 avg-zval = 33.09 2024/11/23-16:54:21.962238 139957273912896 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270737.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:54:22.805243 139957273912896 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270737.sst): second pass time = 1.32's, 82.221'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.84's, 43.795'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3310.044'MB/sec (index lex order gen) rebuild zvType time = 0.72's, 0.323'MB/sec write SST data time = 0.13's, 291.393'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 34566.401'MB/sec zip my value time = 1.32's, unzip length = 0.108'GB zip my value throughput = 82.221'MB/sec zip pipeline throughput = 82.221'MB/sec entries = 926404 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.88 avg-zval = 33.09 usrkeys = 926404 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.88 avg-zval = 33.09 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 926404 bytes = 3474032 } seq expand size = 6484828 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0307 GB dict = 1.08 MB all = 0.0370 GB } UnZip/Zip{ index = 10.5124 value = 3.5320 dict = 1.00 all = 3.6295 } Zip/UnZip{ index = 0.0951 value = 0.2831 dict = 1.00 all = 0.2755 } ---------------------------- total value len = 10.669686 GB avg = 0.158 KB (by entry num) total key len = 1.861379 GB avg = 0.028 KB total ukey len = 1.298276 GB avg = 0.016 KB total ukey num = 0.080570346 Billion total entry num = 0.067378075 Billion write speed all = 0.435854175 MB/sec (with seq num) write speed all = 0.417105879 MB/sec (without seq num) 2024/11/23-16:54:22.852617 139957273912896 [compaction_job.cc:1948] [default] [JOB 31220] Generated table #270737: 926404 keys, 36979594 bytes, temperature: kWarm 2024/11/23-16:54:22.852686 139957273912896 EVENT_LOG_v1 {"time_micros": 1732352062852651, "cf_name": "default", "job": 31220, "event": "table_file_creation", "file_number": 270737, "file_size": 36979594, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3405268578, "largest_seqno": 4012776344, "table_properties": {"data_size": 30656640, "index_size": 1762496, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25939312, "raw_average_key_size": 28, "raw_value_size": 108278476, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 926404, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732352059, "oldest_key_time": 0, "file_creation_time": 1732352059, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 270737, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:54:22.895324 139957273912896 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270738.sst) /dev/shm/ToplingTemp/Topling-122403-jHMEIL 2024/11/23-16:54:23.728175 139957273912896 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270738.sst): first pass time = 0.83's, 161.161'MB/sec 2024/11/23-16:54:25.046987 139957273912896 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270738.sst): old prealloc_size = 147639500, real_size = 33038768 2024/11/23-16:54:25.047579 139957273912896 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270738.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 924824 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.93 raw-val = 0.1083 GB zip-val = 0.0310 GB avg-val = 117.13 avg-zval = 33.55 2024/11/23-16:54:25.048408 139957273912896 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270738.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:54:25.896195 139957273912896 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270738.sst): second pass time = 1.32's, 82.185'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.85's, 43.998'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3166.365'MB/sec (index lex order gen) rebuild zvType time = 0.72's, 0.320'MB/sec write SST data time = 0.13's, 294.372'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 33870.331'MB/sec zip my value time = 1.32's, unzip length = 0.108'GB zip my value throughput = 82.185'MB/sec zip pipeline throughput = 82.185'MB/sec entries = 924824 avg-key = 28.00 avg-zkey = 1.93 avg-val = 117.13 avg-zval = 33.55 usrkeys = 924824 avg-key = 20.00 avg-zkey = 1.93 avg-val = 124.13 avg-zval = 33.55 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 924824 bytes = 3468112 } seq expand size = 6473768 multi value expand size = 0 cnt WriteAppend = 17 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0310 GB dict = 1.08 MB all = 0.0374 GB } UnZip/Zip{ index = 10.3751 value = 3.4915 dict = 1.00 all = 3.5923 } Zip/UnZip{ index = 0.0964 value = 0.2864 dict = 1.00 all = 0.2784 } ---------------------------- total value len = 10.784483 GB avg = 0.158 KB (by entry num) total key len = 1.887274 GB avg = 0.028 KB total ukey len = 1.316773 GB avg = 0.016 KB total ukey num = 0.081495170 Billion total entry num = 0.068302899 Billion write speed all = 0.440700313 MB/sec (with seq num) write speed all = 0.421696723 MB/sec (without seq num) 2024/11/23-16:54:25.943008 139957273912896 [compaction_job.cc:1948] [default] [JOB 31220] Generated table #270738: 924824 keys, 37362550 bytes, temperature: kWarm 2024/11/23-16:54:25.943079 139957273912896 EVENT_LOG_v1 {"time_micros": 1732352065943043, "cf_name": "default", "job": 31220, "event": "table_file_creation", "file_number": 270738, "file_size": 37362550, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3471845708, "largest_seqno": 4012771944, "table_properties": {"data_size": 31024608, "index_size": 1782784, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25895072, "raw_average_key_size": 28, "raw_value_size": 108322672, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 924824, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732352062, "oldest_key_time": 0, "file_creation_time": 1732352062, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 270738, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:54:25.982150 139957273912896 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270739.sst) /dev/shm/ToplingTemp/Topling-122403-F0xWOK 2024/11/23-16:54:26.828179 139957273912896 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270739.sst): first pass time = 0.85's, 158.651'MB/sec 2024/11/23-16:54:28.290523 139957273912896 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270739.sst): old prealloc_size = 147639500, real_size = 35895152 2024/11/23-16:54:28.291089 139957273912896 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270739.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 930405 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0339 GB avg-val = 116.26 avg-zval = 36.43 2024/11/23-16:54:28.291405 139957273912896 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270739.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:54:29.030251 139957273912896 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270739.sst): second pass time = 1.46's, 74.027'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.74's, 51.059'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3243.038'MB/sec (index lex order gen) rebuild zvType time = 0.61's, 0.379'MB/sec write SST data time = 0.13's, 299.545'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 34917.268'MB/sec zip my value time = 1.46's, unzip length = 0.108'GB zip my value throughput = 74.027'MB/sec zip pipeline throughput = 74.027'MB/sec entries = 930405 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.26 avg-zval = 36.43 usrkeys = 930405 avg-key = 20.00 avg-zkey = 1.90 avg-val = 118.28 avg-zval = 36.43 TagRS{ kinds = RS_Key0_TagN bytes = 145480 } TagArray{ size = 268282 bytes = 871936 } seq expand size = 1877974 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0339 GB dict = 1.08 MB all = 0.0378 GB } UnZip/Zip{ index = 10.5124 value = 3.1915 dict = 1.00 all = 3.5537 } Zip/UnZip{ index = 0.0951 value = 0.3133 dict = 1.00 all = 0.2814 } ---------------------------- total value len = 10.894527 GB avg = 0.157 KB (by entry num) total key len = 1.913325 GB avg = 0.028 KB total ukey len = 1.335381 GB avg = 0.016 KB total ukey num = 0.082425575 Billion total entry num = 0.069233304 Billion write speed all = 0.445384930 MB/sec (with seq num) write speed all = 0.426124577 MB/sec (without seq num) 2024/11/23-16:54:29.078841 139957273912896 [compaction_job.cc:1948] [default] [JOB 31220] Generated table #270739: 930405 keys, 37768861 bytes, temperature: kWarm 2024/11/23-16:54:29.078909 139957273912896 EVENT_LOG_v1 {"time_micros": 1732352069078874, "cf_name": "default", "job": 31220, "event": "table_file_creation", "file_number": 270739, "file_size": 37768861, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4012776360, "table_properties": {"data_size": 33892256, "index_size": 1770112, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26051340, "raw_average_key_size": 28, "raw_value_size": 108166522, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 930405, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732352065, "oldest_key_time": 0, "file_creation_time": 1732352065, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 270739, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:54:29.124478 139957273912896 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270740.sst) /dev/shm/ToplingTemp/Topling-122403-ldSynI 2024/11/23-16:54:30.086840 139957273912896 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270740.sst): first pass time = 0.96's, 139.473'MB/sec 2024/11/23-16:54:31.564662 139957273912896 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270740.sst): old prealloc_size = 147639500, real_size = 37333888 2024/11/23-16:54:31.565210 139957273912896 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270740.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 925707 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.93 raw-val = 0.1083 GB zip-val = 0.0353 GB avg-val = 116.99 avg-zval = 38.15 2024/11/23-16:54:31.565569 139957273912896 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270740.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:54:32.300124 139957273912896 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270740.sst): second pass time = 1.48's, 73.322'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.74's, 53.588'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3399.780'MB/sec (index lex order gen) rebuild zvType time = 0.61's, 0.379'MB/sec write SST data time = 0.12's, 315.522'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 34725.525'MB/sec zip my value time = 1.48's, unzip length = 0.108'GB zip my value throughput = 73.322'MB/sec zip pipeline throughput = 73.322'MB/sec entries = 925707 avg-key = 28.00 avg-zkey = 1.93 avg-val = 116.99 avg-zval = 38.15 usrkeys = 925707 avg-key = 20.00 avg-zkey = 1.93 avg-val = 119.15 avg-zval = 38.15 TagRS{ kinds = RS_Key0_TagN bytes = 144760 } TagArray{ size = 286237 bytes = 1073408 } seq expand size = 2003659 multi value expand size = 0 cnt WriteAppend = 17 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0353 GB dict = 1.08 MB all = 0.0394 GB } UnZip/Zip{ index = 10.3783 value = 3.0663 dict = 1.00 all = 3.4056 } Zip/UnZip{ index = 0.0964 value = 0.3261 dict = 1.00 all = 0.2936 } ---------------------------- total value len = 11.004829 GB avg = 0.157 KB (by entry num) total key len = 1.939245 GB avg = 0.028 KB total ukey len = 1.353895 GB avg = 0.016 KB total ukey num = 0.083351282 Billion total entry num = 0.070159011 Billion write speed all = 0.450070766 MB/sec (with seq num) write speed all = 0.430555105 MB/sec (without seq num) 2024/11/23-16:54:32.349586 139957273912896 [compaction_job.cc:1948] [default] [JOB 31220] Generated table #270740: 925707 keys, 39410513 bytes, temperature: kWarm 2024/11/23-16:54:32.349653 139957273912896 EVENT_LOG_v1 {"time_micros": 1732352072349619, "cf_name": "default", "job": 31220, "event": "table_file_creation", "file_number": 270740, "file_size": 39410513, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4038310608, "table_properties": {"data_size": 35318320, "index_size": 1783936, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25919796, "raw_average_key_size": 28, "raw_value_size": 108297942, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 925707, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732352069, "oldest_key_time": 0, "file_creation_time": 1732352069, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 270740, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:54:32.388632 139957273912896 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270741.sst) /dev/shm/ToplingTemp/Topling-122403-tUc2PK 2024/11/23-16:54:33.455757 139957273912896 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270741.sst): first pass time = 1.07's, 125.780'MB/sec 2024/11/23-16:54:34.798788 139957273912896 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270741.sst): old prealloc_size = 147639500, real_size = 35658592 2024/11/23-16:54:34.799380 139957273912896 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270741.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 928232 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1082 GB zip-val = 0.0336 GB avg-val = 116.60 avg-zval = 36.25 2024/11/23-16:54:34.800145 139957273912896 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270741.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:54:35.628526 139957273912896 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270741.sst): second pass time = 1.34's, 80.629'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.83's, 47.781'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3100.836'MB/sec (index lex order gen) rebuild zvType time = 0.70's, 0.331'MB/sec write SST data time = 0.13's, 310.292'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 33389.131'MB/sec zip my value time = 1.34's, unzip length = 0.108'GB zip my value throughput = 80.629'MB/sec zip pipeline throughput = 80.629'MB/sec entries = 928232 avg-key = 28.00 avg-zkey = 1.92 avg-val = 116.60 avg-zval = 36.25 usrkeys = 928232 avg-key = 20.00 avg-zkey = 1.92 avg-val = 123.60 avg-zval = 36.25 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 928232 bytes = 3132800 } seq expand size = 6497624 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0336 GB dict = 1.08 MB all = 0.0396 GB } UnZip/Zip{ index = 10.4429 value = 3.2164 dict = 1.00 all = 3.3855 } Zip/UnZip{ index = 0.0958 value = 0.3109 dict = 1.00 all = 0.2954 } ---------------------------- total value len = 11.119554 GB avg = 0.156 KB (by entry num) total key len = 1.965235 GB avg = 0.028 KB total ukey len = 1.372460 GB avg = 0.016 KB total ukey num = 0.084279514 Billion total entry num = 0.071087243 Billion write speed all = 0.454910853 MB/sec (with seq num) write speed all = 0.435139280 MB/sec (without seq num) 2024/11/23-16:54:35.676411 139957273912896 [compaction_job.cc:1948] [default] [JOB 31220] Generated table #270741: 928232 keys, 39644640 bytes, temperature: kWarm 2024/11/23-16:54:35.676485 139957273912896 EVENT_LOG_v1 {"time_micros": 1732352075676443, "cf_name": "default", "job": 31220, "event": "table_file_creation", "file_number": 270741, "file_size": 39644640, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4038310609, "largest_seqno": 4125725669, "table_properties": {"data_size": 33648592, "index_size": 1777728, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25990496, "raw_average_key_size": 28, "raw_value_size": 108227328, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 928232, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732352072, "oldest_key_time": 0, "file_creation_time": 1732352072, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 270741, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:54:35.715377 139957273912896 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270742.sst) /dev/shm/ToplingTemp/Topling-122403-4jYtyI 2024/11/23-16:54:36.665648 139957273912896 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270742.sst): first pass time = 0.95's, 141.246'MB/sec 2024/11/23-16:54:38.000609 139957273912896 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270742.sst): old prealloc_size = 147639500, real_size = 36390640 2024/11/23-16:54:38.001185 139957273912896 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270742.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927413 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0344 GB avg-val = 116.72 avg-zval = 37.09 2024/11/23-16:54:38.001935 139957273912896 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270742.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:54:38.822182 139957273912896 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270742.sst): second pass time = 1.33's, 81.139'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.82's, 49.144'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3187.879'MB/sec (index lex order gen) rebuild zvType time = 0.69's, 0.334'MB/sec write SST data time = 0.13's, 316.997'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 33531.760'MB/sec zip my value time = 1.33's, unzip length = 0.108'GB zip my value throughput = 81.139'MB/sec zip pipeline throughput = 81.139'MB/sec entries = 927413 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.72 avg-zval = 37.09 usrkeys = 927413 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.72 avg-zval = 37.09 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 927413 bytes = 3130032 } seq expand size = 6491891 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0344 GB dict = 1.08 MB all = 0.0404 GB } UnZip/Zip{ index = 10.5143 value = 3.1473 dict = 1.00 all = 3.3243 } Zip/UnZip{ index = 0.0951 value = 0.3177 dict = 1.00 all = 0.3008 } ---------------------------- total value len = 11.234296 GB avg = 0.156 KB (by entry num) total key len = 1.991203 GB avg = 0.028 KB total ukey len = 1.391008 GB avg = 0.016 KB total ukey num = 0.085206927 Billion total entry num = 0.072014656 Billion write speed all = 0.459751775 MB/sec (with seq num) write speed all = 0.439724483 MB/sec (without seq num) 2024/11/23-16:54:38.873134 139957273912896 [compaction_job.cc:1948] [default] [JOB 31220] Generated table #270742: 927413 keys, 40374730 bytes, temperature: kWarm 2024/11/23-16:54:38.873207 139957273912896 EVENT_LOG_v1 {"time_micros": 1732352078873170, "cf_name": "default", "job": 31220, "event": "table_file_creation", "file_number": 270742, "file_size": 40374730, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4050411210, "largest_seqno": 4125725571, "table_properties": {"data_size": 34394528, "index_size": 1764096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25967564, "raw_average_key_size": 28, "raw_value_size": 108250266, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927413, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732352075, "oldest_key_time": 0, "file_creation_time": 1732352075, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 270742, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:54:38.912645 139957273912896 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270743.sst) /dev/shm/ToplingTemp/Topling-122403-dAhgdM 2024/11/23-16:54:39.048678 139957273912896 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270743.sst): first pass time = 0.14's, 234.894'MB/sec 2024/11/23-16:54:39.350775 139957273912896 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270743.sst): old prealloc_size = 147639500, real_size = 9090960 2024/11/23-16:54:39.350964 139957273912896 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270743.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 221050 prefix = 4 raw-key = 0.0035 GB zip-key = 0.0004 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.0258 GB zip-val = 0.0086 GB avg-val = 116.51 avg-zval = 38.96 2024/11/23-16:54:39.351216 139957273912896 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270743.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0005 GB, waited 0.000 sec, Key+Value = 0.032 GB 2024/11/23-16:54:39.547694 139957273912896 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00/270743.sst): second pass time = 0.30's, 85.452'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.20's, 50.766'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2097.205'MB/sec (index lex order gen) rebuild zvType time = 0.16's, 0.335'MB/sec write SST data time = 0.03's, 314.739'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.266'MB, throughput = 9237.629'MB/sec zip my value time = 0.30's, unzip length = 0.026'GB zip my value throughput = 85.452'MB/sec zip pipeline throughput = 85.452'MB/sec entries = 221050 avg-key = 28.00 avg-zkey = 1.92 avg-val = 116.51 avg-zval = 38.96 usrkeys = 221050 avg-key = 20.00 avg-zkey = 1.92 avg-val = 123.51 avg-zval = 38.96 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 221050 bytes = 690800 } seq expand size = 1547350 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0044 GB value = 0.0258 GB dict = 0.27 MB all = 0.0319 GB } __ZipSize{ index = 0.0004 GB value = 0.0086 GB dict = 0.27 MB all = 0.0100 GB } UnZip/Zip{ index = 10.4143 value = 2.9910 dict = 1.00 all = 3.1958 } Zip/UnZip{ index = 0.0960 value = 0.3343 dict = 1.00 all = 0.3129 } ---------------------------- total value len = 11.261599 GB avg = 0.156 KB (by entry num) total key len = 1.997392 GB avg = 0.028 KB total ukey len = 1.395429 GB avg = 0.016 KB total ukey num = 0.085427977 Billion total entry num = 0.072235706 Billion write speed all = 0.460904415 MB/sec (with seq num) write speed all = 0.440816156 MB/sec (without seq num) 2024/11/23-16:54:39.566447 139957273912896 [compaction_job.cc:1948] [default] [JOB 31220] Generated table #270743: 221050 keys, 9995695 bytes, temperature: kWarm 2024/11/23-16:54:39.566517 139957273912896 EVENT_LOG_v1 {"time_micros": 1732352079566484, "cf_name": "default", "job": 31220, "event": "table_file_creation", "file_number": 270743, "file_size": 9995695, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4106588115, "largest_seqno": 4125725019, "table_properties": {"data_size": 8611008, "index_size": 424512, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 6189400, "raw_average_key_size": 28, "raw_value_size": 25755200, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 221050, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732352078, "oldest_key_time": 0, "file_creation_time": 1732352078, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 270743, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:54:39.578021 139957273912896 [compaction_job.cc:703] job-31220: subcompact[0], size: 0.800571 G, files: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-31220/att-00 [270722,270723,270724,270725,270726,270727,270728,270729,270730,270731,270732,270733,270734,270735,270736,270737,270738,270739,270740,270741,270742,270743] 2024/11/23-16:54:39.710655 139957273912896 (Original Log Time 2024/11/23-16:53:27.362233) EVENT_LOG_v1 {"time_micros": 1732352007362191, "job": 31220, "event": "compaction_started", "compaction_reason": "FilesMarkedForCompaction", "files_L2": [270695], "files_L3": [270711, 270712, 270638, 270639, 270640, 270641, 270642, 270643, 270644, 270645, 270646, 270647, 270648, 270649, 270650, 270651, 270652, 270653, 270654, 270655, 270656, 270716], "score": 0.999499, "input_data_size": 822458115, "oldest_snapshot_seqno": 4125942815} 2024/11/23-16:54:39.710664 139957273912896 (Original Log Time 2024/11/23-16:54:39.709005) [compaction_job.cc:2022] [default] [JOB 31220] Compacted 1@2 + 22@3 files to L3 => 800570551 bytes 2024/11/23-16:54:39.710665 139957273912896 (Original Log Time 2024/11/23-16:54:39.710583) [compaction_job.cc:1224] [default] compacted to: files[0 0 0 22 0 0 0] max score 0.03, MB/sec: 11.4 rd, 11.1 wr, level 3, files in(1, 22) out(22 +0 blob) MB in(27.1, 757.3 +0.0 blob) out(763.5 +0.0 blob), read-write-amplify(57.1) write-amplify(28.2) OK, records in: 19945098, records dropped: 67556 output_compression: Snappy 2024/11/23-16:54:39.710669 139957273912896 (Original Log Time 2024/11/23-16:54:39.710629) EVENT_LOG_v1 {"time_micros": 1732352079710607, "cf": "default", "job": 31220, "event": "compaction_finished", "compaction_time_micros": 72215794, "compaction_time_cpu_micros": 30424970, "output_level": 3, "num_output_files": 22, "total_output_size": 800570551, "num_input_records": 19945098, "num_output_records": 19877542, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "file_write_nanos": 579850228, "file_range_sync_nanos": 0, "file_fsync_nanos": 16327, "file_prepare_write_nanos": 62084, "lsm_state": [0, 0, 0, 22, 0, 0, 0]} 2024/11/23-16:54:39.860141 139957273912896 DEBG dcompact_worker.cpp:240: HttpPost: 200 OK: url = http://nlb-7zny4kaa1poal01o64.cn-shenzhen.nlb.aliyuncs.com:8443, body = {"instanceId":"nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137","labourId":"","dbId":"d89b4006-2803-486e-b7a2-759bcf348921","dbStarts":1732256054,"starts":1732352007,"executesMs":72509,"compactionJobId":31220,"attempt":0,"compactionInputRawBytes":2860111057,"compactionInputZipBytes":822458115,"compactionOutputRawBytes":0,"compactionOutputZipBytes":800570551,"headers":{"Accept":"*/*","Connection":"close","Host":"aliyun-topling-saas.topling.cn:18443","RemoteIp":"120.24.192.169","X-Forwarded-For":"120.24.192.169","region":"cn-shenzhen","token":"e6474c481bd4415abc537135cc03626b","instance-token":"e6474c481bd4415abc537135cc03626b","provider":"aliyun","CloudMarketInstanceId":"si-59c0ae5c955845588903","MeteringAssit":"","Transfer-Encoding":"chunked","traceparent":"00-43c714753b9aab4a2e49a2df294350ca-1691beb90b785fd9-00"}}, response = 2024/11/23-16:54:39.860235 139957273912896 INFO dcompact_worker.cpp:1459: finish /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-31220/att-00: olev 3, work 72.509 s, result 7.790 ms, install 1.680 ms, input{raw 2.664 GiB zip 784.357 MiB}