2024/11/23-16:21:18.789489 139957626406464 DEBG dcompact_worker.cpp:2214: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00: fork to child time = 0.007727 sec 2024/11/23-16:21:18.790225 139957626406464 DEBG dcompact_worker.cpp:1013: Beg SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00 2024/11/23-16:21:18.797318 139957626406464 DEBG dcompact_worker.cpp:1033: End SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00 2024/11/23-16:21:18.798177 139957626406464 TRAC dcompact_worker.cpp:1083: INFO_LOG_LEVEL: rpc = INFO_LEVEL, env_var = undefined 2024/11/23-16:21:18.798421 139957626406464 [WARN] [column_family.cc:386] multiple cf_paths/db_paths and level_compaction_dynamic_level_bytes can't be used together 2024/11/23-16:21:18.852039 139957626406464 [version_set.cc:6208] Recovering from manifest file: /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-30533/att-00/MANIFEST-206347 2024/11/23-16:21:18.894418 139957626406464 [version_set.cc:6251] Recovered from manifest file:/worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-30533/att-00/MANIFEST-206347 succeeded,manifest_file_number is 206347, next_file_number is 269190, last_sequence is 4104956757, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 269018 2024/11/23-16:21:18.894437 139957626406464 [version_set.cc:6266] Column family [default] (ID 0), log number is 0 2024/11/23-16:21:18.894646 139957626406464 [version_set.cc:5721] Creating manifest 269190 2024/11/23-16:21:18.927817 139957626406464 DEBG dcompact_worker.cpp:1218: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00: bottommost_level: fake = 1, rpc = 0 2024/11/23-16:21:18.952286 139957626406464 [compaction_job.cc:2437] [default] [JOB 30533] Compacting 1@2 + 21@3 files to L3, score 0.99, subcompactions 1 : 1 2024/11/23-16:21:18.952312 139957626406464 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 22824 Base level 2, inputs: [269151(25MB)], [269095(38MB) 269096(38MB) 269097(38MB) 269098(33MB) 269099(34MB) 269100(34MB) 269101(35MB) 269102(35MB) 269103(35MB) 269104(37MB) 269105(35MB) 269106(37MB) 269107(34MB) 269108(35MB) 269109(37MB) 269110(35MB) 269111(37MB) 269112(35MB) 269113(35MB) 269114(36MB) 269185(38MB)] 2024/11/23-16:21:18.960671 139957626406464 [top_zip_table.cc:59] core git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-16:21:18.960713 139957626406464 [top_zip_table.cc:60] fsa git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-16:21:18.960741 139957626406464 [top_zip_table.cc:61] zbs git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-16:21:18.960750 139957626406464 [top_zip_table.cc:62] topling-zip_table_reader: git_version_hash_info_is: commit a4a382006cb82713acf5b3425835f22711877681 Author: leipeng Date: 2024-04-11 19:44:14 +0800 fixed_len_hole_index.cc: Add env bool FixedLenHoleIndexUseAVX512 for ut & debug 1. FixedLenHoleIndexUseAVX512 is only in unit tests or debug 2. In release mode, use avx512 by compile options(-march=) g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/23-16:21:18.960765 139957626406464 [top_zip_table.cc:64] topling-rocks git_version_hash_info_is: commit feab587e468621ba0204d47b4ffacc52e7c4290d Author: leipeng Date: 2024-03-22 13:35:06 +0800 ToplingZipTableBuilder::Add: immediately return after error This function returns void, and caller does not check builder->status() after calling this function and graceful abandon. So immediately return after error, and return error status in Finish(). g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/23-16:21:19.597151 139957626406464 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269191.sst) /dev/shm/ToplingTemp/Topling-112152-40S4Lz 2024/11/23-16:21:20.149478 139957626406464 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269191.sst): first pass time = 0.55's, 243.024'MB/sec 2024/11/23-16:21:21.742056 139957626406464 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269191.sst): old prealloc_size = 147639500, real_size = 36714944 2024/11/23-16:21:21.742657 139957626406464 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269191.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 929512 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0347 GB avg-val = 116.40 avg-zval = 37.35 2024/11/23-16:21:21.743396 139957626406464 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269191.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:21:22.775051 139957626406464 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269191.sst): second pass time = 1.59's, 67.970'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.03's, 39.294'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3048.712'MB/sec (index lex order gen) rebuild zvType time = 0.80's, 0.291'MB/sec write SST data time = 0.23's, 174.310'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 36473.668'MB/sec zip my value time = 1.59's, unzip length = 0.108'GB zip my value throughput = 67.970'MB/sec zip pipeline throughput = 90.235'MB/sec entries = 929512 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.40 avg-zval = 37.35 usrkeys = 929512 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.40 avg-zval = 37.35 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 929512 bytes = 3020928 } seq expand size = 6506584 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0347 GB dict = 1.08 MB all = 0.0406 GB } UnZip/Zip{ index = 10.5141 value = 3.1166 dict = 1.00 all = 3.3067 } Zip/UnZip{ index = 0.0951 value = 0.3209 dict = 1.00 all = 0.3024 } ---------------------------- total value len = 8.963318 GB avg = 0.168 KB (by entry num) total key len = 1.466847 GB avg = 0.028 KB total ukey len = 1.016468 GB avg = 0.015 KB total ukey num = 0.066479947 Billion total entry num = 0.053287676 Billion write speed all = 0.389613257 MB/sec (with seq num) write speed all = 0.373688995 MB/sec (without seq num) 2024/11/23-16:21:22.825164 139957626406464 [compaction_job.cc:1948] [default] [JOB 30533] Generated table #269191: 929512 keys, 40589058 bytes, temperature: kWarm 2024/11/23-16:21:22.825250 139957626406464 EVENT_LOG_v1 {"time_micros": 1732350082825196, "cf_name": "default", "job": 30533, "event": "table_file_creation", "file_number": 269191, "file_size": 40589058, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4051668904, "largest_seqno": 4104633009, "table_properties": {"data_size": 34714224, "index_size": 1768128, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26026336, "raw_average_key_size": 28, "raw_value_size": 108191424, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 929512, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732350079, "oldest_key_time": 0, "file_creation_time": 1732350079, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 269191, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:21:22.865290 139957626406464 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269192.sst) /dev/shm/ToplingTemp/Topling-112152-xZW0aA 2024/11/23-16:21:23.849220 139957626406464 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269192.sst): first pass time = 0.98's, 136.415'MB/sec 2024/11/23-16:21:25.414174 139957626406464 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269192.sst): old prealloc_size = 147639500, real_size = 36235328 2024/11/23-16:21:25.414732 139957626406464 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269192.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927446 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.89 raw-val = 0.1082 GB zip-val = 0.0343 GB avg-val = 116.72 avg-zval = 36.93 2024/11/23-16:21:25.415512 139957626406464 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269192.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:21:26.407015 139957626406464 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269192.sst): second pass time = 1.56's, 69.223'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.99's, 40.632'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3257.433'MB/sec (index lex order gen) rebuild zvType time = 0.86's, 0.269'MB/sec write SST data time = 0.13's, 310.466'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 39650.501'MB/sec zip my value time = 1.56's, unzip length = 0.108'GB zip my value throughput = 69.223'MB/sec zip pipeline throughput = 69.223'MB/sec entries = 927446 avg-key = 28.00 avg-zkey = 1.89 avg-val = 116.72 avg-zval = 36.93 usrkeys = 927446 avg-key = 20.00 avg-zkey = 1.89 avg-val = 123.72 avg-zval = 36.93 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 927446 bytes = 3246080 } seq expand size = 6492122 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0343 GB dict = 1.08 MB all = 0.0403 GB } UnZip/Zip{ index = 10.5830 value = 3.1605 dict = 1.00 all = 3.3272 } Zip/UnZip{ index = 0.0945 value = 0.3164 dict = 1.00 all = 0.3006 } ---------------------------- total value len = 9.078059 GB avg = 0.167 KB (by entry num) total key len = 1.492816 GB avg = 0.028 KB total ukey len = 1.035017 GB avg = 0.015 KB total ukey num = 0.067407393 Billion total entry num = 0.054215122 Billion write speed all = 0.394815835 MB/sec (with seq num) write speed all = 0.378616617 MB/sec (without seq num) 2024/11/23-16:21:26.486281 139957626406464 [compaction_job.cc:1948] [default] [JOB 30533] Generated table #269192: 927446 keys, 40339192 bytes, temperature: kWarm 2024/11/23-16:21:26.486351 139957626406464 EVENT_LOG_v1 {"time_micros": 1732350086486316, "cf_name": "default", "job": 30533, "event": "table_file_creation", "file_number": 269192, "file_size": 40339192, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3967285072, "largest_seqno": 4104632935, "table_properties": {"data_size": 34250608, "index_size": 1752704, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25968488, "raw_average_key_size": 28, "raw_value_size": 108249268, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927446, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732350082, "oldest_key_time": 0, "file_creation_time": 1732350082, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 269192, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:21:26.524274 139957626406464 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269193.sst) /dev/shm/ToplingTemp/Topling-112152-eehKqD 2024/11/23-16:21:27.487123 139957626406464 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269193.sst): first pass time = 0.96's, 139.401'MB/sec 2024/11/23-16:21:29.099669 139957626406464 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269193.sst): old prealloc_size = 147639500, real_size = 35730944 2024/11/23-16:21:29.100388 139957626406464 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269193.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 933230 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.93 raw-val = 0.1081 GB zip-val = 0.0337 GB avg-val = 115.82 avg-zval = 36.11 2024/11/23-16:21:29.101503 139957626406464 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269193.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:21:30.062425 139957626406464 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269193.sst): second pass time = 1.61's, 67.064'MB/sec, value only(80.5% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.96's, 41.511'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2600.384'MB/sec (index lex order gen) rebuild zvType time = 0.81's, 0.289'MB/sec write SST data time = 0.16's, 257.401'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 33752.943'MB/sec zip my value time = 1.61's, unzip length = 0.108'GB zip my value throughput = 67.064'MB/sec zip pipeline throughput = 67.064'MB/sec entries = 933230 avg-key = 28.00 avg-zkey = 1.93 avg-val = 115.82 avg-zval = 36.11 usrkeys = 933230 avg-key = 20.00 avg-zkey = 1.93 avg-val = 122.82 avg-zval = 36.11 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 933230 bytes = 3382976 } seq expand size = 6532610 multi value expand size = 0 cnt WriteAppend = 15 UnZipSize{ index = 0.0187 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0337 GB dict = 1.08 MB all = 0.0400 GB } UnZip/Zip{ index = 10.3773 value = 3.2074 dict = 1.00 all = 3.3584 } Zip/UnZip{ index = 0.0964 value = 0.3118 dict = 1.00 all = 0.2978 } ---------------------------- total value len = 9.192679 GB avg = 0.167 KB (by entry num) total key len = 1.518946 GB avg = 0.028 KB total ukey len = 1.053682 GB avg = 0.015 KB total ukey num = 0.068340623 Billion total entry num = 0.055148352 Billion write speed all = 0.400018166 MB/sec (with seq num) write speed all = 0.383542353 MB/sec (without seq num) 2024/11/23-16:21:30.112555 139957626406464 [compaction_job.cc:1948] [default] [JOB 30533] Generated table #269193: 933230 keys, 39964748 bytes, temperature: kWarm 2024/11/23-16:21:30.112632 139957626406464 EVENT_LOG_v1 {"time_micros": 1732350090112588, "cf_name": "default", "job": 30533, "event": "table_file_creation", "file_number": 269193, "file_size": 39964748, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3583362754, "largest_seqno": 4012776165, "table_properties": {"data_size": 33698864, "index_size": 1798592, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26130440, "raw_average_key_size": 28, "raw_value_size": 108087416, "raw_average_value_size": 115, "num_data_blocks": 1, "num_entries": 933230, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732350086, "oldest_key_time": 0, "file_creation_time": 1732350086, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 269193, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:21:30.149367 139957626406464 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269194.sst) /dev/shm/ToplingTemp/Topling-112152-z7A42B 2024/11/23-16:21:31.345907 139957626406464 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269194.sst): first pass time = 1.20's, 112.175'MB/sec 2024/11/23-16:21:32.717709 139957626406464 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269194.sst): old prealloc_size = 147639500, real_size = 30757392 2024/11/23-16:21:32.718441 139957626406464 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269194.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 931989 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1081 GB zip-val = 0.0288 GB avg-val = 116.01 avg-zval = 30.85 2024/11/23-16:21:32.719292 139957626406464 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269194.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:21:33.686442 139957626406464 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269194.sst): second pass time = 1.37's, 78.880'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.97's, 35.928'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2494.712'MB/sec (index lex order gen) rebuild zvType time = 0.81's, 0.289'MB/sec write SST data time = 0.16's, 216.857'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 33699.415'MB/sec zip my value time = 1.37's, unzip length = 0.108'GB zip my value throughput = 78.880'MB/sec zip pipeline throughput = 78.880'MB/sec entries = 931989 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.01 avg-zval = 30.85 usrkeys = 931989 avg-key = 20.00 avg-zkey = 1.90 avg-val = 122.55 avg-zval = 30.85 TagRS{ kinds = RS_Key0_TagN bytes = 145720 } TagArray{ size = 870494 bytes = 3046736 } seq expand size = 6093458 multi value expand size = 0 cnt WriteAppend = 16 UnZipSize{ index = 0.0186 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0288 GB dict = 1.08 MB all = 0.0348 GB } UnZip/Zip{ index = 10.5132 value = 3.7606 dict = 1.00 all = 3.8563 } Zip/UnZip{ index = 0.0951 value = 0.2659 dict = 1.00 all = 0.2593 } ---------------------------- total value len = 9.306895 GB avg = 0.166 KB (by entry num) total key len = 1.545042 GB avg = 0.028 KB total ukey len = 1.072322 GB avg = 0.015 KB total ukey num = 0.069272612 Billion total entry num = 0.056080341 Billion write speed all = 0.405203153 MB/sec (with seq num) write speed all = 0.388451171 MB/sec (without seq num) 2024/11/23-16:21:33.731372 139957626406464 [compaction_job.cc:1948] [default] [JOB 30533] Generated table #269194: 931989 keys, 34804366 bytes, temperature: kWarm 2024/11/23-16:21:33.731439 139957626406464 EVENT_LOG_v1 {"time_micros": 1732350093731404, "cf_name": "default", "job": 30533, "event": "table_file_creation", "file_number": 269194, "file_size": 34804366, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4012776192, "table_properties": {"data_size": 28751232, "index_size": 1772992, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26095692, "raw_average_key_size": 28, "raw_value_size": 108122102, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 931989, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732350090, "oldest_key_time": 0, "file_creation_time": 1732350090, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 269194, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:21:33.772403 139957626406464 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269195.sst) /dev/shm/ToplingTemp/Topling-112152-XrKScD 2024/11/23-16:21:34.605019 139957626406464 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269195.sst): first pass time = 0.83's, 161.207'MB/sec 2024/11/23-16:21:35.993353 139957626406464 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269195.sst): old prealloc_size = 147639500, real_size = 34962880 2024/11/23-16:21:35.993944 139957626406464 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269195.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 1081570 prefix = 4 raw-key = 0.0173 GB zip-key = 0.0021 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1039 GB zip-val = 0.0326 GB avg-val = 96.10 avg-zval = 30.17 2024/11/23-16:21:35.994002 139957626406464 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269195.sst: sumWaitingMem = 0.003 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0028 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:21:36.742768 139957626406464 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269195.sst): second pass time = 1.39's, 74.926'MB/sec, value only(77.4% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.75's, 47.686'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3620.248'MB/sec (index lex order gen) rebuild zvType time = 0.54's, 0.498'MB/sec write SST data time = 0.21's, 173.395'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.031'MB, throughput = 35166.735'MB/sec zip my value time = 1.39's, unzip length = 0.104'GB zip my value throughput = 74.926'MB/sec zip pipeline throughput = 74.926'MB/sec entries = 1081570 avg-key = 28.00 avg-zkey = 1.90 avg-val = 96.10 avg-zval = 30.17 usrkeys = 1081570 avg-key = 20.00 avg-zkey = 1.90 avg-val = 96.10 avg-zval = 30.17 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 11 UnZipSize{ index = 0.0216 GB value = 0.1039 GB dict = 1.03 MB all = 0.1342 GB } __ZipSize{ index = 0.0021 GB value = 0.0326 GB dict = 1.03 MB all = 0.0357 GB } UnZip/Zip{ index = 10.5162 value = 3.1847 dict = 1.00 all = 3.7560 } Zip/UnZip{ index = 0.0951 value = 0.3140 dict = 1.00 all = 0.2662 } ---------------------------- total value len = 9.410829 GB avg = 0.165 KB (by entry num) total key len = 1.575326 GB avg = 0.028 KB total ukey len = 1.093953 GB avg = 0.016 KB total ukey num = 0.070354182 Billion total entry num = 0.057161911 Billion write speed all = 0.410167937 MB/sec (with seq num) write speed all = 0.393094823 MB/sec (without seq num) 2024/11/23-16:21:36.792153 139957626406464 [compaction_job.cc:1948] [default] [JOB 30533] Generated table #269195: 1081570 keys, 35734310 bytes, temperature: kWarm 2024/11/23-16:21:36.792241 139957626406464 EVENT_LOG_v1 {"time_micros": 1732350096792195, "cf_name": "default", "job": 30533, "event": "table_file_creation", "file_number": 269195, "file_size": 35734310, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 32635312, "index_size": 2056960, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 30283960, "raw_average_key_size": 28, "raw_value_size": 103933849, "raw_average_value_size": 96, "num_data_blocks": 1, "num_entries": 1081570, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732350093, "oldest_key_time": 0, "file_creation_time": 1732350093, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 269195, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:21:36.846177 139957626406464 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269196.sst) /dev/shm/ToplingTemp/Topling-112152-8yyjtB 2024/11/23-16:21:37.921089 139957626406464 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269196.sst): first pass time = 1.07's, 124.870'MB/sec 2024/11/23-16:21:39.702867 139957626406464 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269196.sst): old prealloc_size = 147639500, real_size = 33970640 2024/11/23-16:21:39.703438 139957626406464 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269196.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 922137 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1084 GB zip-val = 0.0320 GB avg-val = 117.55 avg-zval = 34.67 2024/11/23-16:21:39.704108 139957626406464 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269196.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:21:40.512931 139957626406464 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269196.sst): second pass time = 1.78's, 60.860'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.81's, 46.313'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3196.102'MB/sec (index lex order gen) rebuild zvType time = 0.68's, 0.339'MB/sec write SST data time = 0.13's, 291.917'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.084'MB, throughput = 28938.358'MB/sec zip my value time = 1.78's, unzip length = 0.108'GB zip my value throughput = 60.860'MB/sec zip pipeline throughput = 125.517'MB/sec entries = 922137 avg-key = 28.00 avg-zkey = 1.91 avg-val = 117.55 avg-zval = 34.67 usrkeys = 922137 avg-key = 20.00 avg-zkey = 1.91 avg-val = 122.69 avg-zval = 34.67 TagRS{ kinds = RS_Key0_TagN bytes = 144200 } TagArray{ size = 676799 bytes = 2538016 } seq expand size = 4737593 multi value expand size = 0 cnt WriteAppend = 16 UnZipSize{ index = 0.0184 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0320 GB dict = 1.08 MB all = 0.0375 GB } UnZip/Zip{ index = 10.4446 value = 3.3902 dict = 1.00 all = 3.5777 } Zip/UnZip{ index = 0.0957 value = 0.2950 dict = 1.00 all = 0.2795 } ---------------------------- total value len = 9.523964 GB avg = 0.164 KB (by entry num) total key len = 1.601146 GB avg = 0.028 KB total ukey len = 1.112396 GB avg = 0.016 KB total ukey num = 0.071276319 Billion total entry num = 0.058084048 Billion write speed all = 0.415297375 MB/sec (with seq num) write speed all = 0.397951279 MB/sec (without seq num) 2024/11/23-16:21:40.560687 139957626406464 [compaction_job.cc:1948] [default] [JOB 30533] Generated table #269196: 922137 keys, 37515398 bytes, temperature: kWarm 2024/11/23-16:21:40.560754 139957626406464 EVENT_LOG_v1 {"time_micros": 1732350100560720, "cf_name": "default", "job": 30533, "event": "table_file_creation", "file_number": 269196, "file_size": 37515398, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4012775885, "table_properties": {"data_size": 31974144, "index_size": 1765760, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25819836, "raw_average_key_size": 28, "raw_value_size": 108397910, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 922137, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732350096, "oldest_key_time": 0, "file_creation_time": 1732350096, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 269196, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:21:40.600607 139957626406464 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269197.sst) /dev/shm/ToplingTemp/Topling-112152-mcuoSD 2024/11/23-16:21:41.427575 139957626406464 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269197.sst): first pass time = 0.83's, 162.310'MB/sec 2024/11/23-16:21:42.744087 139957626406464 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269197.sst): old prealloc_size = 147639500, real_size = 33010048 2024/11/23-16:21:42.744678 139957626406464 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269197.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 930658 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0310 GB avg-val = 116.22 avg-zval = 33.32 2024/11/23-16:21:42.746371 139957626406464 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269197.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:21:43.602429 139957626406464 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269197.sst): second pass time = 1.32's, 82.208'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.86's, 43.381'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3170.158'MB/sec (index lex order gen) rebuild zvType time = 0.73's, 0.318'MB/sec write SST data time = 0.13's, 294.332'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 35478.916'MB/sec zip my value time = 1.32's, unzip length = 0.108'GB zip my value throughput = 82.208'MB/sec zip pipeline throughput = 82.208'MB/sec entries = 930658 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.22 avg-zval = 33.32 usrkeys = 930658 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.22 avg-zval = 33.32 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 930658 bytes = 3373648 } seq expand size = 6514606 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0310 GB dict = 1.08 MB all = 0.0372 GB } UnZip/Zip{ index = 10.5133 value = 3.4883 dict = 1.00 all = 3.6046 } Zip/UnZip{ index = 0.0951 value = 0.2867 dict = 1.00 all = 0.2774 } ---------------------------- total value len = 9.638638 GB avg = 0.163 KB (by entry num) total key len = 1.627204 GB avg = 0.028 KB total ukey len = 1.131009 GB avg = 0.016 KB total ukey num = 0.072206977 Billion total entry num = 0.059014706 Billion write speed all = 0.420502381 MB/sec (with seq num) write speed all = 0.402880388 MB/sec (without seq num) 2024/11/23-16:21:43.647629 139957626406464 [compaction_job.cc:1948] [default] [JOB 30533] Generated table #269197: 930658 keys, 37234694 bytes, temperature: kWarm 2024/11/23-16:21:43.647694 139957626406464 EVENT_LOG_v1 {"time_micros": 1732350103647660, "cf_name": "default", "job": 30533, "event": "table_file_creation", "file_number": 269197, "file_size": 37234694, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3487497056, "largest_seqno": 4012775295, "table_properties": {"data_size": 31006768, "index_size": 1770432, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26058424, "raw_average_key_size": 28, "raw_value_size": 108159372, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 930658, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732350100, "oldest_key_time": 0, "file_creation_time": 1732350100, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 269197, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:21:43.684530 139957626406464 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269198.sst) /dev/shm/ToplingTemp/Topling-112152-ncypEz 2024/11/23-16:21:44.511733 139957626406464 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269198.sst): first pass time = 0.83's, 162.261'MB/sec 2024/11/23-16:21:45.827229 139957626406464 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269198.sst): old prealloc_size = 147639500, real_size = 32794400 2024/11/23-16:21:45.827811 139957626406464 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269198.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 932228 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1081 GB zip-val = 0.0308 GB avg-val = 115.98 avg-zval = 33.03 2024/11/23-16:21:45.829488 139957626406464 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269198.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:21:46.685621 139957626406464 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269198.sst): second pass time = 1.31's, 82.239'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.86's, 42.998'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3170.615'MB/sec (index lex order gen) rebuild zvType time = 0.73's, 0.319'MB/sec write SST data time = 0.13's, 292.620'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 33266.033'MB/sec zip my value time = 1.31's, unzip length = 0.108'GB zip my value throughput = 82.239'MB/sec zip pipeline throughput = 82.239'MB/sec entries = 932228 avg-key = 28.00 avg-zkey = 1.90 avg-val = 115.98 avg-zval = 33.03 usrkeys = 932228 avg-key = 20.00 avg-zkey = 1.90 avg-val = 122.98 avg-zval = 33.03 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 932228 bytes = 3262816 } seq expand size = 6525596 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0186 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0308 GB dict = 1.08 MB all = 0.0369 GB } UnZip/Zip{ index = 10.5117 value = 3.5117 dict = 1.00 all = 3.6366 } Zip/UnZip{ index = 0.0951 value = 0.2848 dict = 1.00 all = 0.2750 } ---------------------------- total value len = 9.753279 GB avg = 0.163 KB (by entry num) total key len = 1.653307 GB avg = 0.028 KB total ukey len = 1.149653 GB avg = 0.016 KB total ukey num = 0.073139205 Billion total entry num = 0.059946934 Billion write speed all = 0.425706696 MB/sec (with seq num) write speed all = 0.407808396 MB/sec (without seq num) 2024/11/23-16:21:46.732004 139957626406464 [compaction_job.cc:1948] [default] [JOB 30533] Generated table #269198: 932228 keys, 36907854 bytes, temperature: kWarm 2024/11/23-16:21:46.732076 139957626406464 EVENT_LOG_v1 {"time_micros": 1732350106732041, "cf_name": "default", "job": 30533, "event": "table_file_creation", "file_number": 269198, "file_size": 36907854, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3807172320, "largest_seqno": 4012775918, "table_properties": {"data_size": 30787472, "index_size": 1773696, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26102384, "raw_average_key_size": 28, "raw_value_size": 108115352, "raw_average_value_size": 115, "num_data_blocks": 1, "num_entries": 932228, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732350103, "oldest_key_time": 0, "file_creation_time": 1732350103, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 269198, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:21:46.771629 139957626406464 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269199.sst) /dev/shm/ToplingTemp/Topling-112152-LSSwNC 2024/11/23-16:21:47.686353 139957626406464 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269199.sst): first pass time = 0.91's, 146.735'MB/sec 2024/11/23-16:21:48.999688 139957626406464 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269199.sst): old prealloc_size = 147639500, real_size = 33081984 2024/11/23-16:21:49.000273 139957626406464 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269199.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 930543 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0311 GB avg-val = 116.24 avg-zval = 33.40 2024/11/23-16:21:49.001882 139957626406464 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269199.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:21:49.858782 139957626406464 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269199.sst): second pass time = 1.31's, 82.438'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.86's, 43.562'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3139.504'MB/sec (index lex order gen) rebuild zvType time = 0.73's, 0.319'MB/sec write SST data time = 0.13's, 288.396'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 36283.204'MB/sec zip my value time = 1.31's, unzip length = 0.108'GB zip my value throughput = 82.438'MB/sec zip pipeline throughput = 82.438'MB/sec entries = 930543 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.24 avg-zval = 33.40 usrkeys = 930543 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.24 avg-zval = 33.40 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 930543 bytes = 3489552 } seq expand size = 6513801 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0311 GB dict = 1.08 MB all = 0.0374 GB } UnZip/Zip{ index = 10.5139 value = 3.4802 dict = 1.00 all = 3.5865 } Zip/UnZip{ index = 0.0951 value = 0.2873 dict = 1.00 all = 0.2788 } ---------------------------- total value len = 9.867956 GB avg = 0.162 KB (by entry num) total key len = 1.679362 GB avg = 0.028 KB total ukey len = 1.168264 GB avg = 0.016 KB total ukey num = 0.074069748 Billion total entry num = 0.060877477 Billion write speed all = 0.430907930 MB/sec (with seq num) write speed all = 0.412733951 MB/sec (without seq num) 2024/11/23-16:21:49.904650 139957626406464 [compaction_job.cc:1948] [default] [JOB 30533] Generated table #269199: 930543 keys, 37422694 bytes, temperature: kWarm 2024/11/23-16:21:49.904720 139957626406464 EVENT_LOG_v1 {"time_micros": 1732350109904684, "cf_name": "default", "job": 30533, "event": "table_file_creation", "file_number": 269199, "file_size": 37422694, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3273701103, "largest_seqno": 4012774578, "table_properties": {"data_size": 31079024, "index_size": 1770112, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26055204, "raw_average_key_size": 28, "raw_value_size": 108162658, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 930543, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732350106, "oldest_key_time": 0, "file_creation_time": 1732350106, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 269199, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:21:49.942586 139957626406464 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269200.sst) /dev/shm/ToplingTemp/Topling-112152-72pbFD 2024/11/23-16:21:50.990960 139957626406464 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269200.sst): first pass time = 1.05's, 128.031'MB/sec 2024/11/23-16:21:52.325304 139957626406464 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269200.sst): old prealloc_size = 147639500, real_size = 34435904 2024/11/23-16:21:52.325857 139957626406464 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269200.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 928829 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1082 GB zip-val = 0.0324 GB avg-val = 116.50 avg-zval = 34.91 2024/11/23-16:21:52.326674 139957626406464 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269200.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:21:53.171224 139957626406464 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269200.sst): second pass time = 1.33's, 81.145'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.85's, 45.698'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3356.001'MB/sec (index lex order gen) rebuild zvType time = 0.72's, 0.324'MB/sec write SST data time = 0.13's, 302.488'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 31992.296'MB/sec zip my value time = 1.33's, unzip length = 0.108'GB zip my value throughput = 81.145'MB/sec zip pipeline throughput = 81.145'MB/sec entries = 928829 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.50 avg-zval = 34.91 usrkeys = 928829 avg-key = 20.00 avg-zkey = 1.91 avg-val = 123.50 avg-zval = 34.91 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 928829 bytes = 3367024 } seq expand size = 6501803 multi value expand size = 0 cnt WriteAppend = 15 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0324 GB dict = 1.08 MB all = 0.0387 GB } UnZip/Zip{ index = 10.4451 value = 3.3373 dict = 1.00 all = 3.4721 } Zip/UnZip{ index = 0.0957 value = 0.2996 dict = 1.00 all = 0.2880 } ---------------------------- total value len = 9.982668 GB avg = 0.162 KB (by entry num) total key len = 1.705369 GB avg = 0.028 KB total ukey len = 1.186841 GB avg = 0.016 KB total ukey num = 0.074998577 Billion total entry num = 0.061806306 Billion write speed all = 0.436105217 MB/sec (with seq num) write speed all = 0.417656232 MB/sec (without seq num) 2024/11/23-16:21:53.219803 139957626406464 [compaction_job.cc:1948] [default] [JOB 30533] Generated table #269200: 928829 keys, 38656204 bytes, temperature: kWarm 2024/11/23-16:21:53.219874 139957626406464 EVENT_LOG_v1 {"time_micros": 1732350113219839, "cf_name": "default", "job": 30533, "event": "table_file_creation", "file_number": 269200, "file_size": 38656204, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3514720078, "largest_seqno": 4012775967, "table_properties": {"data_size": 32425008, "index_size": 1778496, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26007212, "raw_average_key_size": 28, "raw_value_size": 108210614, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 928829, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732350109, "oldest_key_time": 0, "file_creation_time": 1732350109, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 269200, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:21:53.257761 139957626406464 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269201.sst) /dev/shm/ToplingTemp/Topling-112152-2MfQrD 2024/11/23-16:21:54.271560 139957626406464 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269201.sst): first pass time = 1.01's, 132.396'MB/sec 2024/11/23-16:21:55.619042 139957626406464 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269201.sst): old prealloc_size = 147639500, real_size = 33997472 2024/11/23-16:21:55.619579 139957626406464 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269201.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 926015 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0320 GB avg-val = 116.94 avg-zval = 34.56 2024/11/23-16:21:55.621651 139957626406464 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269201.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:21:56.459586 139957626406464 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269201.sst): second pass time = 1.35's, 80.414'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.84's, 45.459'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3428.876'MB/sec (index lex order gen) rebuild zvType time = 0.71's, 0.325'MB/sec write SST data time = 0.13's, 299.463'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 34676.122'MB/sec zip my value time = 1.35's, unzip length = 0.108'GB zip my value throughput = 80.414'MB/sec zip pipeline throughput = 80.414'MB/sec entries = 926015 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.94 avg-zval = 34.56 usrkeys = 926015 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.94 avg-zval = 34.56 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 926015 bytes = 3356816 } seq expand size = 6482105 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0320 GB dict = 1.08 MB all = 0.0382 GB } UnZip/Zip{ index = 10.5141 value = 3.3836 dict = 1.00 all = 3.5127 } Zip/UnZip{ index = 0.0951 value = 0.2955 dict = 1.00 all = 0.2847 } ---------------------------- total value len = 10.097439 GB avg = 0.161 KB (by entry num) total key len = 1.731297 GB avg = 0.028 KB total ukey len = 1.205361 GB avg = 0.016 KB total ukey num = 0.075924592 Billion total entry num = 0.062732321 Billion write speed all = 0.441300878 MB/sec (with seq num) write speed all = 0.422577778 MB/sec (without seq num) 2024/11/23-16:21:56.506579 139957626406464 [compaction_job.cc:1948] [default] [JOB 30533] Generated table #269201: 926015 keys, 38209204 bytes, temperature: kWarm 2024/11/23-16:21:56.506654 139957626406464 EVENT_LOG_v1 {"time_micros": 1732350116506619, "cf_name": "default", "job": 30533, "event": "table_file_creation", "file_number": 269201, "file_size": 38209204, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3516470397, "largest_seqno": 4012776021, "table_properties": {"data_size": 32004304, "index_size": 1761472, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25928420, "raw_average_key_size": 28, "raw_value_size": 108289318, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 926015, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732350113, "oldest_key_time": 0, "file_creation_time": 1732350113, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 269201, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:21:56.544116 139957626406464 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269202.sst) /dev/shm/ToplingTemp/Topling-112152-NiSFYA 2024/11/23-16:21:57.515179 139957626406464 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269202.sst): first pass time = 0.97's, 138.222'MB/sec 2024/11/23-16:21:58.858557 139957626406464 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269202.sst): old prealloc_size = 147639500, real_size = 36088128 2024/11/23-16:21:58.859133 139957626406464 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269202.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 925457 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1083 GB zip-val = 0.0341 GB avg-val = 117.03 avg-zval = 36.83 2024/11/23-16:21:58.859850 139957626406464 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269202.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:21:59.666189 139957626406464 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269202.sst): second pass time = 1.34's, 80.690'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.81's, 49.375'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3195.781'MB/sec (index lex order gen) rebuild zvType time = 0.68's, 0.342'MB/sec write SST data time = 0.13's, 303.569'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 29788.440'MB/sec zip my value time = 1.34's, unzip length = 0.108'GB zip my value throughput = 80.690'MB/sec zip pipeline throughput = 80.690'MB/sec entries = 925457 avg-key = 28.00 avg-zkey = 1.91 avg-val = 117.03 avg-zval = 36.83 usrkeys = 925457 avg-key = 20.00 avg-zkey = 1.91 avg-val = 122.64 avg-zval = 36.83 TagRS{ kinds = RS_Key0_TagN bytes = 144720 } TagArray{ size = 742460 bytes = 2784240 } seq expand size = 5197220 multi value expand size = 0 cnt WriteAppend = 16 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0341 GB dict = 1.08 MB all = 0.0399 GB } UnZip/Zip{ index = 10.4455 value = 3.1775 dict = 1.00 all = 3.3659 } Zip/UnZip{ index = 0.0957 value = 0.3147 dict = 1.00 all = 0.2971 } ---------------------------- total value len = 10.210942 GB avg = 0.160 KB (by entry num) total key len = 1.757210 GB avg = 0.028 KB total ukey len = 1.223870 GB avg = 0.016 KB total ukey num = 0.076850049 Billion total entry num = 0.063657778 Billion write speed all = 0.446448699 MB/sec (with seq num) write speed all = 0.427451659 MB/sec (without seq num) 2024/11/23-16:21:59.720324 139957626406464 [compaction_job.cc:1948] [default] [JOB 30533] Generated table #269202: 925457 keys, 39875592 bytes, temperature: kWarm 2024/11/23-16:21:59.720400 139957626406464 EVENT_LOG_v1 {"time_micros": 1732350119720360, "cf_name": "default", "job": 30533, "event": "table_file_creation", "file_number": 269202, "file_size": 39875592, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4012774830, "table_properties": {"data_size": 34084592, "index_size": 1771968, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25912796, "raw_average_key_size": 28, "raw_value_size": 108305026, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 925457, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732350116, "oldest_key_time": 0, "file_creation_time": 1732350116, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 269202, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:21:59.755620 139957626406464 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269203.sst) /dev/shm/ToplingTemp/Topling-112152-wHyPFz 2024/11/23-16:22:00.783766 139957626406464 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269203.sst): first pass time = 1.03's, 130.549'MB/sec 2024/11/23-16:22:02.119210 139957626406464 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269203.sst): old prealloc_size = 147639500, real_size = 32822784 2024/11/23-16:22:02.119799 139957626406464 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269203.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 931768 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1081 GB zip-val = 0.0308 GB avg-val = 116.05 avg-zval = 33.06 2024/11/23-16:22:02.121922 139957626406464 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269203.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:22:02.983862 139957626406464 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269203.sst): second pass time = 1.33's, 81.018'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.86's, 42.852'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3150.363'MB/sec (index lex order gen) rebuild zvType time = 0.73's, 0.317'MB/sec write SST data time = 0.13's, 285.078'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 28433.147'MB/sec zip my value time = 1.33's, unzip length = 0.108'GB zip my value throughput = 81.018'MB/sec zip pipeline throughput = 81.018'MB/sec entries = 931768 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.05 avg-zval = 33.06 usrkeys = 931768 avg-key = 20.00 avg-zkey = 1.91 avg-val = 123.05 avg-zval = 33.06 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 931768 bytes = 3377680 } seq expand size = 6522376 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0308 GB dict = 1.08 MB all = 0.0371 GB } UnZip/Zip{ index = 10.4458 value = 3.5100 dict = 1.00 all = 3.6225 } Zip/UnZip{ index = 0.0957 value = 0.2849 dict = 1.00 all = 0.2761 } ---------------------------- total value len = 10.325592 GB avg = 0.160 KB (by entry num) total key len = 1.783300 GB avg = 0.028 KB total ukey len = 1.242506 GB avg = 0.016 KB total ukey num = 0.077781817 Billion total entry num = 0.064589546 Billion write speed all = 0.451642844 MB/sec (with seq num) write speed all = 0.432370127 MB/sec (without seq num) 2024/11/23-16:22:03.033167 139957626406464 [compaction_job.cc:1948] [default] [JOB 30533] Generated table #269203: 931768 keys, 37051122 bytes, temperature: kWarm 2024/11/23-16:22:03.033237 139957626406464 EVENT_LOG_v1 {"time_micros": 1732350123033203, "cf_name": "default", "job": 30533, "event": "table_file_creation", "file_number": 269203, "file_size": 37051122, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3480997236, "largest_seqno": 4012776228, "table_properties": {"data_size": 30805680, "index_size": 1784000, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26089504, "raw_average_key_size": 28, "raw_value_size": 108128312, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 931768, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732350119, "oldest_key_time": 0, "file_creation_time": 1732350119, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 269203, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:22:03.069476 139957626406464 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269204.sst) /dev/shm/ToplingTemp/Topling-112152-9QjmRA 2024/11/23-16:22:04.088549 139957626406464 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269204.sst): first pass time = 1.02's, 131.710'MB/sec 2024/11/23-16:22:05.377527 139957626406464 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269204.sst): old prealloc_size = 147639500, real_size = 31976688 2024/11/23-16:22:05.378128 139957626406464 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269204.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 936596 prefix = 4 raw-key = 0.0150 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1080 GB zip-val = 0.0300 GB avg-val = 115.30 avg-zval = 31.99 2024/11/23-16:22:05.380228 139957626406464 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269204.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:22:06.243156 139957626406464 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269204.sst): second pass time = 1.29's, 83.834'MB/sec, value only(80.5% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.87's, 41.844'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3070.233'MB/sec (index lex order gen) rebuild zvType time = 0.74's, 0.318'MB/sec write SST data time = 0.13's, 282.549'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.077'MB, throughput = 33792.787'MB/sec zip my value time = 1.29's, unzip length = 0.108'GB zip my value throughput = 83.834'MB/sec zip pipeline throughput = 83.834'MB/sec entries = 936596 avg-key = 28.00 avg-zkey = 1.90 avg-val = 115.30 avg-zval = 31.99 usrkeys = 936596 avg-key = 20.00 avg-zkey = 1.90 avg-val = 122.30 avg-zval = 31.99 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 936596 bytes = 3395168 } seq expand size = 6556172 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0187 GB value = 0.1080 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0300 GB dict = 1.08 MB all = 0.0362 GB } UnZip/Zip{ index = 10.5135 value = 3.6045 dict = 1.00 all = 3.7056 } Zip/UnZip{ index = 0.0951 value = 0.2774 dict = 1.00 all = 0.2699 } ---------------------------- total value len = 10.440142 GB avg = 0.159 KB (by entry num) total key len = 1.809524 GB avg = 0.028 KB total ukey len = 1.261238 GB avg = 0.016 KB total ukey num = 0.078718413 Billion total entry num = 0.065526142 Billion write speed all = 0.456837959 MB/sec (with seq num) write speed all = 0.437288150 MB/sec (without seq num) 2024/11/23-16:22:06.291785 139957626406464 [compaction_job.cc:1948] [default] [JOB 30533] Generated table #269204: 936596 keys, 36220304 bytes, temperature: kWarm 2024/11/23-16:22:06.291856 139957626406464 EVENT_LOG_v1 {"time_micros": 1732350126291820, "cf_name": "default", "job": 30533, "event": "table_file_creation", "file_number": 269204, "file_size": 36220304, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3512539342, "largest_seqno": 4012776248, "table_properties": {"data_size": 29960672, "index_size": 1781696, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26224688, "raw_average_key_size": 28, "raw_value_size": 107993132, "raw_average_value_size": 115, "num_data_blocks": 1, "num_entries": 936596, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732350123, "oldest_key_time": 0, "file_creation_time": 1732350123, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 269204, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:22:06.373455 139957626406464 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269205.sst) /dev/shm/ToplingTemp/Topling-112152-1bFC1A 2024/11/23-16:22:07.426545 139957626406464 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269205.sst): first pass time = 1.05's, 127.457'MB/sec 2024/11/23-16:22:08.776196 139957626406464 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269205.sst): old prealloc_size = 147639500, real_size = 35190992 2024/11/23-16:22:08.776773 139957626406464 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269205.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 926373 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1083 GB zip-val = 0.0332 GB avg-val = 116.89 avg-zval = 35.82 2024/11/23-16:22:08.779014 139957626406464 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269205.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:22:09.621038 139957626406464 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269205.sst): second pass time = 1.35's, 80.276'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.84's, 46.780'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3206.084'MB/sec (index lex order gen) rebuild zvType time = 0.72's, 0.324'MB/sec write SST data time = 0.13's, 307.878'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 30874.250'MB/sec zip my value time = 1.35's, unzip length = 0.108'GB zip my value throughput = 80.276'MB/sec zip pipeline throughput = 80.276'MB/sec entries = 926373 avg-key = 28.00 avg-zkey = 1.92 avg-val = 116.89 avg-zval = 35.82 usrkeys = 926373 avg-key = 20.00 avg-zkey = 1.92 avg-val = 123.89 avg-zval = 35.82 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 926373 bytes = 3473920 } seq expand size = 6484611 multi value expand size = 0 cnt WriteAppend = 16 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0332 GB dict = 1.08 MB all = 0.0395 GB } UnZip/Zip{ index = 10.4434 value = 3.2629 dict = 1.00 all = 3.3962 } Zip/UnZip{ index = 0.0958 value = 0.3065 dict = 1.00 all = 0.2944 } ---------------------------- total value len = 10.554906 GB avg = 0.159 KB (by entry num) total key len = 1.835463 GB avg = 0.028 KB total ukey len = 1.279765 GB avg = 0.016 KB total ukey num = 0.079644786 Billion total entry num = 0.066452515 Billion write speed all = 0.462027098 MB/sec (with seq num) write speed all = 0.442203402 MB/sec (without seq num) 2024/11/23-16:22:09.673191 139957626406464 [compaction_job.cc:1948] [default] [JOB 30533] Generated table #269205: 926373 keys, 39519410 bytes, temperature: kWarm 2024/11/23-16:22:09.673264 139957626406464 EVENT_LOG_v1 {"time_micros": 1732350129673227, "cf_name": "default", "job": 30533, "event": "table_file_creation", "file_number": 269205, "file_size": 39519410, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3411274482, "largest_seqno": 4012776268, "table_properties": {"data_size": 33185152, "index_size": 1774080, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25938444, "raw_average_key_size": 28, "raw_value_size": 108279334, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 926373, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732350126, "oldest_key_time": 0, "file_creation_time": 1732350126, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 269205, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:22:09.715953 139957626406464 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269206.sst) /dev/shm/ToplingTemp/Topling-112152-dbHfMD 2024/11/23-16:22:10.734180 139957626406464 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269206.sst): first pass time = 1.02's, 131.823'MB/sec 2024/11/23-16:22:12.044966 139957626406464 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269206.sst): old prealloc_size = 147639500, real_size = 31876272 2024/11/23-16:22:12.045568 139957626406464 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269206.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 931242 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1081 GB zip-val = 0.0299 GB avg-val = 116.13 avg-zval = 32.06 2024/11/23-16:22:12.046672 139957626406464 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269206.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:22:12.886194 139957626406464 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269206.sst): second pass time = 1.31's, 82.590'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.84's, 42.919'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3214.552'MB/sec (index lex order gen) rebuild zvType time = 0.71's, 0.327'MB/sec write SST data time = 0.13's, 281.993'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 37383.981'MB/sec zip my value time = 1.31's, unzip length = 0.108'GB zip my value throughput = 82.590'MB/sec zip pipeline throughput = 82.590'MB/sec entries = 931242 avg-key = 28.00 avg-zkey = 1.92 avg-val = 116.13 avg-zval = 32.06 usrkeys = 931242 avg-key = 20.00 avg-zkey = 1.92 avg-val = 123.13 avg-zval = 32.06 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 931242 bytes = 3375760 } seq expand size = 6518694 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0299 GB dict = 1.08 MB all = 0.0361 GB } UnZip/Zip{ index = 10.4433 value = 3.6217 dict = 1.00 all = 3.7176 } Zip/UnZip{ index = 0.0958 value = 0.2761 dict = 1.00 all = 0.2690 } ---------------------------- total value len = 10.669567 GB avg = 0.158 KB (by entry num) total key len = 1.861538 GB avg = 0.028 KB total ukey len = 1.298390 GB avg = 0.016 KB total ukey num = 0.080576028 Billion total entry num = 0.067383757 Billion write speed all = 0.467218163 MB/sec (with seq num) write speed all = 0.447119112 MB/sec (without seq num) 2024/11/23-16:22:12.932583 139957626406464 [compaction_job.cc:1948] [default] [JOB 30533] Generated table #269206: 931242 keys, 36103744 bytes, temperature: kWarm 2024/11/23-16:22:12.932664 139957626406464 EVENT_LOG_v1 {"time_micros": 1732350132932627, "cf_name": "default", "job": 30533, "event": "table_file_creation", "file_number": 269206, "file_size": 36103744, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3525889795, "largest_seqno": 4012776300, "table_properties": {"data_size": 29859872, "index_size": 1783424, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26074776, "raw_average_key_size": 28, "raw_value_size": 108142972, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 931242, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732350129, "oldest_key_time": 0, "file_creation_time": 1732350129, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 269206, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:22:12.971293 139957626406464 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269207.sst) /dev/shm/ToplingTemp/Topling-112152-AEkNkB 2024/11/23-16:22:13.939863 139957626406464 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269207.sst): first pass time = 0.97's, 138.579'MB/sec 2024/11/23-16:22:15.292317 139957626406464 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269207.sst): old prealloc_size = 147639500, real_size = 35389344 2024/11/23-16:22:15.292860 139957626406464 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269207.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 922697 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1084 GB zip-val = 0.0334 GB avg-val = 117.46 avg-zval = 36.20 2024/11/23-16:22:15.294002 139957626406464 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269207.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:22:16.134371 139957626406464 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269207.sst): second pass time = 1.35's, 80.189'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.84's, 47.157'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3368.796'MB/sec (index lex order gen) rebuild zvType time = 0.71's, 0.323'MB/sec write SST data time = 0.13's, 309.586'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.083'MB, throughput = 33630.216'MB/sec zip my value time = 1.35's, unzip length = 0.108'GB zip my value throughput = 80.189'MB/sec zip pipeline throughput = 80.189'MB/sec entries = 922697 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.46 avg-zval = 36.20 usrkeys = 922697 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.46 avg-zval = 36.20 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 922697 bytes = 3460128 } seq expand size = 6458879 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0185 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0334 GB dict = 1.08 MB all = 0.0397 GB } UnZip/Zip{ index = 10.5127 value = 3.2447 dict = 1.00 all = 3.3801 } Zip/UnZip{ index = 0.0951 value = 0.3082 dict = 1.00 all = 0.2958 } ---------------------------- total value len = 10.784408 GB avg = 0.158 KB (by entry num) total key len = 1.887373 GB avg = 0.028 KB total ukey len = 1.316844 GB avg = 0.016 KB total ukey num = 0.081498725 Billion total entry num = 0.068306454 Billion write speed all = 0.472406035 MB/sec (with seq num) write speed all = 0.452034231 MB/sec (without seq num) 2024/11/23-16:22:16.183892 139957626406464 [compaction_job.cc:1948] [default] [JOB 30533] Generated table #269207: 922697 keys, 39707754 bytes, temperature: kWarm 2024/11/23-16:22:16.183961 139957626406464 EVENT_LOG_v1 {"time_micros": 1732350136183926, "cf_name": "default", "job": 30533, "event": "table_file_creation", "file_number": 269207, "file_size": 39707754, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3405268578, "largest_seqno": 4012776316, "table_properties": {"data_size": 33403088, "index_size": 1755392, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25835516, "raw_average_key_size": 28, "raw_value_size": 108382282, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 922697, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732350132, "oldest_key_time": 0, "file_creation_time": 1732350132, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 269207, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:22:16.221934 139957626406464 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269208.sst) /dev/shm/ToplingTemp/Topling-112152-j3oNbD 2024/11/23-16:22:17.053161 139957626406464 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269208.sst): first pass time = 0.83's, 161.477'MB/sec 2024/11/23-16:22:18.356895 139957626406464 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269208.sst): old prealloc_size = 147639500, real_size = 32750912 2024/11/23-16:22:18.357493 139957626406464 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269208.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 931083 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1081 GB zip-val = 0.0307 GB avg-val = 116.15 avg-zval = 33.01 2024/11/23-16:22:18.358596 139957626406464 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269208.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:22:19.215095 139957626406464 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269208.sst): second pass time = 1.30's, 82.998'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.86's, 43.224'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3090.669'MB/sec (index lex order gen) rebuild zvType time = 0.73's, 0.319'MB/sec write SST data time = 0.13's, 290.651'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 33362.658'MB/sec zip my value time = 1.30's, unzip length = 0.108'GB zip my value throughput = 82.998'MB/sec zip pipeline throughput = 82.998'MB/sec entries = 931083 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.15 avg-zval = 33.01 usrkeys = 931083 avg-key = 20.00 avg-zkey = 1.91 avg-val = 123.15 avg-zval = 33.01 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 931083 bytes = 3491584 } seq expand size = 6517581 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0186 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0307 GB dict = 1.08 MB all = 0.0371 GB } UnZip/Zip{ index = 10.4441 value = 3.5187 dict = 1.00 all = 3.6183 } Zip/UnZip{ index = 0.0957 value = 0.2842 dict = 1.00 all = 0.2764 } ---------------------------- total value len = 10.899073 GB avg = 0.157 KB (by entry num) total key len = 1.913444 GB avg = 0.028 KB total ukey len = 1.335465 GB avg = 0.016 KB total ukey num = 0.082429808 Billion total entry num = 0.069237537 Billion write speed all = 0.477597822 MB/sec (with seq num) write speed all = 0.456950702 MB/sec (without seq num) 2024/11/23-16:22:19.262708 139957626406464 [compaction_job.cc:1948] [default] [JOB 30533] Generated table #269208: 931083 keys, 37093988 bytes, temperature: kWarm 2024/11/23-16:22:19.262776 139957626406464 EVENT_LOG_v1 {"time_micros": 1732350139262740, "cf_name": "default", "job": 30533, "event": "table_file_creation", "file_number": 269208, "file_size": 37093988, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3471845708, "largest_seqno": 4012776344, "table_properties": {"data_size": 30734960, "index_size": 1782976, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26070324, "raw_average_key_size": 28, "raw_value_size": 108147522, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 931083, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732350136, "oldest_key_time": 0, "file_creation_time": 1732350136, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 269208, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:22:19.306065 139957626406464 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269209.sst) /dev/shm/ToplingTemp/Topling-112152-chE5dB 2024/11/23-16:22:20.134961 139957626406464 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269209.sst): first pass time = 0.83's, 161.931'MB/sec 2024/11/23-16:22:21.477312 139957626406464 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269209.sst): old prealloc_size = 147639500, real_size = 33663264 2024/11/23-16:22:21.477894 139957626406464 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269209.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927218 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1083 GB zip-val = 0.0317 GB avg-val = 116.75 avg-zval = 34.14 2024/11/23-16:22:21.478545 139957626406464 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269209.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:22:22.288550 139957626406464 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269209.sst): second pass time = 1.34's, 80.693'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.81's, 45.609'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3182.507'MB/sec (index lex order gen) rebuild zvType time = 0.68's, 0.340'MB/sec write SST data time = 0.13's, 284.938'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 35457.934'MB/sec zip my value time = 1.34's, unzip length = 0.108'GB zip my value throughput = 80.693'MB/sec zip pipeline throughput = 80.693'MB/sec entries = 927218 avg-key = 28.00 avg-zkey = 1.92 avg-val = 116.75 avg-zval = 34.14 usrkeys = 927218 avg-key = 20.00 avg-zkey = 1.92 avg-val = 121.61 avg-zval = 34.14 TagRS{ kinds = RS_Key0_TagN bytes = 144960 } TagArray{ size = 642998 bytes = 2330880 } seq expand size = 4500986 multi value expand size = 0 cnt WriteAppend = 18 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0317 GB dict = 1.08 MB all = 0.0370 GB } UnZip/Zip{ index = 10.4435 value = 3.4198 dict = 1.00 all = 3.6277 } Zip/UnZip{ index = 0.0958 value = 0.2924 dict = 1.00 all = 0.2757 } ---------------------------- total value len = 11.011830 GB avg = 0.157 KB (by entry num) total key len = 1.939406 GB avg = 0.028 KB total ukey len = 1.354010 GB avg = 0.016 KB total ukey num = 0.083357026 Billion total entry num = 0.070164755 Billion write speed all = 0.482713386 MB/sec (with seq num) write speed all = 0.461792159 MB/sec (without seq num) 2024/11/23-16:22:22.335286 139957626406464 [compaction_job.cc:1948] [default] [JOB 30533] Generated table #269209: 927218 keys, 36998456 bytes, temperature: kWarm 2024/11/23-16:22:22.335356 139957626406464 EVENT_LOG_v1 {"time_micros": 1732350142335321, "cf_name": "default", "job": 30533, "event": "table_file_creation", "file_number": 269209, "file_size": 36998456, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4012776360, "table_properties": {"data_size": 31655568, "index_size": 1775680, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25962104, "raw_average_key_size": 28, "raw_value_size": 108255724, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927218, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732350139, "oldest_key_time": 0, "file_creation_time": 1732350139, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 269209, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:22:22.376328 139957626406464 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269210.sst) /dev/shm/ToplingTemp/Topling-112152-0bP1GB 2024/11/23-16:22:23.379269 139957626406464 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269210.sst): first pass time = 1.00's, 133.829'MB/sec 2024/11/23-16:22:24.881272 139957626406464 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269210.sst): old prealloc_size = 147639500, real_size = 36883408 2024/11/23-16:22:24.881834 139957626406464 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269210.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 926738 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1083 GB zip-val = 0.0349 GB avg-val = 116.83 avg-zval = 37.63 2024/11/23-16:22:24.882106 139957626406464 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269210.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:22:25.597692 139957626406464 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269210.sst): second pass time = 1.50's, 72.122'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.72's, 53.558'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3307.141'MB/sec (index lex order gen) rebuild zvType time = 0.59's, 0.392'MB/sec write SST data time = 0.12's, 307.911'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 32178.195'MB/sec zip my value time = 1.50's, unzip length = 0.108'GB zip my value throughput = 72.122'MB/sec zip pipeline throughput = 72.122'MB/sec entries = 926738 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.83 avg-zval = 37.63 usrkeys = 926738 avg-key = 20.00 avg-zkey = 1.91 avg-val = 117.99 avg-zval = 37.63 TagRS{ kinds = RS_Key0_TagN bytes = 144920 } TagArray{ size = 154398 bytes = 482512 } seq expand size = 1080786 multi value expand size = 0 cnt WriteAppend = 16 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0349 GB dict = 1.08 MB all = 0.0384 GB } UnZip/Zip{ index = 10.4445 value = 3.1043 dict = 1.00 all = 3.4981 } Zip/UnZip{ index = 0.0957 value = 0.3221 dict = 1.00 all = 0.2859 } ---------------------------- total value len = 11.121180 GB avg = 0.156 KB (by entry num) total key len = 1.965354 GB avg = 0.028 KB total ukey len = 1.372545 GB avg = 0.016 KB total ukey num = 0.084283764 Billion total entry num = 0.071091493 Billion write speed all = 0.487696031 MB/sec (with seq num) write speed all = 0.466501091 MB/sec (without seq num) 2024/11/23-16:22:25.644589 139957626406464 [compaction_job.cc:1948] [default] [JOB 30533] Generated table #269210: 926738 keys, 38368877 bytes, temperature: kWarm 2024/11/23-16:22:25.644666 139957626406464 EVENT_LOG_v1 {"time_micros": 1732350145644630, "cf_name": "default", "job": 30533, "event": "table_file_creation", "file_number": 269210, "file_size": 38368877, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3273700812, "table_properties": {"data_size": 34876928, "index_size": 1774592, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25948664, "raw_average_key_size": 28, "raw_value_size": 108269156, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 926738, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732350142, "oldest_key_time": 0, "file_creation_time": 1732350142, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 269210, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:22:25.681419 139957626406464 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269211.sst) /dev/shm/ToplingTemp/Topling-112152-hn2NOD 2024/11/23-16:22:26.748796 139957626406464 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269211.sst): first pass time = 1.07's, 125.750'MB/sec 2024/11/23-16:22:28.122832 139957626406464 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269211.sst): old prealloc_size = 147639500, real_size = 37037888 2024/11/23-16:22:28.123403 139957626406464 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269211.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927364 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0350 GB avg-val = 116.73 avg-zval = 37.79 2024/11/23-16:22:28.124020 139957626406464 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269211.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:22:28.908234 139957626406464 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269211.sst): second pass time = 1.37's, 78.825'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.79's, 51.369'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3176.589'MB/sec (index lex order gen) rebuild zvType time = 0.66's, 0.354'MB/sec write SST data time = 0.13's, 312.571'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 35348.604'MB/sec zip my value time = 1.37's, unzip length = 0.108'GB zip my value throughput = 78.825'MB/sec zip pipeline throughput = 78.825'MB/sec entries = 927364 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.73 avg-zval = 37.79 usrkeys = 927364 avg-key = 20.00 avg-zkey = 1.90 avg-val = 121.88 avg-zval = 37.79 TagRS{ kinds = RS_Key0_TagN bytes = 145000 } TagArray{ size = 682331 bytes = 2302880 } seq expand size = 4776317 multi value expand size = 0 cnt WriteAppend = 16 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0350 GB dict = 1.08 MB all = 0.0403 GB } UnZip/Zip{ index = 10.5134 value = 3.0892 dict = 1.00 all = 3.3269 } Zip/UnZip{ index = 0.0951 value = 0.3237 dict = 1.00 all = 0.3006 } ---------------------------- total value len = 11.234208 GB avg = 0.156 KB (by entry num) total key len = 1.991320 GB avg = 0.028 KB total ukey len = 1.391092 GB avg = 0.016 KB total ukey num = 0.085211128 Billion total entry num = 0.072018857 Billion write speed all = 0.492815128 MB/sec (with seq num) write speed all = 0.471346356 MB/sec (without seq num) 2024/11/23-16:22:28.959492 139957626406464 [compaction_job.cc:1948] [default] [JOB 30533] Generated table #269211: 927364 keys, 40343658 bytes, temperature: kWarm 2024/11/23-16:22:28.959562 139957626406464 EVENT_LOG_v1 {"time_micros": 1732350148959527, "cf_name": "default", "job": 30533, "event": "table_file_creation", "file_number": 269211, "file_size": 40343658, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4104633226, "table_properties": {"data_size": 35041712, "index_size": 1764160, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25966192, "raw_average_key_size": 28, "raw_value_size": 108251656, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927364, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732350145, "oldest_key_time": 0, "file_creation_time": 1732350145, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 269211, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:22:28.998542 139957626406464 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269212.sst) /dev/shm/ToplingTemp/Topling-112152-AOS9ID 2024/11/23-16:22:29.102232 139957626406464 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269212.sst): first pass time = 0.10's, 232.827'MB/sec 2024/11/23-16:22:29.321118 139957626406464 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269212.sst): old prealloc_size = 147639500, real_size = 7072832 2024/11/23-16:22:29.321274 139957626406464 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269212.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 167226 prefix = 4 raw-key = 0.0027 GB zip-key = 0.0003 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.0195 GB zip-val = 0.0067 GB avg-val = 116.32 avg-zval = 40.13 2024/11/23-16:22:29.321441 139957626406464 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269212.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0004 GB, waited 0.000 sec, Key+Value = 0.024 GB 2024/11/23-16:22:29.466481 139957626406464 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00/269212.sst): second pass time = 0.22's, 89.141'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.15's, 53.243'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2384.188'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.343'MB/sec write SST data time = 0.02's, 329.959'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.204'MB, throughput = 6703.600'MB/sec zip my value time = 0.22's, unzip length = 0.019'GB zip my value throughput = 89.141'MB/sec zip pipeline throughput = 89.141'MB/sec entries = 167226 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.32 avg-zval = 40.13 usrkeys = 167226 avg-key = 20.00 avg-zkey = 1.91 avg-val = 123.32 avg-zval = 40.13 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 167226 bytes = 501696 } seq expand size = 1170582 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0033 GB value = 0.0195 GB dict = 0.20 MB all = 0.0241 GB } __ZipSize{ index = 0.0003 GB value = 0.0067 GB dict = 0.20 MB all = 0.0077 GB } UnZip/Zip{ index = 10.4705 value = 2.8982 dict = 1.00 all = 3.1186 } Zip/UnZip{ index = 0.0955 value = 0.3450 dict = 1.00 all = 0.3207 } ---------------------------- total value len = 11.254830 GB avg = 0.156 KB (by entry num) total key len = 1.996003 GB avg = 0.028 KB total ukey len = 1.394436 GB avg = 0.016 KB total ukey num = 0.085378354 Billion total entry num = 0.072186083 Billion write speed all = 0.493747751 MB/sec (with seq num) write speed all = 0.472229577 MB/sec (without seq num) 2024/11/23-16:22:29.483758 139957626406464 [compaction_job.cc:1948] [default] [JOB 30533] Generated table #269212: 167226 keys, 7738689 bytes, temperature: kWarm 2024/11/23-16:22:29.483809 139957626406464 EVENT_LOG_v1 {"time_micros": 1732350149483782, "cf_name": "default", "job": 30533, "event": "table_file_creation", "file_number": 269212, "file_size": 7738689, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4089494166, "largest_seqno": 4104633111, "table_properties": {"data_size": 6711408, "index_size": 319424, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 4682328, "raw_average_key_size": 28, "raw_value_size": 19451248, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 167226, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732350148, "oldest_key_time": 0, "file_creation_time": 1732350148, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 269212, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:22:29.496517 139957626406464 [compaction_job.cc:703] job-30533: subcompact[0], size: 0.806399 G, files: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30533/att-00 [269191,269192,269193,269194,269195,269196,269197,269198,269199,269200,269201,269202,269203,269204,269205,269206,269207,269208,269209,269210,269211,269212] 2024/11/23-16:22:29.624586 139957626406464 (Original Log Time 2024/11/23-16:21:18.952393) EVENT_LOG_v1 {"time_micros": 1732350078952333, "job": 30533, "event": "compaction_started", "compaction_reason": "FilesMarkedForCompaction", "files_L2": [269151], "files_L3": [269095, 269096, 269097, 269098, 269099, 269100, 269101, 269102, 269103, 269104, 269105, 269106, 269107, 269108, 269109, 269110, 269111, 269112, 269113, 269114, 269185], "score": 0.991951, "input_data_size": 824795982, "oldest_snapshot_seqno": 4104956722} 2024/11/23-16:22:29.624590 139957626406464 (Original Log Time 2024/11/23-16:22:29.622706) [compaction_job.cc:2022] [default] [JOB 30533] Compacted 1@2 + 21@3 files to L3 => 806399316 bytes 2024/11/23-16:22:29.624592 139957626406464 (Original Log Time 2024/11/23-16:22:29.624513) [compaction_job.cc:1224] [default] compacted to: files[0 0 0 22 0 0 0] max score 0.03, MB/sec: 11.7 rd, 11.4 wr, level 3, files in(1, 21) out(22 +0 blob) MB in(25.2, 761.4 +0.0 blob) out(769.0 +0.0 blob), read-write-amplify(61.8) write-amplify(30.6) OK, records in: 19876889, records dropped: 48970 output_compression: Snappy 2024/11/23-16:22:29.624595 139957626406464 (Original Log Time 2024/11/23-16:22:29.624559) EVENT_LOG_v1 {"time_micros": 1732350149624537, "cf": "default", "job": 30533, "event": "compaction_finished", "compaction_time_micros": 70544127, "compaction_time_cpu_micros": 30003751, "output_level": 3, "num_output_files": 22, "total_output_size": 806399316, "num_input_records": 19876889, "num_output_records": 19827919, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "file_write_nanos": 570933246, "file_range_sync_nanos": 0, "file_fsync_nanos": 16433, "file_prepare_write_nanos": 65542, "lsm_state": [0, 0, 0, 22, 0, 0, 0]} 2024/11/23-16:22:29.754340 139957626406464 DEBG dcompact_worker.cpp:240: HttpPost: 200 OK: url = http://nlb-7zny4kaa1poal01o64.cn-shenzhen.nlb.aliyuncs.com:8443, body = {"instanceId":"nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137","labourId":"","dbId":"d89b4006-2803-486e-b7a2-759bcf348921","dbStarts":1732256054,"starts":1732350078,"executesMs":70826,"compactionJobId":30533,"attempt":0,"compactionInputRawBytes":2849661119,"compactionInputZipBytes":824795982,"compactionOutputRawBytes":0,"compactionOutputZipBytes":806399316,"headers":{"Accept":"*/*","Connection":"close","Host":"aliyun-topling-saas.topling.cn:18443","RemoteIp":"120.24.192.169","X-Forwarded-For":"120.24.192.169","region":"cn-shenzhen","token":"e6474c481bd4415abc537135cc03626b","instance-token":"e6474c481bd4415abc537135cc03626b","provider":"aliyun","CloudMarketInstanceId":"si-59c0ae5c955845588903","MeteringAssit":"","Transfer-Encoding":"chunked","traceparent":"00-b40d4a471eb844dd7a2cb0194730b4be-44c361cc5fe121f8-00"}}, response = 2024/11/23-16:22:29.754430 139957626406464 INFO dcompact_worker.cpp:1459: finish /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-30533/att-00: olev 3, work 70.827 s, result 6.022 ms, install 1.914 ms, input{raw 2.654 GiB zip 786.587 MiB}