2024/11/23-14:39:35.992776 139957534086720 DEBG dcompact_worker.cpp:2214: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00: fork to child time = 0.022217 sec 2024/11/23-14:39:35.993703 139957534086720 DEBG dcompact_worker.cpp:1013: Beg SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00 2024/11/23-14:39:36.002157 139957534086720 DEBG dcompact_worker.cpp:1033: End SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00 2024/11/23-14:39:36.003366 139957534086720 TRAC dcompact_worker.cpp:1083: INFO_LOG_LEVEL: rpc = INFO_LEVEL, env_var = undefined 2024/11/23-14:39:36.003727 139957534086720 [WARN] [column_family.cc:386] multiple cf_paths/db_paths and level_compaction_dynamic_level_bytes can't be used together 2024/11/23-14:39:36.065128 139957534086720 [version_set.cc:6208] Recovering from manifest file: /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-28142/att-00/MANIFEST-206347 2024/11/23-14:39:36.100338 139957534086720 [version_set.cc:6251] Recovered from manifest file:/worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-28142/att-00/MANIFEST-206347 succeeded,manifest_file_number is 206347, next_file_number is 263958, last_sequence is 4032328896, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 263764 2024/11/23-14:39:36.100350 139957534086720 [version_set.cc:6266] Column family [default] (ID 0), log number is 0 2024/11/23-14:39:36.100503 139957534086720 [version_set.cc:5721] Creating manifest 263958 2024/11/23-14:39:36.144446 139957534086720 DEBG dcompact_worker.cpp:1218: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00: bottommost_level: fake = 1, rpc = 0 2024/11/23-14:39:36.168965 139957534086720 [compaction_job.cc:2437] [default] [JOB 28142] Compacting 1@2 + 28@3 files to L3, score 1.00, subcompactions 1 : 1 2024/11/23-14:39:36.168997 139957534086720 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 21021 Base level 2, inputs: [263942(27MB)], [263951(39MB) 263952(3384KB) 263910(37MB) 263911(34MB) 263912(34MB) 263913(35MB) 263914(34MB) 263915(34MB) 263916(34MB) 263917(36MB) 263918(34MB) 263919(34MB) 263920(35MB) 263921(36MB) 263922(35MB) 263923(36MB) 263924(37MB) 263925(35MB) 263926(35MB) 263927(36MB) 263928(33MB) 263929(37MB) 263930(33MB) 263931(33MB) 263932(35MB) 263933(39MB) 263934(5797KB) 263944(40MB)] 2024/11/23-14:39:36.175912 139957534086720 [top_zip_table.cc:59] core git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-14:39:36.175942 139957534086720 [top_zip_table.cc:60] fsa git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-14:39:36.175961 139957534086720 [top_zip_table.cc:61] zbs git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-14:39:36.175967 139957534086720 [top_zip_table.cc:62] topling-zip_table_reader: git_version_hash_info_is: commit a4a382006cb82713acf5b3425835f22711877681 Author: leipeng Date: 2024-04-11 19:44:14 +0800 fixed_len_hole_index.cc: Add env bool FixedLenHoleIndexUseAVX512 for ut & debug 1. FixedLenHoleIndexUseAVX512 is only in unit tests or debug 2. In release mode, use avx512 by compile options(-march=) g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/23-14:39:36.175990 139957534086720 [top_zip_table.cc:64] topling-rocks git_version_hash_info_is: commit feab587e468621ba0204d47b4ffacc52e7c4290d Author: leipeng Date: 2024-03-22 13:35:06 +0800 ToplingZipTableBuilder::Add: immediately return after error This function returns void, and caller does not check builder->status() after calling this function and graceful abandon. So immediately return after error, and return error status in Finish(). g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/23-14:39:36.893196 139957534086720 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263959.sst) /dev/shm/ToplingTemp/Topling-77718-956ONS 2024/11/23-14:39:37.644547 139957534086720 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263959.sst): first pass time = 0.75's, 178.645'MB/sec 2024/11/23-14:39:39.052736 139957534086720 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263959.sst): old prealloc_size = 147639500, real_size = 37965664 2024/11/23-14:39:39.053430 139957534086720 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263959.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 924102 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0360 GB avg-val = 117.24 avg-zval = 38.93 2024/11/23-14:39:39.054236 139957534086720 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263959.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-14:39:40.080241 139957534086720 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263959.sst): second pass time = 1.41's, 76.997'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.03's, 40.594'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2619.337'MB/sec (index lex order gen) rebuild zvType time = 0.82's, 0.280'MB/sec write SST data time = 0.20's, 206.619'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.082'MB, throughput = 37407.571'MB/sec zip my value time = 1.41's, unzip length = 0.108'GB zip my value throughput = 76.997'MB/sec zip pipeline throughput = 76.997'MB/sec entries = 924102 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.24 avg-zval = 38.93 usrkeys = 924102 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.24 avg-zval = 38.93 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 924102 bytes = 2887840 } seq expand size = 6468714 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0360 GB dict = 1.08 MB all = 0.0417 GB } UnZip/Zip{ index = 10.5134 value = 3.0115 dict = 1.00 all = 3.2179 } Zip/UnZip{ index = 0.0951 value = 0.3321 dict = 1.00 all = 0.3108 } ---------------------------- total value len = 8.963431 GB avg = 0.168 KB (by entry num) total key len = 1.466696 GB avg = 0.028 KB total ukey len = 1.016360 GB avg = 0.015 KB total ukey num = 0.066474537 Billion total entry num = 0.053282266 Billion write speed all = 0.504654304 MB/sec (with seq num) write speed all = 0.484030107 MB/sec (without seq num) 2024/11/23-14:39:40.131659 139957534086720 [compaction_job.cc:1948] [default] [JOB 28142] Generated table #263959: 924102 keys, 41710318 bytes, temperature: kWarm 2024/11/23-14:39:40.131775 139957534086720 EVENT_LOG_v1 {"time_micros": 1732343980131707, "cf_name": "default", "job": 28142, "event": "table_file_creation", "file_number": 263959, "file_size": 41710318, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4012777827, "largest_seqno": 4031990717, "table_properties": {"data_size": 35976528, "index_size": 1757952, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25874856, "raw_average_key_size": 28, "raw_value_size": 108342876, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 924102, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732343976, "oldest_key_time": 0, "file_creation_time": 1732343976, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 263959, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-14:39:40.171582 139957534086720 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263960.sst) /dev/shm/ToplingTemp/Topling-77718-jdistS 2024/11/23-14:39:41.522318 139957534086720 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263960.sst): first pass time = 1.35's, 99.369'MB/sec 2024/11/23-14:39:43.116157 139957534086720 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263960.sst): old prealloc_size = 147639500, real_size = 35832496 2024/11/23-14:39:43.116711 139957534086720 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263960.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 925184 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1083 GB zip-val = 0.0338 GB avg-val = 117.07 avg-zval = 36.57 2024/11/23-14:39:43.117495 139957534086720 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263960.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-14:39:43.961787 139957534086720 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263960.sst): second pass time = 1.59's, 68.088'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.85's, 47.357'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3312.096'MB/sec (index lex order gen) rebuild zvType time = 0.72's, 0.321'MB/sec write SST data time = 0.13's, 319.778'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 35677.892'MB/sec zip my value time = 1.59's, unzip length = 0.108'GB zip my value throughput = 68.088'MB/sec zip pipeline throughput = 69.567'MB/sec entries = 925184 avg-key = 28.00 avg-zkey = 1.91 avg-val = 117.07 avg-zval = 36.57 usrkeys = 925184 avg-key = 20.00 avg-zkey = 1.91 avg-val = 124.07 avg-zval = 36.57 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 925184 bytes = 3353808 } seq expand size = 6476288 multi value expand size = 0 cnt WriteAppend = 16 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0338 GB dict = 1.08 MB all = 0.0400 GB } UnZip/Zip{ index = 10.4447 value = 3.2017 dict = 1.00 all = 3.3517 } Zip/UnZip{ index = 0.0957 value = 0.3123 dict = 1.00 all = 0.2984 } ---------------------------- total value len = 9.078220 GB avg = 0.167 KB (by entry num) total key len = 1.492601 GB avg = 0.028 KB total ukey len = 1.034864 GB avg = 0.015 KB total ukey num = 0.067399721 Billion total entry num = 0.054207450 Billion write speed all = 0.511365650 MB/sec (with seq num) write speed all = 0.490387278 MB/sec (without seq num) 2024/11/23-14:39:44.011554 139957534086720 [compaction_job.cc:1948] [default] [JOB 28142] Generated table #263960: 925184 keys, 40045108 bytes, temperature: kWarm 2024/11/23-14:39:44.011621 139957534086720 EVENT_LOG_v1 {"time_micros": 1732343984011588, "cf_name": "default", "job": 28142, "event": "table_file_creation", "file_number": 263960, "file_size": 40045108, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3583362754, "largest_seqno": 4031990527, "table_properties": {"data_size": 33829408, "index_size": 1771584, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25905152, "raw_average_key_size": 28, "raw_value_size": 108312644, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 925184, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732343980, "oldest_key_time": 0, "file_creation_time": 1732343980, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 263960, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-14:39:44.050542 139957534086720 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263961.sst) /dev/shm/ToplingTemp/Topling-77718-udoDHS 2024/11/23-14:39:45.086925 139957534086720 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263961.sst): first pass time = 1.04's, 129.511'MB/sec 2024/11/23-14:39:46.880858 139957534086720 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263961.sst): old prealloc_size = 147639500, real_size = 31255872 2024/11/23-14:39:46.881422 139957534086720 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263961.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 931642 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1081 GB zip-val = 0.0292 GB avg-val = 116.07 avg-zval = 31.38 2024/11/23-14:39:46.882348 139957534086720 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263961.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-14:39:47.814178 139957534086720 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263961.sst): second pass time = 1.79's, 60.303'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.93's, 38.021'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3293.814'MB/sec (index lex order gen) rebuild zvType time = 0.72's, 0.323'MB/sec write SST data time = 0.21's, 167.652'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 28509.705'MB/sec zip my value time = 1.79's, unzip length = 0.108'GB zip my value throughput = 60.303'MB/sec zip pipeline throughput = 133.710'MB/sec entries = 931642 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.07 avg-zval = 31.38 usrkeys = 931642 avg-key = 20.00 avg-zkey = 1.91 avg-val = 123.07 avg-zval = 31.38 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 931642 bytes = 3377216 } seq expand size = 6521494 multi value expand size = 0 cnt WriteAppend = 15 UnZipSize{ index = 0.0186 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0292 GB dict = 1.08 MB all = 0.0355 GB } UnZip/Zip{ index = 10.4455 value = 3.6982 dict = 1.00 all = 3.7825 } Zip/UnZip{ index = 0.0957 value = 0.2704 dict = 1.00 all = 0.2644 } ---------------------------- total value len = 9.192874 GB avg = 0.167 KB (by entry num) total key len = 1.518687 GB avg = 0.028 KB total ukey len = 1.053497 GB avg = 0.015 KB total ukey num = 0.068331363 Billion total entry num = 0.055139092 Billion write speed all = 0.518077393 MB/sec (with seq num) write speed all = 0.496742450 MB/sec (without seq num) 2024/11/23-14:39:47.864736 139957534086720 [compaction_job.cc:1948] [default] [JOB 28142] Generated table #263961: 931642 keys, 35484098 bytes, temperature: kWarm 2024/11/23-14:39:47.864829 139957534086720 EVENT_LOG_v1 {"time_micros": 1732343987864779, "cf_name": "default", "job": 28142, "event": "table_file_creation", "file_number": 263961, "file_size": 35484098, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3621075956, "largest_seqno": 4012776122, "table_properties": {"data_size": 29238960, "index_size": 1783808, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26085976, "raw_average_key_size": 28, "raw_value_size": 108131812, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 931642, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732343984, "oldest_key_time": 0, "file_creation_time": 1732343984, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 263961, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-14:39:47.926604 139957534086720 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263962.sst) /dev/shm/ToplingTemp/Topling-77718-DuQS6T 2024/11/23-14:39:49.012863 139957534086720 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263962.sst): first pass time = 1.09's, 123.568'MB/sec 2024/11/23-14:39:50.509248 139957534086720 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263962.sst): old prealloc_size = 147639500, real_size = 31396160 2024/11/23-14:39:50.509909 139957534086720 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263962.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 931352 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1081 GB zip-val = 0.0294 GB avg-val = 116.11 avg-zval = 31.55 2024/11/23-14:39:50.510861 139957534086720 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263962.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-14:39:51.544048 139957534086720 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263962.sst): second pass time = 1.50's, 72.306'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.03's, 34.539'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2783.321'MB/sec (index lex order gen) rebuild zvType time = 0.89's, 0.262'MB/sec write SST data time = 0.15's, 244.955'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 30943.502'MB/sec zip my value time = 1.50's, unzip length = 0.108'GB zip my value throughput = 72.306'MB/sec zip pipeline throughput = 72.306'MB/sec entries = 931352 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.11 avg-zval = 31.55 usrkeys = 931352 avg-key = 20.00 avg-zkey = 1.91 avg-val = 123.11 avg-zval = 31.55 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 931352 bytes = 3492592 } seq expand size = 6519464 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0186 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0294 GB dict = 1.08 MB all = 0.0357 GB } UnZip/Zip{ index = 10.4483 value = 3.6807 dict = 1.00 all = 3.7554 } Zip/UnZip{ index = 0.0957 value = 0.2717 dict = 1.00 all = 0.2663 } ---------------------------- total value len = 9.307533 GB avg = 0.166 KB (by entry num) total key len = 1.544765 GB avg = 0.028 KB total ukey len = 1.072124 GB avg = 0.015 KB total ukey num = 0.069262715 Billion total entry num = 0.056070444 Billion write speed all = 0.524789647 MB/sec (with seq num) write speed all = 0.503098250 MB/sec (without seq num) 2024/11/23-14:39:51.590360 139957534086720 [compaction_job.cc:1948] [default] [JOB 28142] Generated table #263962: 931352 keys, 35740060 bytes, temperature: kWarm 2024/11/23-14:39:51.590433 139957534086720 EVENT_LOG_v1 {"time_micros": 1732343991590394, "cf_name": "default", "job": 28142, "event": "table_file_creation", "file_number": 263962, "file_size": 35740060, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3376774746, "largest_seqno": 4012776133, "table_properties": {"data_size": 29380336, "index_size": 1782784, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26077856, "raw_average_key_size": 28, "raw_value_size": 108139968, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 931352, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732343987, "oldest_key_time": 0, "file_creation_time": 1732343987, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 263962, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-14:39:51.626771 139957534086720 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263963.sst) /dev/shm/ToplingTemp/Topling-77718-Vh3p3T 2024/11/23-14:39:52.573753 139957534086720 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263963.sst): first pass time = 0.95's, 141.737'MB/sec 2024/11/23-14:39:53.900777 139957534086720 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263963.sst): old prealloc_size = 147639500, real_size = 33275568 2024/11/23-14:39:53.901302 139957534086720 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263963.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 928076 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1082 GB zip-val = 0.0313 GB avg-val = 116.62 avg-zval = 33.69 2024/11/23-14:39:53.902085 139957534086720 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263963.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-14:39:54.757812 139957534086720 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263963.sst): second pass time = 1.33's, 81.602'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.86's, 43.749'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3480.694'MB/sec (index lex order gen) rebuild zvType time = 0.73's, 0.318'MB/sec write SST data time = 0.13's, 296.522'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 34047.925'MB/sec zip my value time = 1.33's, unzip length = 0.108'GB zip my value throughput = 81.602'MB/sec zip pipeline throughput = 81.602'MB/sec entries = 928076 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.62 avg-zval = 33.69 usrkeys = 928076 avg-key = 20.00 avg-zkey = 1.91 avg-val = 123.62 avg-zval = 33.69 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 928076 bytes = 3364288 } seq expand size = 6496532 multi value expand size = 0 cnt WriteAppend = 15 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0313 GB dict = 1.08 MB all = 0.0375 GB } UnZip/Zip{ index = 10.4445 value = 3.4616 dict = 1.00 all = 3.5798 } Zip/UnZip{ index = 0.0957 value = 0.2889 dict = 1.00 all = 0.2793 } ---------------------------- total value len = 9.422261 GB avg = 0.165 KB (by entry num) total key len = 1.570751 GB avg = 0.028 KB total ukey len = 1.090685 GB avg = 0.016 KB total ukey num = 0.070190791 Billion total entry num = 0.056998520 Billion write speed all = 0.531511637 MB/sec (with seq num) write speed all = 0.509464630 MB/sec (without seq num) 2024/11/23-14:39:54.806100 139957534086720 [compaction_job.cc:1948] [default] [JOB 28142] Generated table #263963: 928076 keys, 37493576 bytes, temperature: kWarm 2024/11/23-14:39:54.806171 139957534086720 EVENT_LOG_v1 {"time_micros": 1732343994806137, "cf_name": "default", "job": 28142, "event": "table_file_creation", "file_number": 263963, "file_size": 37493576, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3563652023, "largest_seqno": 4012776149, "table_properties": {"data_size": 31266208, "index_size": 1777152, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25986128, "raw_average_key_size": 28, "raw_value_size": 108231736, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 928076, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732343991, "oldest_key_time": 0, "file_creation_time": 1732343991, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 263963, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-14:39:54.844877 139957534086720 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263964.sst) /dev/shm/ToplingTemp/Topling-77718-HXMljU 2024/11/23-14:39:56.141880 139957534086720 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263964.sst): first pass time = 1.30's, 103.486'MB/sec 2024/11/23-14:39:57.776805 139957534086720 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263964.sst): old prealloc_size = 147639500, real_size = 32385856 2024/11/23-14:39:57.777412 139957534086720 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263964.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 934454 prefix = 4 raw-key = 0.0150 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1081 GB zip-val = 0.0304 GB avg-val = 115.63 avg-zval = 32.50 2024/11/23-14:39:57.778213 139957534086720 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263964.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-14:39:58.638709 139957534086720 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263964.sst): second pass time = 1.63's, 66.123'MB/sec, value only(80.5% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.86's, 42.357'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3043.606'MB/sec (index lex order gen) rebuild zvType time = 0.74's, 0.317'MB/sec write SST data time = 0.13's, 291.403'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 36444.880'MB/sec zip my value time = 1.63's, unzip length = 0.108'GB zip my value throughput = 66.123'MB/sec zip pipeline throughput = 124.350'MB/sec entries = 934454 avg-key = 28.00 avg-zkey = 1.90 avg-val = 115.63 avg-zval = 32.50 usrkeys = 934454 avg-key = 20.00 avg-zkey = 1.90 avg-val = 122.63 avg-zval = 32.50 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 934454 bytes = 3270608 } seq expand size = 6541178 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0187 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0304 GB dict = 1.08 MB all = 0.0365 GB } UnZip/Zip{ index = 10.5133 value = 3.5574 dict = 1.00 all = 3.6765 } Zip/UnZip{ index = 0.0951 value = 0.2811 dict = 1.00 all = 0.2720 } ---------------------------- total value len = 9.536856 GB avg = 0.165 KB (by entry num) total key len = 1.596916 GB avg = 0.028 KB total ukey len = 1.109374 GB avg = 0.016 KB total ukey num = 0.071125245 Billion total entry num = 0.057932974 Billion write speed all = 0.538216336 MB/sec (with seq num) write speed all = 0.515812088 MB/sec (without seq num) 2024/11/23-14:39:58.683723 139957534086720 [compaction_job.cc:1948] [default] [JOB 28142] Generated table #263964: 934454 keys, 36506828 bytes, temperature: kWarm 2024/11/23-14:39:58.683794 139957534086720 EVENT_LOG_v1 {"time_micros": 1732343998683759, "cf_name": "default", "job": 28142, "event": "table_file_creation", "file_number": 263964, "file_size": 36506828, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3759280178, "largest_seqno": 4012776176, "table_properties": {"data_size": 30374384, "index_size": 1777664, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26164712, "raw_average_key_size": 28, "raw_value_size": 108053112, "raw_average_value_size": 115, "num_data_blocks": 1, "num_entries": 934454, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732343994, "oldest_key_time": 0, "file_creation_time": 1732343994, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 263964, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-14:39:58.719405 139957534086720 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263965.sst) /dev/shm/ToplingTemp/Topling-77718-hCHMPS 2024/11/23-14:39:59.725350 139957534086720 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263965.sst): first pass time = 1.01's, 133.430'MB/sec 2024/11/23-14:40:01.042875 139957534086720 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263965.sst): old prealloc_size = 147639500, real_size = 32574656 2024/11/23-14:40:01.043446 139957534086720 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263965.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 931885 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1081 GB zip-val = 0.0306 GB avg-val = 116.03 avg-zval = 32.79 2024/11/23-14:40:01.045347 139957534086720 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263965.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-14:40:01.906232 139957534086720 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263965.sst): second pass time = 1.32's, 82.135'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.86's, 42.494'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3242.884'MB/sec (index lex order gen) rebuild zvType time = 0.73's, 0.317'MB/sec write SST data time = 0.13's, 284.899'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 30961.907'MB/sec zip my value time = 1.32's, unzip length = 0.108'GB zip my value throughput = 82.135'MB/sec zip pipeline throughput = 82.135'MB/sec entries = 931885 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.03 avg-zval = 32.79 usrkeys = 931885 avg-key = 20.00 avg-zkey = 1.91 avg-val = 123.03 avg-zval = 32.79 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 931885 bytes = 3261616 } seq expand size = 6523195 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0306 GB dict = 1.08 MB all = 0.0367 GB } UnZip/Zip{ index = 10.4464 value = 3.5384 dict = 1.00 all = 3.6585 } Zip/UnZip{ index = 0.0957 value = 0.2826 dict = 1.00 all = 0.2733 } ---------------------------- total value len = 9.651504 GB avg = 0.164 KB (by entry num) total key len = 1.623009 GB avg = 0.028 KB total ukey len = 1.128012 GB avg = 0.016 KB total ukey num = 0.072057130 Billion total entry num = 0.058864859 Billion write speed all = 0.544933808 MB/sec (with seq num) write speed all = 0.522172769 MB/sec (without seq num) 2024/11/23-14:40:01.952093 139957534086720 [compaction_job.cc:1948] [default] [JOB 28142] Generated table #263965: 931885 keys, 36686888 bytes, temperature: kWarm 2024/11/23-14:40:01.952166 139957534086720 EVENT_LOG_v1 {"time_micros": 1732344001952131, "cf_name": "default", "job": 28142, "event": "table_file_creation", "file_number": 263965, "file_size": 36686888, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3801926538, "largest_seqno": 4012776192, "table_properties": {"data_size": 30557360, "index_size": 1784128, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26092780, "raw_average_key_size": 28, "raw_value_size": 108125074, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 931885, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732343998, "oldest_key_time": 0, "file_creation_time": 1732343998, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 263965, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-14:40:01.991362 139957534086720 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263966.sst) /dev/shm/ToplingTemp/Topling-77718-CgqxtS 2024/11/23-14:40:03.053431 139957534086720 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263966.sst): first pass time = 1.06's, 126.380'MB/sec 2024/11/23-14:40:04.328762 139957534086720 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263966.sst): old prealloc_size = 147639500, real_size = 34001808 2024/11/23-14:40:04.329420 139957534086720 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263966.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 1087376 prefix = 4 raw-key = 0.0174 GB zip-key = 0.0021 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1038 GB zip-val = 0.0316 GB avg-val = 95.43 avg-zval = 29.10 2024/11/23-14:40:04.329801 139957534086720 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263966.sst: sumWaitingMem = 0.003 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0029 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-14:40:05.051755 139957534086720 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263966.sst): second pass time = 1.27's, 81.421'MB/sec, value only(77.3% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.72's, 49.671'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3325.173'MB/sec (index lex order gen) rebuild zvType time = 0.58's, 0.465'MB/sec write SST data time = 0.14's, 260.315'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.036'MB, throughput = 33181.443'MB/sec zip my value time = 1.27's, unzip length = 0.104'GB zip my value throughput = 81.421'MB/sec zip pipeline throughput = 81.421'MB/sec entries = 1087376 avg-key = 28.00 avg-zkey = 1.91 avg-val = 95.43 avg-zval = 29.10 usrkeys = 1087376 avg-key = 20.00 avg-zkey = 1.91 avg-val = 97.34 avg-zval = 29.10 TagRS{ kinds = RS_Key0_TagN bytes = 170000 } TagArray{ size = 296304 bytes = 963008 } seq expand size = 2074128 multi value expand size = 0 cnt WriteAppend = 16 UnZipSize{ index = 0.0217 GB value = 0.1038 GB dict = 1.04 MB all = 0.1342 GB } __ZipSize{ index = 0.0021 GB value = 0.0316 GB dict = 1.04 MB all = 0.0359 GB } UnZip/Zip{ index = 10.4456 value = 3.2789 dict = 1.00 all = 3.7376 } Zip/UnZip{ index = 0.0957 value = 0.3050 dict = 1.00 all = 0.2676 } ---------------------------- total value len = 9.757349 GB avg = 0.163 KB (by entry num) total key len = 1.653455 GB avg = 0.028 KB total ukey len = 1.149759 GB avg = 0.016 KB total ukey num = 0.073144506 Billion total entry num = 0.059952235 Billion write speed all = 0.551437405 MB/sec (with seq num) write speed all = 0.528259439 MB/sec (without seq num) 2024/11/23-14:40:05.096810 139957534086720 [compaction_job.cc:1948] [default] [JOB 28142] Generated table #263966: 1087376 keys, 35910291 bytes, temperature: kWarm 2024/11/23-14:40:05.096881 139957534086720 EVENT_LOG_v1 {"time_micros": 1732344005096846, "cf_name": "default", "job": 28142, "event": "table_file_creation", "file_number": 263966, "file_size": 35910291, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4012775259, "table_properties": {"data_size": 31647808, "index_size": 2081984, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 30446528, "raw_average_key_size": 28, "raw_value_size": 103771321, "raw_average_value_size": 95, "num_data_blocks": 1, "num_entries": 1087376, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732344001, "oldest_key_time": 0, "file_creation_time": 1732344001, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 263966, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-14:40:05.135185 139957534086720 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263967.sst) /dev/shm/ToplingTemp/Topling-77718-VazsTS 2024/11/23-14:40:06.147415 139957534086720 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263967.sst): first pass time = 1.01's, 132.601'MB/sec 2024/11/23-14:40:07.567786 139957534086720 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263967.sst): old prealloc_size = 147639500, real_size = 36432688 2024/11/23-14:40:07.568365 139957534086720 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263967.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 924163 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1083 GB zip-val = 0.0344 GB avg-val = 117.23 avg-zval = 37.26 2024/11/23-14:40:07.568735 139957534086720 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263967.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-14:40:08.307967 139957534086720 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263967.sst): second pass time = 1.42's, 76.365'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.74's, 52.126'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3265.037'MB/sec (index lex order gen) rebuild zvType time = 0.62's, 0.375'MB/sec write SST data time = 0.12's, 312.953'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.082'MB, throughput = 34675.535'MB/sec zip my value time = 1.42's, unzip length = 0.108'GB zip my value throughput = 76.365'MB/sec zip pipeline throughput = 76.365'MB/sec entries = 924163 avg-key = 28.00 avg-zkey = 1.91 avg-val = 117.23 avg-zval = 37.26 usrkeys = 924163 avg-key = 20.00 avg-zkey = 1.91 avg-val = 119.71 avg-zval = 37.26 TagRS{ kinds = RS_Key0_TagN bytes = 144520 } TagArray{ size = 326832 bytes = 1143920 } seq expand size = 2287824 multi value expand size = 0 cnt WriteAppend = 16 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0344 GB dict = 1.08 MB all = 0.0386 GB } UnZip/Zip{ index = 10.4453 value = 3.1465 dict = 1.00 all = 3.4788 } Zip/UnZip{ index = 0.0957 value = 0.3178 dict = 1.00 all = 0.2875 } ---------------------------- total value len = 9.867978 GB avg = 0.162 KB (by entry num) total key len = 1.679332 GB avg = 0.028 KB total ukey len = 1.168243 GB avg = 0.016 KB total ukey num = 0.074068669 Billion total entry num = 0.060876398 Billion write speed all = 0.557946362 MB/sec (with seq num) write speed all = 0.534414810 MB/sec (without seq num) 2024/11/23-14:40:08.356285 139957534086720 [compaction_job.cc:1948] [default] [JOB 28142] Generated table #263967: 924163 keys, 38581529 bytes, temperature: kWarm 2024/11/23-14:40:08.356361 139957534086720 EVENT_LOG_v1 {"time_micros": 1732344008356324, "cf_name": "default", "job": 28142, "event": "table_file_creation", "file_number": 263967, "file_size": 38581529, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3444198677, "table_properties": {"data_size": 34431904, "index_size": 1769536, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25876564, "raw_average_key_size": 28, "raw_value_size": 108341182, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 924163, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732344005, "oldest_key_time": 0, "file_creation_time": 1732344005, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 263967, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-14:40:08.392277 139957534086720 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263968.sst) /dev/shm/ToplingTemp/Topling-77718-ojWCYQ 2024/11/23-14:40:09.225714 139957534086720 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263968.sst): first pass time = 0.83's, 161.048'MB/sec 2024/11/23-14:40:10.502849 139957534086720 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263968.sst): old prealloc_size = 147639500, real_size = 31982656 2024/11/23-14:40:10.503412 139957534086720 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263968.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 931429 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1081 GB zip-val = 0.0300 GB avg-val = 116.10 avg-zval = 32.18 2024/11/23-14:40:10.504273 139957534086720 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263968.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-14:40:11.342344 139957534086720 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263968.sst): second pass time = 1.28's, 84.727'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.84's, 43.273'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3267.009'MB/sec (index lex order gen) rebuild zvType time = 0.71's, 0.326'MB/sec write SST data time = 0.12's, 290.925'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 34038.763'MB/sec zip my value time = 1.28's, unzip length = 0.108'GB zip my value throughput = 84.727'MB/sec zip pipeline throughput = 84.727'MB/sec entries = 931429 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.10 avg-zval = 32.18 usrkeys = 931429 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.10 avg-zval = 32.18 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 931429 bytes = 3492880 } seq expand size = 6520003 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0300 GB dict = 1.08 MB all = 0.0363 GB } UnZip/Zip{ index = 10.5145 value = 3.6072 dict = 1.00 all = 3.6947 } Zip/UnZip{ index = 0.0951 value = 0.2772 dict = 1.00 all = 0.2707 } ---------------------------- total value len = 9.982636 GB avg = 0.162 KB (by entry num) total key len = 1.705412 GB avg = 0.028 KB total ukey len = 1.186871 GB avg = 0.016 KB total ukey num = 0.075000098 Billion total entry num = 0.061807827 Billion write speed all = 0.564663783 MB/sec (with seq num) write speed all = 0.540775693 MB/sec (without seq num) 2024/11/23-14:40:11.386036 139957534086720 [compaction_job.cc:1948] [default] [JOB 28142] Generated table #263968: 931429 keys, 36326876 bytes, temperature: kWarm 2024/11/23-14:40:11.386106 139957534086720 EVENT_LOG_v1 {"time_micros": 1732344011386070, "cf_name": "default", "job": 28142, "event": "table_file_creation", "file_number": 263968, "file_size": 36326876, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3444201104, "largest_seqno": 4012775885, "table_properties": {"data_size": 29977904, "index_size": 1771712, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26080012, "raw_average_key_size": 28, "raw_value_size": 108137762, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 931429, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732344008, "oldest_key_time": 0, "file_creation_time": 1732344008, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 263968, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-14:40:11.420654 139957534086720 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263969.sst) /dev/shm/ToplingTemp/Topling-77718-t7hMKQ 2024/11/23-14:40:12.241024 139957534086720 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263969.sst): first pass time = 0.82's, 163.615'MB/sec 2024/11/23-14:40:13.530180 139957534086720 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263969.sst): old prealloc_size = 147639500, real_size = 31676864 2024/11/23-14:40:13.530744 139957534086720 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263969.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 931309 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1081 GB zip-val = 0.0297 GB avg-val = 116.12 avg-zval = 31.86 2024/11/23-14:40:13.531517 139957534086720 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263969.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-14:40:14.367187 139957534086720 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263969.sst): second pass time = 1.29's, 83.975'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.84's, 42.758'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3285.749'MB/sec (index lex order gen) rebuild zvType time = 0.71's, 0.327'MB/sec write SST data time = 0.12's, 287.170'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 37038.467'MB/sec zip my value time = 1.29's, unzip length = 0.108'GB zip my value throughput = 83.975'MB/sec zip pipeline throughput = 83.975'MB/sec entries = 931309 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.12 avg-zval = 31.86 usrkeys = 931309 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.12 avg-zval = 31.86 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 931309 bytes = 3259600 } seq expand size = 6519163 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0297 GB dict = 1.08 MB all = 0.0358 GB } UnZip/Zip{ index = 10.5123 value = 3.6446 dict = 1.00 all = 3.7504 } Zip/UnZip{ index = 0.0951 value = 0.2744 dict = 1.00 all = 0.2666 } ---------------------------- total value len = 10.097296 GB avg = 0.161 KB (by entry num) total key len = 1.731488 GB avg = 0.028 KB total ukey len = 1.205497 GB avg = 0.016 KB total ukey num = 0.075931407 Billion total entry num = 0.062739136 Billion write speed all = 0.571379459 MB/sec (with seq num) write speed all = 0.547134971 MB/sec (without seq num) 2024/11/23-14:40:14.410693 139957534086720 [compaction_job.cc:1948] [default] [JOB 28142] Generated table #263969: 931309 keys, 35787868 bytes, temperature: kWarm 2024/11/23-14:40:14.410766 139957534086720 EVENT_LOG_v1 {"time_micros": 1732344014410725, "cf_name": "default", "job": 28142, "event": "table_file_creation", "file_number": 263969, "file_size": 35787868, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3807172320, "largest_seqno": 4012775902, "table_properties": {"data_size": 29671984, "index_size": 1771840, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26076652, "raw_average_key_size": 28, "raw_value_size": 108141150, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 931309, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732344011, "oldest_key_time": 0, "file_creation_time": 1732344011, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 263969, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-14:40:14.445402 139957534086720 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263970.sst) /dev/shm/ToplingTemp/Topling-77718-jXizYP 2024/11/23-14:40:15.292130 139957534086720 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263970.sst): first pass time = 0.85's, 158.519'MB/sec 2024/11/23-14:40:16.590227 139957534086720 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263970.sst): old prealloc_size = 147639500, real_size = 31941424 2024/11/23-14:40:16.590776 139957534086720 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263970.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 931462 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1081 GB zip-val = 0.0299 GB avg-val = 116.09 avg-zval = 32.14 2024/11/23-14:40:16.591584 139957534086720 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263970.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-14:40:17.430251 139957534086720 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263970.sst): second pass time = 1.30's, 83.353'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.84's, 43.198'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3372.947'MB/sec (index lex order gen) rebuild zvType time = 0.71's, 0.326'MB/sec write SST data time = 0.13's, 289.611'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 27939.058'MB/sec zip my value time = 1.30's, unzip length = 0.108'GB zip my value throughput = 83.353'MB/sec zip pipeline throughput = 83.353'MB/sec entries = 931462 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.09 avg-zval = 32.14 usrkeys = 931462 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.09 avg-zval = 32.14 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 931462 bytes = 3492992 } seq expand size = 6520234 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0299 GB dict = 1.08 MB all = 0.0363 GB } UnZip/Zip{ index = 10.5122 value = 3.6122 dict = 1.00 all = 3.6989 } Zip/UnZip{ index = 0.0951 value = 0.2768 dict = 1.00 all = 0.2703 } ---------------------------- total value len = 10.211954 GB avg = 0.160 KB (by entry num) total key len = 1.757569 GB avg = 0.028 KB total ukey len = 1.224127 GB avg = 0.016 KB total ukey num = 0.076862869 Billion total entry num = 0.063670598 Billion write speed all = 0.578092157 MB/sec (with seq num) write speed all = 0.553491361 MB/sec (without seq num) 2024/11/23-14:40:17.474718 139957534086720 [compaction_job.cc:1948] [default] [JOB 28142] Generated table #263970: 931462 keys, 36285720 bytes, temperature: kWarm 2024/11/23-14:40:17.474799 139957534086720 EVENT_LOG_v1 {"time_micros": 1732344017474753, "cf_name": "default", "job": 28142, "event": "table_file_creation", "file_number": 263970, "file_size": 36285720, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3273701103, "largest_seqno": 4012775918, "table_properties": {"data_size": 29936224, "index_size": 1772160, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26080936, "raw_average_key_size": 28, "raw_value_size": 108136860, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 931462, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732344014, "oldest_key_time": 0, "file_creation_time": 1732344014, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 263970, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-14:40:17.513145 139957534086720 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263971.sst) /dev/shm/ToplingTemp/Topling-77718-X6kkkR 2024/11/23-14:40:18.545678 139957534086720 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263971.sst): first pass time = 1.03's, 129.994'MB/sec 2024/11/23-14:40:19.862216 139957534086720 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263971.sst): old prealloc_size = 147639500, real_size = 33286400 2024/11/23-14:40:19.862747 139957534086720 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263971.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 925405 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0313 GB avg-val = 117.04 avg-zval = 33.82 2024/11/23-14:40:19.863567 139957534086720 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263971.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-14:40:20.703560 139957534086720 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263971.sst): second pass time = 1.32's, 82.342'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.84's, 44.568'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3456.617'MB/sec (index lex order gen) rebuild zvType time = 0.72's, 0.323'MB/sec write SST data time = 0.12's, 300.501'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 24406.189'MB/sec zip my value time = 1.32's, unzip length = 0.108'GB zip my value throughput = 82.342'MB/sec zip pipeline throughput = 82.342'MB/sec entries = 925405 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.04 avg-zval = 33.82 usrkeys = 925405 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.04 avg-zval = 33.82 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 925405 bytes = 3354608 } seq expand size = 6477835 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0313 GB dict = 1.08 MB all = 0.0375 GB } UnZip/Zip{ index = 10.5141 value = 3.4609 dict = 1.00 all = 3.5795 } Zip/UnZip{ index = 0.0951 value = 0.2889 dict = 1.00 all = 0.2794 } ---------------------------- total value len = 10.326738 GB avg = 0.160 KB (by entry num) total key len = 1.783481 GB avg = 0.028 KB total ukey len = 1.242635 GB avg = 0.016 KB total ukey num = 0.077788274 Billion total entry num = 0.064596003 Billion write speed all = 0.584794882 MB/sec (with seq num) write speed all = 0.559840477 MB/sec (without seq num) 2024/11/23-14:40:20.749112 139957534086720 [compaction_job.cc:1948] [default] [JOB 28142] Generated table #263971: 925405 keys, 37495966 bytes, temperature: kWarm 2024/11/23-14:40:20.749185 139957534086720 EVENT_LOG_v1 {"time_micros": 1732344020749147, "cf_name": "default", "job": 28142, "event": "table_file_creation", "file_number": 263971, "file_size": 37495966, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3623676327, "largest_seqno": 4012775947, "table_properties": {"data_size": 31294576, "index_size": 1760320, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25911340, "raw_average_key_size": 28, "raw_value_size": 108306414, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 925405, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732344017, "oldest_key_time": 0, "file_creation_time": 1732344017, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 263971, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-14:40:20.785601 139957534086720 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263972.sst) /dev/shm/ToplingTemp/Topling-77718-fqsAaU 2024/11/23-14:40:21.617706 139957534086720 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263972.sst): first pass time = 0.83's, 161.308'MB/sec 2024/11/23-14:40:22.903907 139957534086720 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263972.sst): old prealloc_size = 147639500, real_size = 33771856 2024/11/23-14:40:22.904451 139957534086720 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263972.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 922724 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1084 GB zip-val = 0.0318 GB avg-val = 117.46 avg-zval = 34.44 2024/11/23-14:40:22.905553 139957534086720 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263972.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-14:40:23.763414 139957534086720 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263972.sst): second pass time = 1.29's, 84.320'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.86's, 44.184'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3393.978'MB/sec (index lex order gen) rebuild zvType time = 0.73's, 0.315'MB/sec write SST data time = 0.13's, 301.805'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.083'MB, throughput = 31892.400'MB/sec zip my value time = 1.29's, unzip length = 0.108'GB zip my value throughput = 84.320'MB/sec zip pipeline throughput = 84.320'MB/sec entries = 922724 avg-key = 28.00 avg-zkey = 1.91 avg-val = 117.46 avg-zval = 34.44 usrkeys = 922724 avg-key = 20.00 avg-zkey = 1.91 avg-val = 124.46 avg-zval = 34.44 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 922724 bytes = 3344896 } seq expand size = 6459068 multi value expand size = 0 cnt WriteAppend = 15 UnZipSize{ index = 0.0185 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0318 GB dict = 1.08 MB all = 0.0380 GB } UnZip/Zip{ index = 10.4441 value = 3.4110 dict = 1.00 all = 3.5344 } Zip/UnZip{ index = 0.0957 value = 0.2932 dict = 1.00 all = 0.2829 } ---------------------------- total value len = 10.441578 GB avg = 0.159 KB (by entry num) total key len = 1.809317 GB avg = 0.028 KB total ukey len = 1.261089 GB avg = 0.016 KB total ukey num = 0.078710998 Billion total entry num = 0.065518727 Billion write speed all = 0.591500684 MB/sec (with seq num) write speed all = 0.566193556 MB/sec (without seq num) 2024/11/23-14:40:23.809169 139957534086720 [compaction_job.cc:1948] [default] [JOB 28142] Generated table #263972: 922724 keys, 37974954 bytes, temperature: kWarm 2024/11/23-14:40:23.809253 139957534086720 EVENT_LOG_v1 {"time_micros": 1732344023809211, "cf_name": "default", "job": 28142, "event": "table_file_creation", "file_number": 263972, "file_size": 37974954, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3514720078, "largest_seqno": 4012775967, "table_properties": {"data_size": 31774016, "index_size": 1766976, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25836272, "raw_average_key_size": 28, "raw_value_size": 108381600, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 922724, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732344020, "oldest_key_time": 0, "file_creation_time": 1732344020, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 263972, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-14:40:23.848160 139957534086720 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263973.sst) /dev/shm/ToplingTemp/Topling-77718-gNi1eU 2024/11/23-14:40:24.689499 139957534086720 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263973.sst): first pass time = 0.84's, 159.538'MB/sec 2024/11/23-14:40:26.012926 139957534086720 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263973.sst): old prealloc_size = 147639500, real_size = 33719824 2024/11/23-14:40:26.013499 139957534086720 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263973.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 932147 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1081 GB zip-val = 0.0317 GB avg-val = 115.99 avg-zval = 34.02 2024/11/23-14:40:26.015625 139957534086720 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263973.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-14:40:26.863107 139957534086720 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263973.sst): second pass time = 1.32's, 81.790'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.85's, 44.638'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3223.185'MB/sec (index lex order gen) rebuild zvType time = 0.72's, 0.322'MB/sec write SST data time = 0.13's, 299.300'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 33560.281'MB/sec zip my value time = 1.32's, unzip length = 0.108'GB zip my value throughput = 81.790'MB/sec zip pipeline throughput = 81.790'MB/sec entries = 932147 avg-key = 28.00 avg-zkey = 1.90 avg-val = 115.99 avg-zval = 34.02 usrkeys = 932147 avg-key = 20.00 avg-zkey = 1.90 avg-val = 122.99 avg-zval = 34.02 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 932147 bytes = 3379040 } seq expand size = 6525029 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0317 GB dict = 1.08 MB all = 0.0379 GB } UnZip/Zip{ index = 10.5134 value = 3.4092 dict = 1.00 all = 3.5367 } Zip/UnZip{ index = 0.0951 value = 0.2933 dict = 1.00 all = 0.2827 } ---------------------------- total value len = 10.556221 GB avg = 0.159 KB (by entry num) total key len = 1.835417 GB avg = 0.028 KB total ukey len = 1.279732 GB avg = 0.016 KB total ukey num = 0.079643145 Billion total entry num = 0.066450874 Billion write speed all = 0.598206533 MB/sec (with seq num) write speed all = 0.572543196 MB/sec (without seq num) 2024/11/23-14:40:26.909355 139957534086720 [compaction_job.cc:1948] [default] [JOB 28142] Generated table #263973: 932147 keys, 37949454 bytes, temperature: kWarm 2024/11/23-14:40:26.909425 139957534086720 EVENT_LOG_v1 {"time_micros": 1732344026909391, "cf_name": "default", "job": 28142, "event": "table_file_creation", "file_number": 263973, "file_size": 37949454, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3516470397, "largest_seqno": 4012775987, "table_properties": {"data_size": 31713344, "index_size": 1773248, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26100116, "raw_average_key_size": 28, "raw_value_size": 108117614, "raw_average_value_size": 115, "num_data_blocks": 1, "num_entries": 932147, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732344023, "oldest_key_time": 0, "file_creation_time": 1732344023, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 263973, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-14:40:26.953325 139957534086720 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263974.sst) /dev/shm/ToplingTemp/Topling-77718-AlJASS 2024/11/23-14:40:28.000549 139957534086720 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263974.sst): first pass time = 1.05's, 128.171'MB/sec 2024/11/23-14:40:29.341633 139957534086720 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263974.sst): old prealloc_size = 147639500, real_size = 34224176 2024/11/23-14:40:29.342179 139957534086720 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263974.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 930611 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0322 GB avg-val = 116.23 avg-zval = 34.62 2024/11/23-14:40:29.343039 139957534086720 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263974.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-14:40:30.167018 139957534086720 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263974.sst): second pass time = 1.34's, 80.697'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.83's, 46.129'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3351.144'MB/sec (index lex order gen) rebuild zvType time = 0.70's, 0.333'MB/sec write SST data time = 0.13's, 300.086'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 33566.898'MB/sec zip my value time = 1.34's, unzip length = 0.108'GB zip my value throughput = 80.697'MB/sec zip pipeline throughput = 80.697'MB/sec entries = 930611 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.23 avg-zval = 34.62 usrkeys = 930611 avg-key = 20.00 avg-zkey = 1.90 avg-val = 121.94 avg-zval = 34.62 TagRS{ kinds = RS_Key0_TagN bytes = 145520 } TagArray{ size = 759505 bytes = 2848160 } seq expand size = 5316535 multi value expand size = 0 cnt WriteAppend = 15 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0322 GB dict = 1.08 MB all = 0.0381 GB } UnZip/Zip{ index = 10.5155 value = 3.3568 dict = 1.00 all = 3.5253 } Zip/UnZip{ index = 0.0951 value = 0.2979 dict = 1.00 all = 0.2837 } ---------------------------- total value len = 10.669698 GB avg = 0.158 KB (by entry num) total key len = 1.861474 GB avg = 0.028 KB total ukey len = 1.298344 GB avg = 0.016 KB total ukey num = 0.080573756 Billion total entry num = 0.067381485 Billion write speed all = 0.604846086 MB/sec (with seq num) write speed all = 0.578827497 MB/sec (without seq num) 2024/11/23-14:40:30.212532 139957534086720 [compaction_job.cc:1948] [default] [JOB 28142] Generated table #263974: 930611 keys, 38073242 bytes, temperature: kWarm 2024/11/23-14:40:30.212600 139957534086720 EVENT_LOG_v1 {"time_micros": 1732344030212565, "cf_name": "default", "job": 28142, "event": "table_file_creation", "file_number": 263974, "file_size": 38073242, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4012776021, "table_properties": {"data_size": 32221344, "index_size": 1769984, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26057108, "raw_average_key_size": 28, "raw_value_size": 108160714, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 930611, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732344026, "oldest_key_time": 0, "file_creation_time": 1732344026, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 263974, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-14:40:30.256452 139957534086720 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263975.sst) /dev/shm/ToplingTemp/Topling-77718-LZ6VvQ 2024/11/23-14:40:31.231941 139957534086720 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263975.sst): first pass time = 0.98's, 137.596'MB/sec 2024/11/23-14:40:32.528822 139957534086720 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263975.sst): old prealloc_size = 147639500, real_size = 32512336 2024/11/23-14:40:32.529369 139957534086720 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263975.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 929039 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0305 GB avg-val = 116.47 avg-zval = 32.84 2024/11/23-14:40:32.531565 139957534086720 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263975.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-14:40:33.369230 139957534086720 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263975.sst): second pass time = 1.30's, 83.481'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.84's, 43.973'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3374.860'MB/sec (index lex order gen) rebuild zvType time = 0.71's, 0.327'MB/sec write SST data time = 0.13's, 285.252'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 34896.237'MB/sec zip my value time = 1.30's, unzip length = 0.108'GB zip my value throughput = 83.481'MB/sec zip pipeline throughput = 83.481'MB/sec entries = 929039 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.47 avg-zval = 32.84 usrkeys = 929039 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.38 avg-zval = 32.84 TagRS{ kinds = RS_Key0_TagN bytes = 145280 } TagArray{ size = 917148 bytes = 3439312 } seq expand size = 6420036 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0305 GB dict = 1.08 MB all = 0.0370 GB } UnZip/Zip{ index = 10.5137 value = 3.5462 dict = 1.00 all = 3.6321 } Zip/UnZip{ index = 0.0951 value = 0.2820 dict = 1.00 all = 0.2753 } ---------------------------- total value len = 10.784323 GB avg = 0.158 KB (by entry num) total key len = 1.887487 GB avg = 0.028 KB total ukey len = 1.316925 GB avg = 0.016 KB total ukey num = 0.081502795 Billion total entry num = 0.068310524 Billion write speed all = 0.611539779 MB/sec (with seq num) write speed all = 0.585166528 MB/sec (without seq num) 2024/11/23-14:40:33.413852 139957534086720 [compaction_job.cc:1948] [default] [JOB 28142] Generated table #263975: 929039 keys, 36953742 bytes, temperature: kWarm 2024/11/23-14:40:33.413921 139957534086720 EVENT_LOG_v1 {"time_micros": 1732344033413886, "cf_name": "default", "job": 28142, "event": "table_file_creation", "file_number": 263975, "file_size": 36953742, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4012776210, "table_properties": {"data_size": 30512576, "index_size": 1767296, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26013092, "raw_average_key_size": 28, "raw_value_size": 108204770, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 929039, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732344030, "oldest_key_time": 0, "file_creation_time": 1732344030, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 263975, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-14:40:33.450513 139957534086720 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263976.sst) /dev/shm/ToplingTemp/Topling-77718-tfzxiR 2024/11/23-14:40:34.276409 139957534086720 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263976.sst): first pass time = 0.83's, 162.520'MB/sec 2024/11/23-14:40:35.577808 139957534086720 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263976.sst): old prealloc_size = 147639500, real_size = 32182176 2024/11/23-14:40:35.578361 139957534086720 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263976.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 931692 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1081 GB zip-val = 0.0302 GB avg-val = 116.06 avg-zval = 32.39 2024/11/23-14:40:35.579199 139957534086720 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263976.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-14:40:36.424833 139957534086720 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263976.sst): second pass time = 1.30's, 83.135'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.85's, 42.988'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3328.623'MB/sec (index lex order gen) rebuild zvType time = 0.72's, 0.323'MB/sec write SST data time = 0.13's, 288.457'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 34910.975'MB/sec zip my value time = 1.30's, unzip length = 0.108'GB zip my value throughput = 83.135'MB/sec zip pipeline throughput = 83.135'MB/sec entries = 931692 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.06 avg-zval = 32.39 usrkeys = 931692 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.06 avg-zval = 32.39 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 931692 bytes = 3377392 } seq expand size = 6521844 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0186 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0302 GB dict = 1.08 MB all = 0.0364 GB } UnZip/Zip{ index = 10.5136 value = 3.5832 dict = 1.00 all = 3.6862 } Zip/UnZip{ index = 0.0951 value = 0.2791 dict = 1.00 all = 0.2713 } ---------------------------- total value len = 10.898975 GB avg = 0.157 KB (by entry num) total key len = 1.913575 GB avg = 0.028 KB total ukey len = 1.335559 GB avg = 0.016 KB total ukey num = 0.082434487 Billion total entry num = 0.069242216 Billion write speed all = 0.618240686 MB/sec (with seq num) write speed all = 0.591511670 MB/sec (without seq num) 2024/11/23-14:40:36.470120 139957534086720 [compaction_job.cc:1948] [default] [JOB 28142] Generated table #263976: 931692 keys, 36410448 bytes, temperature: kWarm 2024/11/23-14:40:36.470192 139957534086720 EVENT_LOG_v1 {"time_micros": 1732344036470155, "cf_name": "default", "job": 28142, "event": "table_file_creation", "file_number": 263976, "file_size": 36410448, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3512539342, "largest_seqno": 4012776228, "table_properties": {"data_size": 30176720, "index_size": 1772352, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26087376, "raw_average_key_size": 28, "raw_value_size": 108130408, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 931692, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732344033, "oldest_key_time": 0, "file_creation_time": 1732344033, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 263976, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-14:40:36.512650 139957534086720 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263977.sst) /dev/shm/ToplingTemp/Topling-77718-GuSQBQ 2024/11/23-14:40:37.356792 139957534086720 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263977.sst): first pass time = 0.84's, 159.007'MB/sec 2024/11/23-14:40:38.681753 139957534086720 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263977.sst): old prealloc_size = 147639500, real_size = 33739552 2024/11/23-14:40:38.682298 139957534086720 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263977.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 933210 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1081 GB zip-val = 0.0317 GB avg-val = 115.82 avg-zval = 33.99 2024/11/23-14:40:38.683240 139957534086720 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263977.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-14:40:39.529085 139957534086720 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263977.sst): second pass time = 1.32's, 81.655'MB/sec, value only(80.5% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.85's, 44.816'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3423.892'MB/sec (index lex order gen) rebuild zvType time = 0.72's, 0.324'MB/sec write SST data time = 0.13's, 299.179'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 33035.620'MB/sec zip my value time = 1.32's, unzip length = 0.108'GB zip my value throughput = 81.655'MB/sec zip pipeline throughput = 81.655'MB/sec entries = 933210 avg-key = 28.00 avg-zkey = 1.91 avg-val = 115.82 avg-zval = 33.99 usrkeys = 933210 avg-key = 20.00 avg-zkey = 1.91 avg-val = 122.82 avg-zval = 33.99 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 933210 bytes = 3382896 } seq expand size = 6532470 multi value expand size = 0 cnt WriteAppend = 15 UnZipSize{ index = 0.0187 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0317 GB dict = 1.08 MB all = 0.0380 GB } UnZip/Zip{ index = 10.4444 value = 3.4077 dict = 1.00 all = 3.5346 } Zip/UnZip{ index = 0.0957 value = 0.2935 dict = 1.00 all = 0.2829 } ---------------------------- total value len = 11.013596 GB avg = 0.157 KB (by entry num) total key len = 1.939704 GB avg = 0.028 KB total ukey len = 1.354223 GB avg = 0.016 KB total ukey num = 0.083367697 Billion total entry num = 0.070175426 Billion write speed all = 0.624938660 MB/sec (with seq num) write speed all = 0.597853462 MB/sec (without seq num) 2024/11/23-14:40:39.576627 139957534086720 [compaction_job.cc:1948] [default] [JOB 28142] Generated table #263977: 933210 keys, 37972680 bytes, temperature: kWarm 2024/11/23-14:40:39.576697 139957534086720 EVENT_LOG_v1 {"time_micros": 1732344039576661, "cf_name": "default", "job": 28142, "event": "table_file_creation", "file_number": 263977, "file_size": 37972680, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3485447251, "largest_seqno": 4012776268, "table_properties": {"data_size": 31719056, "index_size": 1787008, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26129880, "raw_average_key_size": 28, "raw_value_size": 108087848, "raw_average_value_size": 115, "num_data_blocks": 1, "num_entries": 933210, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732344036, "oldest_key_time": 0, "file_creation_time": 1732344036, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 263977, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-14:40:39.615734 139957534086720 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263978.sst) /dev/shm/ToplingTemp/Topling-77718-mx9ZwR 2024/11/23-14:40:40.601514 139957534086720 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263978.sst): first pass time = 0.99's, 136.159'MB/sec 2024/11/23-14:40:41.883180 139957534086720 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263978.sst): old prealloc_size = 147639500, real_size = 31657104 2024/11/23-14:40:41.883774 139957534086720 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263978.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 926877 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1083 GB zip-val = 0.0297 GB avg-val = 116.81 avg-zval = 31.99 2024/11/23-14:40:41.885868 139957534086720 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263978.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-14:40:42.708109 139957534086720 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263978.sst): second pass time = 1.28's, 84.551'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.82's, 43.626'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3129.577'MB/sec (index lex order gen) rebuild zvType time = 0.70's, 0.333'MB/sec write SST data time = 0.13's, 280.825'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 35897.784'MB/sec zip my value time = 1.28's, unzip length = 0.108'GB zip my value throughput = 84.551'MB/sec zip pipeline throughput = 84.551'MB/sec entries = 926877 avg-key = 28.00 avg-zkey = 1.92 avg-val = 116.81 avg-zval = 31.99 usrkeys = 926877 avg-key = 20.00 avg-zkey = 1.92 avg-val = 123.81 avg-zval = 31.99 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 926877 bytes = 3475808 } seq expand size = 6488139 multi value expand size = 0 cnt WriteAppend = 15 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0297 GB dict = 1.08 MB all = 0.0360 GB } UnZip/Zip{ index = 10.4427 value = 3.6514 dict = 1.00 all = 3.7296 } Zip/UnZip{ index = 0.0958 value = 0.2739 dict = 1.00 all = 0.2681 } ---------------------------- total value len = 11.128349 GB avg = 0.157 KB (by entry num) total key len = 1.965657 GB avg = 0.028 KB total ukey len = 1.372761 GB avg = 0.016 KB total ukey num = 0.084294574 Billion total entry num = 0.071102303 Billion write speed all = 0.631630212 MB/sec (with seq num) write speed all = 0.604191482 MB/sec (without seq num) 2024/11/23-14:40:42.753311 139957534086720 [compaction_job.cc:1948] [default] [JOB 28142] Generated table #263978: 926877 keys, 35987296 bytes, temperature: kWarm 2024/11/23-14:40:42.753383 139957534086720 EVENT_LOG_v1 {"time_micros": 1732344042753348, "cf_name": "default", "job": 28142, "event": "table_file_creation", "file_number": 263978, "file_size": 35987296, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3411274482, "largest_seqno": 4012776300, "table_properties": {"data_size": 29650048, "index_size": 1775168, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25952556, "raw_average_key_size": 28, "raw_value_size": 108265178, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 926877, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732344039, "oldest_key_time": 0, "file_creation_time": 1732344039, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 263978, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-14:40:42.792226 139957534086720 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263979.sst) /dev/shm/ToplingTemp/Topling-77718-O2nBKQ 2024/11/23-14:40:43.685558 139957534086720 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263979.sst): first pass time = 0.89's, 150.250'MB/sec 2024/11/23-14:40:45.020497 139957534086720 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263979.sst): old prealloc_size = 147639500, real_size = 34645312 2024/11/23-14:40:45.021087 139957534086720 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263979.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927991 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1082 GB zip-val = 0.0326 GB avg-val = 116.63 avg-zval = 35.17 2024/11/23-14:40:45.023256 139957534086720 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263979.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-14:40:45.863443 139957534086720 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263979.sst): second pass time = 1.33's, 81.143'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.84's, 46.242'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3123.672'MB/sec (index lex order gen) rebuild zvType time = 0.72's, 0.324'MB/sec write SST data time = 0.13's, 307.745'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 31684.946'MB/sec zip my value time = 1.33's, unzip length = 0.108'GB zip my value throughput = 81.143'MB/sec zip pipeline throughput = 81.143'MB/sec entries = 927991 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.63 avg-zval = 35.17 usrkeys = 927991 avg-key = 20.00 avg-zkey = 1.91 avg-val = 123.63 avg-zval = 35.17 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 927991 bytes = 3479984 } seq expand size = 6495937 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0326 GB dict = 1.08 MB all = 0.0390 GB } UnZip/Zip{ index = 10.4455 value = 3.3164 dict = 1.00 all = 3.4434 } Zip/UnZip{ index = 0.0957 value = 0.3015 dict = 1.00 all = 0.2904 } ---------------------------- total value len = 11.243079 GB avg = 0.156 KB (by entry num) total key len = 1.991641 GB avg = 0.028 KB total ukey len = 1.391321 GB avg = 0.016 KB total ukey num = 0.085222565 Billion total entry num = 0.072030294 Billion write speed all = 0.638320818 MB/sec (with seq num) write speed all = 0.610528201 MB/sec (without seq num) 2024/11/23-14:40:45.910931 139957534086720 [compaction_job.cc:1948] [default] [JOB 28142] Generated table #263979: 927991 keys, 38978468 bytes, temperature: kWarm 2024/11/23-14:40:45.911016 139957534086720 EVENT_LOG_v1 {"time_micros": 1732344045910966, "cf_name": "default", "job": 28142, "event": "table_file_creation", "file_number": 263979, "file_size": 38978468, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3405268578, "largest_seqno": 4012776316, "table_properties": {"data_size": 32636272, "index_size": 1776832, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25983748, "raw_average_key_size": 28, "raw_value_size": 108233990, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927991, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732344042, "oldest_key_time": 0, "file_creation_time": 1732344042, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 263979, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-14:40:45.948490 139957534086720 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263980.sst) /dev/shm/ToplingTemp/Topling-77718-K9swwQ 2024/11/23-14:40:46.943818 139957534086720 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263980.sst): first pass time = 1.00's, 134.852'MB/sec 2024/11/23-14:40:48.250794 139957534086720 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263980.sst): old prealloc_size = 147639500, real_size = 30278736 2024/11/23-14:40:48.251344 139957534086720 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263980.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 931062 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.93 raw-val = 0.1081 GB zip-val = 0.0283 GB avg-val = 116.16 avg-zval = 30.34 2024/11/23-14:40:48.253535 139957534086720 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263980.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-14:40:49.071347 139957534086720 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263980.sst): second pass time = 1.31's, 82.796'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.82's, 42.192'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3397.618'MB/sec (index lex order gen) rebuild zvType time = 0.69's, 0.336'MB/sec write SST data time = 0.13's, 273.912'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 34114.000'MB/sec zip my value time = 1.31's, unzip length = 0.108'GB zip my value throughput = 82.796'MB/sec zip pipeline throughput = 82.796'MB/sec entries = 931062 avg-key = 28.00 avg-zkey = 1.93 avg-val = 116.16 avg-zval = 30.34 usrkeys = 931062 avg-key = 20.00 avg-zkey = 1.93 avg-val = 123.16 avg-zval = 30.34 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 931062 bytes = 3491504 } seq expand size = 6517434 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0186 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0283 GB dict = 1.08 MB all = 0.0346 GB } UnZip/Zip{ index = 10.3769 value = 3.8281 dict = 1.00 all = 3.8769 } Zip/UnZip{ index = 0.0964 value = 0.2612 dict = 1.00 all = 0.2579 } ---------------------------- total value len = 11.357744 GB avg = 0.156 KB (by entry num) total key len = 2.017710 GB avg = 0.028 KB total ukey len = 1.409942 GB avg = 0.016 KB total ukey num = 0.086153627 Billion total entry num = 0.072961356 Billion write speed all = 0.645008791 MB/sec (with seq num) write speed all = 0.616861283 MB/sec (without seq num) 2024/11/23-14:40:49.115141 139957534086720 [compaction_job.cc:1948] [default] [JOB 28142] Generated table #263980: 931062 keys, 34619872 bytes, temperature: kWarm 2024/11/23-14:40:49.115210 139957534086720 EVENT_LOG_v1 {"time_micros": 1732344049115175, "cf_name": "default", "job": 28142, "event": "table_file_creation", "file_number": 263980, "file_size": 34619872, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3408241940, "largest_seqno": 4012776344, "table_properties": {"data_size": 28251264, "index_size": 1794496, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26069736, "raw_average_key_size": 28, "raw_value_size": 108148044, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 931062, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732344045, "oldest_key_time": 0, "file_creation_time": 1732344045, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 263980, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-14:40:49.152298 139957534086720 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263981.sst) /dev/shm/ToplingTemp/Topling-77718-T3wEPR 2024/11/23-14:40:49.991005 139957534086720 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263981.sst): first pass time = 0.84's, 160.036'MB/sec 2024/11/23-14:40:51.265897 139957534086720 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263981.sst): old prealloc_size = 147639500, real_size = 31171856 2024/11/23-14:40:51.266484 139957534086720 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263981.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 923122 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.93 raw-val = 0.1084 GB zip-val = 0.0292 GB avg-val = 117.40 avg-zval = 31.59 2024/11/23-14:40:51.267317 139957534086720 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263981.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-14:40:52.085387 139957534086720 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263981.sst): second pass time = 1.27's, 85.088'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.82's, 43.311'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3154.437'MB/sec (index lex order gen) rebuild zvType time = 0.69's, 0.333'MB/sec write SST data time = 0.13's, 280.943'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.083'MB, throughput = 35339.752'MB/sec zip my value time = 1.27's, unzip length = 0.108'GB zip my value throughput = 85.088'MB/sec zip pipeline throughput = 85.088'MB/sec entries = 923122 avg-key = 28.00 avg-zkey = 1.93 avg-val = 117.40 avg-zval = 31.59 usrkeys = 923122 avg-key = 20.00 avg-zkey = 1.93 avg-val = 124.40 avg-zval = 31.59 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 923122 bytes = 3461728 } seq expand size = 6461854 multi value expand size = 0 cnt WriteAppend = 18 UnZipSize{ index = 0.0185 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0292 GB dict = 1.08 MB all = 0.0355 GB } UnZip/Zip{ index = 10.3753 value = 3.7162 dict = 1.00 all = 3.7817 } Zip/UnZip{ index = 0.0964 value = 0.2691 dict = 1.00 all = 0.2644 } ---------------------------- total value len = 11.472577 GB avg = 0.155 KB (by entry num) total key len = 2.043558 GB avg = 0.028 KB total ukey len = 1.428404 GB avg = 0.016 KB total ukey num = 0.087076749 Billion total entry num = 0.073884478 Billion write speed all = 0.651698111 MB/sec (with seq num) write speed all = 0.623198617 MB/sec (without seq num) 2024/11/23-14:40:52.130332 139957534086720 [compaction_job.cc:1948] [default] [JOB 28142] Generated table #263981: 923122 keys, 35491466 bytes, temperature: kWarm 2024/11/23-14:40:52.130406 139957534086720 EVENT_LOG_v1 {"time_micros": 1732344052130370, "cf_name": "default", "job": 28142, "event": "table_file_creation", "file_number": 263981, "file_size": 35491466, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3471845708, "largest_seqno": 4012776360, "table_properties": {"data_size": 29161408, "index_size": 1779456, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25847416, "raw_average_key_size": 28, "raw_value_size": 108370436, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 923122, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732344049, "oldest_key_time": 0, "file_creation_time": 1732344049, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 263981, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-14:40:52.167774 139957534086720 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263982.sst) /dev/shm/ToplingTemp/Topling-77718-zAGr8Q 2024/11/23-14:40:53.061888 139957534086720 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263982.sst): first pass time = 0.89's, 150.120'MB/sec 2024/11/23-14:40:54.575149 139957534086720 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263982.sst): old prealloc_size = 147639500, real_size = 36611456 2024/11/23-14:40:54.575708 139957534086720 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263982.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 928316 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1082 GB zip-val = 0.0346 GB avg-val = 116.58 avg-zval = 37.27 2024/11/23-14:40:54.575901 139957534086720 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263982.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-14:40:55.278079 139957534086720 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263982.sst): second pass time = 1.51's, 71.557'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.70's, 53.808'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3310.328'MB/sec (index lex order gen) rebuild zvType time = 0.58's, 0.401'MB/sec write SST data time = 0.12's, 307.105'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 35245.870'MB/sec zip my value time = 1.51's, unzip length = 0.108'GB zip my value throughput = 71.557'MB/sec zip pipeline throughput = 71.557'MB/sec entries = 928316 avg-key = 28.00 avg-zkey = 1.92 avg-val = 116.58 avg-zval = 37.27 usrkeys = 928316 avg-key = 20.00 avg-zkey = 1.92 avg-val = 117.10 avg-zval = 37.27 TagRS{ kinds = RS_Key0_TagN bytes = 145160 } TagArray{ size = 69094 bytes = 207296 } seq expand size = 483658 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0346 GB dict = 1.08 MB all = 0.0378 GB } UnZip/Zip{ index = 10.4435 value = 3.1278 dict = 1.00 all = 3.5487 } Zip/UnZip{ index = 0.0958 value = 0.3197 dict = 1.00 all = 0.2818 } ---------------------------- total value len = 11.581285 GB avg = 0.155 KB (by entry num) total key len = 2.069551 GB avg = 0.028 KB total ukey len = 1.446971 GB avg = 0.016 KB total ukey num = 0.088005065 Billion total entry num = 0.074812794 Billion write speed all = 0.658091614 MB/sec (with seq num) write speed all = 0.629238482 MB/sec (without seq num) 2024/11/23-14:40:55.324861 139957534086720 [compaction_job.cc:1948] [default] [JOB 28142] Generated table #263982: 928316 keys, 37821791 bytes, temperature: kWarm 2024/11/23-14:40:55.324927 139957534086720 EVENT_LOG_v1 {"time_micros": 1732344055324891, "cf_name": "default", "job": 28142, "event": "table_file_creation", "file_number": 263982, "file_size": 37821791, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4012773626, "table_properties": {"data_size": 34601392, "index_size": 1777792, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25992848, "raw_average_key_size": 28, "raw_value_size": 108225016, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 928316, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732344052, "oldest_key_time": 0, "file_creation_time": 1732344052, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 263982, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-14:40:55.372266 139957534086720 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263983.sst) /dev/shm/ToplingTemp/Topling-77718-xKbPWT 2024/11/23-14:40:56.448293 139957534086720 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263983.sst): first pass time = 1.08's, 124.739'MB/sec 2024/11/23-14:40:57.878426 139957534086720 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263983.sst): old prealloc_size = 147639500, real_size = 37729232 2024/11/23-14:40:57.879009 139957534086720 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263983.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 925142 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0357 GB avg-val = 117.08 avg-zval = 38.63 2024/11/23-14:40:57.879538 139957534086720 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263983.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-14:40:58.627214 139957534086720 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263983.sst): second pass time = 1.43's, 75.779'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.75's, 54.147'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3126.986'MB/sec (index lex order gen) rebuild zvType time = 0.62's, 0.372'MB/sec write SST data time = 0.13's, 320.048'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 35035.010'MB/sec zip my value time = 1.43's, unzip length = 0.108'GB zip my value throughput = 75.779'MB/sec zip pipeline throughput = 75.779'MB/sec entries = 925142 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.08 avg-zval = 38.63 usrkeys = 925142 avg-key = 20.00 avg-zkey = 1.90 avg-val = 120.73 avg-zval = 38.63 TagRS{ kinds = RS_Key0_TagN bytes = 144640 } TagArray{ size = 482771 bytes = 1810400 } seq expand size = 3379397 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0357 GB dict = 1.08 MB all = 0.0405 GB } UnZip/Zip{ index = 10.5149 value = 3.0308 dict = 1.00 all = 3.3105 } Zip/UnZip{ index = 0.0951 value = 0.3299 dict = 1.00 all = 0.3021 } ---------------------------- total value len = 11.692979 GB avg = 0.154 KB (by entry num) total key len = 2.095455 GB avg = 0.028 KB total ukey len = 1.465473 GB avg = 0.016 KB total ukey num = 0.088930207 Billion total entry num = 0.075737936 Billion write speed all = 0.664617717 MB/sec (with seq num) write speed all = 0.635412500 MB/sec (without seq num) 2024/11/23-14:40:58.678041 139957534086720 [compaction_job.cc:1948] [default] [JOB 28142] Generated table #263983: 925142 keys, 40543303 bytes, temperature: kWarm 2024/11/23-14:40:58.678110 139957534086720 EVENT_LOG_v1 {"time_micros": 1732344058678075, "cf_name": "default", "job": 28142, "event": "table_file_creation", "file_number": 263983, "file_size": 40543303, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4031990469, "table_properties": {"data_size": 35738112, "index_size": 1759680, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25903976, "raw_average_key_size": 28, "raw_value_size": 108313892, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 925142, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732344055, "oldest_key_time": 0, "file_creation_time": 1732344055, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 263983, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-14:40:58.717041 139957534086720 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263984.sst) /dev/shm/ToplingTemp/Topling-77718-PfHdgR 2024/11/23-14:40:59.801410 139957534086720 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263984.sst): first pass time = 1.08's, 123.781'MB/sec 2024/11/23-14:41:01.148301 139957534086720 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263984.sst): old prealloc_size = 147639500, real_size = 38285760 2024/11/23-14:41:01.148848 139957534086720 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263984.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 923706 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1084 GB zip-val = 0.0363 GB avg-val = 117.30 avg-zval = 39.30 2024/11/23-14:41:01.149717 139957534086720 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263984.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-14:41:01.941970 139957534086720 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263984.sst): second pass time = 1.35's, 80.494'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.79's, 53.690'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3347.147'MB/sec (index lex order gen) rebuild zvType time = 0.67's, 0.346'MB/sec write SST data time = 0.13's, 337.751'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.082'MB, throughput = 35152.043'MB/sec zip my value time = 1.35's, unzip length = 0.108'GB zip my value throughput = 80.494'MB/sec zip pipeline throughput = 80.494'MB/sec entries = 923706 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.30 avg-zval = 39.30 usrkeys = 923706 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.30 avg-zval = 39.30 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 923706 bytes = 3463920 } seq expand size = 6465942 multi value expand size = 0 cnt WriteAppend = 16 UnZipSize{ index = 0.0185 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0363 GB dict = 1.08 MB all = 0.0426 GB } UnZip/Zip{ index = 10.5123 value = 2.9852 dict = 1.00 all = 3.1499 } Zip/UnZip{ index = 0.0951 value = 0.3350 dict = 1.00 all = 0.3175 } ---------------------------- total value len = 11.807799 GB avg = 0.154 KB (by entry num) total key len = 2.121318 GB avg = 0.028 KB total ukey len = 1.483948 GB avg = 0.017 KB total ukey num = 0.089853913 Billion total entry num = 0.076661642 Billion write speed all = 0.671291576 MB/sec (with seq num) write speed all = 0.641734892 MB/sec (without seq num) 2024/11/23-14:41:01.993869 139957534086720 [compaction_job.cc:1948] [default] [JOB 28142] Generated table #263984: 923706 keys, 42610744 bytes, temperature: kWarm 2024/11/23-14:41:01.993941 139957534086720 EVENT_LOG_v1 {"time_micros": 1732344061993906, "cf_name": "default", "job": 28142, "event": "table_file_creation", "file_number": 263984, "file_size": 42610744, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3236084454, "largest_seqno": 4031990926, "table_properties": {"data_size": 36297264, "index_size": 1757376, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25863768, "raw_average_key_size": 28, "raw_value_size": 108354088, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 923706, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732344058, "oldest_key_time": 0, "file_creation_time": 1732344058, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 263984, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-14:41:02.033433 139957534086720 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263985.sst) /dev/shm/ToplingTemp/Topling-77718-e0FjlT 2024/11/23-14:41:02.237131 139957534086720 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263985.sst): first pass time = 0.20's, 225.762'MB/sec 2024/11/23-14:41:02.684437 139957534086720 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263985.sst): old prealloc_size = 147639500, real_size = 13132288 2024/11/23-14:41:02.684680 139957534086720 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263985.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 318706 prefix = 4 raw-key = 0.0051 GB zip-key = 0.0006 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.0371 GB zip-val = 0.0124 GB avg-val = 116.26 avg-zval = 39.04 2024/11/23-14:41:02.684957 139957534086720 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263985.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0008 GB, waited 0.000 sec, Key+Value = 0.046 GB 2024/11/23-14:41:02.960298 139957534086720 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00/263985.sst): second pass time = 0.45's, 82.965'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.28's, 52.029'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2784.587'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.345'MB/sec write SST data time = 0.04's, 320.001'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.380'MB, throughput = 13377.690'MB/sec zip my value time = 0.45's, unzip length = 0.037'GB zip my value throughput = 82.965'MB/sec zip pipeline throughput = 82.965'MB/sec entries = 318706 avg-key = 28.00 avg-zkey = 1.92 avg-val = 116.26 avg-zval = 39.04 usrkeys = 318706 avg-key = 20.00 avg-zkey = 1.92 avg-val = 123.26 avg-zval = 39.04 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 318706 bytes = 916288 } seq expand size = 2230942 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0064 GB value = 0.0371 GB dict = 0.38 MB all = 0.0460 GB } __ZipSize{ index = 0.0006 GB value = 0.0124 GB dict = 0.38 MB all = 0.0144 GB } UnZip/Zip{ index = 10.4300 value = 2.9782 dict = 1.00 all = 3.2036 } Zip/UnZip{ index = 0.0959 value = 0.3358 dict = 1.00 all = 0.3121 } ---------------------------- total value len = 11.847082 GB avg = 0.154 KB (by entry num) total key len = 2.130242 GB avg = 0.028 KB total ukey len = 1.490322 GB avg = 0.017 KB total ukey num = 0.090172619 Billion total entry num = 0.076980348 Billion write speed all = 0.673581794 MB/sec (with seq num) write speed all = 0.643903690 MB/sec (without seq num) 2024/11/23-14:41:02.981716 139957534086720 [compaction_job.cc:1948] [default] [JOB 28142] Generated table #263985: 318706 keys, 14351469 bytes, temperature: kWarm 2024/11/23-14:41:02.981785 139957534086720 EVENT_LOG_v1 {"time_micros": 1732344062981751, "cf_name": "default", "job": 28142, "event": "table_file_creation", "file_number": 263985, "file_size": 14351469, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4024414239, "largest_seqno": 4031990648, "table_properties": {"data_size": 12441264, "index_size": 611136, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 8923768, "raw_average_key_size": 28, "raw_value_size": 37052612, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 318706, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732344062, "oldest_key_time": 0, "file_creation_time": 1732344062, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 263985, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-14:41:02.996855 139957534086720 [compaction_job.cc:703] job-28142: subcompact[0], size: 0.989794 G, files: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-28142/att-00 [263959,263960,263961,263962,263963,263964,263965,263966,263967,263968,263969,263970,263971,263972,263973,263974,263975,263976,263977,263978,263979,263980,263981,263982,263983,263984,263985] 2024/11/23-14:41:03.151824 139957534086720 (Original Log Time 2024/11/23-14:39:36.169055) EVENT_LOG_v1 {"time_micros": 1732343976169012, "job": 28142, "event": "compaction_started", "compaction_reason": "FilesMarkedForCompaction", "files_L2": [263942], "files_L3": [263951, 263952, 263910, 263911, 263912, 263913, 263914, 263915, 263916, 263917, 263918, 263919, 263920, 263921, 263922, 263923, 263924, 263925, 263926, 263927, 263928, 263929, 263930, 263931, 263932, 263933, 263934, 263944], "score": 0.998312, "input_data_size": 1017665850, "oldest_snapshot_seqno": 4032328896} 2024/11/23-14:41:03.151828 139957534086720 (Original Log Time 2024/11/23-14:41:03.149828) [compaction_job.cc:2022] [default] [JOB 28142] Compacted 1@2 + 28@3 files to L3 => 989794055 bytes 2024/11/23-14:41:03.151829 139957534086720 (Original Log Time 2024/11/23-14:41:03.151747) [compaction_job.cc:1224] [default] compacted to: files[0 0 0 27 0 0 0] max score 0.04, MB/sec: 11.7 rd, 11.4 wr, level 3, files in(1, 28) out(27 +0 blob) MB in(27.1, 943.4 +0.0 blob) out(943.9 +0.0 blob), read-write-amplify(70.5) write-amplify(34.8) OK, records in: 24732588, records dropped: 110404 output_compression: Snappy 2024/11/23-14:41:03.151833 139957534086720 (Original Log Time 2024/11/23-14:41:03.151797) EVENT_LOG_v1 {"time_micros": 1732344063151772, "cf": "default", "job": 28142, "event": "compaction_finished", "compaction_time_micros": 86827810, "compaction_time_cpu_micros": 36949240, "output_level": 3, "num_output_files": 27, "total_output_size": 989794055, "num_input_records": 24732588, "num_output_records": 24622184, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "file_write_nanos": 672852969, "file_range_sync_nanos": 0, "file_fsync_nanos": 19400, "file_prepare_write_nanos": 74192, "lsm_state": [0, 0, 0, 27, 0, 0, 0]} 2024/11/23-14:41:03.273071 139957534086720 DEBG dcompact_worker.cpp:240: HttpPost: 200 OK: url = http://nlb-7zny4kaa1poal01o64.cn-shenzhen.nlb.aliyuncs.com:8443, body = {"instanceId":"nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137","labourId":"","dbId":"d89b4006-2803-486e-b7a2-759bcf348921","dbStarts":1732256054,"starts":1732343975,"executesMs":87149,"compactionJobId":28142,"attempt":0,"compactionInputRawBytes":3551316641,"compactionInputZipBytes":1017665850,"compactionOutputRawBytes":0,"compactionOutputZipBytes":989794055,"headers":{"Accept":"*/*","Connection":"close","Host":"aliyun-topling-saas.topling.cn:18443","RemoteIp":"120.24.192.169","X-Forwarded-For":"120.24.192.169","region":"cn-shenzhen","token":"e6474c481bd4415abc537135cc03626b","instance-token":"e6474c481bd4415abc537135cc03626b","provider":"aliyun","CloudMarketInstanceId":"si-59c0ae5c955845588903","MeteringAssit":"","Transfer-Encoding":"chunked","traceparent":"00-45cd4f6995e55036c31f8bfc2556dcb1-8ae854cfe956bf8c-00"}}, response = 2024/11/23-14:41:03.273167 139957534086720 INFO dcompact_worker.cpp:1459: finish /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-28142/att-00: olev 3, work 87.149 s, result 7.732 ms, install 2.021 ms, input{raw 3.307 GiB zip 970.522 MiB}