2024/11/23-18:04:29.321443 139957651584576 DEBG dcompact_worker.cpp:2214: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00: fork to child time = 0.022390 sec 2024/11/23-18:04:29.322415 139957651584576 DEBG dcompact_worker.cpp:1013: Beg SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00 2024/11/23-18:04:29.333195 139957651584576 DEBG dcompact_worker.cpp:1033: End SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00 2024/11/23-18:04:29.334453 139957651584576 TRAC dcompact_worker.cpp:1083: INFO_LOG_LEVEL: rpc = INFO_LEVEL, env_var = undefined 2024/11/23-18:04:29.335045 139957651584576 [WARN] [column_family.cc:386] multiple cf_paths/db_paths and level_compaction_dynamic_level_bytes can't be used together 2024/11/23-18:04:29.385049 139957651584576 [version_set.cc:6208] Recovering from manifest file: /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-32641/att-00/MANIFEST-206347 2024/11/23-18:04:29.421928 139957651584576 [version_set.cc:6251] Recovered from manifest file:/worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-32641/att-00/MANIFEST-206347 succeeded,manifest_file_number is 206347, next_file_number is 273845, last_sequence is 4169471257, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 273709 2024/11/23-18:04:29.421946 139957651584576 [version_set.cc:6266] Column family [default] (ID 0), log number is 0 2024/11/23-18:04:29.422180 139957651584576 [version_set.cc:5721] Creating manifest 273845 2024/11/23-18:04:29.458226 139957651584576 DEBG dcompact_worker.cpp:1218: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00: bottommost_level: fake = 1, rpc = 0 2024/11/23-18:04:29.484373 139957651584576 [compaction_job.cc:2437] [default] [JOB 32641] Compacting 1@2 + 22@3 files to L3, score 1.00, subcompactions 1 : 1 2024/11/23-18:04:29.484411 139957651584576 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 24438 Base level 2, inputs: [273841(31MB)], [273767(40MB) 273768(40MB) 273769(40MB) 273770(40MB) 273771(40MB) 273772(40MB) 273773(40MB) 273774(40MB) 273775(40MB) 273776(40MB) 273777(40MB) 273778(40MB) 273779(40MB) 273780(40MB) 273781(40MB) 273782(40MB) 273783(40MB) 273784(40MB) 273785(40MB) 273786(40MB) 273787(40MB) 273790(40MB)] 2024/11/23-18:04:29.494026 139957651584576 [top_zip_table.cc:59] core git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-18:04:29.494071 139957651584576 [top_zip_table.cc:60] fsa git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-18:04:29.494101 139957651584576 [top_zip_table.cc:61] zbs git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-18:04:29.494111 139957651584576 [top_zip_table.cc:62] topling-zip_table_reader: git_version_hash_info_is: commit a4a382006cb82713acf5b3425835f22711877681 Author: leipeng Date: 2024-04-11 19:44:14 +0800 fixed_len_hole_index.cc: Add env bool FixedLenHoleIndexUseAVX512 for ut & debug 1. FixedLenHoleIndexUseAVX512 is only in unit tests or debug 2. In release mode, use avx512 by compile options(-march=) g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/23-18:04:29.494130 139957651584576 [top_zip_table.cc:64] topling-rocks git_version_hash_info_is: commit feab587e468621ba0204d47b4ffacc52e7c4290d Author: leipeng Date: 2024-03-22 13:35:06 +0800 ToplingZipTableBuilder::Add: immediately return after error This function returns void, and caller does not check builder->status() after calling this function and graceful abandon. So immediately return after error, and return error status in Finish(). g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/23-18:04:30.251229 139957651584576 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273846.sst) /dev/shm/ToplingTemp/Topling-143235-Fss1lY 2024/11/23-18:04:30.613866 139957651584576 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273846.sst): first pass time = 0.36's, 370.189'MB/sec 2024/11/23-18:04:31.806223 139957651584576 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273846.sst): old prealloc_size = 147639500, real_size = 40585328 2024/11/23-18:04:31.806405 139957651584576 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273846.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129430 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.80 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1016.99 avg-zval = 311.52 2024/11/23-18:04:31.806618 139957651584576 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273846.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-18:04:32.186201 139957651584576 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273846.sst): second pass time = 1.19's, 110.601'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.38's, 111.628'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1634.816'MB/sec (index lex order gen) rebuild zvType time = 0.33's, 0.098'MB/sec write SST data time = 0.05's, 843.266'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 36240.748'MB/sec zip my value time = 1.19's, unzip length = 0.132'GB zip my value throughput = 110.601'MB/sec zip pipeline throughput = 110.601'MB/sec entries = 129430 avg-key = 20.00 avg-zkey = 1.80 avg-val = 1016.99 avg-zval = 311.52 usrkeys = 129430 avg-key = 12.00 avg-zkey = 1.80 avg-val = 1023.99 avg-zval = 311.52 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129430 bytes = 485376 } seq expand size = 906010 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0424 GB } UnZip/Zip{ index = 6.6579 value = 3.2647 dict = 1.00 all = 3.1642 } Zip/UnZip{ index = 0.1502 value = 0.3063 dict = 1.00 all = 0.3160 } ---------------------------- total value len = 8.981155 GB avg = 0.171 KB (by entry num) total key len = 1.443410 GB avg = 0.028 KB total ukey len = 0.999431 GB avg = 0.015 KB total ukey num = 0.065679865 Billion total entry num = 0.052487594 Billion write speed all = 0.316279544 MB/sec (with seq num) write speed all = 0.303539826 MB/sec (without seq num) 2024/11/23-18:04:32.239441 139957651584576 [compaction_job.cc:1948] [default] [JOB 32641] Generated table #273846: 129430 keys, 42417964 bytes, temperature: kWarm 2024/11/23-18:04:32.239537 139957651584576 EVENT_LOG_v1 {"time_micros": 1732356272239481, "cf_name": "default", "job": 32641, "event": "table_file_creation", "file_number": 273846, "file_size": 42417964, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237877277, "largest_seqno": 4169430779, "table_properties": {"data_size": 40319520, "index_size": 233280, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588600, "raw_average_key_size": 20, "raw_value_size": 131629287, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129430, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732356270, "oldest_key_time": 0, "file_creation_time": 1732356270, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 273846, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-18:04:32.278671 139957651584576 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273847.sst) /dev/shm/ToplingTemp/Topling-143235-67i4NY 2024/11/23-18:04:33.016324 139957651584576 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273847.sst): first pass time = 0.74's, 181.960'MB/sec 2024/11/23-18:04:33.969522 139957651584576 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273847.sst): old prealloc_size = 147639500, real_size = 40873328 2024/11/23-18:04:33.969792 139957651584576 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273847.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129432 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.74 raw-val = 0.1316 GB zip-val = 0.0406 GB avg-val =1016.98 avg-zval = 313.80 2024/11/23-18:04:33.970014 139957651584576 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273847.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-18:04:34.147338 139957651584576 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273847.sst): second pass time = 0.94's, 139.798'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.18's, 240.161'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1177.431'MB/sec (index lex order gen) rebuild zvType time = 0.13's, 0.253'MB/sec write SST data time = 0.05's, 856.943'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 49751.237'MB/sec zip my value time = 0.94's, unzip length = 0.132'GB zip my value throughput = 139.798'MB/sec zip pipeline throughput = 139.798'MB/sec entries = 129432 avg-key = 20.00 avg-zkey = 1.74 avg-val = 1016.98 avg-zval = 313.80 usrkeys = 129432 avg-key = 12.00 avg-zkey = 1.74 avg-val = 1023.98 avg-zval = 313.80 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129432 bytes = 485392 } seq expand size = 906024 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0406 GB dict = 1.38 MB all = 0.0427 GB } UnZip/Zip{ index = 6.9102 value = 3.2408 dict = 1.00 all = 3.1428 } Zip/UnZip{ index = 0.1447 value = 0.3086 dict = 1.00 all = 0.3182 } ---------------------------- total value len = 9.113690 GB avg = 0.173 KB (by entry num) total key len = 1.445998 GB avg = 0.027 KB total ukey len = 1.000984 GB avg = 0.015 KB total ukey num = 0.065809297 Billion total entry num = 0.052617026 Billion write speed all = 0.320360117 MB/sec (with seq num) write speed all = 0.307589743 MB/sec (without seq num) 2024/11/23-18:04:34.200896 139957651584576 [compaction_job.cc:1948] [default] [JOB 32641] Generated table #273847: 129432 keys, 42705888 bytes, temperature: kWarm 2024/11/23-18:04:34.200954 139957651584576 EVENT_LOG_v1 {"time_micros": 1732356274200921, "cf_name": "default", "job": 32641, "event": "table_file_creation", "file_number": 273847, "file_size": 42705888, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237868195, "largest_seqno": 4169416688, "table_properties": {"data_size": 40616032, "index_size": 224768, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588640, "raw_average_key_size": 20, "raw_value_size": 131629173, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129432, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732356272, "oldest_key_time": 0, "file_creation_time": 1732356272, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 273847, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-18:04:34.244490 139957651584576 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273848.sst) /dev/shm/ToplingTemp/Topling-143235-cUQKdW 2024/11/23-18:04:34.815916 139957651584576 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273848.sst): first pass time = 0.57's, 234.898'MB/sec 2024/11/23-18:04:37.235467 139957651584576 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273848.sst): old prealloc_size = 147639500, real_size = 40580656 2024/11/23-18:04:37.235615 139957651584576 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273848.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129434 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.80 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1016.96 avg-zval = 311.47 2024/11/23-18:04:37.235831 139957651584576 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273848.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-18:04:37.539824 139957651584576 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273848.sst): second pass time = 2.42's, 54.461'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.30's, 139.360'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1898.268'MB/sec (index lex order gen) rebuild zvType time = 0.26's, 0.126'MB/sec write SST data time = 0.05's, 898.562'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 30001.785'MB/sec zip my value time = 2.42's, unzip length = 0.132'GB zip my value throughput = 54.461'MB/sec zip pipeline throughput = 144.317'MB/sec entries = 129434 avg-key = 20.00 avg-zkey = 1.80 avg-val = 1016.96 avg-zval = 311.47 usrkeys = 129434 avg-key = 12.00 avg-zkey = 1.80 avg-val = 1023.96 avg-zval = 311.47 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129434 bytes = 485392 } seq expand size = 906038 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0424 GB } UnZip/Zip{ index = 6.6581 value = 3.2650 dict = 1.00 all = 3.1645 } Zip/UnZip{ index = 0.1502 value = 0.3063 dict = 1.00 all = 0.3160 } ---------------------------- total value len = 9.246226 GB avg = 0.175 KB (by entry num) total key len = 1.448587 GB avg = 0.027 KB total ukey len = 1.002538 GB avg = 0.015 KB total ukey num = 0.065938731 Billion total entry num = 0.052746460 Billion write speed all = 0.324426123 MB/sec (with seq num) write speed all = 0.311625653 MB/sec (without seq num) 2024/11/23-18:04:37.591666 139957651584576 [compaction_job.cc:1948] [default] [JOB 32641] Generated table #273848: 129434 keys, 42413917 bytes, temperature: kWarm 2024/11/23-18:04:37.591827 139957651584576 EVENT_LOG_v1 {"time_micros": 1732356277591698, "cf_name": "default", "job": 32641, "event": "table_file_creation", "file_number": 273848, "file_size": 42413917, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237873554, "largest_seqno": 4169432288, "table_properties": {"data_size": 40314848, "index_size": 233280, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588680, "raw_average_key_size": 20, "raw_value_size": 131629329, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129434, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732356274, "oldest_key_time": 0, "file_creation_time": 1732356274, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 273848, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-18:04:37.632470 139957651584576 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273849.sst) /dev/shm/ToplingTemp/Topling-143235-zVHWcZ 2024/11/23-18:04:38.364516 139957651584576 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273849.sst): first pass time = 0.73's, 183.356'MB/sec 2024/11/23-18:04:39.321323 139957651584576 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273849.sst): old prealloc_size = 147639500, real_size = 40869040 2024/11/23-18:04:39.321443 139957651584576 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273849.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129435 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.74 raw-val = 0.1316 GB zip-val = 0.0406 GB avg-val =1016.96 avg-zval = 313.76 2024/11/23-18:04:39.321611 139957651584576 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273849.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-18:04:39.509469 139957651584576 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273849.sst): second pass time = 0.96's, 137.787'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.19's, 226.985'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2297.463'MB/sec (index lex order gen) rebuild zvType time = 0.14's, 0.233'MB/sec write SST data time = 0.05's, 865.452'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 39966.615'MB/sec zip my value time = 0.96's, unzip length = 0.132'GB zip my value throughput = 137.787'MB/sec zip pipeline throughput = 137.787'MB/sec entries = 129435 avg-key = 20.00 avg-zkey = 1.74 avg-val = 1016.96 avg-zval = 313.76 usrkeys = 129435 avg-key = 12.00 avg-zkey = 1.74 avg-val = 1023.96 avg-zval = 313.76 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129435 bytes = 485392 } seq expand size = 906045 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0406 GB dict = 1.38 MB all = 0.0427 GB } UnZip/Zip{ index = 6.9084 value = 3.2412 dict = 1.00 all = 3.1432 } Zip/UnZip{ index = 0.1448 value = 0.3085 dict = 1.00 all = 0.3182 } ---------------------------- total value len = 9.378761 GB avg = 0.177 KB (by entry num) total key len = 1.451176 GB avg = 0.027 KB total ukey len = 1.004091 GB avg = 0.015 KB total ukey num = 0.066068166 Billion total entry num = 0.052875895 Billion write speed all = 0.328505482 MB/sec (with seq num) write speed all = 0.315674367 MB/sec (without seq num) 2024/11/23-18:04:39.568870 139957651584576 [compaction_job.cc:1948] [default] [JOB 32641] Generated table #273849: 129435 keys, 42701768 bytes, temperature: kWarm 2024/11/23-18:04:39.568930 139957651584576 EVENT_LOG_v1 {"time_micros": 1732356279568897, "cf_name": "default", "job": 32641, "event": "table_file_creation", "file_number": 273849, "file_size": 42701768, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237868596, "largest_seqno": 4169432386, "table_properties": {"data_size": 40611680, "index_size": 224832, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588700, "raw_average_key_size": 20, "raw_value_size": 131629675, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129435, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732356277, "oldest_key_time": 0, "file_creation_time": 1732356277, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 273849, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-18:04:39.607534 139957651584576 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273850.sst) /dev/shm/ToplingTemp/Topling-143235-y3wj4X 2024/11/23-18:04:40.439115 139957651584576 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273850.sst): first pass time = 0.83's, 161.407'MB/sec 2024/11/23-18:04:42.211744 139957651584576 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273850.sst): old prealloc_size = 147639500, real_size = 40586480 2024/11/23-18:04:42.211895 139957651584576 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273850.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129429 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.80 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1017.00 avg-zval = 311.53 2024/11/23-18:04:42.212099 139957651584576 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273850.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-18:04:42.449283 139957651584576 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273850.sst): second pass time = 1.77's, 74.298'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.24's, 178.593'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1823.896'MB/sec (index lex order gen) rebuild zvType time = 0.19's, 0.171'MB/sec write SST data time = 0.05's, 884.639'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 46055.687'MB/sec zip my value time = 1.77's, unzip length = 0.132'GB zip my value throughput = 74.298'MB/sec zip pipeline throughput = 158.985'MB/sec entries = 129429 avg-key = 20.00 avg-zkey = 1.80 avg-val = 1017.00 avg-zval = 311.53 usrkeys = 129429 avg-key = 12.00 avg-zkey = 1.80 avg-val = 1024.00 avg-zval = 311.53 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129429 bytes = 485376 } seq expand size = 906003 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0424 GB } UnZip/Zip{ index = 6.6579 value = 3.2646 dict = 1.00 all = 3.1641 } Zip/UnZip{ index = 0.1502 value = 0.3063 dict = 1.00 all = 0.3160 } ---------------------------- total value len = 9.511297 GB avg = 0.179 KB (by entry num) total key len = 1.453764 GB avg = 0.027 KB total ukey len = 1.005644 GB avg = 0.015 KB total ukey num = 0.066197595 Billion total entry num = 0.053005324 Billion write speed all = 0.332574548 MB/sec (with seq num) write speed all = 0.319713171 MB/sec (without seq num) 2024/11/23-18:04:42.509530 139957651584576 [compaction_job.cc:1948] [default] [JOB 32641] Generated table #273850: 129429 keys, 42419127 bytes, temperature: kWarm 2024/11/23-18:04:42.509596 139957651584576 EVENT_LOG_v1 {"time_micros": 1732356282509562, "cf_name": "default", "job": 32641, "event": "table_file_creation", "file_number": 273850, "file_size": 42419127, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237869923, "largest_seqno": 4169427651, "table_properties": {"data_size": 40320672, "index_size": 233280, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588580, "raw_average_key_size": 20, "raw_value_size": 131629210, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129429, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732356279, "oldest_key_time": 0, "file_creation_time": 1732356279, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 273850, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-18:04:42.548002 139957651584576 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273851.sst) /dev/shm/ToplingTemp/Topling-143235-t2gJ4X 2024/11/23-18:04:43.162020 139957651584576 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273851.sst): first pass time = 0.61's, 218.602'MB/sec 2024/11/23-18:04:44.016072 139957651584576 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273851.sst): old prealloc_size = 147639500, real_size = 40582448 2024/11/23-18:04:44.016222 139957651584576 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273851.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129431 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.80 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1016.98 avg-zval = 311.49 2024/11/23-18:04:44.016403 139957651584576 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273851.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-18:04:44.186110 139957651584576 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273851.sst): second pass time = 0.85's, 154.257'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.17's, 249.469'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1853.311'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.270'MB/sec write SST data time = 0.05's, 845.798'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 39886.960'MB/sec zip my value time = 0.85's, unzip length = 0.132'GB zip my value throughput = 154.257'MB/sec zip pipeline throughput = 154.257'MB/sec entries = 129431 avg-key = 20.00 avg-zkey = 1.80 avg-val = 1016.98 avg-zval = 311.49 usrkeys = 129431 avg-key = 12.00 avg-zkey = 1.80 avg-val = 1023.98 avg-zval = 311.49 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129431 bytes = 485376 } seq expand size = 906017 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0424 GB } UnZip/Zip{ index = 6.6580 value = 3.2649 dict = 1.00 all = 3.1644 } Zip/UnZip{ index = 0.1502 value = 0.3063 dict = 1.00 all = 0.3160 } ---------------------------- total value len = 9.643832 GB avg = 0.181 KB (by entry num) total key len = 1.456353 GB avg = 0.027 KB total ukey len = 1.007197 GB avg = 0.015 KB total ukey num = 0.066327026 Billion total entry num = 0.053134755 Billion write speed all = 0.336655169 MB/sec (with seq num) write speed all = 0.323763067 MB/sec (without seq num) 2024/11/23-18:04:44.241483 139957651584576 [compaction_job.cc:1948] [default] [JOB 32641] Generated table #273851: 129431 keys, 42415501 bytes, temperature: kWarm 2024/11/23-18:04:44.241552 139957651584576 EVENT_LOG_v1 {"time_micros": 1732356284241516, "cf_name": "default", "job": 32641, "event": "table_file_creation", "file_number": 273851, "file_size": 42415501, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237872175, "largest_seqno": 4169427683, "table_properties": {"data_size": 40316640, "index_size": 233280, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588620, "raw_average_key_size": 20, "raw_value_size": 131629135, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129431, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732356282, "oldest_key_time": 0, "file_creation_time": 1732356282, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 273851, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-18:04:44.281571 139957651584576 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273852.sst) /dev/shm/ToplingTemp/Topling-143235-2YXCtV 2024/11/23-18:04:45.149347 139957651584576 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273852.sst): first pass time = 0.87's, 154.676'MB/sec 2024/11/23-18:04:46.348041 139957651584576 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273852.sst): old prealloc_size = 147639500, real_size = 41035344 2024/11/23-18:04:46.348167 139957651584576 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273852.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129427 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.73 raw-val = 0.1316 GB zip-val = 0.0408 GB avg-val =1017.02 avg-zval = 315.07 2024/11/23-18:04:46.348337 139957651584576 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273852.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-18:04:46.531375 139957651584576 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273852.sst): second pass time = 1.20's, 109.883'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.18's, 233.858'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2201.621'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.272'MB/sec write SST data time = 0.06's, 669.090'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 39981.309'MB/sec zip my value time = 1.20's, unzip length = 0.132'GB zip my value throughput = 109.883'MB/sec zip pipeline throughput = 109.883'MB/sec entries = 129427 avg-key = 20.00 avg-zkey = 1.73 avg-val = 1017.02 avg-zval = 315.07 usrkeys = 129427 avg-key = 12.00 avg-zkey = 1.73 avg-val = 1024.02 avg-zval = 315.07 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129427 bytes = 485360 } seq expand size = 905989 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0408 GB dict = 1.38 MB all = 0.0429 GB } UnZip/Zip{ index = 6.9395 value = 3.2279 dict = 1.00 all = 3.1310 } Zip/UnZip{ index = 0.1441 value = 0.3098 dict = 1.00 all = 0.3194 } ---------------------------- total value len = 9.776368 GB avg = 0.184 KB (by entry num) total key len = 1.458941 GB avg = 0.027 KB total ukey len = 1.008750 GB avg = 0.015 KB total ukey num = 0.066456453 Billion total entry num = 0.053264182 Billion write speed all = 0.340729094 MB/sec (with seq num) write speed all = 0.327806508 MB/sec (without seq num) 2024/11/23-18:04:46.589883 139957651584576 [compaction_job.cc:1948] [default] [JOB 32641] Generated table #273852: 129427 keys, 42867603 bytes, temperature: kWarm 2024/11/23-18:04:46.589969 139957651584576 EVENT_LOG_v1 {"time_micros": 1732356286589921, "cf_name": "default", "job": 32641, "event": "table_file_creation", "file_number": 273852, "file_size": 42867603, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237946515, "largest_seqno": 4169427412, "table_properties": {"data_size": 40779008, "index_size": 223808, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588540, "raw_average_key_size": 20, "raw_value_size": 131629903, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129427, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732356284, "oldest_key_time": 0, "file_creation_time": 1732356284, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 273852, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-18:04:46.660923 139957651584576 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273853.sst) /dev/shm/ToplingTemp/Topling-143235-UlrWZY 2024/11/23-18:04:47.276022 139957651584576 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273853.sst): first pass time = 0.62's, 218.231'MB/sec 2024/11/23-18:04:48.145612 139957651584576 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273853.sst): old prealloc_size = 147639500, real_size = 40930864 2024/11/23-18:04:48.145747 139957651584576 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273853.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129430 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.73 raw-val = 0.1316 GB zip-val = 0.0407 GB avg-val =1016.99 avg-zval = 314.26 2024/11/23-18:04:48.145914 139957651584576 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273853.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-18:04:48.309912 139957651584576 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273853.sst): second pass time = 0.87's, 151.636'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 260.314'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1982.015'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.275'MB/sec write SST data time = 0.05's, 917.894'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 48548.327'MB/sec zip my value time = 0.87's, unzip length = 0.132'GB zip my value throughput = 151.636'MB/sec zip pipeline throughput = 151.636'MB/sec entries = 129430 avg-key = 20.00 avg-zkey = 1.73 avg-val = 1016.99 avg-zval = 314.26 usrkeys = 129430 avg-key = 12.00 avg-zkey = 1.73 avg-val = 1023.99 avg-zval = 314.26 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129430 bytes = 485376 } seq expand size = 906010 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0407 GB dict = 1.38 MB all = 0.0428 GB } UnZip/Zip{ index = 6.9357 value = 3.2362 dict = 1.00 all = 3.1386 } Zip/UnZip{ index = 0.1442 value = 0.3090 dict = 1.00 all = 0.3186 } ---------------------------- total value len = 9.908903 GB avg = 0.186 KB (by entry num) total key len = 1.461530 GB avg = 0.027 KB total ukey len = 1.010303 GB avg = 0.015 KB total ukey num = 0.066585883 Billion total entry num = 0.053393612 Billion write speed all = 0.344808353 MB/sec (with seq num) write speed all = 0.331855063 MB/sec (without seq num) 2024/11/23-18:04:48.363159 139957651584576 [compaction_job.cc:1948] [default] [JOB 32641] Generated table #273853: 129430 keys, 42763950 bytes, temperature: kWarm 2024/11/23-18:04:48.363219 139957651584576 EVENT_LOG_v1 {"time_micros": 1732356288363187, "cf_name": "default", "job": 32641, "event": "table_file_creation", "file_number": 273853, "file_size": 42763950, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237868290, "largest_seqno": 4169433999, "table_properties": {"data_size": 40674400, "index_size": 223936, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588600, "raw_average_key_size": 20, "raw_value_size": 131629398, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129430, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732356286, "oldest_key_time": 0, "file_creation_time": 1732356286, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 273853, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-18:04:48.406775 139957651584576 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273854.sst) /dev/shm/ToplingTemp/Topling-143235-BrA40V 2024/11/23-18:04:48.975702 139957651584576 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273854.sst): first pass time = 0.57's, 235.934'MB/sec 2024/11/23-18:04:49.841751 139957651584576 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273854.sst): old prealloc_size = 147639500, real_size = 41007056 2024/11/23-18:04:49.841870 139957651584576 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273854.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129431 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.72 raw-val = 0.1316 GB zip-val = 0.0408 GB avg-val =1016.99 avg-zval = 314.86 2024/11/23-18:04:49.842052 139957651584576 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273854.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-18:04:50.007132 139957651584576 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273854.sst): second pass time = 0.86's, 152.262'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.17's, 259.111'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2329.431'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.269'MB/sec write SST data time = 0.04's, 952.094'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 48017.663'MB/sec zip my value time = 0.86's, unzip length = 0.132'GB zip my value throughput = 152.262'MB/sec zip pipeline throughput = 152.262'MB/sec entries = 129431 avg-key = 20.00 avg-zkey = 1.72 avg-val = 1016.99 avg-zval = 314.86 usrkeys = 129431 avg-key = 12.00 avg-zkey = 1.72 avg-val = 1023.99 avg-zval = 314.86 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129431 bytes = 485376 } seq expand size = 906017 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0408 GB dict = 1.38 MB all = 0.0428 GB } UnZip/Zip{ index = 6.9877 value = 3.2300 dict = 1.00 all = 3.1330 } Zip/UnZip{ index = 0.1431 value = 0.3096 dict = 1.00 all = 0.3192 } ---------------------------- total value len = 10.041439 GB avg = 0.188 KB (by entry num) total key len = 1.464119 GB avg = 0.027 KB total ukey len = 1.011857 GB avg = 0.015 KB total ukey num = 0.066715314 Billion total entry num = 0.053523043 Billion write speed all = 0.348888047 MB/sec (with seq num) write speed all = 0.335904027 MB/sec (without seq num) 2024/11/23-18:04:50.061921 139957651584576 [compaction_job.cc:1948] [default] [JOB 32641] Generated table #273854: 129431 keys, 42840122 bytes, temperature: kWarm 2024/11/23-18:04:50.062006 139957651584576 EVENT_LOG_v1 {"time_micros": 1732356290061956, "cf_name": "default", "job": 32641, "event": "table_file_creation", "file_number": 273854, "file_size": 42840122, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237919999, "largest_seqno": 4169436298, "table_properties": {"data_size": 40752256, "index_size": 222272, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588620, "raw_average_key_size": 20, "raw_value_size": 131629902, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129431, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732356288, "oldest_key_time": 0, "file_creation_time": 1732356288, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 273854, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-18:04:50.117212 139957651584576 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273855.sst) /dev/shm/ToplingTemp/Topling-143235-9uJVsY 2024/11/23-18:04:50.842026 139957651584576 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273855.sst): first pass time = 0.72's, 185.193'MB/sec 2024/11/23-18:04:51.632881 139957651584576 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273855.sst): old prealloc_size = 147639500, real_size = 40581072 2024/11/23-18:04:51.633037 139957651584576 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273855.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129432 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.80 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1016.98 avg-zval = 311.48 2024/11/23-18:04:51.633195 139957651584576 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273855.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-18:04:51.796925 139957651584576 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273855.sst): second pass time = 0.79's, 166.699'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 258.589'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1973.587'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.271'MB/sec write SST data time = 0.04's, 953.734'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 45669.871'MB/sec zip my value time = 0.79's, unzip length = 0.132'GB zip my value throughput = 166.699'MB/sec zip pipeline throughput = 166.699'MB/sec entries = 129432 avg-key = 20.00 avg-zkey = 1.80 avg-val = 1016.98 avg-zval = 311.48 usrkeys = 129432 avg-key = 12.00 avg-zkey = 1.80 avg-val = 1023.98 avg-zval = 311.48 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129432 bytes = 485392 } seq expand size = 906024 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0424 GB } UnZip/Zip{ index = 6.6580 value = 3.2650 dict = 1.00 all = 3.1645 } Zip/UnZip{ index = 0.1502 value = 0.3063 dict = 1.00 all = 0.3160 } ---------------------------- total value len = 10.173975 GB avg = 0.190 KB (by entry num) total key len = 1.466707 GB avg = 0.027 KB total ukey len = 1.013410 GB avg = 0.015 KB total ukey num = 0.066844746 Billion total entry num = 0.053652475 Billion write speed all = 0.352966338 MB/sec (with seq num) write speed all = 0.339951625 MB/sec (without seq num) 2024/11/23-18:04:51.850681 139957651584576 [compaction_job.cc:1948] [default] [JOB 32641] Generated table #273855: 129432 keys, 42413562 bytes, temperature: kWarm 2024/11/23-18:04:51.850749 139957651584576 EVENT_LOG_v1 {"time_micros": 1732356291850715, "cf_name": "default", "job": 32641, "event": "table_file_creation", "file_number": 273855, "file_size": 42413562, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237874127, "largest_seqno": 4169432122, "table_properties": {"data_size": 40315264, "index_size": 233280, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588640, "raw_average_key_size": 20, "raw_value_size": 131630100, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129432, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732356290, "oldest_key_time": 0, "file_creation_time": 1732356290, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 273855, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-18:04:51.896009 139957651584576 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273856.sst) /dev/shm/ToplingTemp/Topling-143235-gzgQBZ 2024/11/23-18:04:52.467175 139957651584576 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273856.sst): first pass time = 0.57's, 235.010'MB/sec 2024/11/23-18:04:53.279117 139957651584576 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273856.sst): old prealloc_size = 147639500, real_size = 40586128 2024/11/23-18:04:53.279254 139957651584576 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273856.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129430 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.80 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1016.99 avg-zval = 311.52 2024/11/23-18:04:53.279415 139957651584576 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273856.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-18:04:53.441496 139957651584576 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273856.sst): second pass time = 0.81's, 162.337'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 261.275'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2033.969'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.275'MB/sec write SST data time = 0.04's, 947.596'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.379'MB, throughput = 48465.019'MB/sec zip my value time = 0.81's, unzip length = 0.132'GB zip my value throughput = 162.337'MB/sec zip pipeline throughput = 162.337'MB/sec entries = 129430 avg-key = 20.00 avg-zkey = 1.80 avg-val = 1016.99 avg-zval = 311.52 usrkeys = 129430 avg-key = 12.00 avg-zkey = 1.80 avg-val = 1023.99 avg-zval = 311.52 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129430 bytes = 485376 } seq expand size = 906010 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0424 GB } UnZip/Zip{ index = 6.6579 value = 3.2646 dict = 1.00 all = 3.1641 } Zip/UnZip{ index = 0.1502 value = 0.3063 dict = 1.00 all = 0.3160 } ---------------------------- total value len = 10.306510 GB avg = 0.192 KB (by entry num) total key len = 1.469296 GB avg = 0.027 KB total ukey len = 1.014963 GB avg = 0.015 KB total ukey num = 0.066974176 Billion total entry num = 0.053781905 Billion write speed all = 0.357045733 MB/sec (with seq num) write speed all = 0.344000274 MB/sec (without seq num) 2024/11/23-18:04:53.493926 139957651584576 [compaction_job.cc:1948] [default] [JOB 32641] Generated table #273856: 129430 keys, 42419434 bytes, temperature: kWarm 2024/11/23-18:04:53.494020 139957651584576 EVENT_LOG_v1 {"time_micros": 1732356293493961, "cf_name": "default", "job": 32641, "event": "table_file_creation", "file_number": 273856, "file_size": 42419434, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237873605, "largest_seqno": 4169436299, "table_properties": {"data_size": 40320320, "index_size": 233280, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588600, "raw_average_key_size": 20, "raw_value_size": 131629332, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129430, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732356291, "oldest_key_time": 0, "file_creation_time": 1732356291, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 273856, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-18:04:53.534574 139957651584576 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273857.sst) /dev/shm/ToplingTemp/Topling-143235-tJmuMZ 2024/11/23-18:04:54.269551 139957651584576 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273857.sst): first pass time = 0.73's, 182.627'MB/sec 2024/11/23-18:04:55.095603 139957651584576 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273857.sst): old prealloc_size = 147639500, real_size = 40801584 2024/11/23-18:04:55.095758 139957651584576 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273857.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129430 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.77 raw-val = 0.1316 GB zip-val = 0.0405 GB avg-val =1017.00 avg-zval = 313.21 2024/11/23-18:04:55.095944 139957651584576 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273857.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-18:04:55.273761 139957651584576 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273857.sst): second pass time = 0.83's, 159.498'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.18's, 239.325'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1819.951'MB/sec (index lex order gen) rebuild zvType time = 0.13's, 0.248'MB/sec write SST data time = 0.05's, 898.409'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 48174.519'MB/sec zip my value time = 0.83's, unzip length = 0.132'GB zip my value throughput = 159.498'MB/sec zip pipeline throughput = 159.498'MB/sec entries = 129430 avg-key = 20.00 avg-zkey = 1.77 avg-val = 1017.00 avg-zval = 313.21 usrkeys = 129430 avg-key = 12.00 avg-zkey = 1.77 avg-val = 1024.00 avg-zval = 313.21 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129430 bytes = 485376 } seq expand size = 906010 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0405 GB dict = 1.38 MB all = 0.0426 GB } UnZip/Zip{ index = 6.7618 value = 3.2470 dict = 1.00 all = 3.1481 } Zip/UnZip{ index = 0.1479 value = 0.3080 dict = 1.00 all = 0.3177 } ---------------------------- total value len = 10.439047 GB avg = 0.194 KB (by entry num) total key len = 1.471885 GB avg = 0.027 KB total ukey len = 1.016516 GB avg = 0.015 KB total ukey num = 0.067103606 Billion total entry num = 0.053911335 Billion write speed all = 0.361122692 MB/sec (with seq num) write speed all = 0.348046564 MB/sec (without seq num) 2024/11/23-18:04:55.325089 139957651584576 [compaction_job.cc:1948] [default] [JOB 32641] Generated table #273857: 129430 keys, 42634656 bytes, temperature: kWarm 2024/11/23-18:04:55.325160 139957651584576 EVENT_LOG_v1 {"time_micros": 1732356295325125, "cf_name": "default", "job": 32641, "event": "table_file_creation", "file_number": 273857, "file_size": 42634656, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237872082, "largest_seqno": 4169418359, "table_properties": {"data_size": 40539360, "index_size": 229696, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588600, "raw_average_key_size": 20, "raw_value_size": 131630152, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129430, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732356293, "oldest_key_time": 0, "file_creation_time": 1732356293, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 273857, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-18:04:55.360838 139957651584576 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273858.sst) /dev/shm/ToplingTemp/Topling-143235-2HBxzW 2024/11/23-18:04:55.900522 139957651584576 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273858.sst): first pass time = 0.54's, 248.718'MB/sec 2024/11/23-18:04:56.761360 139957651584576 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273858.sst): old prealloc_size = 147639500, real_size = 40944208 2024/11/23-18:04:56.761490 139957651584576 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273858.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129429 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.75 raw-val = 0.1316 GB zip-val = 0.0407 GB avg-val =1017.01 avg-zval = 314.35 2024/11/23-18:04:56.761672 139957651584576 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273858.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-18:04:56.942865 139957651584576 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273858.sst): second pass time = 0.86's, 153.052'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.18's, 235.701'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2142.798'MB/sec (index lex order gen) rebuild zvType time = 0.13's, 0.243'MB/sec write SST data time = 0.05's, 890.103'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 43399.194'MB/sec zip my value time = 0.86's, unzip length = 0.132'GB zip my value throughput = 153.052'MB/sec zip pipeline throughput = 153.052'MB/sec entries = 129429 avg-key = 20.00 avg-zkey = 1.75 avg-val = 1017.01 avg-zval = 314.35 usrkeys = 129429 avg-key = 12.00 avg-zkey = 1.75 avg-val = 1024.01 avg-zval = 314.35 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129429 bytes = 485376 } seq expand size = 906003 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0407 GB dict = 1.38 MB all = 0.0428 GB } UnZip/Zip{ index = 6.8709 value = 3.2353 dict = 1.00 all = 3.1376 } Zip/UnZip{ index = 0.1455 value = 0.3091 dict = 1.00 all = 0.3187 } ---------------------------- total value len = 10.571583 GB avg = 0.196 KB (by entry num) total key len = 1.474473 GB avg = 0.027 KB total ukey len = 1.018069 GB avg = 0.015 KB total ukey num = 0.067233035 Billion total entry num = 0.054040764 Billion write speed all = 0.365201001 MB/sec (with seq num) write speed all = 0.352094144 MB/sec (without seq num) 2024/11/23-18:04:56.995938 139957651584576 [compaction_job.cc:1948] [default] [JOB 32641] Generated table #273858: 129429 keys, 42777073 bytes, temperature: kWarm 2024/11/23-18:04:56.996023 139957651584576 EVENT_LOG_v1 {"time_micros": 1732356296995972, "cf_name": "default", "job": 32641, "event": "table_file_creation", "file_number": 273858, "file_size": 42777073, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237871365, "largest_seqno": 4169433356, "table_properties": {"data_size": 40685632, "index_size": 226048, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588580, "raw_average_key_size": 20, "raw_value_size": 131630081, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129429, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732356295, "oldest_key_time": 0, "file_creation_time": 1732356295, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 273858, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-18:04:57.034804 139957651584576 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273859.sst) /dev/shm/ToplingTemp/Topling-143235-RRxtHW 2024/11/23-18:04:57.820082 139957651584576 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273859.sst): first pass time = 0.79's, 170.929'MB/sec 2024/11/23-18:04:58.592716 139957651584576 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273859.sst): old prealloc_size = 147639500, real_size = 40579264 2024/11/23-18:04:58.592847 139957651584576 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273859.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129427 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.78 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1017.02 avg-zval = 311.50 2024/11/23-18:04:58.593009 139957651584576 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273859.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-18:04:58.757199 139957651584576 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273859.sst): second pass time = 0.77's, 170.676'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 257.408'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2155.620'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.275'MB/sec write SST data time = 0.05's, 905.268'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.377'MB, throughput = 48174.572'MB/sec zip my value time = 0.77's, unzip length = 0.132'GB zip my value throughput = 170.676'MB/sec zip pipeline throughput = 170.676'MB/sec entries = 129427 avg-key = 20.00 avg-zkey = 1.78 avg-val = 1017.02 avg-zval = 311.50 usrkeys = 129427 avg-key = 12.00 avg-zkey = 1.78 avg-val = 1022.66 avg-zval = 311.50 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 104285 bytes = 391088 } seq expand size = 729995 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0423 GB } UnZip/Zip{ index = 6.7447 value = 3.2649 dict = 1.00 all = 3.1702 } Zip/UnZip{ index = 0.1483 value = 0.3063 dict = 1.00 all = 0.3154 } ---------------------------- total value len = 10.703943 GB avg = 0.198 KB (by entry num) total key len = 1.477062 GB avg = 0.027 KB total ukey len = 1.019622 GB avg = 0.015 KB total ukey num = 0.067362462 Billion total entry num = 0.054170191 Billion write speed all = 0.369271936 MB/sec (with seq num) write speed all = 0.356134411 MB/sec (without seq num) 2024/11/23-18:04:58.812107 139957651584576 [compaction_job.cc:1948] [default] [JOB 32641] Generated table #273859: 129427 keys, 42337374 bytes, temperature: kWarm 2024/11/23-18:04:58.812179 139957651584576 EVENT_LOG_v1 {"time_micros": 1732356298812142, "cf_name": "default", "job": 32641, "event": "table_file_creation", "file_number": 273859, "file_size": 42337374, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4169425292, "table_properties": {"data_size": 40316464, "index_size": 230272, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588540, "raw_average_key_size": 20, "raw_value_size": 131630153, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129427, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732356297, "oldest_key_time": 0, "file_creation_time": 1732356297, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 273859, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-18:04:58.850851 139957651584576 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273860.sst) /dev/shm/ToplingTemp/Topling-143235-Sx3YQX 2024/11/23-18:04:59.557907 139957651584576 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273860.sst): first pass time = 0.71's, 189.839'MB/sec 2024/11/23-18:05:00.334395 139957651584576 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273860.sst): old prealloc_size = 147639500, real_size = 40672224 2024/11/23-18:05:00.334517 139957651584576 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273860.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129432 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.70 raw-val = 0.1316 GB zip-val = 0.0404 GB avg-val =1016.98 avg-zval = 312.28 2024/11/23-18:05:00.334648 139957651584576 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273860.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-18:05:00.501326 139957651584576 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273860.sst): second pass time = 0.78's, 169.703'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.17's, 253.052'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2250.911'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.265'MB/sec write SST data time = 0.04's, 940.965'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 35581.691'MB/sec zip my value time = 0.78's, unzip length = 0.132'GB zip my value throughput = 169.703'MB/sec zip pipeline throughput = 169.703'MB/sec entries = 129432 avg-key = 20.00 avg-zkey = 1.70 avg-val = 1016.98 avg-zval = 312.28 usrkeys = 129432 avg-key = 12.00 avg-zkey = 1.70 avg-val = 1019.81 avg-zval = 312.28 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 52301 bytes = 196144 } seq expand size = 366107 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0404 GB dict = 1.38 MB all = 0.0422 GB } UnZip/Zip{ index = 7.0466 value = 3.2566 dict = 1.00 all = 3.1778 } Zip/UnZip{ index = 0.1419 value = 0.3071 dict = 1.00 all = 0.3147 } ---------------------------- total value len = 10.835939 GB avg = 0.200 KB (by entry num) total key len = 1.479650 GB avg = 0.027 KB total ukey len = 1.021176 GB avg = 0.015 KB total ukey num = 0.067491894 Billion total entry num = 0.054299623 Billion write speed all = 0.373332177 MB/sec (with seq num) write speed all = 0.360163958 MB/sec (without seq num) 2024/11/23-18:05:00.555545 139957651584576 [compaction_job.cc:1948] [default] [JOB 32641] Generated table #273860: 129432 keys, 42235948 bytes, temperature: kWarm 2024/11/23-18:05:00.555617 139957651584576 EVENT_LOG_v1 {"time_micros": 1732356300555580, "cf_name": "default", "job": 32641, "event": "table_file_creation", "file_number": 273860, "file_size": 42235948, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4169378813, "table_properties": {"data_size": 40419280, "index_size": 220416, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588640, "raw_average_key_size": 20, "raw_value_size": 131629686, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129432, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732356298, "oldest_key_time": 0, "file_creation_time": 1732356298, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 273860, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-18:05:00.594367 139957651584576 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273861.sst) /dev/shm/ToplingTemp/Topling-143235-IZnpNX 2024/11/23-18:05:01.252704 139957651584576 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273861.sst): first pass time = 0.66's, 203.888'MB/sec 2024/11/23-18:05:02.118570 139957651584576 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273861.sst): old prealloc_size = 147639500, real_size = 40918672 2024/11/23-18:05:02.118722 139957651584576 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273861.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129428 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.73 raw-val = 0.1316 GB zip-val = 0.0407 GB avg-val =1017.01 avg-zval = 314.17 2024/11/23-18:05:02.118896 139957651584576 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273861.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-18:05:02.300730 139957651584576 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273861.sst): second pass time = 0.87's, 152.156'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.18's, 234.310'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1772.039'MB/sec (index lex order gen) rebuild zvType time = 0.13's, 0.244'MB/sec write SST data time = 0.05's, 864.401'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 43883.222'MB/sec zip my value time = 0.87's, unzip length = 0.132'GB zip my value throughput = 152.156'MB/sec zip pipeline throughput = 152.156'MB/sec entries = 129428 avg-key = 20.00 avg-zkey = 1.73 avg-val = 1017.01 avg-zval = 314.17 usrkeys = 129428 avg-key = 12.00 avg-zkey = 1.73 avg-val = 1022.68 avg-zval = 314.17 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 104857 bytes = 393232 } seq expand size = 733999 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0407 GB dict = 1.38 MB all = 0.0427 GB } UnZip/Zip{ index = 6.9515 value = 3.2371 dict = 1.00 all = 3.1448 } Zip/UnZip{ index = 0.1439 value = 0.3089 dict = 1.00 all = 0.3180 } ---------------------------- total value len = 10.968302 GB avg = 0.202 KB (by entry num) total key len = 1.482239 GB avg = 0.027 KB total ukey len = 1.022729 GB avg = 0.015 KB total ukey num = 0.067621322 Billion total entry num = 0.054429051 Billion write speed all = 0.377402493 MB/sec (with seq num) write speed all = 0.364203607 MB/sec (without seq num) 2024/11/23-18:05:02.353926 139957651584576 [compaction_job.cc:1948] [default] [JOB 32641] Generated table #273861: 129428 keys, 42679193 bytes, temperature: kWarm 2024/11/23-18:05:02.354010 139957651584576 EVENT_LOG_v1 {"time_micros": 1732356302353962, "cf_name": "default", "job": 32641, "event": "table_file_creation", "file_number": 273861, "file_size": 42679193, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4169427610, "table_properties": {"data_size": 40662720, "index_size": 223424, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588560, "raw_average_key_size": 20, "raw_value_size": 131629311, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129428, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732356300, "oldest_key_time": 0, "file_creation_time": 1732356300, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 273861, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-18:05:02.392041 139957651584576 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273862.sst) /dev/shm/ToplingTemp/Topling-143235-88wDLY 2024/11/23-18:05:02.933178 139957651584576 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273862.sst): first pass time = 0.54's, 248.049'MB/sec 2024/11/23-18:05:03.749786 139957651584576 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273862.sst): old prealloc_size = 147639500, real_size = 40955424 2024/11/23-18:05:03.749899 139957651584576 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273862.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129427 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.71 raw-val = 0.1316 GB zip-val = 0.0407 GB avg-val =1017.02 avg-zval = 314.47 2024/11/23-18:05:03.750058 139957651584576 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273862.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-18:05:03.909725 139957651584576 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273862.sst): second pass time = 0.82's, 161.307'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 267.063'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2134.770'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.277'MB/sec write SST data time = 0.04's, 992.197'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 43019.230'MB/sec zip my value time = 0.82's, unzip length = 0.132'GB zip my value throughput = 161.307'MB/sec zip pipeline throughput = 161.307'MB/sec entries = 129427 avg-key = 20.00 avg-zkey = 1.71 avg-val = 1017.02 avg-zval = 314.47 usrkeys = 129427 avg-key = 12.00 avg-zkey = 1.71 avg-val = 1022.55 avg-zval = 314.47 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 102311 bytes = 383680 } seq expand size = 716177 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0407 GB dict = 1.38 MB all = 0.0427 GB } UnZip/Zip{ index = 6.9996 value = 3.2341 dict = 1.00 all = 3.1428 } Zip/UnZip{ index = 0.1429 value = 0.3092 dict = 1.00 all = 0.3182 } ---------------------------- total value len = 11.100648 GB avg = 0.203 KB (by entry num) total key len = 1.484827 GB avg = 0.027 KB total ukey len = 1.024282 GB avg = 0.015 KB total ukey num = 0.067750749 Billion total entry num = 0.054558478 Billion write speed all = 0.381474040 MB/sec (with seq num) write speed all = 0.368244413 MB/sec (without seq num) 2024/11/23-18:05:03.963451 139957651584576 [compaction_job.cc:1948] [default] [JOB 32641] Generated table #273862: 129427 keys, 42706845 bytes, temperature: kWarm 2024/11/23-18:05:03.963516 139957651584576 EVENT_LOG_v1 {"time_micros": 1732356303963483, "cf_name": "default", "job": 32641, "event": "table_file_creation", "file_number": 273862, "file_size": 42706845, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4169426380, "table_properties": {"data_size": 40701008, "index_size": 221888, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588540, "raw_average_key_size": 20, "raw_value_size": 131629758, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129427, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732356302, "oldest_key_time": 0, "file_creation_time": 1732356302, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 273862, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-18:05:04.000888 139957651584576 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273863.sst) /dev/shm/ToplingTemp/Topling-143235-cgsjtV 2024/11/23-18:05:04.676761 139957651584576 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273863.sst): first pass time = 0.68's, 198.595'MB/sec 2024/11/23-18:05:05.647295 139957651584576 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273863.sst): old prealloc_size = 147639500, real_size = 40708960 2024/11/23-18:05:05.647420 139957651584576 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273863.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129428 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.77 raw-val = 0.1316 GB zip-val = 0.0404 GB avg-val =1017.01 avg-zval = 312.51 2024/11/23-18:05:05.647578 139957651584576 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273863.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-18:05:05.808386 139957651584576 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273863.sst): second pass time = 0.97's, 135.733'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 263.716'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2269.288'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.274'MB/sec write SST data time = 0.04's, 990.222'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 45280.050'MB/sec zip my value time = 0.97's, unzip length = 0.132'GB zip my value throughput = 135.733'MB/sec zip pipeline throughput = 150.251'MB/sec entries = 129428 avg-key = 20.00 avg-zkey = 1.77 avg-val = 1017.01 avg-zval = 312.51 usrkeys = 129428 avg-key = 12.00 avg-zkey = 1.77 avg-val = 1022.76 avg-zval = 312.51 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 106315 bytes = 398704 } seq expand size = 744205 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0404 GB dict = 1.38 MB all = 0.0425 GB } UnZip/Zip{ index = 6.7844 value = 3.2543 dict = 1.00 all = 3.1599 } Zip/UnZip{ index = 0.1474 value = 0.3073 dict = 1.00 all = 0.3165 } ---------------------------- total value len = 11.233022 GB avg = 0.205 KB (by entry num) total key len = 1.487416 GB avg = 0.027 KB total ukey len = 1.025835 GB avg = 0.015 KB total ukey num = 0.067880177 Billion total entry num = 0.054687906 Billion write speed all = 0.385542651 MB/sec (with seq num) write speed all = 0.372282402 MB/sec (without seq num) 2024/11/23-18:05:05.860748 139957651584576 [compaction_job.cc:1948] [default] [JOB 32641] Generated table #273863: 129428 keys, 42475841 bytes, temperature: kWarm 2024/11/23-18:05:05.860813 139957651584576 EVENT_LOG_v1 {"time_micros": 1732356305860780, "cf_name": "default", "job": 32641, "event": "table_file_creation", "file_number": 273863, "file_size": 42475841, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4169435743, "table_properties": {"data_size": 40447504, "index_size": 228928, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588560, "raw_average_key_size": 20, "raw_value_size": 131629604, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129428, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732356303, "oldest_key_time": 0, "file_creation_time": 1732356303, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 273863, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-18:05:05.908095 139957651584576 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273864.sst) /dev/shm/ToplingTemp/Topling-143235-AV0YTX 2024/11/23-18:05:06.511752 139957651584576 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273864.sst): first pass time = 0.60's, 222.357'MB/sec 2024/11/23-18:05:07.315940 139957651584576 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273864.sst): old prealloc_size = 147639500, real_size = 40464224 2024/11/23-18:05:07.316072 139957651584576 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273864.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129431 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.72 raw-val = 0.1316 GB zip-val = 0.0402 GB avg-val =1016.99 avg-zval = 310.66 2024/11/23-18:05:07.316161 139957651584576 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273864.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-18:05:07.477131 139957651584576 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273864.sst): second pass time = 0.80's, 163.829'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 260.295'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2251.922'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.272'MB/sec write SST data time = 0.04's, 991.457'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 46381.241'MB/sec zip my value time = 0.80's, unzip length = 0.132'GB zip my value throughput = 163.829'MB/sec zip pipeline throughput = 163.829'MB/sec entries = 129431 avg-key = 20.00 avg-zkey = 1.72 avg-val = 1016.99 avg-zval = 310.66 usrkeys = 129431 avg-key = 12.00 avg-zkey = 1.72 avg-val = 1018.72 avg-zval = 310.66 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 31937 bytes = 119776 } seq expand size = 223559 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0402 GB dict = 1.38 MB all = 0.0420 GB } UnZip/Zip{ index = 6.9938 value = 3.2736 dict = 1.00 all = 3.1994 } Zip/UnZip{ index = 0.1430 value = 0.3055 dict = 1.00 all = 0.3126 } ---------------------------- total value len = 11.364875 GB avg = 0.207 KB (by entry num) total key len = 1.490005 GB avg = 0.027 KB total ukey len = 1.027388 GB avg = 0.015 KB total ukey num = 0.068009608 Billion total entry num = 0.054817337 Billion write speed all = 0.389597739 MB/sec (with seq num) write speed all = 0.376306780 MB/sec (without seq num) 2024/11/23-18:05:07.532797 139957651584576 [compaction_job.cc:1948] [default] [JOB 32641] Generated table #273864: 129431 keys, 41951357 bytes, temperature: kWarm 2024/11/23-18:05:07.532868 139957651584576 EVENT_LOG_v1 {"time_micros": 1732356307532831, "cf_name": "default", "job": 32641, "event": "table_file_creation", "file_number": 273864, "file_size": 41951357, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4169433317, "table_properties": {"data_size": 40209616, "index_size": 222080, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588620, "raw_average_key_size": 20, "raw_value_size": 131629901, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129431, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732356305, "oldest_key_time": 0, "file_creation_time": 1732356305, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 273864, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-18:05:07.573000 139957651584576 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273865.sst) /dev/shm/ToplingTemp/Topling-143235-lw9wBZ 2024/11/23-18:05:08.293635 139957651584576 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273865.sst): first pass time = 0.72's, 186.260'MB/sec 2024/11/23-18:05:09.247670 139957651584576 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273865.sst): old prealloc_size = 147639500, real_size = 40599904 2024/11/23-18:05:09.247790 139957651584576 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273865.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129425 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.72 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1017.03 avg-zval = 311.73 2024/11/23-18:05:09.247869 139957651584576 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273865.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-18:05:09.405501 139957651584576 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273865.sst): second pass time = 0.95's, 138.079'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 266.693'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2242.666'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.277'MB/sec write SST data time = 0.04's, 1023.923'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 43828.478'MB/sec zip my value time = 0.95's, unzip length = 0.132'GB zip my value throughput = 138.079'MB/sec zip pipeline throughput = 138.079'MB/sec entries = 129425 avg-key = 20.00 avg-zkey = 1.72 avg-val = 1017.03 avg-zval = 311.73 usrkeys = 129425 avg-key = 12.00 avg-zkey = 1.72 avg-val = 1018.73 avg-zval = 311.73 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 31337 bytes = 117536 } seq expand size = 219359 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0421 GB } UnZip/Zip{ index = 6.9934 value = 3.2626 dict = 1.00 all = 3.1892 } Zip/UnZip{ index = 0.1430 value = 0.3065 dict = 1.00 all = 0.3136 } ---------------------------- total value len = 11.496724 GB avg = 0.209 KB (by entry num) total key len = 1.492593 GB avg = 0.027 KB total ukey len = 1.028941 GB avg = 0.015 KB total ukey num = 0.068139033 Billion total entry num = 0.054946762 Billion write speed all = 0.393649173 MB/sec (with seq num) write speed all = 0.380327612 MB/sec (without seq num) 2024/11/23-18:05:09.458504 139957651584576 [compaction_job.cc:1948] [default] [JOB 32641] Generated table #273865: 129425 keys, 42085190 bytes, temperature: kWarm 2024/11/23-18:05:09.458570 139957651584576 EVENT_LOG_v1 {"time_micros": 1732356309458536, "cf_name": "default", "job": 32641, "event": "table_file_creation", "file_number": 273865, "file_size": 42085190, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4169431247, "table_properties": {"data_size": 40345296, "index_size": 222080, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588500, "raw_average_key_size": 20, "raw_value_size": 131629355, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129425, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732356307, "oldest_key_time": 0, "file_creation_time": 1732356307, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 273865, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-18:05:09.504178 139957651584576 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273866.sst) /dev/shm/ToplingTemp/Topling-143235-p3NmqY 2024/11/23-18:05:10.057377 139957651584576 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273866.sst): first pass time = 0.55's, 242.642'MB/sec 2024/11/23-18:05:10.834579 139957651584576 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273866.sst): old prealloc_size = 147639500, real_size = 40463392 2024/11/23-18:05:10.834701 139957651584576 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273866.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129431 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.72 raw-val = 0.1316 GB zip-val = 0.0402 GB avg-val =1016.99 avg-zval = 310.66 2024/11/23-18:05:10.834785 139957651584576 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273866.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-18:05:10.994913 139957651584576 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273866.sst): second pass time = 0.78's, 169.844'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 261.665'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2213.804'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.275'MB/sec write SST data time = 0.04's, 984.150'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 46164.695'MB/sec zip my value time = 0.78's, unzip length = 0.132'GB zip my value throughput = 169.844'MB/sec zip pipeline throughput = 169.844'MB/sec entries = 129431 avg-key = 20.00 avg-zkey = 1.72 avg-val = 1016.99 avg-zval = 310.66 usrkeys = 129431 avg-key = 12.00 avg-zkey = 1.72 avg-val = 1018.67 avg-zval = 310.66 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 31064 bytes = 116512 } seq expand size = 217448 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0402 GB dict = 1.38 MB all = 0.0419 GB } UnZip/Zip{ index = 6.9938 value = 3.2737 dict = 1.00 all = 3.1997 } Zip/UnZip{ index = 0.1430 value = 0.3055 dict = 1.00 all = 0.3125 } ---------------------------- total value len = 11.628571 GB avg = 0.211 KB (by entry num) total key len = 1.495182 GB avg = 0.027 KB total ukey len = 1.030494 GB avg = 0.015 KB total ukey num = 0.068268464 Billion total entry num = 0.055076193 Billion write speed all = 0.397704184 MB/sec (with seq num) write speed all = 0.384351886 MB/sec (without seq num) 2024/11/23-18:05:11.048513 139957651584576 [compaction_job.cc:1948] [default] [JOB 32641] Generated table #273866: 129431 keys, 41947292 bytes, temperature: kWarm 2024/11/23-18:05:11.048582 139957651584576 EVENT_LOG_v1 {"time_micros": 1732356311048547, "cf_name": "default", "job": 32641, "event": "table_file_creation", "file_number": 273866, "file_size": 41947292, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4169412665, "table_properties": {"data_size": 40208784, "index_size": 222080, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588620, "raw_average_key_size": 20, "raw_value_size": 131630037, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129431, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732356309, "oldest_key_time": 0, "file_creation_time": 1732356309, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 273866, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-18:05:11.088386 139957651584576 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273867.sst) /dev/shm/ToplingTemp/Topling-143235-HGukLW 2024/11/23-18:05:11.742947 139957651584576 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273867.sst): first pass time = 0.65's, 205.063'MB/sec 2024/11/23-18:05:12.732272 139957651584576 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273867.sst): old prealloc_size = 147639500, real_size = 40889456 2024/11/23-18:05:12.732400 139957651584576 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273867.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129431 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.72 raw-val = 0.1316 GB zip-val = 0.0406 GB avg-val =1016.99 avg-zval = 313.95 2024/11/23-18:05:12.732540 139957651584576 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273867.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-18:05:12.893031 139957651584576 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273867.sst): second pass time = 0.99's, 133.149'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 265.200'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2148.349'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.273'MB/sec write SST data time = 0.04's, 1014.520'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 34839.879'MB/sec zip my value time = 0.99's, unzip length = 0.132'GB zip my value throughput = 133.149'MB/sec zip pipeline throughput = 143.571'MB/sec entries = 129431 avg-key = 20.00 avg-zkey = 1.72 avg-val = 1016.99 avg-zval = 313.95 usrkeys = 129431 avg-key = 12.00 avg-zkey = 1.72 avg-val = 1022.30 avg-zval = 313.95 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 98271 bytes = 368528 } seq expand size = 687897 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0406 GB dict = 1.38 MB all = 0.0426 GB } UnZip/Zip{ index = 6.9897 value = 3.2393 dict = 1.00 all = 3.1488 } Zip/UnZip{ index = 0.1431 value = 0.3087 dict = 1.00 all = 0.3176 } ---------------------------- total value len = 11.760889 GB avg = 0.213 KB (by entry num) total key len = 1.497770 GB avg = 0.027 KB total ukey len = 1.032048 GB avg = 0.015 KB total ukey num = 0.068397895 Billion total entry num = 0.055205624 Billion write speed all = 0.401769287 MB/sec (with seq num) write speed all = 0.388386380 MB/sec (without seq num) 2024/11/23-18:05:12.945477 139957651584576 [compaction_job.cc:1948] [default] [JOB 32641] Generated table #273867: 129431 keys, 42625422 bytes, temperature: kWarm 2024/11/23-18:05:12.945547 139957651584576 EVENT_LOG_v1 {"time_micros": 1732356312945511, "cf_name": "default", "job": 32641, "event": "table_file_creation", "file_number": 273867, "file_size": 42625422, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4169435342, "table_properties": {"data_size": 40634720, "index_size": 222208, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588620, "raw_average_key_size": 20, "raw_value_size": 131629502, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129431, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732356311, "oldest_key_time": 0, "file_creation_time": 1732356311, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 273867, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-18:05:12.989776 139957651584576 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273868.sst) /dev/shm/ToplingTemp/Topling-143235-ruV4mX 2024/11/23-18:05:12.997700 139957651584576 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273868.sst): first pass time = 0.01's, 371.598'MB/sec 2024/11/23-18:05:13.028762 139957651584576 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273868.sst): old prealloc_size = 147639500, real_size = 931496 2024/11/23-18:05:13.028809 139957651584576 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273868.sst): index type = UintIndex_IL_256_32 , store type = DictZipBlobStore usrkeys = 2826 prefix = 4 raw-key = 0.0000 GB zip-key = 0.0000 GB avg-key = 8.00 avg-zkey = 0.30 raw-val = 0.0029 GB zip-val = 0.0009 GB avg-val =1016.99 avg-zval = 329.00 2024/11/23-18:05:13.032361 139957651584576 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00/273868.sst): second pass time = 0.03's, 94.362'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.00's, 271.357'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 30.823'MB/sec (index lex order gen) rebuild zvType time = 0.00's, 0.304'MB/sec write SST data time = 0.00's, 787.470'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.033'MB, throughput = 1438.793'MB/sec zip my value time = 0.03's, unzip length = 0.003'GB zip my value throughput = 94.362'MB/sec zip pipeline throughput = 94.362'MB/sec entries = 2826 avg-key = 20.00 avg-zkey = 0.32 avg-val = 1016.99 avg-zval = 329.00 usrkeys = 2826 avg-key = 12.00 avg-zkey = 0.32 avg-val = 1023.99 avg-zval = 329.00 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 2826 bytes = 8848 } seq expand size = 19782 multi value expand size = 0 cnt WriteAppend = 11 UnZipSize{ index = 0.0000 GB value = 0.0029 GB dict = 0.03 MB all = 0.0029 GB } __ZipSize{ index = 0.0000 GB value = 0.0009 GB dict = 0.03 MB all = 0.0010 GB } UnZip/Zip{ index = 37.8482 value = 3.0912 dict = 1.00 all = 3.0112 } Zip/UnZip{ index = 0.0264 value = 0.3235 dict = 1.00 all = 0.3321 } ---------------------------- total value len = 11.763783 GB avg = 0.213 KB (by entry num) total key len = 1.497827 GB avg = 0.027 KB total ukey len = 1.032081 GB avg = 0.015 KB total ukey num = 0.068400721 Billion total entry num = 0.055208450 Billion write speed all = 0.401856991 MB/sec (with seq num) write speed all = 0.388473456 MB/sec (without seq num) 2024/11/23-18:05:13.040822 139957651584576 [compaction_job.cc:1948] [default] [JOB 32641] Generated table #273868: 2826 keys, 973230 bytes, temperature: kWarm 2024/11/23-18:05:13.040878 139957651584576 EVENT_LOG_v1 {"time_micros": 1732356313040844, "cf_name": "default", "job": 32641, "event": "table_file_creation", "file_number": 273868, "file_size": 973230, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4137859715, "largest_seqno": 4167925725, "table_properties": {"data_size": 929744, "index_size": 896, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 56520, "raw_average_key_size": 20, "raw_value_size": 2874022, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 2826, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-UintIndex_IL_256_32-DictZipBlobStore", "creation_time": 1732356312, "oldest_key_time": 0, "file_creation_time": 1732356312, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 273868, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-18:05:13.050795 139957651584576 [compaction_job.cc:703] job-32641: subcompact[0], size: 0.935808 G, files: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-32641/att-00 [273846,273847,273848,273849,273850,273851,273852,273853,273854,273855,273856,273857,273858,273859,273860,273861,273862,273863,273864,273865,273866,273867,273868] 2024/11/23-18:05:13.195593 139957651584576 (Original Log Time 2024/11/23-18:04:29.484501) EVENT_LOG_v1 {"time_micros": 1732356269484434, "job": 32641, "event": "compaction_started", "compaction_reason": "FilesMarkedForCompaction", "files_L2": [273841], "files_L3": [273767, 273768, 273769, 273770, 273771, 273772, 273773, 273774, 273775, 273776, 273777, 273778, 273779, 273780, 273781, 273782, 273783, 273784, 273785, 273786, 273787, 273790], "score": 0.99511, "input_data_size": 967541321, "oldest_snapshot_seqno": 4169471206} 2024/11/23-18:05:13.195596 139957651584576 (Original Log Time 2024/11/23-18:05:13.194007) [compaction_job.cc:2022] [default] [JOB 32641] Compacted 1@2 + 22@3 files to L3 => 935808257 bytes 2024/11/23-18:05:13.195597 139957651584576 (Original Log Time 2024/11/23-18:05:13.195519) [compaction_job.cc:1224] [default] compacted to: files[0 0 0 23 0 0 0] max score 0.03, MB/sec: 22.2 rd, 21.5 wr, level 3, files in(1, 22) out(23 +0 blob) MB in(31.2, 891.5 +0.0 blob) out(892.5 +0.0 blob), read-write-amplify(58.2) write-amplify(28.6) OK, records in: 2879373, records dropped: 29087 output_compression: Snappy 2024/11/23-18:05:13.195601 139957651584576 (Original Log Time 2024/11/23-18:05:13.195567) EVENT_LOG_v1 {"time_micros": 1732356313195542, "cf": "default", "job": 32641, "event": "compaction_finished", "compaction_time_micros": 43566298, "compaction_time_cpu_micros": 8640182, "output_level": 3, "num_output_files": 23, "total_output_size": 935808257, "num_input_records": 2879373, "num_output_records": 2850286, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "file_write_nanos": 684798365, "file_range_sync_nanos": 0, "file_fsync_nanos": 15244, "file_prepare_write_nanos": 51314, "lsm_state": [0, 0, 0, 23, 0, 0, 0]} 2024/11/23-18:05:13.328497 139957651584576 DEBG dcompact_worker.cpp:240: HttpPost: 200 OK: url = http://nlb-7zny4kaa1poal01o64.cn-shenzhen.nlb.aliyuncs.com:8443, body = {"instanceId":"nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137","labourId":"","dbId":"d89b4006-2803-486e-b7a2-759bcf348921","dbStarts":1732256054,"starts":1732356269,"executesMs":43864,"compactionJobId":32641,"attempt":0,"compactionInputRawBytes":2985895310,"compactionInputZipBytes":967541321,"compactionOutputRawBytes":0,"compactionOutputZipBytes":935808257,"headers":{"Accept":"*/*","Connection":"close","Host":"aliyun-topling-saas.topling.cn:18443","RemoteIp":"120.24.192.169","X-Forwarded-For":"120.24.192.169","region":"cn-shenzhen","token":"e6474c481bd4415abc537135cc03626b","instance-token":"e6474c481bd4415abc537135cc03626b","provider":"aliyun","CloudMarketInstanceId":"si-59c0ae5c955845588903","MeteringAssit":"","Transfer-Encoding":"chunked","traceparent":"00-59efa49388559d942a07320331c28089-7c0f5f89adaf8b0e-00"}}, response = 2024/11/23-18:05:13.328579 139957651584576 INFO dcompact_worker.cpp:1459: finish /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-32641/att-00: olev 3, work 43.864 s, result 8.113 ms, install 1.609 ms, input{raw 2.781 GiB zip 922.719 MiB}