2024/11/23-21:25:23.944207 139957626406464 DEBG dcompact_worker.cpp:2214: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00: fork to child time = 0.007573 sec 2024/11/23-21:25:23.944920 139957626406464 DEBG dcompact_worker.cpp:1013: Beg SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00 2024/11/23-21:25:23.954027 139957626406464 DEBG dcompact_worker.cpp:1033: End SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00 2024/11/23-21:25:23.954904 139957626406464 TRAC dcompact_worker.cpp:1083: INFO_LOG_LEVEL: rpc = INFO_LEVEL, env_var = undefined 2024/11/23-21:25:23.955142 139957626406464 [WARN] [column_family.cc:386] multiple cf_paths/db_paths and level_compaction_dynamic_level_bytes can't be used together 2024/11/23-21:25:24.007750 139957626406464 [version_set.cc:6208] Recovering from manifest file: /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-36124/att-00/MANIFEST-206347 2024/11/23-21:25:24.040536 139957626406464 [version_set.cc:6251] Recovered from manifest file:/worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-36124/att-00/MANIFEST-206347 succeeded,manifest_file_number is 206347, next_file_number is 281430, last_sequence is 4271528702, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 281178 2024/11/23-21:25:24.040543 139957626406464 [version_set.cc:6266] Column family [default] (ID 0), log number is 0 2024/11/23-21:25:24.040870 139957626406464 [version_set.cc:5721] Creating manifest 281430 2024/11/23-21:25:24.075171 139957626406464 DEBG dcompact_worker.cpp:1218: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00: bottommost_level: fake = 1, rpc = 1 2024/11/23-21:25:24.097909 139957626406464 [compaction_job.cc:2437] [default] [JOB 36124] Compacting 9@3 + 147@4 files to L4, score -1.00, subcompactions 1 : 1 2024/11/23-21:25:24.097961 139957626406464 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 27038 Base level 3, inputs: [281414(40MB) 281415(40MB) 281416(40MB) 281417(40MB) 281418(40MB) 281419(40MB) 281420(40MB) 281421(40MB) 281422(40MB)], [200710(31MB) 200711(31MB) 200781(39MB) 200787(39MB) 200859(64MB) 200864(39MB) 200925(34MB) 200939(39MB) 200997(61MB) 201017(39MB) 201074(34MB) 201081(39MB) 201094(39MB) 201164(31MB) 201169(39MB) 201171(34MB) 201245(39MB) 201247(39MB) 201305(31MB) 201320(39MB) 201323(34MB) 201381(39MB) 201401(39MB) 201402(31MB) 201459(39MB) 201476(37MB) 201534(39MB) 201553(39MB) 201554(38MB) 201619(39MB) 201628(37MB) 201690(39MB) 201701(38MB) 201704(39MB) 201767(39MB) 201783(30MB) 201848(39MB) 201858(35MB) 201860(39MB) 201928(39MB) 201934(33MB) 201935(39MB) 202005(32MB) 202014(39MB) 202016(39MB) 202080(36MB) 202091(39MB) 202156(39MB) 202162(39MB) 202166(39MB) 202218(29MB) 202230(39MB) 202246(36MB) 202316(39MB) 202320(39MB) 202321(29MB) 202388(39MB) 202394(33MB) 202460(39MB) 202466(39MB) 202468(36MB) 202535(39MB) 202541(29MB) 202542(39MB) 202611(39MB) 202614(36MB) 202615(39MB) 202684(29MB) 202690(39MB) 202754(39MB) 202763(36MB) 202765(39MB) 202827(36MB) 202841(39MB) 202842(39MB) 202913(32MB) 202916(39MB) 202917(33MB) 202994(39MB) 202995(39MB) 203060(32MB) 203064(39MB) 203071(33MB) 209758(918KB) 214399(724KB) 206703(4486KB) 214175(710KB) 277850(79MB) 277851(49MB) 203263(39MB) 262444(537KB) 262334(534KB) 262112(1187KB) 236579(1303KB) 228939(1966KB) 216211(820KB) 261640(2852KB) 261499(84KB) 207496(2554KB) 221256(778KB) 243723(594KB) 228032(662KB) 243528(1595KB) 243378(97KB) 220589(1394KB) 220377(752KB) 235187(620KB) 235078(624KB) 234976(658KB) 227110(1259KB) 260894(542KB) 203696(39MB) 203697(39MB) 203698(39MB) 203699(39MB) 259123(85KB) 241684(602KB) 258757(567KB) 204800(39MB) 204801(39MB) 204802(39MB) 204803(39MB) 260684(1952KB) 260304(1310KB) 260096(1349KB) 242514(3059KB) 242286(1271KB) 226425(1739KB) 233838(40KB) 209793(520KB) 249711(3514KB) 249328(32KB) 225592(47KB) 225466(1460KB) 257481(112KB) 225028(1444KB) 240585(653KB) 224818(49KB) 224703(1340KB) 257218(34KB) 248651(1809KB) 208693(4430KB) 224030(1384KB) 205681(39MB) 205678(39MB) 205679(39MB) 205680(39MB)] 2024/11/23-21:25:24.106077 139957626406464 [top_zip_table.cc:59] core git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-21:25:24.106104 139957626406464 [top_zip_table.cc:60] fsa git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-21:25:24.106129 139957626406464 [top_zip_table.cc:61] zbs git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-21:25:24.106135 139957626406464 [top_zip_table.cc:62] topling-zip_table_reader: git_version_hash_info_is: commit a4a382006cb82713acf5b3425835f22711877681 Author: leipeng Date: 2024-04-11 19:44:14 +0800 fixed_len_hole_index.cc: Add env bool FixedLenHoleIndexUseAVX512 for ut & debug 1. FixedLenHoleIndexUseAVX512 is only in unit tests or debug 2. In release mode, use avx512 by compile options(-march=) g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/23-21:25:24.106140 139957626406464 [top_zip_table.cc:64] topling-rocks git_version_hash_info_is: commit feab587e468621ba0204d47b4ffacc52e7c4290d Author: leipeng Date: 2024-03-22 13:35:06 +0800 ToplingZipTableBuilder::Add: immediately return after error This function returns void, and caller does not check builder->status() after calling this function and graceful abandon. So immediately return after error, and return error status in Finish(). g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/23-21:25:25.044528 139957626406464 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281431.sst) /dev/shm/ToplingTemp/Topling-193418-QE8cZz 2024/11/23-21:25:26.190070 139957626406464 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281431.sst): first pass time = 1.15's, 234.344'MB/sec 2024/11/23-21:25:27.710379 139957626406464 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281431.sst): old prealloc_size = 295279001, real_size = 80495744 2024/11/23-21:25:27.710561 139957626406464 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281431.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258859 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1017.00 avg-zval = 309.03 2024/11/23-21:25:27.710605 139957626406464 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281431.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:25:28.033272 139957626406464 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281431.sst): second pass time = 1.52's, 173.330'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.32's, 257.441'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2682.908'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.275'MB/sec write SST data time = 0.09's, 947.572'MB/sec dict compress time = 0.00's, 2662271.287'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 83314.557'MB/sec zip my value time = 1.52's, unzip length = 0.263'GB zip my value throughput = 173.330'MB/sec zip pipeline throughput = 173.330'MB/sec entries = 258859 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1017.00 avg-zval = 309.03 usrkeys = 258859 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1017.00 avg-zval = 309.03 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1230 value = 3.2910 dict = 1.00 all = 3.2294 } Zip/UnZip{ index = 0.1404 value = 0.3039 dict = 1.00 all = 0.3097 } ---------------------------- total value len = 9.111879 GB avg = 0.173 KB (by entry num) total key len = 1.445998 GB avg = 0.027 KB total ukey len = 1.000984 GB avg = 0.015 KB total ukey num = 0.065809294 Billion total entry num = 0.052617023 Billion write speed all = 0.234537047 MB/sec (with seq num) write speed all = 0.225186197 MB/sec (without seq num) 2024/11/23-21:25:28.130005 139957626406464 [compaction_job.cc:1948] [default] [JOB 36124] Generated table #281431: 258859 keys, 83122097 bytes, temperature: kWarm 2024/11/23-21:25:28.130108 139957626406464 EVENT_LOG_v1 {"time_micros": 1732368328130045, "cf_name": "default", "job": 36124, "event": "table_file_creation", "file_number": 281431, "file_size": 83122097, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79994736, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177180, "raw_average_key_size": 20, "raw_value_size": 263259123, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 258859, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732368325, "oldest_key_time": 0, "file_creation_time": 1732368325, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281431, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:25:28.190016 139957626406464 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281432.sst) /dev/shm/ToplingTemp/Topling-193418-g6l6Jw 2024/11/23-21:25:29.878667 139957626406464 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281432.sst): first pass time = 1.69's, 158.969'MB/sec 2024/11/23-21:25:31.431706 139957626406464 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281432.sst): old prealloc_size = 295279001, real_size = 81068480 2024/11/23-21:25:31.431897 139957626406464 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281432.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258859 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0806 GB avg-val =1017.00 avg-zval = 311.24 2024/11/23-21:25:31.431934 139957626406464 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281432.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:25:31.753413 139957626406464 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281432.sst): second pass time = 1.55's, 169.646'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.32's, 260.178'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2599.167'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.275'MB/sec write SST data time = 0.09's, 967.133'MB/sec dict compress time = 0.00's, 2662904.950'MB/sec z-dict build time = 0.00's, sample length = 2.690'MB, throughput = 76322.654'MB/sec zip my value time = 1.55's, unzip length = 0.263'GB zip my value throughput = 169.646'MB/sec zip pipeline throughput = 169.646'MB/sec entries = 258859 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1017.00 avg-zval = 311.24 usrkeys = 258859 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1017.00 avg-zval = 311.24 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0806 GB dict = 2.69 MB all = 0.0837 GB } UnZip/Zip{ index = 7.1230 value = 3.2676 dict = 1.00 all = 3.2073 } Zip/UnZip{ index = 0.1404 value = 0.3060 dict = 1.00 all = 0.3118 } ---------------------------- total value len = 9.375138 GB avg = 0.177 KB (by entry num) total key len = 1.451175 GB avg = 0.027 KB total ukey len = 1.004091 GB avg = 0.015 KB total ukey num = 0.066068153 Billion total entry num = 0.052875882 Billion write speed all = 0.240480325 MB/sec (with seq num) write speed all = 0.231084248 MB/sec (without seq num) 2024/11/23-21:25:31.857553 139957626406464 [compaction_job.cc:1948] [default] [JOB 36124] Generated table #281432: 258859 keys, 83695473 bytes, temperature: kWarm 2024/11/23-21:25:31.857621 139957626406464 EVENT_LOG_v1 {"time_micros": 1732368331857587, "cf_name": "default", "job": 36124, "event": "table_file_creation", "file_number": 281432, "file_size": 83695473, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 80567472, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177180, "raw_average_key_size": 20, "raw_value_size": 263258944, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 258859, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732368328, "oldest_key_time": 0, "file_creation_time": 1732368328, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281432, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:25:31.914616 139957626406464 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281433.sst) /dev/shm/ToplingTemp/Topling-193418-gX5wbz 2024/11/23-21:25:33.330414 139957626406464 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281433.sst): first pass time = 1.42's, 189.606'MB/sec 2024/11/23-21:25:34.777278 139957626406464 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281433.sst): old prealloc_size = 295279001, real_size = 80480000 2024/11/23-21:25:34.777456 139957626406464 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281433.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258859 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1017.00 avg-zval = 308.97 2024/11/23-21:25:34.777494 139957626406464 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281433.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:25:35.099231 139957626406464 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281433.sst): second pass time = 1.45's, 182.122'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.32's, 258.159'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2810.440'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.279'MB/sec write SST data time = 0.09's, 928.052'MB/sec dict compress time = 0.00's, 2662942.574'MB/sec z-dict build time = 0.00's, sample length = 2.690'MB, throughput = 78713.805'MB/sec zip my value time = 1.45's, unzip length = 0.263'GB zip my value throughput = 182.122'MB/sec zip pipeline throughput = 182.122'MB/sec entries = 258859 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1017.00 avg-zval = 308.97 usrkeys = 258859 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1017.00 avg-zval = 308.97 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1230 value = 3.2916 dict = 1.00 all = 3.2300 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 9.638396 GB avg = 0.181 KB (by entry num) total key len = 1.456353 GB avg = 0.027 KB total ukey len = 1.007197 GB avg = 0.015 KB total ukey num = 0.066327012 Billion total entry num = 0.053134741 Billion write speed all = 0.246424662 MB/sec (with seq num) write speed all = 0.236983287 MB/sec (without seq num) 2024/11/23-21:25:35.198424 139957626406464 [compaction_job.cc:1948] [default] [JOB 36124] Generated table #281433: 258859 keys, 83107031 bytes, temperature: kWarm 2024/11/23-21:25:35.198495 139957626406464 EVENT_LOG_v1 {"time_micros": 1732368335198457, "cf_name": "default", "job": 36124, "event": "table_file_creation", "file_number": 281433, "file_size": 83107031, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79978992, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177180, "raw_average_key_size": 20, "raw_value_size": 263258636, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 258859, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732368331, "oldest_key_time": 0, "file_creation_time": 1732368331, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281433, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:25:35.255332 139957626406464 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281434.sst) /dev/shm/ToplingTemp/Topling-193418-jpuyjA 2024/11/23-21:25:36.494662 139957626406464 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281434.sst): first pass time = 1.24's, 216.604'MB/sec 2024/11/23-21:25:37.970349 139957626406464 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281434.sst): old prealloc_size = 295279001, real_size = 80484592 2024/11/23-21:25:37.970533 139957626406464 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281434.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258855 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1017.01 avg-zval = 308.99 2024/11/23-21:25:37.970569 139957626406464 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281434.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:25:38.291483 139957626406464 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281434.sst): second pass time = 1.47's, 178.569'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.32's, 258.825'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2694.945'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.277'MB/sec write SST data time = 0.09's, 950.532'MB/sec dict compress time = 0.00's, 2663139.604'MB/sec z-dict build time = 0.00's, sample length = 2.690'MB, throughput = 86518.415'MB/sec zip my value time = 1.47's, unzip length = 0.263'GB zip my value throughput = 178.569'MB/sec zip pipeline throughput = 178.569'MB/sec entries = 258855 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1017.01 avg-zval = 308.99 usrkeys = 258855 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1017.01 avg-zval = 308.99 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1229 value = 3.2914 dict = 1.00 all = 3.2298 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 9.901655 GB avg = 0.185 KB (by entry num) total key len = 1.461530 GB avg = 0.027 KB total ukey len = 1.010303 GB avg = 0.015 KB total ukey num = 0.066585867 Billion total entry num = 0.053393596 Billion write speed all = 0.252368972 MB/sec (with seq num) write speed all = 0.242882274 MB/sec (without seq num) 2024/11/23-21:25:38.387950 139957626406464 [compaction_job.cc:1948] [default] [JOB 36124] Generated table #281434: 258855 keys, 83111838 bytes, temperature: kWarm 2024/11/23-21:25:38.388032 139957626406464 EVENT_LOG_v1 {"time_micros": 1732368338387995, "cf_name": "default", "job": 36124, "event": "table_file_creation", "file_number": 281434, "file_size": 83111838, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79983584, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177100, "raw_average_key_size": 20, "raw_value_size": 263258504, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 258855, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732368335, "oldest_key_time": 0, "file_creation_time": 1732368335, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281434, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:25:38.449117 139957626406464 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281435.sst) /dev/shm/ToplingTemp/Topling-193418-McQJEw 2024/11/23-21:25:40.147870 139957626406464 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281435.sst): first pass time = 1.70's, 158.024'MB/sec 2024/11/23-21:25:41.607378 139957626406464 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281435.sst): old prealloc_size = 295279001, real_size = 80477120 2024/11/23-21:25:41.607566 139957626406464 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281435.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258861 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1016.99 avg-zval = 308.95 2024/11/23-21:25:41.607607 139957626406464 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281435.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:25:41.926778 139957626406464 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281435.sst): second pass time = 1.46's, 180.558'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.32's, 260.202'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2646.551'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.279'MB/sec write SST data time = 0.09's, 954.446'MB/sec dict compress time = 0.00's, 2662497.030'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 81306.222'MB/sec zip my value time = 1.46's, unzip length = 0.263'GB zip my value throughput = 180.558'MB/sec zip pipeline throughput = 180.558'MB/sec entries = 258861 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1016.99 avg-zval = 308.95 usrkeys = 258861 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1016.99 avg-zval = 308.95 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1230 value = 3.2917 dict = 1.00 all = 3.2301 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 10.164914 GB avg = 0.189 KB (by entry num) total key len = 1.466707 GB avg = 0.027 KB total ukey len = 1.013410 GB avg = 0.015 KB total ukey num = 0.066844728 Billion total entry num = 0.053652457 Billion write speed all = 0.258309909 MB/sec (with seq num) write speed all = 0.248777988 MB/sec (without seq num) 2024/11/23-21:25:42.024500 139957626406464 [compaction_job.cc:1948] [default] [JOB 36124] Generated table #281435: 258861 keys, 83103701 bytes, temperature: kWarm 2024/11/23-21:25:42.024568 139957626406464 EVENT_LOG_v1 {"time_micros": 1732368342024533, "cf_name": "default", "job": 36124, "event": "table_file_creation", "file_number": 281435, "file_size": 83103701, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79976112, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177220, "raw_average_key_size": 20, "raw_value_size": 263258881, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 258861, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732368338, "oldest_key_time": 0, "file_creation_time": 1732368338, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281435, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:25:42.081424 139957626406464 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281436.sst) /dev/shm/ToplingTemp/Topling-193418-pGnhBz 2024/11/23-21:25:43.429943 139957626406464 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281436.sst): first pass time = 1.35's, 199.066'MB/sec 2024/11/23-21:25:44.938001 139957626406464 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281436.sst): old prealloc_size = 295279001, real_size = 80481232 2024/11/23-21:25:44.938200 139957626406464 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281436.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258855 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1017.01 avg-zval = 308.98 2024/11/23-21:25:44.938245 139957626406464 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281436.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:25:45.264096 139957626406464 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281436.sst): second pass time = 1.51's, 174.738'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.33's, 254.858'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2612.120'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.276'MB/sec write SST data time = 0.09's, 909.027'MB/sec dict compress time = 0.00's, 2662574.257'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 82087.912'MB/sec zip my value time = 1.51's, unzip length = 0.263'GB zip my value throughput = 174.738'MB/sec zip pipeline throughput = 174.738'MB/sec entries = 258855 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1017.01 avg-zval = 308.98 usrkeys = 258855 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1017.01 avg-zval = 308.98 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1229 value = 3.2916 dict = 1.00 all = 3.2300 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 10.428173 GB avg = 0.193 KB (by entry num) total key len = 1.471884 GB avg = 0.027 KB total ukey len = 1.016516 GB avg = 0.015 KB total ukey num = 0.067103583 Billion total entry num = 0.053911312 Billion write speed all = 0.264251641 MB/sec (with seq num) write speed all = 0.254674442 MB/sec (without seq num) 2024/11/23-21:25:45.359632 139957626406464 [compaction_job.cc:1948] [default] [JOB 36124] Generated table #281436: 258855 keys, 83107875 bytes, temperature: kWarm 2024/11/23-21:25:45.359706 139957626406464 EVENT_LOG_v1 {"time_micros": 1732368345359667, "cf_name": "default", "job": 36124, "event": "table_file_creation", "file_number": 281436, "file_size": 83107875, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79980224, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177100, "raw_average_key_size": 20, "raw_value_size": 263259316, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 258855, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732368342, "oldest_key_time": 0, "file_creation_time": 1732368342, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281436, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:25:45.415276 139957626406464 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281437.sst) /dev/shm/ToplingTemp/Topling-193418-xOxtQw 2024/11/23-21:25:46.725362 139957626406464 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281437.sst): first pass time = 1.31's, 204.906'MB/sec 2024/11/23-21:25:48.249708 139957626406464 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281437.sst): old prealloc_size = 295279001, real_size = 80481744 2024/11/23-21:25:48.249883 139957626406464 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281437.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258860 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1016.99 avg-zval = 308.97 2024/11/23-21:25:48.249921 139957626406464 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281437.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:25:48.606208 139957626406464 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281437.sst): second pass time = 1.52's, 172.850'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.36's, 233.134'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2856.574'MB/sec (index lex order gen) rebuild zvType time = 0.25's, 0.256'MB/sec write SST data time = 0.10's, 802.319'MB/sec dict compress time = 0.00's, 2662273.267'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 87264.986'MB/sec zip my value time = 1.52's, unzip length = 0.263'GB zip my value throughput = 172.850'MB/sec zip pipeline throughput = 172.850'MB/sec entries = 258860 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1016.99 avg-zval = 308.97 usrkeys = 258860 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1016.99 avg-zval = 308.97 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1230 value = 3.2915 dict = 1.00 all = 3.2300 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 10.691432 GB avg = 0.197 KB (by entry num) total key len = 1.477061 GB avg = 0.027 KB total ukey len = 1.019622 GB avg = 0.015 KB total ukey num = 0.067362443 Billion total entry num = 0.054170172 Billion write speed all = 0.270192460 MB/sec (with seq num) write speed all = 0.260569989 MB/sec (without seq num) 2024/11/23-21:25:48.727658 139957626406464 [compaction_job.cc:1948] [default] [JOB 36124] Generated table #281437: 258860 keys, 83108083 bytes, temperature: kWarm 2024/11/23-21:25:48.727704 139957626406464 EVENT_LOG_v1 {"time_micros": 1732368348727676, "cf_name": "default", "job": 36124, "event": "table_file_creation", "file_number": 281437, "file_size": 83108083, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79980736, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177200, "raw_average_key_size": 20, "raw_value_size": 263258972, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 258860, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732368345, "oldest_key_time": 0, "file_creation_time": 1732368345, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281437, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:25:48.792564 139957626406464 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281438.sst) /dev/shm/ToplingTemp/Topling-193418-yNNxPw 2024/11/23-21:25:49.890697 139957626406464 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281438.sst): first pass time = 1.10's, 244.456'MB/sec 2024/11/23-21:25:52.209128 139957626406464 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281438.sst): old prealloc_size = 295279001, real_size = 80473760 2024/11/23-21:25:52.209315 139957626406464 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281438.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258863 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1016.98 avg-zval = 308.94 2024/11/23-21:25:52.209359 139957626406464 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281438.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:25:52.550167 139957626406464 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281438.sst): second pass time = 2.31's, 113.813'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.34's, 243.683'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2609.994'MB/sec (index lex order gen) rebuild zvType time = 0.25's, 0.264'MB/sec write SST data time = 0.10's, 872.110'MB/sec dict compress time = 0.00's, 2662929.703'MB/sec z-dict build time = 0.00's, sample length = 2.690'MB, throughput = 66403.945'MB/sec zip my value time = 2.31's, unzip length = 0.263'GB zip my value throughput = 113.813'MB/sec zip pipeline throughput = 135.151'MB/sec entries = 258863 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1016.98 avg-zval = 308.94 usrkeys = 258863 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1016.98 avg-zval = 308.94 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 8 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1231 value = 3.2919 dict = 1.00 all = 3.2302 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 10.954691 GB avg = 0.201 KB (by entry num) total key len = 1.482239 GB avg = 0.027 KB total ukey len = 1.022728 GB avg = 0.015 KB total ukey num = 0.067621306 Billion total entry num = 0.054429035 Billion write speed all = 0.276128704 MB/sec (with seq num) write speed all = 0.266461096 MB/sec (without seq num) 2024/11/23-21:25:52.647783 139957626406464 [compaction_job.cc:1948] [default] [JOB 36124] Generated table #281438: 258863 keys, 83100746 bytes, temperature: kWarm 2024/11/23-21:25:52.647853 139957626406464 EVENT_LOG_v1 {"time_micros": 1732368352647816, "cf_name": "default", "job": 36124, "event": "table_file_creation", "file_number": 281438, "file_size": 83100746, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79972752, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177260, "raw_average_key_size": 20, "raw_value_size": 263258800, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 258863, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732368348, "oldest_key_time": 0, "file_creation_time": 1732368348, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281438, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:25:52.707376 139957626406464 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281439.sst) /dev/shm/ToplingTemp/Topling-193418-bmDZuy 2024/11/23-21:25:54.136086 139957626406464 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281439.sst): first pass time = 1.43's, 187.892'MB/sec 2024/11/23-21:25:56.236320 139957626406464 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281439.sst): old prealloc_size = 295279001, real_size = 80485568 2024/11/23-21:25:56.236550 139957626406464 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281439.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258854 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1017.02 avg-zval = 308.99 2024/11/23-21:25:56.236598 139957626406464 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281439.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:25:56.652917 139957626406464 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281439.sst): second pass time = 2.10's, 125.466'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.42's, 199.502'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2134.795'MB/sec (index lex order gen) rebuild zvType time = 0.32's, 0.204'MB/sec write SST data time = 0.10's, 838.465'MB/sec dict compress time = 0.00's, 2662451.485'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 85232.203'MB/sec zip my value time = 2.10's, unzip length = 0.263'GB zip my value throughput = 125.466'MB/sec zip pipeline throughput = 156.483'MB/sec entries = 258854 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1017.02 avg-zval = 308.99 usrkeys = 258854 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1017.02 avg-zval = 308.99 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1229 value = 3.2914 dict = 1.00 all = 3.2298 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 11.217950 GB avg = 0.205 KB (by entry num) total key len = 1.487416 GB avg = 0.027 KB total ukey len = 1.025835 GB avg = 0.015 KB total ukey num = 0.067880160 Billion total entry num = 0.054687889 Billion write speed all = 0.282062905 MB/sec (with seq num) write speed all = 0.272350205 MB/sec (without seq num) 2024/11/23-21:25:56.750199 139957626406464 [compaction_job.cc:1948] [default] [JOB 36124] Generated table #281439: 258854 keys, 83112103 bytes, temperature: kWarm 2024/11/23-21:25:56.750264 139957626406464 EVENT_LOG_v1 {"time_micros": 1732368356750232, "cf_name": "default", "job": 36124, "event": "table_file_creation", "file_number": 281439, "file_size": 83112103, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79984560, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177080, "raw_average_key_size": 20, "raw_value_size": 263258565, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 258854, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732368352, "oldest_key_time": 0, "file_creation_time": 1732368352, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281439, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:25:56.809199 139957626406464 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281440.sst) /dev/shm/ToplingTemp/Topling-193418-t0nzOz 2024/11/23-21:25:58.654225 139957626406464 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281440.sst): first pass time = 1.84's, 145.495'MB/sec 2024/11/23-21:26:00.542016 139957626406464 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281440.sst): old prealloc_size = 295279001, real_size = 80481248 2024/11/23-21:26:00.542202 139957626406464 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281440.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258854 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1017.02 avg-zval = 308.98 2024/11/23-21:26:00.542242 139957626406464 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281440.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:26:00.865474 139957626406464 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281440.sst): second pass time = 1.89's, 139.576'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.32's, 256.949'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2662.092'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.278'MB/sec write SST data time = 0.09's, 919.501'MB/sec dict compress time = 0.00's, 2662127.723'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 90597.379'MB/sec zip my value time = 1.89's, unzip length = 0.263'GB zip my value throughput = 139.576'MB/sec zip pipeline throughput = 139.576'MB/sec entries = 258854 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1017.02 avg-zval = 308.98 usrkeys = 258854 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1017.02 avg-zval = 308.98 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 7 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1229 value = 3.2915 dict = 1.00 all = 3.2300 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 11.481208 GB avg = 0.209 KB (by entry num) total key len = 1.492593 GB avg = 0.027 KB total ukey len = 1.028941 GB avg = 0.015 KB total ukey num = 0.068139014 Billion total entry num = 0.054946743 Billion write speed all = 0.287995328 MB/sec (with seq num) write speed all = 0.278237567 MB/sec (without seq num) 2024/11/23-21:26:00.978850 139957626406464 [compaction_job.cc:1948] [default] [JOB 36124] Generated table #281440: 258854 keys, 83107424 bytes, temperature: kWarm 2024/11/23-21:26:00.978917 139957626406464 EVENT_LOG_v1 {"time_micros": 1732368360978881, "cf_name": "default", "job": 36124, "event": "table_file_creation", "file_number": 281440, "file_size": 83107424, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79980240, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177080, "raw_average_key_size": 20, "raw_value_size": 263258756, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 258854, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732368356, "oldest_key_time": 0, "file_creation_time": 1732368356, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281440, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:26:01.039321 139957626406464 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281441.sst) /dev/shm/ToplingTemp/Topling-193418-Xw9Mjz 2024/11/23-21:26:02.818097 139957626406464 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281441.sst): first pass time = 1.78's, 150.913'MB/sec 2024/11/23-21:26:04.399593 139957626406464 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281441.sst): old prealloc_size = 295279001, real_size = 80481328 2024/11/23-21:26:04.399763 139957626406464 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281441.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258853 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1017.02 avg-zval = 308.98 2024/11/23-21:26:04.399806 139957626406464 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281441.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:26:04.732251 139957626406464 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281441.sst): second pass time = 1.58's, 166.595'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.33's, 249.846'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2954.900'MB/sec (index lex order gen) rebuild zvType time = 0.24's, 0.270'MB/sec write SST data time = 0.09's, 895.563'MB/sec dict compress time = 0.00's, 2662205.941'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 87186.381'MB/sec zip my value time = 1.58's, unzip length = 0.263'GB zip my value throughput = 166.595'MB/sec zip pipeline throughput = 166.595'MB/sec entries = 258853 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1017.02 avg-zval = 308.98 usrkeys = 258853 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1017.02 avg-zval = 308.98 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1228 value = 3.2915 dict = 1.00 all = 3.2300 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 11.744467 GB avg = 0.213 KB (by entry num) total key len = 1.497770 GB avg = 0.027 KB total ukey len = 1.032047 GB avg = 0.015 KB total ukey num = 0.068397867 Billion total entry num = 0.055205596 Billion write speed all = 0.293928904 MB/sec (with seq num) write speed all = 0.284126016 MB/sec (without seq num) 2024/11/23-21:26:04.825661 139957626406464 [compaction_job.cc:1948] [default] [JOB 36124] Generated table #281441: 258853 keys, 83107631 bytes, temperature: kWarm 2024/11/23-21:26:04.825716 139957626406464 EVENT_LOG_v1 {"time_micros": 1732368364825686, "cf_name": "default", "job": 36124, "event": "table_file_creation", "file_number": 281441, "file_size": 83107631, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79980320, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177060, "raw_average_key_size": 20, "raw_value_size": 263259095, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 258853, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732368361, "oldest_key_time": 0, "file_creation_time": 1732368361, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281441, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:26:04.880858 139957626406464 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281442.sst) /dev/shm/ToplingTemp/Topling-193418-nOsaPw 2024/11/23-21:26:06.076186 139957626406464 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281442.sst): first pass time = 1.20's, 224.579'MB/sec 2024/11/23-21:26:07.552864 139957626406464 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281442.sst): old prealloc_size = 295279001, real_size = 80480784 2024/11/23-21:26:07.553057 139957626406464 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281442.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258854 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1017.02 avg-zval = 308.98 2024/11/23-21:26:07.553096 139957626406464 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281442.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:26:07.873286 139957626406464 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281442.sst): second pass time = 1.48's, 178.443'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.32's, 259.382'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2547.706'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.280'MB/sec write SST data time = 0.09's, 935.521'MB/sec dict compress time = 0.00's, 2662554.455'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 85276.042'MB/sec zip my value time = 1.48's, unzip length = 0.263'GB zip my value throughput = 178.443'MB/sec zip pipeline throughput = 178.444'MB/sec entries = 258854 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1017.02 avg-zval = 308.98 usrkeys = 258854 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1017.02 avg-zval = 308.98 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1229 value = 3.2916 dict = 1.00 all = 3.2300 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 12.007726 GB avg = 0.216 KB (by entry num) total key len = 1.502947 GB avg = 0.027 KB total ukey len = 1.035153 GB avg = 0.015 KB total ukey num = 0.068656721 Billion total entry num = 0.055464450 Billion write speed all = 0.299866282 MB/sec (with seq num) write speed all = 0.290018116 MB/sec (without seq num) 2024/11/23-21:26:07.966022 139957626406464 [compaction_job.cc:1948] [default] [JOB 36124] Generated table #281442: 258854 keys, 83107407 bytes, temperature: kWarm 2024/11/23-21:26:07.966089 139957626406464 EVENT_LOG_v1 {"time_micros": 1732368367966055, "cf_name": "default", "job": 36124, "event": "table_file_creation", "file_number": 281442, "file_size": 83107407, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79979776, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177080, "raw_average_key_size": 20, "raw_value_size": 263258656, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 258854, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732368364, "oldest_key_time": 0, "file_creation_time": 1732368364, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281442, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:26:08.025307 139957626406464 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281443.sst) /dev/shm/ToplingTemp/Topling-193418-Jpvi9A 2024/11/23-21:26:09.304068 139957626406464 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281443.sst): first pass time = 1.28's, 209.926'MB/sec 2024/11/23-21:26:11.250200 139957626406464 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281443.sst): old prealloc_size = 295279001, real_size = 80474000 2024/11/23-21:26:11.250381 139957626406464 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281443.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258862 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1016.98 avg-zval = 308.94 2024/11/23-21:26:11.250418 139957626406464 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281443.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:26:11.571428 139957626406464 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281443.sst): second pass time = 1.94's, 135.383'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.32's, 258.708'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2745.159'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.278'MB/sec write SST data time = 0.09's, 938.481'MB/sec dict compress time = 0.00's, 2662436.634'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 97134.121'MB/sec zip my value time = 1.94's, unzip length = 0.263'GB zip my value throughput = 135.383'MB/sec zip pipeline throughput = 135.512'MB/sec entries = 258862 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1016.98 avg-zval = 308.94 usrkeys = 258862 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1016.98 avg-zval = 308.94 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1231 value = 3.2918 dict = 1.00 all = 3.2303 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 12.270984 GB avg = 0.220 KB (by entry num) total key len = 1.508124 GB avg = 0.027 KB total ukey len = 1.038260 GB avg = 0.015 KB total ukey num = 0.068915583 Billion total entry num = 0.055723312 Billion write speed all = 0.305799051 MB/sec (with seq num) write speed all = 0.295905734 MB/sec (without seq num) 2024/11/23-21:26:11.674163 139957626406464 [compaction_job.cc:1948] [default] [JOB 36124] Generated table #281443: 258862 keys, 83100504 bytes, temperature: kWarm 2024/11/23-21:26:11.674241 139957626406464 EVENT_LOG_v1 {"time_micros": 1732368371674206, "cf_name": "default", "job": 36124, "event": "table_file_creation", "file_number": 281443, "file_size": 83100504, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79972992, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177240, "raw_average_key_size": 20, "raw_value_size": 263258445, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 258862, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732368368, "oldest_key_time": 0, "file_creation_time": 1732368368, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281443, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:26:11.732412 139957626406464 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281444.sst) /dev/shm/ToplingTemp/Topling-193418-gKXtEA 2024/11/23-21:26:13.122714 139957626406464 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281444.sst): first pass time = 1.39's, 193.083'MB/sec 2024/11/23-21:26:14.589815 139957626406464 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281444.sst): old prealloc_size = 295279001, real_size = 80486320 2024/11/23-21:26:14.590025 139957626406464 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281444.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258854 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1017.02 avg-zval = 309.00 2024/11/23-21:26:14.590064 139957626406464 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281444.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:26:14.909203 139957626406464 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281444.sst): second pass time = 1.47's, 179.624'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.32's, 260.249'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2256.151'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.277'MB/sec write SST data time = 0.09's, 974.170'MB/sec dict compress time = 0.00's, 2662077.228'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 81072.790'MB/sec zip my value time = 1.47's, unzip length = 0.263'GB zip my value throughput = 179.624'MB/sec zip pipeline throughput = 179.624'MB/sec entries = 258854 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1017.02 avg-zval = 309.00 usrkeys = 258854 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1017.02 avg-zval = 309.00 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1229 value = 3.2913 dict = 1.00 all = 3.2298 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 12.534243 GB avg = 0.224 KB (by entry num) total key len = 1.513301 GB avg = 0.027 KB total ukey len = 1.041366 GB avg = 0.015 KB total ukey num = 0.069174437 Billion total entry num = 0.055982166 Billion write speed all = 0.311733335 MB/sec (with seq num) write speed all = 0.301794797 MB/sec (without seq num) 2024/11/23-21:26:15.004861 139957626406464 [compaction_job.cc:1948] [default] [JOB 36124] Generated table #281444: 258854 keys, 83112493 bytes, temperature: kWarm 2024/11/23-21:26:15.004928 139957626406464 EVENT_LOG_v1 {"time_micros": 1732368375004893, "cf_name": "default", "job": 36124, "event": "table_file_creation", "file_number": 281444, "file_size": 83112493, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79985312, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177080, "raw_average_key_size": 20, "raw_value_size": 263258470, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 258854, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732368371, "oldest_key_time": 0, "file_creation_time": 1732368371, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281444, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:26:15.058868 139957626406464 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281445.sst) /dev/shm/ToplingTemp/Topling-193418-A0WeVw 2024/11/23-21:26:16.391494 139957626406464 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281445.sst): first pass time = 1.33's, 201.441'MB/sec 2024/11/23-21:26:17.820300 139957626406464 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281445.sst): old prealloc_size = 295279001, real_size = 80477328 2024/11/23-21:26:17.820470 139957626406464 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281445.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258856 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1017.01 avg-zval = 308.96 2024/11/23-21:26:17.820511 139957626406464 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281445.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:26:18.136639 139957626406464 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281445.sst): second pass time = 1.43's, 184.393'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.32's, 262.725'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2983.342'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.278'MB/sec write SST data time = 0.08's, 992.558'MB/sec dict compress time = 0.00's, 2662727.723'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 91661.725'MB/sec zip my value time = 1.43's, unzip length = 0.263'GB zip my value throughput = 184.393'MB/sec zip pipeline throughput = 184.393'MB/sec entries = 258856 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1017.01 avg-zval = 308.96 usrkeys = 258856 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1017.01 avg-zval = 308.96 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1229 value = 3.2917 dict = 1.00 all = 3.2301 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 12.797502 GB avg = 0.228 KB (by entry num) total key len = 1.518478 GB avg = 0.027 KB total ukey len = 1.044472 GB avg = 0.015 KB total ukey num = 0.069433293 Billion total entry num = 0.056241022 Billion write speed all = 0.317667535 MB/sec (with seq num) write speed all = 0.307683757 MB/sec (without seq num) 2024/11/23-21:26:18.229393 139957626406464 [compaction_job.cc:1948] [default] [JOB 36124] Generated table #281445: 258856 keys, 83104126 bytes, temperature: kWarm 2024/11/23-21:26:18.229465 139957626406464 EVENT_LOG_v1 {"time_micros": 1732368378229429, "cf_name": "default", "job": 36124, "event": "table_file_creation", "file_number": 281445, "file_size": 83104126, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79976320, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177120, "raw_average_key_size": 20, "raw_value_size": 263259158, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 258856, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732368375, "oldest_key_time": 0, "file_creation_time": 1732368375, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281445, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:26:18.286119 139957626406464 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281446.sst) /dev/shm/ToplingTemp/Topling-193418-g7k3Zx 2024/11/23-21:26:19.646131 139957626406464 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281446.sst): first pass time = 1.36's, 197.384'MB/sec 2024/11/23-21:26:21.093720 139957626406464 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281446.sst): old prealloc_size = 295279001, real_size = 80475152 2024/11/23-21:26:21.093896 139957626406464 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281446.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258861 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1016.99 avg-zval = 308.95 2024/11/23-21:26:21.093934 139957626406464 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281446.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:26:21.410135 139957626406464 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281446.sst): second pass time = 1.45's, 182.025'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.32's, 262.656'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2820.638'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.278'MB/sec write SST data time = 0.08's, 999.159'MB/sec dict compress time = 0.00's, 2662656.436'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 79864.669'MB/sec zip my value time = 1.45's, unzip length = 0.263'GB zip my value throughput = 182.025'MB/sec zip pipeline throughput = 182.025'MB/sec entries = 258861 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1016.99 avg-zval = 308.95 usrkeys = 258861 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1016.99 avg-zval = 308.95 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1230 value = 3.2918 dict = 1.00 all = 3.2302 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 13.060761 GB avg = 0.231 KB (by entry num) total key len = 1.523655 GB avg = 0.027 KB total ukey len = 1.047579 GB avg = 0.015 KB total ukey num = 0.069692154 Billion total entry num = 0.056499883 Billion write speed all = 0.323600557 MB/sec (with seq num) write speed all = 0.313571554 MB/sec (without seq num) 2024/11/23-21:26:21.505123 139957626406464 [compaction_job.cc:1948] [default] [JOB 36124] Generated table #281446: 258861 keys, 83101878 bytes, temperature: kWarm 2024/11/23-21:26:21.505188 139957626406464 EVENT_LOG_v1 {"time_micros": 1732368381505155, "cf_name": "default", "job": 36124, "event": "table_file_creation", "file_number": 281446, "file_size": 83101878, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79974144, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177220, "raw_average_key_size": 20, "raw_value_size": 263259169, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 258861, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732368378, "oldest_key_time": 0, "file_creation_time": 1732368378, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281446, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:26:21.563704 139957626406464 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281447.sst) /dev/shm/ToplingTemp/Topling-193418-k9stdy 2024/11/23-21:26:22.906214 139957626406464 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281447.sst): first pass time = 1.34's, 199.958'MB/sec 2024/11/23-21:26:24.373145 139957626406464 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281447.sst): old prealloc_size = 295279001, real_size = 80475568 2024/11/23-21:26:24.373327 139957626406464 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281447.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258858 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1017.00 avg-zval = 308.95 2024/11/23-21:26:24.373366 139957626406464 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281447.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:26:24.693514 139957626406464 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281447.sst): second pass time = 1.47's, 179.624'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.32's, 259.409'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2689.958'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.277'MB/sec write SST data time = 0.09's, 957.244'MB/sec dict compress time = 0.00's, 2661674.257'MB/sec z-dict build time = 0.00's, sample length = 2.688'MB, throughput = 86481.937'MB/sec zip my value time = 1.47's, unzip length = 0.263'GB zip my value throughput = 179.624'MB/sec zip pipeline throughput = 179.624'MB/sec entries = 258858 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1017.00 avg-zval = 308.95 usrkeys = 258858 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1017.00 avg-zval = 308.95 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1230 value = 3.2918 dict = 1.00 all = 3.2302 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 13.324021 GB avg = 0.235 KB (by entry num) total key len = 1.528833 GB avg = 0.027 KB total ukey len = 1.050685 GB avg = 0.015 KB total ukey num = 0.069951012 Billion total entry num = 0.056758741 Billion write speed all = 0.329532645 MB/sec (with seq num) write speed all = 0.319458428 MB/sec (without seq num) 2024/11/23-21:26:24.789066 139957626406464 [compaction_job.cc:1948] [default] [JOB 36124] Generated table #281447: 258858 keys, 83101334 bytes, temperature: kWarm 2024/11/23-21:26:24.789133 139957626406464 EVENT_LOG_v1 {"time_micros": 1732368384789101, "cf_name": "default", "job": 36124, "event": "table_file_creation", "file_number": 281447, "file_size": 83101334, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79974560, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177160, "raw_average_key_size": 20, "raw_value_size": 263259289, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 258858, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732368381, "oldest_key_time": 0, "file_creation_time": 1732368381, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281447, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:26:24.844572 139957626406464 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281448.sst) /dev/shm/ToplingTemp/Topling-193418-401cfy 2024/11/23-21:26:26.397767 139957626406464 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281448.sst): first pass time = 1.55's, 172.832'MB/sec 2024/11/23-21:26:27.914303 139957626406464 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281448.sst): old prealloc_size = 295279001, real_size = 80481328 2024/11/23-21:26:27.914482 139957626406464 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281448.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258853 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1017.02 avg-zval = 308.98 2024/11/23-21:26:27.914518 139957626406464 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281448.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:26:28.244247 139957626406464 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281448.sst): second pass time = 1.52's, 173.745'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.33's, 251.909'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2834.332'MB/sec (index lex order gen) rebuild zvType time = 0.24's, 0.267'MB/sec write SST data time = 0.09's, 950.073'MB/sec dict compress time = 0.00's, 2662871.287'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 3930.196'MB/sec zip my value time = 1.52's, unzip length = 0.263'GB zip my value throughput = 173.745'MB/sec zip pipeline throughput = 173.745'MB/sec entries = 258853 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1017.02 avg-zval = 308.98 usrkeys = 258853 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1017.02 avg-zval = 308.98 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1228 value = 3.2915 dict = 1.00 all = 3.2299 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 13.587279 GB avg = 0.238 KB (by entry num) total key len = 1.534010 GB avg = 0.027 KB total ukey len = 1.053791 GB avg = 0.015 KB total ukey num = 0.070209865 Billion total entry num = 0.057017594 Billion write speed all = 0.335461858 MB/sec (with seq num) write speed all = 0.325342494 MB/sec (without seq num) 2024/11/23-21:26:28.340214 139957626406464 [compaction_job.cc:1948] [default] [JOB 36124] Generated table #281448: 258853 keys, 83108303 bytes, temperature: kWarm 2024/11/23-21:26:28.340292 139957626406464 EVENT_LOG_v1 {"time_micros": 1732368388340250, "cf_name": "default", "job": 36124, "event": "table_file_creation", "file_number": 281448, "file_size": 83108303, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79980320, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177060, "raw_average_key_size": 20, "raw_value_size": 263258399, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 258853, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732368384, "oldest_key_time": 0, "file_creation_time": 1732368384, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281448, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:26:28.396484 139957626406464 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281449.sst) /dev/shm/ToplingTemp/Topling-193418-99U1ZA 2024/11/23-21:26:30.281314 139957626406464 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281449.sst): first pass time = 1.88's, 142.422'MB/sec 2024/11/23-21:26:31.763928 139957626406464 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281449.sst): old prealloc_size = 295279001, real_size = 80475536 2024/11/23-21:26:31.764143 139957626406464 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281449.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258860 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1016.99 avg-zval = 308.95 2024/11/23-21:26:31.764186 139957626406464 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281449.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:26:32.086310 139957626406464 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281449.sst): second pass time = 1.48's, 177.738'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.32's, 257.795'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2257.600'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.277'MB/sec write SST data time = 0.09's, 938.904'MB/sec dict compress time = 0.00's, 2662936.634'MB/sec z-dict build time = 0.00's, sample length = 2.690'MB, throughput = 82699.895'MB/sec zip my value time = 1.48's, unzip length = 0.263'GB zip my value throughput = 177.738'MB/sec zip pipeline throughput = 177.738'MB/sec entries = 258860 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1016.99 avg-zval = 308.95 usrkeys = 258860 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1016.99 avg-zval = 308.95 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1230 value = 3.2918 dict = 1.00 all = 3.2302 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 13.850537 GB avg = 0.242 KB (by entry num) total key len = 1.539187 GB avg = 0.027 KB total ukey len = 1.056897 GB avg = 0.015 KB total ukey num = 0.070468725 Billion total entry num = 0.057276454 Billion write speed all = 0.341387934 MB/sec (with seq num) write speed all = 0.331223494 MB/sec (without seq num) 2024/11/23-21:26:32.183448 139957626406464 [compaction_job.cc:1948] [default] [JOB 36124] Generated table #281449: 258860 keys, 83102545 bytes, temperature: kWarm 2024/11/23-21:26:32.183517 139957626406464 EVENT_LOG_v1 {"time_micros": 1732368392183482, "cf_name": "default", "job": 36124, "event": "table_file_creation", "file_number": 281449, "file_size": 83102545, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79974528, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177200, "raw_average_key_size": 20, "raw_value_size": 263258399, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 258860, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732368388, "oldest_key_time": 0, "file_creation_time": 1732368388, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281449, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:26:32.242637 139957626406464 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281450.sst) /dev/shm/ToplingTemp/Topling-193418-DRv9eA 2024/11/23-21:26:33.552090 139957626406464 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281450.sst): first pass time = 1.31's, 205.005'MB/sec 2024/11/23-21:26:35.033599 139957626406464 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281450.sst): old prealloc_size = 295279001, real_size = 80485136 2024/11/23-21:26:35.033784 139957626406464 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281450.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258851 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1017.03 avg-zval = 309.00 2024/11/23-21:26:35.033826 139957626406464 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281450.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:26:35.358900 139957626406464 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281450.sst): second pass time = 1.48's, 177.858'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.33's, 255.507'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2736.271'MB/sec (index lex order gen) rebuild zvType time = 0.24's, 0.275'MB/sec write SST data time = 0.09's, 925.900'MB/sec dict compress time = 0.00's, 2661707.921'MB/sec z-dict build time = 0.00's, sample length = 2.688'MB, throughput = 83155.217'MB/sec zip my value time = 1.48's, unzip length = 0.263'GB zip my value throughput = 177.858'MB/sec zip pipeline throughput = 177.858'MB/sec entries = 258851 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1017.03 avg-zval = 309.00 usrkeys = 258851 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1017.03 avg-zval = 309.00 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1228 value = 3.2914 dict = 1.00 all = 3.2298 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 14.113796 GB avg = 0.245 KB (by entry num) total key len = 1.544364 GB avg = 0.027 KB total ukey len = 1.060004 GB avg = 0.015 KB total ukey num = 0.070727576 Billion total entry num = 0.057535305 Billion write speed all = 0.347317386 MB/sec (with seq num) write speed all = 0.337107752 MB/sec (without seq num) 2024/11/23-21:26:35.453456 139957626406464 [compaction_job.cc:1948] [default] [JOB 36124] Generated table #281450: 258851 keys, 83110904 bytes, temperature: kWarm 2024/11/23-21:26:35.453527 139957626406464 EVENT_LOG_v1 {"time_micros": 1732368395453492, "cf_name": "default", "job": 36124, "event": "table_file_creation", "file_number": 281450, "file_size": 83110904, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79984128, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177020, "raw_average_key_size": 20, "raw_value_size": 263258561, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 258851, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732368392, "oldest_key_time": 0, "file_creation_time": 1732368392, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281450, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:26:35.511095 139957626406464 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281451.sst) /dev/shm/ToplingTemp/Topling-193418-ZNgH6A 2024/11/23-21:26:36.808549 139957626406464 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281451.sst): first pass time = 1.30's, 206.901'MB/sec 2024/11/23-21:26:38.279545 139957626406464 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281451.sst): old prealloc_size = 295279001, real_size = 80481232 2024/11/23-21:26:38.279739 139957626406464 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281451.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258859 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1017.00 avg-zval = 308.97 2024/11/23-21:26:38.279780 139957626406464 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281451.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:26:38.610066 139957626406464 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281451.sst): second pass time = 1.47's, 179.147'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.33's, 251.462'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2577.918'MB/sec (index lex order gen) rebuild zvType time = 0.24's, 0.269'MB/sec write SST data time = 0.09's, 922.705'MB/sec dict compress time = 0.00's, 2662567.327'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 77646.041'MB/sec zip my value time = 1.47's, unzip length = 0.263'GB zip my value throughput = 179.147'MB/sec zip pipeline throughput = 179.147'MB/sec entries = 258859 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1017.00 avg-zval = 308.97 usrkeys = 258859 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1017.00 avg-zval = 308.97 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1230 value = 3.2915 dict = 1.00 all = 3.2300 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 14.377054 GB avg = 0.249 KB (by entry num) total key len = 1.549541 GB avg = 0.027 KB total ukey len = 1.063110 GB avg = 0.015 KB total ukey num = 0.070986435 Billion total entry num = 0.057794164 Billion write speed all = 0.353246145 MB/sec (with seq num) write speed all = 0.342991315 MB/sec (without seq num) 2024/11/23-21:26:38.706405 139957626406464 [compaction_job.cc:1948] [default] [JOB 36124] Generated table #281451: 258859 keys, 83107868 bytes, temperature: kWarm 2024/11/23-21:26:38.706476 139957626406464 EVENT_LOG_v1 {"time_micros": 1732368398706441, "cf_name": "default", "job": 36124, "event": "table_file_creation", "file_number": 281451, "file_size": 83107868, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79980224, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177180, "raw_average_key_size": 20, "raw_value_size": 263258374, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 258859, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732368395, "oldest_key_time": 0, "file_creation_time": 1732368395, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281451, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:26:38.771096 139957626406464 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281452.sst) /dev/shm/ToplingTemp/Topling-193418-zIykNA 2024/11/23-21:26:40.093337 139957626406464 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281452.sst): first pass time = 1.32's, 203.022'MB/sec 2024/11/23-21:26:41.566511 139957626406464 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281452.sst): old prealloc_size = 295279001, real_size = 80479488 2024/11/23-21:26:41.566690 139957626406464 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281452.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258856 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1017.01 avg-zval = 308.97 2024/11/23-21:26:41.566731 139957626406464 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281452.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:26:41.891645 139957626406464 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281452.sst): second pass time = 1.47's, 178.862'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.33's, 255.622'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2776.196'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.276'MB/sec write SST data time = 0.09's, 922.083'MB/sec dict compress time = 0.00's, 2662549.505'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 74315.343'MB/sec zip my value time = 1.47's, unzip length = 0.263'GB zip my value throughput = 178.862'MB/sec zip pipeline throughput = 178.862'MB/sec entries = 258856 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1017.01 avg-zval = 308.97 usrkeys = 258856 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1017.01 avg-zval = 308.97 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1229 value = 3.2916 dict = 1.00 all = 3.2300 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 14.640313 GB avg = 0.252 KB (by entry num) total key len = 1.554718 GB avg = 0.027 KB total ukey len = 1.066216 GB avg = 0.015 KB total ukey num = 0.071245291 Billion total entry num = 0.058053020 Billion write speed all = 0.359173808 MB/sec (with seq num) write speed all = 0.348873797 MB/sec (without seq num) 2024/11/23-21:26:41.987679 139957626406464 [compaction_job.cc:1948] [default] [JOB 36124] Generated table #281452: 258856 keys, 83106122 bytes, temperature: kWarm 2024/11/23-21:26:41.987750 139957626406464 EVENT_LOG_v1 {"time_micros": 1732368401987715, "cf_name": "default", "job": 36124, "event": "table_file_creation", "file_number": 281452, "file_size": 83106122, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79978480, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177120, "raw_average_key_size": 20, "raw_value_size": 263258462, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 258856, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732368398, "oldest_key_time": 0, "file_creation_time": 1732368398, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281452, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:26:42.046149 139957626406464 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281453.sst) /dev/shm/ToplingTemp/Topling-193418-zGMS2x 2024/11/23-21:26:43.408594 139957626406464 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281453.sst): first pass time = 1.36's, 197.032'MB/sec 2024/11/23-21:26:44.820703 139957626406464 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281453.sst): old prealloc_size = 295279001, real_size = 80477968 2024/11/23-21:26:44.820872 139957626406464 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281453.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258857 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1017.01 avg-zval = 308.96 2024/11/23-21:26:44.820911 139957626406464 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281453.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:26:45.138460 139957626406464 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281453.sst): second pass time = 1.41's, 186.591'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.32's, 261.553'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2964.522'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.279'MB/sec write SST data time = 0.09's, 973.435'MB/sec dict compress time = 0.00's, 2661904.950'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 85733.729'MB/sec zip my value time = 1.41's, unzip length = 0.263'GB zip my value throughput = 186.591'MB/sec zip pipeline throughput = 186.591'MB/sec entries = 258857 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1017.01 avg-zval = 308.96 usrkeys = 258857 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1017.01 avg-zval = 308.96 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1229 value = 3.2917 dict = 1.00 all = 3.2301 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 14.903572 GB avg = 0.256 KB (by entry num) total key len = 1.559895 GB avg = 0.027 KB total ukey len = 1.069323 GB avg = 0.015 KB total ukey num = 0.071504148 Billion total entry num = 0.058311877 Billion write speed all = 0.365100905 MB/sec (with seq num) write speed all = 0.354755712 MB/sec (without seq num) 2024/11/23-21:26:45.232072 139957626406464 [compaction_job.cc:1948] [default] [JOB 36124] Generated table #281453: 258857 keys, 83103935 bytes, temperature: kWarm 2024/11/23-21:26:45.232141 139957626406464 EVENT_LOG_v1 {"time_micros": 1732368405232105, "cf_name": "default", "job": 36124, "event": "table_file_creation", "file_number": 281453, "file_size": 83103935, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79976960, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177140, "raw_average_key_size": 20, "raw_value_size": 263259200, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 258857, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732368402, "oldest_key_time": 0, "file_creation_time": 1732368402, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281453, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:26:45.288757 139957626406464 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281454.sst) /dev/shm/ToplingTemp/Topling-193418-RKmhUw 2024/11/23-21:26:46.712132 139957626406464 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281454.sst): first pass time = 1.42's, 188.597'MB/sec 2024/11/23-21:26:48.177161 139957626406464 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281454.sst): old prealloc_size = 295279001, real_size = 80474032 2024/11/23-21:26:48.177352 139957626406464 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281454.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258862 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1016.98 avg-zval = 308.94 2024/11/23-21:26:48.177391 139957626406464 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281454.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:26:48.502587 139957626406464 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281454.sst): second pass time = 1.46's, 179.857'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.33's, 255.375'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2714.015'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.276'MB/sec write SST data time = 0.09's, 912.901'MB/sec dict compress time = 0.00's, 2662497.030'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 84782.206'MB/sec zip my value time = 1.46's, unzip length = 0.263'GB zip my value throughput = 179.857'MB/sec zip pipeline throughput = 179.857'MB/sec entries = 258862 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1016.98 avg-zval = 308.94 usrkeys = 258862 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1016.98 avg-zval = 308.94 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1231 value = 3.2918 dict = 1.00 all = 3.2302 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 15.166830 GB avg = 0.259 KB (by entry num) total key len = 1.565073 GB avg = 0.027 KB total ukey len = 1.072429 GB avg = 0.015 KB total ukey num = 0.071763010 Billion total entry num = 0.058570739 Billion write speed all = 0.371026172 MB/sec (with seq num) write speed all = 0.360635829 MB/sec (without seq num) 2024/11/23-21:26:48.596475 139957626406464 [compaction_job.cc:1948] [default] [JOB 36124] Generated table #281454: 258862 keys, 83100629 bytes, temperature: kWarm 2024/11/23-21:26:48.596543 139957626406464 EVENT_LOG_v1 {"time_micros": 1732368408596508, "cf_name": "default", "job": 36124, "event": "table_file_creation", "file_number": 281454, "file_size": 83100629, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79973024, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177240, "raw_average_key_size": 20, "raw_value_size": 263258531, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 258862, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732368405, "oldest_key_time": 0, "file_creation_time": 1732368405, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281454, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:26:48.652585 139957626406464 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281455.sst) /dev/shm/ToplingTemp/Topling-193418-1Vr2Sw 2024/11/23-21:26:49.805513 139957626406464 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281455.sst): first pass time = 1.15's, 232.838'MB/sec 2024/11/23-21:26:51.259286 139957626406464 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281455.sst): old prealloc_size = 295279001, real_size = 80484080 2024/11/23-21:26:51.259466 139957626406464 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281455.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258853 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1017.02 avg-zval = 308.99 2024/11/23-21:26:51.259504 139957626406464 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281455.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:26:51.584911 139957626406464 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281455.sst): second pass time = 1.45's, 181.264'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.33's, 255.253'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2761.115'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.276'MB/sec write SST data time = 0.09's, 914.441'MB/sec dict compress time = 0.00's, 2662316.832'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 80909.310'MB/sec zip my value time = 1.45's, unzip length = 0.263'GB zip my value throughput = 181.264'MB/sec zip pipeline throughput = 181.264'MB/sec entries = 258853 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1017.02 avg-zval = 308.99 usrkeys = 258853 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1017.02 avg-zval = 308.99 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1228 value = 3.2914 dict = 1.00 all = 3.2299 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 15.430089 GB avg = 0.262 KB (by entry num) total key len = 1.570250 GB avg = 0.027 KB total ukey len = 1.075535 GB avg = 0.015 KB total ukey num = 0.072021863 Billion total entry num = 0.058829592 Billion write speed all = 0.376952908 MB/sec (with seq num) write speed all = 0.366517358 MB/sec (without seq num) 2024/11/23-21:26:51.681014 139957626406464 [compaction_job.cc:1948] [default] [JOB 36124] Generated table #281455: 258853 keys, 83110495 bytes, temperature: kWarm 2024/11/23-21:26:51.681083 139957626406464 EVENT_LOG_v1 {"time_micros": 1732368411681047, "cf_name": "default", "job": 36124, "event": "table_file_creation", "file_number": 281455, "file_size": 83110495, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79983072, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177060, "raw_average_key_size": 20, "raw_value_size": 263258647, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 258853, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732368408, "oldest_key_time": 0, "file_creation_time": 1732368408, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281455, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:26:51.787463 139957626406464 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281456.sst) /dev/shm/ToplingTemp/Topling-193418-IVKe9A 2024/11/23-21:26:53.165205 139957626406464 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281456.sst): first pass time = 1.38's, 194.844'MB/sec 2024/11/23-21:26:54.668091 139957626406464 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281456.sst): old prealloc_size = 295279001, real_size = 80487296 2024/11/23-21:26:54.668292 139957626406464 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281456.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258854 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1017.02 avg-zval = 309.00 2024/11/23-21:26:54.668330 139957626406464 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281456.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:26:54.990466 139957626406464 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281456.sst): second pass time = 1.50's, 175.348'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.32's, 257.835'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2452.568'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.277'MB/sec write SST data time = 0.09's, 939.798'MB/sec dict compress time = 0.00's, 2662214.851'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 72241.725'MB/sec zip my value time = 1.50's, unzip length = 0.263'GB zip my value throughput = 175.348'MB/sec zip pipeline throughput = 175.348'MB/sec entries = 258854 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1017.02 avg-zval = 309.00 usrkeys = 258854 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1017.02 avg-zval = 309.00 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1229 value = 3.2913 dict = 1.00 all = 3.2297 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 15.693348 GB avg = 0.266 KB (by entry num) total key len = 1.575427 GB avg = 0.027 KB total ukey len = 1.078641 GB avg = 0.015 KB total ukey num = 0.072280717 Billion total entry num = 0.059088446 Billion write speed all = 0.382876098 MB/sec (with seq num) write speed all = 0.372395422 MB/sec (without seq num) 2024/11/23-21:26:55.087645 139957626406464 [compaction_job.cc:1948] [default] [JOB 36124] Generated table #281456: 258854 keys, 83113592 bytes, temperature: kWarm 2024/11/23-21:26:55.087714 139957626406464 EVENT_LOG_v1 {"time_micros": 1732368415087680, "cf_name": "default", "job": 36124, "event": "table_file_creation", "file_number": 281456, "file_size": 83113592, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79986288, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177080, "raw_average_key_size": 20, "raw_value_size": 263258938, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 258854, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732368411, "oldest_key_time": 0, "file_creation_time": 1732368411, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281456, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:26:55.144585 139957626406464 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281457.sst) /dev/shm/ToplingTemp/Topling-193418-dKASYA 2024/11/23-21:26:57.443988 139957626406464 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281457.sst): first pass time = 2.30's, 116.744'MB/sec 2024/11/23-21:26:58.929632 139957626406464 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281457.sst): old prealloc_size = 295279001, real_size = 80477504 2024/11/23-21:26:58.929825 139957626406464 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281457.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258859 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1017.00 avg-zval = 308.96 2024/11/23-21:26:58.929863 139957626406464 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281457.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:26:59.253790 139957626406464 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281457.sst): second pass time = 1.48's, 177.367'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.32's, 256.385'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2632.587'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.276'MB/sec write SST data time = 0.09's, 926.899'MB/sec dict compress time = 0.00's, 2662180.198'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 83891.361'MB/sec zip my value time = 1.48's, unzip length = 0.263'GB zip my value throughput = 177.367'MB/sec zip pipeline throughput = 177.367'MB/sec entries = 258859 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1017.00 avg-zval = 308.96 usrkeys = 258859 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1017.00 avg-zval = 308.96 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1230 value = 3.2917 dict = 1.00 all = 3.2301 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 15.956607 GB avg = 0.269 KB (by entry num) total key len = 1.580604 GB avg = 0.027 KB total ukey len = 1.081748 GB avg = 0.015 KB total ukey num = 0.072539576 Billion total entry num = 0.059347305 Billion write speed all = 0.388790997 MB/sec (with seq num) write speed all = 0.378265401 MB/sec (without seq num) 2024/11/23-21:26:59.349716 139957626406464 [compaction_job.cc:1948] [default] [JOB 36124] Generated table #281457: 258859 keys, 83103765 bytes, temperature: kWarm 2024/11/23-21:26:59.349787 139957626406464 EVENT_LOG_v1 {"time_micros": 1732368419349751, "cf_name": "default", "job": 36124, "event": "table_file_creation", "file_number": 281457, "file_size": 83103765, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79976496, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177180, "raw_average_key_size": 20, "raw_value_size": 263258717, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 258859, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732368415, "oldest_key_time": 0, "file_creation_time": 1732368415, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281457, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:26:59.407240 139957626406464 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281458.sst) /dev/shm/ToplingTemp/Topling-193418-biiJzy 2024/11/23-21:27:00.552483 139957626406464 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281458.sst): first pass time = 1.15's, 234.399'MB/sec 2024/11/23-21:27:02.103760 139957626406464 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281458.sst): old prealloc_size = 295279001, real_size = 81136192 2024/11/23-21:27:02.103947 139957626406464 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281458.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258856 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0806 GB avg-val =1017.01 avg-zval = 311.51 2024/11/23-21:27:02.104006 139957626406464 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281458.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:27:02.436363 139957626406464 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281458.sst): second pass time = 1.55's, 169.856'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.33's, 251.859'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2700.485'MB/sec (index lex order gen) rebuild zvType time = 0.24's, 0.273'MB/sec write SST data time = 0.10's, 876.026'MB/sec dict compress time = 0.00's, 2662786.139'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 69576.603'MB/sec zip my value time = 1.55's, unzip length = 0.263'GB zip my value throughput = 169.856'MB/sec zip pipeline throughput = 169.856'MB/sec entries = 258856 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1017.01 avg-zval = 311.51 usrkeys = 258856 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1017.01 avg-zval = 311.51 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 8 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0806 GB dict = 2.69 MB all = 0.0838 GB } UnZip/Zip{ index = 7.1229 value = 3.2648 dict = 1.00 all = 3.2047 } Zip/UnZip{ index = 0.1404 value = 0.3063 dict = 1.00 all = 0.3120 } ---------------------------- total value len = 16.219865 GB avg = 0.272 KB (by entry num) total key len = 1.585781 GB avg = 0.027 KB total ukey len = 1.084854 GB avg = 0.015 KB total ukey num = 0.072798432 Billion total entry num = 0.059606161 Billion write speed all = 0.394714225 MB/sec (with seq num) write speed all = 0.384143466 MB/sec (without seq num) 2024/11/23-21:27:02.535240 139957626406464 [compaction_job.cc:1948] [default] [JOB 36124] Generated table #281458: 258856 keys, 83763065 bytes, temperature: kWarm 2024/11/23-21:27:02.535314 139957626406464 EVENT_LOG_v1 {"time_micros": 1732368422535277, "cf_name": "default", "job": 36124, "event": "table_file_creation", "file_number": 281458, "file_size": 83763065, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 80635184, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177120, "raw_average_key_size": 20, "raw_value_size": 263258369, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 258856, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732368419, "oldest_key_time": 0, "file_creation_time": 1732368419, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281458, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:27:02.591262 139957626406464 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281459.sst) /dev/shm/ToplingTemp/Topling-193418-MeZvSx 2024/11/23-21:27:03.946569 139957626406464 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281459.sst): first pass time = 1.36's, 198.071'MB/sec 2024/11/23-21:27:05.449955 139957626406464 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281459.sst): old prealloc_size = 295279001, real_size = 80481120 2024/11/23-21:27:05.450168 139957626406464 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281459.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258856 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1017.01 avg-zval = 308.98 2024/11/23-21:27:05.450217 139957626406464 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281459.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:27:05.776058 139957626406464 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281459.sst): second pass time = 1.50's, 175.259'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.33's, 254.872'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2666.977'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.277'MB/sec write SST data time = 0.09's, 904.262'MB/sec dict compress time = 0.00's, 2662331.683'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 87722.409'MB/sec zip my value time = 1.50's, unzip length = 0.263'GB zip my value throughput = 175.259'MB/sec zip pipeline throughput = 175.259'MB/sec entries = 258856 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1017.01 avg-zval = 308.98 usrkeys = 258856 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1017.01 avg-zval = 308.98 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 8 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1229 value = 3.2915 dict = 1.00 all = 3.2300 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 16.483124 GB avg = 0.275 KB (by entry num) total key len = 1.590958 GB avg = 0.027 KB total ukey len = 1.087960 GB avg = 0.015 KB total ukey num = 0.073057288 Billion total entry num = 0.059865017 Billion write speed all = 0.400635223 MB/sec (with seq num) write speed all = 0.390019344 MB/sec (without seq num) 2024/11/23-21:27:05.878763 139957626406464 [compaction_job.cc:1948] [default] [JOB 36124] Generated table #281459: 258856 keys, 83107502 bytes, temperature: kWarm 2024/11/23-21:27:05.878831 139957626406464 EVENT_LOG_v1 {"time_micros": 1732368425878796, "cf_name": "default", "job": 36124, "event": "table_file_creation", "file_number": 281459, "file_size": 83107502, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79980112, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177120, "raw_average_key_size": 20, "raw_value_size": 263258447, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 258856, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732368422, "oldest_key_time": 0, "file_creation_time": 1732368422, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281459, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:27:05.935557 139957626406464 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281460.sst) /dev/shm/ToplingTemp/Topling-193418-574TYx 2024/11/23-21:27:07.614132 139957626406464 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281460.sst): first pass time = 1.68's, 159.923'MB/sec 2024/11/23-21:27:09.092816 139957626406464 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281460.sst): old prealloc_size = 295279001, real_size = 80476352 2024/11/23-21:27:09.093025 139957626406464 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281460.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258857 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1017.00 avg-zval = 308.96 2024/11/23-21:27:09.093061 139957626406464 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281460.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:27:09.416114 139957626406464 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281460.sst): second pass time = 1.48's, 178.207'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.32's, 257.065'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2321.759'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.276'MB/sec write SST data time = 0.09's, 941.042'MB/sec dict compress time = 0.00's, 2662451.485'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 84588.739'MB/sec zip my value time = 1.48's, unzip length = 0.263'GB zip my value throughput = 178.207'MB/sec zip pipeline throughput = 178.207'MB/sec entries = 258857 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1017.00 avg-zval = 308.96 usrkeys = 258857 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1017.00 avg-zval = 308.96 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1229 value = 3.2917 dict = 1.00 all = 3.2302 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 16.746382 GB avg = 0.279 KB (by entry num) total key len = 1.596135 GB avg = 0.027 KB total ukey len = 1.091067 GB avg = 0.015 KB total ukey num = 0.073316145 Billion total entry num = 0.060123874 Billion write speed all = 0.406552647 MB/sec (with seq num) write speed all = 0.395891724 MB/sec (without seq num) 2024/11/23-21:27:09.513522 139957626406464 [compaction_job.cc:1948] [default] [JOB 36124] Generated table #281460: 258857 keys, 83102887 bytes, temperature: kWarm 2024/11/23-21:27:09.513589 139957626406464 EVENT_LOG_v1 {"time_micros": 1732368429513554, "cf_name": "default", "job": 36124, "event": "table_file_creation", "file_number": 281460, "file_size": 83102887, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79975344, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177140, "raw_average_key_size": 20, "raw_value_size": 263258764, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 258857, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732368425, "oldest_key_time": 0, "file_creation_time": 1732368425, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281460, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:27:09.578289 139957626406464 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281461.sst) /dev/shm/ToplingTemp/Topling-193418-0lsWvA 2024/11/23-21:27:10.984334 139957626406464 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281461.sst): first pass time = 1.41's, 190.922'MB/sec 2024/11/23-21:27:12.491791 139957626406464 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281461.sst): old prealloc_size = 295279001, real_size = 80481392 2024/11/23-21:27:12.491968 139957626406464 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281461.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258858 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1017.00 avg-zval = 308.97 2024/11/23-21:27:12.492027 139957626406464 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281461.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:27:12.816290 139957626406464 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281461.sst): second pass time = 1.51's, 174.804'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.32's, 256.127'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2507.913'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.278'MB/sec write SST data time = 0.09's, 907.794'MB/sec dict compress time = 0.00's, 2662540.594'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 81561.554'MB/sec zip my value time = 1.51's, unzip length = 0.263'GB zip my value throughput = 174.804'MB/sec zip pipeline throughput = 174.804'MB/sec entries = 258858 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1017.00 avg-zval = 308.97 usrkeys = 258858 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1017.00 avg-zval = 308.97 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1230 value = 3.2915 dict = 1.00 all = 3.2300 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 17.009642 GB avg = 0.282 KB (by entry num) total key len = 1.601312 GB avg = 0.027 KB total ukey len = 1.094173 GB avg = 0.015 KB total ukey num = 0.073575003 Billion total entry num = 0.060382732 Billion write speed all = 0.412471320 MB/sec (with seq num) write speed all = 0.401765305 MB/sec (without seq num) 2024/11/23-21:27:12.914074 139957626406464 [compaction_job.cc:1948] [default] [JOB 36124] Generated table #281461: 258858 keys, 83108033 bytes, temperature: kWarm 2024/11/23-21:27:12.914141 139957626406464 EVENT_LOG_v1 {"time_micros": 1732368432914105, "cf_name": "default", "job": 36124, "event": "table_file_creation", "file_number": 281461, "file_size": 83108033, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79980384, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177160, "raw_average_key_size": 20, "raw_value_size": 263259301, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 258858, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732368429, "oldest_key_time": 0, "file_creation_time": 1732368429, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281461, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:27:12.974063 139957626406464 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281462.sst) /dev/shm/ToplingTemp/Topling-193418-j9xeWy 2024/11/23-21:27:14.290106 139957626406464 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281462.sst): first pass time = 1.32's, 203.979'MB/sec 2024/11/23-21:27:15.767406 139957626406464 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281462.sst): old prealloc_size = 295279001, real_size = 80480688 2024/11/23-21:27:15.767582 139957626406464 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281462.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258857 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1017.00 avg-zval = 308.97 2024/11/23-21:27:15.767619 139957626406464 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281462.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:27:16.090728 139957626406464 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281462.sst): second pass time = 1.48's, 178.356'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.32's, 257.059'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2837.079'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.279'MB/sec write SST data time = 0.09's, 915.383'MB/sec dict compress time = 0.00's, 2661632.673'MB/sec z-dict build time = 0.00's, sample length = 2.688'MB, throughput = 70222.272'MB/sec zip my value time = 1.48's, unzip length = 0.263'GB zip my value throughput = 178.356'MB/sec zip pipeline throughput = 178.356'MB/sec entries = 258857 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1017.00 avg-zval = 308.97 usrkeys = 258857 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1017.00 avg-zval = 308.97 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1229 value = 3.2916 dict = 1.00 all = 3.2300 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 17.272900 GB avg = 0.285 KB (by entry num) total key len = 1.606490 GB avg = 0.026 KB total ukey len = 1.097279 GB avg = 0.015 KB total ukey num = 0.073833860 Billion total entry num = 0.060641589 Billion write speed all = 0.418390249 MB/sec (with seq num) write speed all = 0.407639118 MB/sec (without seq num) 2024/11/23-21:27:16.187344 139957626406464 [compaction_job.cc:1948] [default] [JOB 36124] Generated table #281462: 258857 keys, 83106412 bytes, temperature: kWarm 2024/11/23-21:27:16.187410 139957626406464 EVENT_LOG_v1 {"time_micros": 1732368436187376, "cf_name": "default", "job": 36124, "event": "table_file_creation", "file_number": 281462, "file_size": 83106412, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79979680, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177140, "raw_average_key_size": 20, "raw_value_size": 263258507, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 258857, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732368432, "oldest_key_time": 0, "file_creation_time": 1732368432, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281462, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:27:16.244651 139957626406464 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281463.sst) /dev/shm/ToplingTemp/Topling-193418-EOL2oz 2024/11/23-21:27:18.052489 139957626406464 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281463.sst): first pass time = 1.81's, 148.488'MB/sec 2024/11/23-21:27:19.511422 139957626406464 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281463.sst): old prealloc_size = 295279001, real_size = 80479920 2024/11/23-21:27:19.511594 139957626406464 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281463.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258859 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1017.00 avg-zval = 308.97 2024/11/23-21:27:19.511631 139957626406464 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281463.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:27:19.841039 139957626406464 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281463.sst): second pass time = 1.46's, 180.610'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.33's, 252.155'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2886.065'MB/sec (index lex order gen) rebuild zvType time = 0.24's, 0.269'MB/sec write SST data time = 0.09's, 938.540'MB/sec dict compress time = 0.00's, 2662390.099'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 87530.159'MB/sec zip my value time = 1.46's, unzip length = 0.263'GB zip my value throughput = 180.610'MB/sec zip pipeline throughput = 180.610'MB/sec entries = 258859 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1017.00 avg-zval = 308.97 usrkeys = 258859 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1017.00 avg-zval = 308.97 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1230 value = 3.2916 dict = 1.00 all = 3.2300 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 17.536159 GB avg = 0.288 KB (by entry num) total key len = 1.611667 GB avg = 0.026 KB total ukey len = 1.100385 GB avg = 0.015 KB total ukey num = 0.074092719 Billion total entry num = 0.060900448 Billion write speed all = 0.424303857 MB/sec (with seq num) write speed all = 0.413507730 MB/sec (without seq num) 2024/11/23-21:27:19.936772 139957626406464 [compaction_job.cc:1948] [default] [JOB 36124] Generated table #281463: 258859 keys, 83106409 bytes, temperature: kWarm 2024/11/23-21:27:19.936841 139957626406464 EVENT_LOG_v1 {"time_micros": 1732368439936805, "cf_name": "default", "job": 36124, "event": "table_file_creation", "file_number": 281463, "file_size": 83106409, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79978912, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177180, "raw_average_key_size": 20, "raw_value_size": 263258966, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 258859, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732368436, "oldest_key_time": 0, "file_creation_time": 1732368436, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281463, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:27:20.002031 139957626406464 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281464.sst) /dev/shm/ToplingTemp/Topling-193418-2qUcEx 2024/11/23-21:27:21.372050 139957626406464 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281464.sst): first pass time = 1.37's, 195.941'MB/sec 2024/11/23-21:27:22.876740 139957626406464 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281464.sst): old prealloc_size = 295279001, real_size = 80479520 2024/11/23-21:27:22.876915 139957626406464 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281464.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258859 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1017.00 avg-zval = 308.97 2024/11/23-21:27:22.876951 139957626406464 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281464.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:27:23.205295 139957626406464 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281464.sst): second pass time = 1.50's, 175.112'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.33's, 252.963'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2864.981'MB/sec (index lex order gen) rebuild zvType time = 0.24's, 0.272'MB/sec write SST data time = 0.09's, 917.892'MB/sec dict compress time = 0.00's, 2662454.455'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 66683.504'MB/sec zip my value time = 1.50's, unzip length = 0.263'GB zip my value throughput = 175.112'MB/sec zip pipeline throughput = 175.112'MB/sec entries = 258859 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1017.00 avg-zval = 308.97 usrkeys = 258859 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1017.00 avg-zval = 308.97 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 8 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1230 value = 3.2916 dict = 1.00 all = 3.2300 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 17.799418 GB avg = 0.291 KB (by entry num) total key len = 1.616844 GB avg = 0.026 KB total ukey len = 1.103492 GB avg = 0.015 KB total ukey num = 0.074351578 Billion total entry num = 0.061159307 Billion write speed all = 0.430220160 MB/sec (with seq num) write speed all = 0.419378952 MB/sec (without seq num) 2024/11/23-21:27:23.303871 139957626406464 [compaction_job.cc:1948] [default] [JOB 36124] Generated table #281464: 258859 keys, 83106026 bytes, temperature: kWarm 2024/11/23-21:27:23.303940 139957626406464 EVENT_LOG_v1 {"time_micros": 1732368443303905, "cf_name": "default", "job": 36124, "event": "table_file_creation", "file_number": 281464, "file_size": 83106026, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79978512, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177180, "raw_average_key_size": 20, "raw_value_size": 263258926, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 258859, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732368439, "oldest_key_time": 0, "file_creation_time": 1732368439, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281464, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:27:23.362760 139957626406464 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281465.sst) /dev/shm/ToplingTemp/Topling-193418-j9ATBx 2024/11/23-21:27:24.430221 139957626406464 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281465.sst): first pass time = 1.07's, 251.480'MB/sec 2024/11/23-21:27:25.898990 139957626406464 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281465.sst): old prealloc_size = 295279001, real_size = 80480784 2024/11/23-21:27:25.899173 139957626406464 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281465.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258853 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1017.02 avg-zval = 308.98 2024/11/23-21:27:25.899222 139957626406464 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281465.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:27:26.218746 139957626406464 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281465.sst): second pass time = 1.47's, 179.403'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.32's, 259.920'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2788.980'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.280'MB/sec write SST data time = 0.09's, 938.578'MB/sec dict compress time = 0.00's, 2662937.624'MB/sec z-dict build time = 0.00's, sample length = 2.690'MB, throughput = 86461.793'MB/sec zip my value time = 1.47's, unzip length = 0.263'GB zip my value throughput = 179.403'MB/sec zip pipeline throughput = 179.403'MB/sec entries = 258853 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1017.02 avg-zval = 308.98 usrkeys = 258853 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1017.02 avg-zval = 308.98 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1228 value = 3.2916 dict = 1.00 all = 3.2300 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 18.062677 GB avg = 0.294 KB (by entry num) total key len = 1.622021 GB avg = 0.026 KB total ukey len = 1.106598 GB avg = 0.015 KB total ukey num = 0.074610431 Billion total entry num = 0.061418160 Billion write speed all = 0.436138970 MB/sec (with seq num) write speed all = 0.425252604 MB/sec (without seq num) 2024/11/23-21:27:26.314510 139957626406464 [compaction_job.cc:1948] [default] [JOB 36124] Generated table #281465: 258853 keys, 83107794 bytes, temperature: kWarm 2024/11/23-21:27:26.314571 139957626406464 EVENT_LOG_v1 {"time_micros": 1732368446314536, "cf_name": "default", "job": 36124, "event": "table_file_creation", "file_number": 281465, "file_size": 83107794, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79979776, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177060, "raw_average_key_size": 20, "raw_value_size": 263258957, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 258853, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732368443, "oldest_key_time": 0, "file_creation_time": 1732368443, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281465, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:27:26.370438 139957626406464 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281466.sst) /dev/shm/ToplingTemp/Topling-193418-0OWllx 2024/11/23-21:27:27.498685 139957626406464 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281466.sst): first pass time = 1.13's, 237.932'MB/sec 2024/11/23-21:27:29.022265 139957626406464 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281466.sst): old prealloc_size = 295279001, real_size = 80481616 2024/11/23-21:27:29.022441 139957626406464 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281466.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258860 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1016.99 avg-zval = 308.97 2024/11/23-21:27:29.022480 139957626406464 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281466.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:27:29.347433 139957626406464 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281466.sst): second pass time = 1.52's, 172.945'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.33's, 255.604'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2845.762'MB/sec (index lex order gen) rebuild zvType time = 0.24's, 0.275'MB/sec write SST data time = 0.09's, 923.540'MB/sec dict compress time = 0.00's, 2662535.644'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 83761.439'MB/sec zip my value time = 1.52's, unzip length = 0.263'GB zip my value throughput = 172.945'MB/sec zip pipeline throughput = 172.945'MB/sec entries = 258860 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1016.99 avg-zval = 308.97 usrkeys = 258860 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1016.99 avg-zval = 308.97 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1230 value = 3.2915 dict = 1.00 all = 3.2300 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 18.325936 GB avg = 0.297 KB (by entry num) total key len = 1.627198 GB avg = 0.026 KB total ukey len = 1.109704 GB avg = 0.015 KB total ukey num = 0.074869291 Billion total entry num = 0.061677020 Billion write speed all = 0.442055857 MB/sec (with seq num) write speed all = 0.431124366 MB/sec (without seq num) 2024/11/23-21:27:29.444415 139957626406464 [compaction_job.cc:1948] [default] [JOB 36124] Generated table #281466: 258860 keys, 83108220 bytes, temperature: kWarm 2024/11/23-21:27:29.444482 139957626406464 EVENT_LOG_v1 {"time_micros": 1732368449444447, "cf_name": "default", "job": 36124, "event": "table_file_creation", "file_number": 281466, "file_size": 83108220, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79980608, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177200, "raw_average_key_size": 20, "raw_value_size": 263258692, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 258860, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732368446, "oldest_key_time": 0, "file_creation_time": 1732368446, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281466, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:27:29.502959 139957626406464 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281467.sst) /dev/shm/ToplingTemp/Topling-193418-8pTsTA 2024/11/23-21:27:30.831227 139957626406464 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281467.sst): first pass time = 1.33's, 202.103'MB/sec 2024/11/23-21:27:32.322893 139957626406464 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281467.sst): old prealloc_size = 295279001, real_size = 80475824 2024/11/23-21:27:32.323100 139957626406464 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281467.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258858 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1017.00 avg-zval = 308.95 2024/11/23-21:27:32.323139 139957626406464 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281467.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:27:32.647756 139957626406464 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281467.sst): second pass time = 1.49's, 176.655'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.32's, 255.826'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2386.337'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.277'MB/sec write SST data time = 0.09's, 914.981'MB/sec dict compress time = 0.00's, 2662411.881'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 85988.616'MB/sec zip my value time = 1.49's, unzip length = 0.263'GB zip my value throughput = 176.655'MB/sec zip pipeline throughput = 176.655'MB/sec entries = 258858 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1017.00 avg-zval = 308.95 usrkeys = 258858 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1017.00 avg-zval = 308.95 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1230 value = 3.2918 dict = 1.00 all = 3.2302 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 18.589194 GB avg = 0.300 KB (by entry num) total key len = 1.632375 GB avg = 0.026 KB total ukey len = 1.112811 GB avg = 0.015 KB total ukey num = 0.075128149 Billion total entry num = 0.061935878 Billion write speed all = 0.447970216 MB/sec (with seq num) write speed all = 0.436993648 MB/sec (without seq num) 2024/11/23-21:27:32.743879 139957626406464 [compaction_job.cc:1948] [default] [JOB 36124] Generated table #281467: 258858 keys, 83102335 bytes, temperature: kWarm 2024/11/23-21:27:32.743949 139957626406464 EVENT_LOG_v1 {"time_micros": 1732368452743913, "cf_name": "default", "job": 36124, "event": "table_file_creation", "file_number": 281467, "file_size": 83102335, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79974816, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177160, "raw_average_key_size": 20, "raw_value_size": 263258482, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 258858, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732368449, "oldest_key_time": 0, "file_creation_time": 1732368449, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281467, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:27:32.801664 139957626406464 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281468.sst) /dev/shm/ToplingTemp/Topling-193418-E3Go6w 2024/11/23-21:27:34.554947 139957626406464 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281468.sst): first pass time = 1.75's, 153.108'MB/sec 2024/11/23-21:27:36.021297 139957626406464 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281468.sst): old prealloc_size = 295279001, real_size = 80472752 2024/11/23-21:27:36.021473 139957626406464 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281468.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258864 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1016.98 avg-zval = 308.93 2024/11/23-21:27:36.021508 139957626406464 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281468.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:27:36.340426 139957626406464 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281468.sst): second pass time = 1.46's, 179.704'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.32's, 260.413'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2816.484'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.278'MB/sec write SST data time = 0.09's, 964.365'MB/sec dict compress time = 0.00's, 2662186.139'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 82138.628'MB/sec zip my value time = 1.46's, unzip length = 0.263'GB zip my value throughput = 179.704'MB/sec zip pipeline throughput = 179.704'MB/sec entries = 258864 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1016.98 avg-zval = 308.93 usrkeys = 258864 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1016.98 avg-zval = 308.93 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1231 value = 3.2919 dict = 1.00 all = 3.2303 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 18.852453 GB avg = 0.303 KB (by entry num) total key len = 1.637553 GB avg = 0.026 KB total ukey len = 1.115917 GB avg = 0.015 KB total ukey num = 0.075387013 Billion total entry num = 0.062194742 Billion write speed all = 0.453879781 MB/sec (with seq num) write speed all = 0.442858238 MB/sec (without seq num) 2024/11/23-21:27:36.436574 139957626406464 [compaction_job.cc:1948] [default] [JOB 36124] Generated table #281468: 258864 keys, 83099035 bytes, temperature: kWarm 2024/11/23-21:27:36.436645 139957626406464 EVENT_LOG_v1 {"time_micros": 1732368456436609, "cf_name": "default", "job": 36124, "event": "table_file_creation", "file_number": 281468, "file_size": 83099035, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79971744, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177280, "raw_average_key_size": 20, "raw_value_size": 263259088, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 258864, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732368452, "oldest_key_time": 0, "file_creation_time": 1732368452, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281468, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:27:36.492906 139957626406464 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281469.sst) /dev/shm/ToplingTemp/Topling-193418-lC6p5A 2024/11/23-21:27:37.813702 139957626406464 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281469.sst): first pass time = 1.32's, 203.244'MB/sec 2024/11/23-21:27:39.296765 139957626406464 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281469.sst): old prealloc_size = 295279001, real_size = 80476848 2024/11/23-21:27:39.296944 139957626406464 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281469.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258864 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1016.98 avg-zval = 308.95 2024/11/23-21:27:39.297014 139957626406464 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281469.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:27:39.621521 139957626406464 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281469.sst): second pass time = 1.48's, 177.678'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.32's, 255.915'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2812.180'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.276'MB/sec write SST data time = 0.09's, 925.896'MB/sec dict compress time = 0.00's, 2662824.752'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 85556.004'MB/sec zip my value time = 1.48's, unzip length = 0.263'GB zip my value throughput = 177.678'MB/sec zip pipeline throughput = 177.678'MB/sec entries = 258864 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1016.98 avg-zval = 308.95 usrkeys = 258864 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1016.98 avg-zval = 308.95 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1231 value = 3.2917 dict = 1.00 all = 3.2301 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 19.115712 GB avg = 0.306 KB (by entry num) total key len = 1.642730 GB avg = 0.026 KB total ukey len = 1.119023 GB avg = 0.015 KB total ukey num = 0.075645877 Billion total entry num = 0.062453606 Billion write speed all = 0.459792568 MB/sec (with seq num) write speed all = 0.448725955 MB/sec (without seq num) 2024/11/23-21:27:39.716689 139957626406464 [compaction_job.cc:1948] [default] [JOB 36124] Generated table #281469: 258864 keys, 83103776 bytes, temperature: kWarm 2024/11/23-21:27:39.716756 139957626406464 EVENT_LOG_v1 {"time_micros": 1732368459716721, "cf_name": "default", "job": 36124, "event": "table_file_creation", "file_number": 281469, "file_size": 83103776, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79975840, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177280, "raw_average_key_size": 20, "raw_value_size": 263258915, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 258864, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732368456, "oldest_key_time": 0, "file_creation_time": 1732368456, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281469, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:27:39.778307 139957626406464 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281470.sst) /dev/shm/ToplingTemp/Topling-193418-zDcWUy 2024/11/23-21:27:41.608261 139957626406464 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281470.sst): first pass time = 1.83's, 146.693'MB/sec 2024/11/23-21:27:43.155338 139957626406464 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281470.sst): old prealloc_size = 295279001, real_size = 80476656 2024/11/23-21:27:43.155527 139957626406464 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281470.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258864 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1016.98 avg-zval = 308.95 2024/11/23-21:27:43.155569 139957626406464 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281470.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:27:43.479844 139957626406464 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281470.sst): second pass time = 1.55's, 170.330'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.32's, 256.107'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2633.748'MB/sec (index lex order gen) rebuild zvType time = 0.24's, 0.275'MB/sec write SST data time = 0.09's, 931.985'MB/sec dict compress time = 0.00's, 2661978.218'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 83040.368'MB/sec zip my value time = 1.55's, unzip length = 0.263'GB zip my value throughput = 170.330'MB/sec zip pipeline throughput = 170.330'MB/sec entries = 258864 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1016.98 avg-zval = 308.95 usrkeys = 258864 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1016.98 avg-zval = 308.95 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1231 value = 3.2917 dict = 1.00 all = 3.2302 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 19.378971 GB avg = 0.309 KB (by entry num) total key len = 1.647907 GB avg = 0.026 KB total ukey len = 1.122130 GB avg = 0.015 KB total ukey num = 0.075904741 Billion total entry num = 0.062712470 Billion write speed all = 0.465698543 MB/sec (with seq num) write speed all = 0.454587011 MB/sec (without seq num) 2024/11/23-21:27:43.575859 139957626406464 [compaction_job.cc:1948] [default] [JOB 36124] Generated table #281470: 258864 keys, 83102729 bytes, temperature: kWarm 2024/11/23-21:27:43.575927 139957626406464 EVENT_LOG_v1 {"time_micros": 1732368463575893, "cf_name": "default", "job": 36124, "event": "table_file_creation", "file_number": 281470, "file_size": 83102729, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79975648, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177280, "raw_average_key_size": 20, "raw_value_size": 263259021, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 258864, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732368459, "oldest_key_time": 0, "file_creation_time": 1732368459, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281470, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:27:43.635314 139957626406464 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281471.sst) /dev/shm/ToplingTemp/Topling-193418-PPelLA 2024/11/23-21:27:44.606893 139957626406464 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281471.sst): first pass time = 0.97's, 276.301'MB/sec 2024/11/23-21:27:46.062755 139957626406464 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281471.sst): old prealloc_size = 295279001, real_size = 80555312 2024/11/23-21:27:46.062955 139957626406464 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281471.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258857 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0801 GB avg-val =1017.00 avg-zval = 309.26 2024/11/23-21:27:46.063008 139957626406464 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281471.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:27:46.388623 139957626406464 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281471.sst): second pass time = 1.45's, 180.985'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.33's, 255.282'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2470.085'MB/sec (index lex order gen) rebuild zvType time = 0.24's, 0.272'MB/sec write SST data time = 0.09's, 946.930'MB/sec dict compress time = 0.00's, 2662373.267'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 82177.037'MB/sec zip my value time = 1.45's, unzip length = 0.263'GB zip my value throughput = 180.985'MB/sec zip pipeline throughput = 180.985'MB/sec entries = 258857 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1017.00 avg-zval = 309.26 usrkeys = 258857 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1017.00 avg-zval = 309.26 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0801 GB dict = 2.69 MB all = 0.0832 GB } UnZip/Zip{ index = 7.1229 value = 3.2885 dict = 1.00 all = 3.2271 } Zip/UnZip{ index = 0.1404 value = 0.3041 dict = 1.00 all = 0.3099 } ---------------------------- total value len = 19.642230 GB avg = 0.312 KB (by entry num) total key len = 1.653084 GB avg = 0.026 KB total ukey len = 1.125236 GB avg = 0.015 KB total ukey num = 0.076163598 Billion total entry num = 0.062971327 Billion write speed all = 0.471613412 MB/sec (with seq num) write speed all = 0.460456733 MB/sec (without seq num) 2024/11/23-21:27:46.484085 139957626406464 [compaction_job.cc:1948] [default] [JOB 36124] Generated table #281471: 258857 keys, 83181784 bytes, temperature: kWarm 2024/11/23-21:27:46.484153 139957626406464 EVENT_LOG_v1 {"time_micros": 1732368466484119, "cf_name": "default", "job": 36124, "event": "table_file_creation", "file_number": 281471, "file_size": 83181784, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 80054304, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177140, "raw_average_key_size": 20, "raw_value_size": 263258459, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 258857, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732368463, "oldest_key_time": 0, "file_creation_time": 1732368463, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281471, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:27:46.539041 139957626406464 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281472.sst) /dev/shm/ToplingTemp/Topling-193418-T6pUMA 2024/11/23-21:27:47.810161 139957626406464 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281472.sst): first pass time = 1.27's, 211.188'MB/sec 2024/11/23-21:27:49.365301 139957626406464 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281472.sst): old prealloc_size = 295279001, real_size = 81079696 2024/11/23-21:27:49.365485 139957626406464 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281472.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258861 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0806 GB avg-val =1016.99 avg-zval = 311.28 2024/11/23-21:27:49.365524 139957626406464 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281472.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:27:49.685668 139957626406464 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281472.sst): second pass time = 1.55's, 169.434'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.32's, 261.304'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2761.832'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.278'MB/sec write SST data time = 0.09's, 957.537'MB/sec dict compress time = 0.00's, 2662690.099'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 88484.750'MB/sec zip my value time = 1.55's, unzip length = 0.263'GB zip my value throughput = 169.434'MB/sec zip pipeline throughput = 169.434'MB/sec entries = 258861 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1016.99 avg-zval = 311.28 usrkeys = 258861 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1016.99 avg-zval = 311.28 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0806 GB dict = 2.69 MB all = 0.0837 GB } UnZip/Zip{ index = 7.1230 value = 3.2671 dict = 1.00 all = 3.2069 } Zip/UnZip{ index = 0.1404 value = 0.3061 dict = 1.00 all = 0.3118 } ---------------------------- total value len = 19.905488 GB avg = 0.315 KB (by entry num) total key len = 1.658262 GB avg = 0.026 KB total ukey len = 1.128342 GB avg = 0.015 KB total ukey num = 0.076422459 Billion total entry num = 0.063230188 Billion write speed all = 0.477523417 MB/sec (with seq num) write speed all = 0.466321694 MB/sec (without seq num) 2024/11/23-21:27:49.781557 139957626406464 [compaction_job.cc:1948] [default] [JOB 36124] Generated table #281472: 258861 keys, 83706456 bytes, temperature: kWarm 2024/11/23-21:27:49.781629 139957626406464 EVENT_LOG_v1 {"time_micros": 1732368469781592, "cf_name": "default", "job": 36124, "event": "table_file_creation", "file_number": 281472, "file_size": 83706456, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 80578688, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177220, "raw_average_key_size": 20, "raw_value_size": 263258622, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 258861, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732368466, "oldest_key_time": 0, "file_creation_time": 1732368466, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281472, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:27:49.840331 139957626406464 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281473.sst) /dev/shm/ToplingTemp/Topling-193418-5GTgqA 2024/11/23-21:27:51.687829 139957626406464 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281473.sst): first pass time = 1.85's, 145.300'MB/sec 2024/11/23-21:27:53.173998 139957626406464 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281473.sst): old prealloc_size = 295279001, real_size = 80480704 2024/11/23-21:27:53.174183 139957626406464 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281473.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258857 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1017.01 avg-zval = 308.97 2024/11/23-21:27:53.174234 139957626406464 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281473.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:27:53.499632 139957626406464 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281473.sst): second pass time = 1.48's, 177.306'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.33's, 255.216'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2566.765'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.276'MB/sec write SST data time = 0.09's, 914.345'MB/sec dict compress time = 0.00's, 2662124.752'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 84724.941'MB/sec zip my value time = 1.48's, unzip length = 0.263'GB zip my value throughput = 177.306'MB/sec zip pipeline throughput = 177.306'MB/sec entries = 258857 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1017.01 avg-zval = 308.97 usrkeys = 258857 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1017.01 avg-zval = 308.97 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1229 value = 3.2916 dict = 1.00 all = 3.2300 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 20.168747 GB avg = 0.318 KB (by entry num) total key len = 1.663439 GB avg = 0.026 KB total ukey len = 1.131449 GB avg = 0.015 KB total ukey num = 0.076681316 Billion total entry num = 0.063489045 Billion write speed all = 0.483427032 MB/sec (with seq num) write speed all = 0.472180400 MB/sec (without seq num) 2024/11/23-21:27:53.594565 139957626406464 [compaction_job.cc:1948] [default] [JOB 36124] Generated table #281473: 258857 keys, 83106909 bytes, temperature: kWarm 2024/11/23-21:27:53.594633 139957626406464 EVENT_LOG_v1 {"time_micros": 1732368473594599, "cf_name": "default", "job": 36124, "event": "table_file_creation", "file_number": 281473, "file_size": 83106909, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79979696, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177140, "raw_average_key_size": 20, "raw_value_size": 263258932, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 258857, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732368469, "oldest_key_time": 0, "file_creation_time": 1732368469, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281473, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:27:53.650871 139957626406464 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281474.sst) /dev/shm/ToplingTemp/Topling-193418-YZKFFA 2024/11/23-21:27:54.964061 139957626406464 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281474.sst): first pass time = 1.31's, 204.422'MB/sec 2024/11/23-21:27:56.449045 139957626406464 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281474.sst): old prealloc_size = 295279001, real_size = 80483472 2024/11/23-21:27:56.449256 139957626406464 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281474.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258857 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1017.01 avg-zval = 308.98 2024/11/23-21:27:56.449295 139957626406464 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281474.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:27:56.771995 139957626406464 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281474.sst): second pass time = 1.48's, 177.444'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.32's, 257.375'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2302.756'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.278'MB/sec write SST data time = 0.09's, 926.321'MB/sec dict compress time = 0.00's, 2662226.733'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 86477.632'MB/sec zip my value time = 1.48's, unzip length = 0.263'GB zip my value throughput = 177.444'MB/sec zip pipeline throughput = 177.444'MB/sec entries = 258857 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1017.01 avg-zval = 308.98 usrkeys = 258857 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1017.01 avg-zval = 308.98 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1229 value = 3.2915 dict = 1.00 all = 3.2299 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 20.432006 GB avg = 0.321 KB (by entry num) total key len = 1.668616 GB avg = 0.026 KB total ukey len = 1.134555 GB avg = 0.015 KB total ukey num = 0.076940173 Billion total entry num = 0.063747902 Billion write speed all = 0.489335518 MB/sec (with seq num) write speed all = 0.478043849 MB/sec (without seq num) 2024/11/23-21:27:56.868901 139957626406464 [compaction_job.cc:1948] [default] [JOB 36124] Generated table #281474: 258857 keys, 83109764 bytes, temperature: kWarm 2024/11/23-21:27:56.868965 139957626406464 EVENT_LOG_v1 {"time_micros": 1732368476868930, "cf_name": "default", "job": 36124, "event": "table_file_creation", "file_number": 281474, "file_size": 83109764, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79982464, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177140, "raw_average_key_size": 20, "raw_value_size": 263258962, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 258857, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732368473, "oldest_key_time": 0, "file_creation_time": 1732368473, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281474, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:27:56.925985 139957626406464 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281475.sst) /dev/shm/ToplingTemp/Topling-193418-Al9z6w 2024/11/23-21:27:58.048959 139957626406464 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281475.sst): first pass time = 1.12's, 239.049'MB/sec 2024/11/23-21:27:59.526308 139957626406464 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281475.sst): old prealloc_size = 295279001, real_size = 80478224 2024/11/23-21:27:59.526481 139957626406464 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281475.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258859 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1017.00 avg-zval = 308.96 2024/11/23-21:27:59.526519 139957626406464 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281475.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:27:59.845145 139957626406464 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281475.sst): second pass time = 1.48's, 178.374'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.32's, 260.666'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2889.163'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.278'MB/sec write SST data time = 0.09's, 969.666'MB/sec dict compress time = 0.00's, 2662341.584'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 78604.022'MB/sec zip my value time = 1.48's, unzip length = 0.263'GB zip my value throughput = 178.374'MB/sec zip pipeline throughput = 178.374'MB/sec entries = 258859 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1017.00 avg-zval = 308.96 usrkeys = 258859 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1017.00 avg-zval = 308.96 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1230 value = 3.2917 dict = 1.00 all = 3.2301 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 20.695265 GB avg = 0.323 KB (by entry num) total key len = 1.673793 GB avg = 0.026 KB total ukey len = 1.137661 GB avg = 0.015 KB total ukey num = 0.077199032 Billion total entry num = 0.064006761 Billion write speed all = 0.495245333 MB/sec (with seq num) write speed all = 0.483908584 MB/sec (without seq num) 2024/11/23-21:27:59.952474 139957626406464 [compaction_job.cc:1948] [default] [JOB 36124] Generated table #281475: 258859 keys, 83104632 bytes, temperature: kWarm 2024/11/23-21:27:59.952543 139957626406464 EVENT_LOG_v1 {"time_micros": 1732368479952510, "cf_name": "default", "job": 36124, "event": "table_file_creation", "file_number": 281475, "file_size": 83104632, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79977216, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177180, "raw_average_key_size": 20, "raw_value_size": 263258958, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 258859, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732368476, "oldest_key_time": 0, "file_creation_time": 1732368476, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281475, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:28:00.008690 139957626406464 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281476.sst) /dev/shm/ToplingTemp/Topling-193418-AiwOly 2024/11/23-21:28:01.290870 139957626406464 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281476.sst): first pass time = 1.28's, 209.365'MB/sec 2024/11/23-21:28:02.794022 139957626406464 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281476.sst): old prealloc_size = 295279001, real_size = 80478416 2024/11/23-21:28:02.794210 139957626406464 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281476.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258858 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1017.00 avg-zval = 308.96 2024/11/23-21:28:02.794255 139957626406464 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281476.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:28:03.116393 139957626406464 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281476.sst): second pass time = 1.50's, 175.290'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.32's, 257.797'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2676.174'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.278'MB/sec write SST data time = 0.09's, 933.401'MB/sec dict compress time = 0.00's, 2661953.465'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 61759.424'MB/sec zip my value time = 1.50's, unzip length = 0.263'GB zip my value throughput = 175.290'MB/sec zip pipeline throughput = 175.290'MB/sec entries = 258858 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1017.00 avg-zval = 308.96 usrkeys = 258858 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1017.00 avg-zval = 308.96 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1230 value = 3.2917 dict = 1.00 all = 3.2301 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 20.958524 GB avg = 0.326 KB (by entry num) total key len = 1.678970 GB avg = 0.026 KB total ukey len = 1.140767 GB avg = 0.015 KB total ukey num = 0.077457890 Billion total entry num = 0.064265619 Billion write speed all = 0.501152148 MB/sec (with seq num) write speed all = 0.489770375 MB/sec (without seq num) 2024/11/23-21:28:03.218112 139957626406464 [compaction_job.cc:1948] [default] [JOB 36124] Generated table #281476: 258858 keys, 83104432 bytes, temperature: kWarm 2024/11/23-21:28:03.218181 139957626406464 EVENT_LOG_v1 {"time_micros": 1732368483218146, "cf_name": "default", "job": 36124, "event": "table_file_creation", "file_number": 281476, "file_size": 83104432, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79977408, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177160, "raw_average_key_size": 20, "raw_value_size": 263259083, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 258858, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732368479, "oldest_key_time": 0, "file_creation_time": 1732368479, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281476, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:28:03.275356 139957626406464 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281477.sst) /dev/shm/ToplingTemp/Topling-193418-MONZnx 2024/11/23-21:28:05.234861 139957626406464 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281477.sst): first pass time = 1.96's, 136.995'MB/sec 2024/11/23-21:28:06.742428 139957626406464 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281477.sst): old prealloc_size = 295279001, real_size = 81136848 2024/11/23-21:28:06.742618 139957626406464 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281477.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258856 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0806 GB avg-val =1017.01 avg-zval = 311.51 2024/11/23-21:28:06.742655 139957626406464 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281477.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:28:07.065365 139957626406464 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281477.sst): second pass time = 1.51's, 174.794'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.32's, 259.397'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2636.041'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.279'MB/sec write SST data time = 0.09's, 925.011'MB/sec dict compress time = 0.00's, 2662488.119'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 80623.403'MB/sec zip my value time = 1.51's, unzip length = 0.263'GB zip my value throughput = 174.794'MB/sec zip pipeline throughput = 174.794'MB/sec entries = 258856 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1017.01 avg-zval = 311.51 usrkeys = 258856 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1017.01 avg-zval = 311.51 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0806 GB dict = 2.69 MB all = 0.0838 GB } UnZip/Zip{ index = 7.1229 value = 3.2648 dict = 1.00 all = 3.2047 } Zip/UnZip{ index = 0.1404 value = 0.3063 dict = 1.00 all = 0.3120 } ---------------------------- total value len = 21.221784 GB avg = 0.329 KB (by entry num) total key len = 1.684147 GB avg = 0.026 KB total ukey len = 1.143874 GB avg = 0.015 KB total ukey num = 0.077716746 Billion total entry num = 0.064524475 Billion write speed all = 0.507050505 MB/sec (with seq num) write speed all = 0.495623886 MB/sec (without seq num) 2024/11/23-21:28:07.163041 139957626406464 [compaction_job.cc:1948] [default] [JOB 36124] Generated table #281477: 258856 keys, 83763404 bytes, temperature: kWarm 2024/11/23-21:28:07.163112 139957626406464 EVENT_LOG_v1 {"time_micros": 1732368487163076, "cf_name": "default", "job": 36124, "event": "table_file_creation", "file_number": 281477, "file_size": 83763404, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 80635840, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177120, "raw_average_key_size": 20, "raw_value_size": 263259311, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 258856, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732368483, "oldest_key_time": 0, "file_creation_time": 1732368483, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281477, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:28:07.220826 139957626406464 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281478.sst) /dev/shm/ToplingTemp/Topling-193418-8AQpUz 2024/11/23-21:28:08.599847 139957626406464 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281478.sst): first pass time = 1.38's, 194.663'MB/sec 2024/11/23-21:28:10.077758 139957626406464 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281478.sst): old prealloc_size = 295279001, real_size = 80481200 2024/11/23-21:28:10.077932 139957626406464 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281478.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 258856 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2633 GB zip-val = 0.0800 GB avg-val =1017.01 avg-zval = 308.98 2024/11/23-21:28:10.077970 139957626406464 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281478.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0006 GB, waited 0.000 sec, Key+Value = 0.268 GB 2024/11/23-21:28:10.398494 139957626406464 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281478.sst): second pass time = 1.48's, 178.296'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.32's, 259.134'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2869.260'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.278'MB/sec write SST data time = 0.09's, 942.918'MB/sec dict compress time = 0.00's, 2662504.950'MB/sec z-dict build time = 0.00's, sample length = 2.689'MB, throughput = 79767.738'MB/sec zip my value time = 1.48's, unzip length = 0.263'GB zip my value throughput = 178.296'MB/sec zip pipeline throughput = 178.296'MB/sec entries = 258856 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1017.01 avg-zval = 308.98 usrkeys = 258856 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1017.01 avg-zval = 308.98 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0031 GB value = 0.2633 GB dict = 2.69 MB all = 0.2684 GB } __ZipSize{ index = 0.0004 GB value = 0.0800 GB dict = 2.69 MB all = 0.0831 GB } UnZip/Zip{ index = 7.1229 value = 3.2916 dict = 1.00 all = 3.2300 } Zip/UnZip{ index = 0.1404 value = 0.3038 dict = 1.00 all = 0.3096 } ---------------------------- total value len = 21.485043 GB avg = 0.332 KB (by entry num) total key len = 1.689324 GB avg = 0.026 KB total ukey len = 1.146980 GB avg = 0.015 KB total ukey num = 0.077975602 Billion total entry num = 0.064783331 Billion write speed all = 0.512954818 MB/sec (with seq num) write speed all = 0.501483205 MB/sec (without seq num) 2024/11/23-21:28:10.493517 139957626406464 [compaction_job.cc:1948] [default] [JOB 36124] Generated table #281478: 258856 keys, 83108061 bytes, temperature: kWarm 2024/11/23-21:28:10.493585 139957626406464 EVENT_LOG_v1 {"time_micros": 1732368490493550, "cf_name": "default", "job": 36124, "event": "table_file_creation", "file_number": 281478, "file_size": 83108061, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 79980192, "index_size": 436096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 5177120, "raw_average_key_size": 20, "raw_value_size": 263259090, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 258856, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732368487, "oldest_key_time": 0, "file_creation_time": 1732368487, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281478, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:28:10.558005 139957626406464 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281479.sst) /dev/shm/ToplingTemp/Topling-193418-7NK69x 2024/11/23-21:28:11.285232 139957626406464 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281479.sst): first pass time = 0.73's, 343.952'MB/sec 2024/11/23-21:28:12.644926 139957626406464 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281479.sst): old prealloc_size = 295279001, real_size = 75014912 2024/11/23-21:28:12.645138 139957626406464 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281479.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 241194 prefix = 4 raw-key = 0.0019 GB zip-key = 0.0004 GB avg-key = 8.00 avg-zkey = 1.68 raw-val = 0.2453 GB zip-val = 0.0745 GB avg-val =1017.00 avg-zval = 309.08 2024/11/23-21:28:12.645179 139957626406464 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281479.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0005 GB, waited 0.000 sec, Key+Value = 0.250 GB 2024/11/23-21:28:12.943897 139957626406464 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00/281479.sst): second pass time = 1.36's, 180.578'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.30's, 259.161'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2153.093'MB/sec (index lex order gen) rebuild zvType time = 0.22's, 0.280'MB/sec write SST data time = 0.08's, 926.707'MB/sec dict compress time = 0.00's, 2494635.644'MB/sec z-dict build time = 0.00's, sample length = 2.520'MB, throughput = 81924.305'MB/sec zip my value time = 1.36's, unzip length = 0.245'GB zip my value throughput = 180.578'MB/sec zip pipeline throughput = 180.578'MB/sec entries = 241194 avg-key = 20.00 avg-zkey = 1.68 avg-val = 1017.00 avg-zval = 309.08 usrkeys = 241194 avg-key = 12.00 avg-zkey = 1.68 avg-val = 1017.00 avg-zval = 309.08 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0029 GB value = 0.2453 GB dict = 2.52 MB all = 0.2501 GB } __ZipSize{ index = 0.0004 GB value = 0.0745 GB dict = 2.52 MB all = 0.0775 GB } UnZip/Zip{ index = 7.1230 value = 3.2904 dict = 1.00 all = 3.2283 } Zip/UnZip{ index = 0.1404 value = 0.3039 dict = 1.00 all = 0.3098 } ---------------------------- total value len = 21.730336 GB avg = 0.334 KB (by entry num) total key len = 1.694148 GB avg = 0.026 KB total ukey len = 1.149874 GB avg = 0.015 KB total ukey num = 0.078216796 Billion total entry num = 0.065024525 Billion write speed all = 0.518461857 MB/sec (with seq num) write speed all = 0.506948182 MB/sec (without seq num) 2024/11/23-21:28:13.033247 139957626406464 [compaction_job.cc:1948] [default] [JOB 36124] Generated table #281479: 241194 keys, 77476305 bytes, temperature: kWarm 2024/11/23-21:28:13.033314 139957626406464 EVENT_LOG_v1 {"time_micros": 1732368493033280, "cf_name": "default", "job": 36124, "event": "table_file_creation", "file_number": 281479, "file_size": 77476305, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 74548080, "index_size": 406336, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 4823880, "raw_average_key_size": 20, "raw_value_size": 245293823, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 241194, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732368490, "oldest_key_time": 0, "file_creation_time": 1732368490, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 281479, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-21:28:13.076823 139957626406464 [compaction_job.cc:703] job-36124: subcompact[0], size: 4.069166 G, files: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-36124/att-00 [281431,281432,281433,281434,281435,281436,281437,281438,281439,281440,281441,281442,281443,281444,281445,281446,281447,281448,281449,281450,281451,281452,281453,281454,281455,281456,281457,281458,281459,281460,281461,281462,281463,281464,281465,281466,281467,281468,281469,281470,281471,281472,281473,281474,281475,281476,281477,281478,281479] 2024/11/23-21:28:13.630986 139957626406464 (Original Log Time 2024/11/23-21:25:24.098032) EVENT_LOG_v1 {"time_micros": 1732368324097986, "job": 36124, "event": "compaction_started", "compaction_reason": "ManualCompaction", "files_L3": [281414, 281415, 281416, 281417, 281418, 281419, 281420, 281421, 281422], "files_L4": [200710, 200711, 200781, 200787, 200859, 200864, 200925, 200939, 200997, 201017, 201074, 201081, 201094, 201164, 201169, 201171, 201245, 201247, 201305, 201320, 201323, 201381, 201401, 201402, 201459, 201476, 201534, 201553, 201554, 201619, 201628, 201690, 201701, 201704, 201767, 201783, 201848, 201858, 201860, 201928, 201934, 201935, 202005, 202014, 202016, 202080, 202091, 202156, 202162, 202166, 202218, 202230, 202246, 202316, 202320, 202321, 202388, 202394, 202460, 202466, 202468, 202535, 202541, 202542, 202611, 202614, 202615, 202684, 202690, 202754, 202763, 202765, 202827, 202841, 202842, 202913, 202916, 202917, 202994, 202995, 203060, 203064, 203071, 209758, 214399, 206703, 214175, 277850, 277851, 203263, 262444, 262334, 262112, 236579, 228939, 216211, 261640, 261499, 207496, 221256, 243723, 228032, 243528, 243378, 220589, 220377, 235187, 235078, 234976, 227110, 260894, 203696, 203697, 203698, 203699, 259123, 241684, 258757, 204800, 204801, 204802, 204803, 260684, 260304, 260096, 242514, 242286, 226425, 233838, 209793, 249711, 249328, 225592, 225466, 257481, 225028, 240585, 224818, 224703, 257218, 248651, 208693, 224030, 205681, 205678, 205679, 205680], "score": -1, "input_data_size": 4410744047, "oldest_snapshot_seqno": 4271528678} 2024/11/23-21:28:13.630991 139957626406464 (Original Log Time 2024/11/23-21:28:13.628923) [compaction_job.cc:2022] [default] [JOB 36124] Compacted 9@3 + 147@4 files to L4 => 4069165872 bytes 2024/11/23-21:28:13.630993 139957626406464 (Original Log Time 2024/11/23-21:28:13.630888) [compaction_job.cc:1224] [default] compacted to: files[0 0 0 0 49 0 0] max score 0.02, MB/sec: 26.1 rd, 24.1 wr, level 4, files in(9, 147) out(49 +0 blob) MB in(365.0, 3841.4 +0.0 blob) out(3880.7 +0.0 blob), read-write-amplify(22.2) write-amplify(10.6) OK, records in: 13658785, records dropped: 992424 output_compression: Snappy 2024/11/23-21:28:13.630996 139957626406464 (Original Log Time 2024/11/23-21:28:13.630943) EVENT_LOG_v1 {"time_micros": 1732368493630911, "cf": "default", "job": 36124, "event": "compaction_finished", "compaction_time_micros": 168978797, "compaction_time_cpu_micros": 34975327, "output_level": 4, "num_output_files": 49, "total_output_size": 4069165872, "num_input_records": 13658785, "num_output_records": 12666361, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "file_write_nanos": 2708689050, "file_range_sync_nanos": 0, "file_fsync_nanos": 35301, "file_prepare_write_nanos": 104048, "lsm_state": [0, 0, 0, 0, 49, 0, 0]} 2024/11/23-21:28:13.771759 139957626406464 DEBG dcompact_worker.cpp:240: HttpPost: 200 OK: url = http://nlb-7zny4kaa1poal01o64.cn-shenzhen.nlb.aliyuncs.com:8443, body = {"instanceId":"nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137","labourId":"","dbId":"d89b4006-2803-486e-b7a2-759bcf348921","dbStarts":1732256054,"starts":1732368323,"executesMs":169676,"compactionJobId":36124,"attempt":0,"compactionInputRawBytes":14164191795,"compactionInputZipBytes":4410744047,"compactionOutputRawBytes":0,"compactionOutputZipBytes":4069165872,"headers":{"Accept":"*/*","Connection":"close","Host":"aliyun-topling-saas.topling.cn:18443","RemoteIp":"120.24.192.169","X-Forwarded-For":"120.24.192.169","region":"cn-shenzhen","token":"e6474c481bd4415abc537135cc03626b","instance-token":"e6474c481bd4415abc537135cc03626b","provider":"aliyun","CloudMarketInstanceId":"si-59c0ae5c955845588903","MeteringAssit":"","Transfer-Encoding":"chunked","traceparent":"00-5892400cab80ab971da936f25e942fd2-ca8602a7cf65093a-00"}}, response = 2024/11/23-21:28:13.771848 139957626406464 INFO dcompact_worker.cpp:1459: finish /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-36124/att-00: olev 4, work 169.677 s, result 7.839 ms, install 2.093 ms, input{raw 13.191 GiB zip 4.108 GiB}