2024/11/23-20:04:40.756045 139957534086720 DEBG dcompact_worker.cpp:2214: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00: fork to child time = 0.008633 sec 2024/11/23-20:04:40.756837 139957534086720 DEBG dcompact_worker.cpp:1013: Beg SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00 2024/11/23-20:04:40.764385 139957534086720 DEBG dcompact_worker.cpp:1033: End SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00 2024/11/23-20:04:40.765328 139957534086720 TRAC dcompact_worker.cpp:1083: INFO_LOG_LEVEL: rpc = INFO_LEVEL, env_var = undefined 2024/11/23-20:04:40.765608 139957534086720 [WARN] [column_family.cc:386] multiple cf_paths/db_paths and level_compaction_dynamic_level_bytes can't be used together 2024/11/23-20:04:40.816984 139957534086720 [version_set.cc:6208] Recovering from manifest file: /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-34819/att-00/MANIFEST-206347 2024/11/23-20:04:40.851559 139957534086720 [version_set.cc:6251] Recovered from manifest file:/worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-34819/att-00/MANIFEST-206347 succeeded,manifest_file_number is 206347, next_file_number is 278533, last_sequence is 4233581475, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 278381 2024/11/23-20:04:40.851570 139957534086720 [version_set.cc:6266] Column family [default] (ID 0), log number is 0 2024/11/23-20:04:40.851733 139957534086720 [version_set.cc:5721] Creating manifest 278533 2024/11/23-20:04:40.885297 139957534086720 DEBG dcompact_worker.cpp:1218: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00: bottommost_level: fake = 1, rpc = 0 2024/11/23-20:04:40.907458 139957534086720 [compaction_job.cc:2437] [default] [JOB 34819] Compacting 1@2 + 22@3 files to L3, score 1.00, subcompactions 1 : 1 2024/11/23-20:04:40.907474 139957534086720 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 26061 Base level 2, inputs: [278526(31MB)], [278444(40MB) 278445(40MB) 278446(40MB) 278447(40MB) 278448(40MB) 278449(40MB) 278450(40MB) 278451(40MB) 278452(40MB) 278453(40MB) 278454(40MB) 278455(40MB) 278456(40MB) 278457(40MB) 278458(40MB) 278459(40MB) 278460(40MB) 278461(40MB) 278462(40MB) 278463(40MB) 278464(40MB) 278529(40MB)] 2024/11/23-20:04:40.915504 139957534086720 [top_zip_table.cc:59] core git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-20:04:40.915535 139957534086720 [top_zip_table.cc:60] fsa git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-20:04:40.915554 139957534086720 [top_zip_table.cc:61] zbs git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-20:04:40.915560 139957534086720 [top_zip_table.cc:62] topling-zip_table_reader: git_version_hash_info_is: commit a4a382006cb82713acf5b3425835f22711877681 Author: leipeng Date: 2024-04-11 19:44:14 +0800 fixed_len_hole_index.cc: Add env bool FixedLenHoleIndexUseAVX512 for ut & debug 1. FixedLenHoleIndexUseAVX512 is only in unit tests or debug 2. In release mode, use avx512 by compile options(-march=) g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/23-20:04:40.915571 139957534086720 [top_zip_table.cc:64] topling-rocks git_version_hash_info_is: commit feab587e468621ba0204d47b4ffacc52e7c4290d Author: leipeng Date: 2024-03-22 13:35:06 +0800 ToplingZipTableBuilder::Add: immediately return after error This function returns void, and caller does not check builder->status() after calling this function and graceful abandon. So immediately return after error, and return error status in Finish(). g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/23-20:04:41.567238 139957534086720 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278534.sst) /dev/shm/ToplingTemp/Topling-174721-YTZIjK 2024/11/23-20:04:41.752141 139957534086720 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278534.sst): first pass time = 0.18's, 726.139'MB/sec 2024/11/23-20:04:43.817262 139957534086720 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278534.sst): old prealloc_size = 147639500, real_size = 40590336 2024/11/23-20:04:43.817403 139957534086720 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278534.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129431 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.79 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1016.99 avg-zval = 311.56 2024/11/23-20:04:43.817599 139957534086720 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278534.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-20:04:44.187633 139957534086720 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278534.sst): second pass time = 2.05's, 64.087'MB/sec, value only(98.1% of KV) wait indexing time = 0.01's, remap KeyValue time = 0.37's, 114.549'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1938.617'MB/sec (index lex order gen) rebuild zvType time = 0.29's, 0.113'MB/sec write SST data time = 0.08's, 509.578'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.379'MB, throughput = 48198.098'MB/sec zip my value time = 2.05's, unzip length = 0.132'GB zip my value throughput = 64.087'MB/sec zip pipeline throughput = 115.780'MB/sec entries = 129431 avg-key = 20.00 avg-zkey = 1.79 avg-val = 1016.99 avg-zval = 311.56 usrkeys = 129431 avg-key = 12.00 avg-zkey = 1.79 avg-val = 1023.99 avg-zval = 311.56 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129431 bytes = 485376 } seq expand size = 906017 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0424 GB } UnZip/Zip{ index = 6.6855 value = 3.2642 dict = 1.00 all = 3.1638 } Zip/UnZip{ index = 0.1496 value = 0.3064 dict = 1.00 all = 0.3161 } ---------------------------- total value len = 8.981156 GB avg = 0.171 KB (by entry num) total key len = 1.443410 GB avg = 0.028 KB total ukey len = 0.999431 GB avg = 0.015 KB total ukey num = 0.065679866 Billion total entry num = 0.052487595 Billion write speed all = 0.259498472 MB/sec (with seq num) write speed all = 0.249045892 MB/sec (without seq num) 2024/11/23-20:04:44.243900 139957534086720 [compaction_job.cc:1948] [default] [JOB 34819] Generated table #278534: 129431 keys, 42423681 bytes, temperature: kWarm 2024/11/23-20:04:44.244005 139957534086720 EVENT_LOG_v1 {"time_micros": 1732363484243936, "cf_name": "default", "job": 34819, "event": "table_file_creation", "file_number": 278534, "file_size": 42423681, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237877277, "largest_seqno": 4233515468, "table_properties": {"data_size": 40325488, "index_size": 232320, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588620, "raw_average_key_size": 20, "raw_value_size": 131630092, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129431, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732363481, "oldest_key_time": 0, "file_creation_time": 1732363481, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 278534, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-20:04:44.285940 139957534086720 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278535.sst) /dev/shm/ToplingTemp/Topling-174721-ZwiThN 2024/11/23-20:04:44.885105 139957534086720 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278535.sst): first pass time = 0.60's, 224.027'MB/sec 2024/11/23-20:04:45.786684 139957534086720 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278535.sst): old prealloc_size = 147639500, real_size = 40869952 2024/11/23-20:04:45.786803 139957534086720 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278535.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129433 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.73 raw-val = 0.1316 GB zip-val = 0.0406 GB avg-val =1016.97 avg-zval = 313.78 2024/11/23-20:04:45.786960 139957534086720 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278535.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-20:04:46.031663 139957534086720 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278535.sst): second pass time = 0.90's, 146.110'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.24's, 174.342'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2240.390'MB/sec (index lex order gen) rebuild zvType time = 0.18's, 0.183'MB/sec write SST data time = 0.07's, 624.348'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 44962.799'MB/sec zip my value time = 0.90's, unzip length = 0.132'GB zip my value throughput = 146.110'MB/sec zip pipeline throughput = 146.110'MB/sec entries = 129433 avg-key = 20.00 avg-zkey = 1.73 avg-val = 1016.97 avg-zval = 313.78 usrkeys = 129433 avg-key = 12.00 avg-zkey = 1.73 avg-val = 1023.97 avg-zval = 313.78 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129433 bytes = 485392 } seq expand size = 906031 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0406 GB dict = 1.38 MB all = 0.0427 GB } UnZip/Zip{ index = 6.9220 value = 3.2411 dict = 1.00 all = 3.1431 } Zip/UnZip{ index = 0.1445 value = 0.3085 dict = 1.00 all = 0.3182 } ---------------------------- total value len = 9.113691 GB avg = 0.173 KB (by entry num) total key len = 1.445998 GB avg = 0.027 KB total ukey len = 1.000984 GB avg = 0.015 KB total ukey num = 0.065809299 Billion total entry num = 0.052617028 Billion write speed all = 0.262850043 MB/sec (with seq num) write speed all = 0.252372168 MB/sec (without seq num) 2024/11/23-20:04:46.088317 139957534086720 [compaction_job.cc:1948] [default] [JOB 34819] Generated table #278535: 129433 keys, 42702575 bytes, temperature: kWarm 2024/11/23-20:04:46.088405 139957534086720 EVENT_LOG_v1 {"time_micros": 1732363486088359, "cf_name": "default", "job": 34819, "event": "table_file_creation", "file_number": 278535, "file_size": 42702575, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237868195, "largest_seqno": 4233517968, "table_properties": {"data_size": 40613040, "index_size": 224384, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588660, "raw_average_key_size": 20, "raw_value_size": 131629212, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129433, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732363484, "oldest_key_time": 0, "file_creation_time": 1732363484, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 278535, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-20:04:46.143408 139957534086720 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278536.sst) /dev/shm/ToplingTemp/Topling-174721-8u13tN 2024/11/23-20:04:46.823527 139957534086720 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278536.sst): first pass time = 0.68's, 197.360'MB/sec 2024/11/23-20:04:49.160686 139957534086720 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278536.sst): old prealloc_size = 147639500, real_size = 40580544 2024/11/23-20:04:49.160809 139957534086720 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278536.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129433 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.79 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1016.97 avg-zval = 311.48 2024/11/23-20:04:49.160990 139957534086720 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278536.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-20:04:49.329812 139957534086720 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278536.sst): second pass time = 2.34's, 56.337'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.17's, 250.804'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2239.855'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.263'MB/sec write SST data time = 0.05's, 918.427'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 27216.918'MB/sec zip my value time = 2.34's, unzip length = 0.132'GB zip my value throughput = 56.337'MB/sec zip pipeline throughput = 111.745'MB/sec entries = 129433 avg-key = 20.00 avg-zkey = 1.79 avg-val = 1016.97 avg-zval = 311.48 usrkeys = 129433 avg-key = 12.00 avg-zkey = 1.79 avg-val = 1023.97 avg-zval = 311.48 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129433 bytes = 485392 } seq expand size = 906031 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0424 GB } UnZip/Zip{ index = 6.6856 value = 3.2650 dict = 1.00 all = 3.1645 } Zip/UnZip{ index = 0.1496 value = 0.3063 dict = 1.00 all = 0.3160 } ---------------------------- total value len = 9.246227 GB avg = 0.175 KB (by entry num) total key len = 1.448587 GB avg = 0.027 KB total ukey len = 1.002538 GB avg = 0.015 KB total ukey num = 0.065938732 Billion total entry num = 0.052746461 Billion write speed all = 0.266191677 MB/sec (with seq num) write speed all = 0.255688890 MB/sec (without seq num) 2024/11/23-20:04:49.385016 139957534086720 [compaction_job.cc:1948] [default] [JOB 34819] Generated table #278536: 129433 keys, 42413374 bytes, temperature: kWarm 2024/11/23-20:04:49.385085 139957534086720 EVENT_LOG_v1 {"time_micros": 1732363489385051, "cf_name": "default", "job": 34819, "event": "table_file_creation", "file_number": 278536, "file_size": 42413374, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237874654, "largest_seqno": 4233517869, "table_properties": {"data_size": 40315696, "index_size": 232320, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588660, "raw_average_key_size": 20, "raw_value_size": 131629467, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129433, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732363486, "oldest_key_time": 0, "file_creation_time": 1732363486, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 278536, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-20:04:49.429751 139957534086720 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278537.sst) /dev/shm/ToplingTemp/Topling-174721-Jd40RL 2024/11/23-20:04:50.030708 139957534086720 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278537.sst): first pass time = 0.60's, 223.355'MB/sec 2024/11/23-20:04:51.143413 139957534086720 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278537.sst): old prealloc_size = 147639500, real_size = 40862112 2024/11/23-20:04:51.143564 139957534086720 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278537.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129435 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.74 raw-val = 0.1316 GB zip-val = 0.0406 GB avg-val =1016.95 avg-zval = 313.71 2024/11/23-20:04:51.143750 139957534086720 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278537.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-20:04:51.395305 139957534086720 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278537.sst): second pass time = 1.11's, 118.391'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.25's, 169.507'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1791.016'MB/sec (index lex order gen) rebuild zvType time = 0.20's, 0.160'MB/sec write SST data time = 0.05's, 870.018'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 51728.546'MB/sec zip my value time = 1.11's, unzip length = 0.132'GB zip my value throughput = 118.391'MB/sec zip pipeline throughput = 159.518'MB/sec entries = 129435 avg-key = 20.00 avg-zkey = 1.74 avg-val = 1016.95 avg-zval = 313.71 usrkeys = 129435 avg-key = 12.00 avg-zkey = 1.74 avg-val = 1023.95 avg-zval = 313.71 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129435 bytes = 485392 } seq expand size = 906045 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0406 GB dict = 1.38 MB all = 0.0427 GB } UnZip/Zip{ index = 6.9143 value = 3.2417 dict = 1.00 all = 3.1437 } Zip/UnZip{ index = 0.1446 value = 0.3085 dict = 1.00 all = 0.3181 } ---------------------------- total value len = 9.378762 GB avg = 0.177 KB (by entry num) total key len = 1.451176 GB avg = 0.027 KB total ukey len = 1.004091 GB avg = 0.015 KB total ukey num = 0.066068167 Billion total entry num = 0.052875896 Billion write speed all = 0.269541028 MB/sec (with seq num) write speed all = 0.259013009 MB/sec (without seq num) 2024/11/23-20:04:51.447026 139957534086720 [compaction_job.cc:1948] [default] [JOB 34819] Generated table #278537: 129435 keys, 42694808 bytes, temperature: kWarm 2024/11/23-20:04:51.447095 139957534086720 EVENT_LOG_v1 {"time_micros": 1732363491447061, "cf_name": "default", "job": 34819, "event": "table_file_creation", "file_number": 278537, "file_size": 42694808, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237868596, "largest_seqno": 4233497424, "table_properties": {"data_size": 40604944, "index_size": 224640, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588700, "raw_average_key_size": 20, "raw_value_size": 131629239, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129435, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732363489, "oldest_key_time": 0, "file_creation_time": 1732363489, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 278537, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-20:04:51.484678 139957534086720 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278538.sst) /dev/shm/ToplingTemp/Topling-174721-EMvBeN 2024/11/23-20:04:52.486620 139957534086720 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278538.sst): first pass time = 1.00's, 133.963'MB/sec 2024/11/23-20:04:53.616313 139957534086720 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278538.sst): old prealloc_size = 147639500, real_size = 40597872 2024/11/23-20:04:53.616447 139957534086720 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278538.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129433 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.79 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1016.97 avg-zval = 311.62 2024/11/23-20:04:53.616611 139957534086720 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278538.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-20:04:53.785952 139957534086720 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278538.sst): second pass time = 1.13's, 116.668'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.17's, 250.153'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2067.681'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.267'MB/sec write SST data time = 0.05's, 875.776'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 44872.636'MB/sec zip my value time = 1.13's, unzip length = 0.132'GB zip my value throughput = 116.668'MB/sec zip pipeline throughput = 121.615'MB/sec entries = 129433 avg-key = 20.00 avg-zkey = 1.79 avg-val = 1016.97 avg-zval = 311.62 usrkeys = 129433 avg-key = 12.00 avg-zkey = 1.79 avg-val = 1023.97 avg-zval = 311.62 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129433 bytes = 485392 } seq expand size = 906031 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0424 GB } UnZip/Zip{ index = 6.6948 value = 3.2635 dict = 1.00 all = 3.1632 } Zip/UnZip{ index = 0.1494 value = 0.3064 dict = 1.00 all = 0.3161 } ---------------------------- total value len = 9.511298 GB avg = 0.179 KB (by entry num) total key len = 1.453764 GB avg = 0.027 KB total ukey len = 1.005644 GB avg = 0.015 KB total ukey num = 0.066197600 Billion total entry num = 0.053005329 Billion write speed all = 0.272887836 MB/sec (with seq num) write speed all = 0.262334674 MB/sec (without seq num) 2024/11/23-20:04:53.838305 139957534086720 [compaction_job.cc:1948] [default] [JOB 34819] Generated table #278538: 129433 keys, 42430934 bytes, temperature: kWarm 2024/11/23-20:04:53.838386 139957534086720 EVENT_LOG_v1 {"time_micros": 1732363493838342, "cf_name": "default", "job": 34819, "event": "table_file_creation", "file_number": 278538, "file_size": 42430934, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237869923, "largest_seqno": 4233503768, "table_properties": {"data_size": 40333344, "index_size": 232000, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588660, "raw_average_key_size": 20, "raw_value_size": 131629698, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129433, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732363491, "oldest_key_time": 0, "file_creation_time": 1732363491, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 278538, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-20:04:53.880194 139957534086720 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278539.sst) /dev/shm/ToplingTemp/Topling-174721-qWUZEM 2024/11/23-20:04:54.627913 139957534086720 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278539.sst): first pass time = 0.75's, 179.518'MB/sec 2024/11/23-20:04:55.542026 139957534086720 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278539.sst): old prealloc_size = 147639500, real_size = 40587008 2024/11/23-20:04:55.542182 139957534086720 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278539.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129430 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.79 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1016.99 avg-zval = 311.54 2024/11/23-20:04:55.542382 139957534086720 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278539.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-20:04:55.843353 139957534086720 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278539.sst): second pass time = 0.91's, 144.302'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.30's, 140.782'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1775.997'MB/sec (index lex order gen) rebuild zvType time = 0.23's, 0.143'MB/sec write SST data time = 0.08's, 565.221'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 45379.590'MB/sec zip my value time = 0.91's, unzip length = 0.132'GB zip my value throughput = 144.302'MB/sec zip pipeline throughput = 144.302'MB/sec entries = 129430 avg-key = 20.00 avg-zkey = 1.79 avg-val = 1016.99 avg-zval = 311.54 usrkeys = 129430 avg-key = 12.00 avg-zkey = 1.79 avg-val = 1023.99 avg-zval = 311.54 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129430 bytes = 485376 } seq expand size = 906010 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0424 GB } UnZip/Zip{ index = 6.6854 value = 3.2644 dict = 1.00 all = 3.1640 } Zip/UnZip{ index = 0.1496 value = 0.3063 dict = 1.00 all = 0.3161 } ---------------------------- total value len = 9.643833 GB avg = 0.181 KB (by entry num) total key len = 1.456353 GB avg = 0.027 KB total ukey len = 1.007197 GB avg = 0.015 KB total ukey num = 0.066327030 Billion total entry num = 0.053134759 Billion write speed all = 0.276236531 MB/sec (with seq num) write speed all = 0.265658141 MB/sec (without seq num) 2024/11/23-20:04:55.895451 139957534086720 [compaction_job.cc:1948] [default] [JOB 34819] Generated table #278539: 129430 keys, 42419833 bytes, temperature: kWarm 2024/11/23-20:04:55.895520 139957534086720 EVENT_LOG_v1 {"time_micros": 1732363495895483, "cf_name": "default", "job": 34819, "event": "table_file_creation", "file_number": 278539, "file_size": 42419833, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237872175, "largest_seqno": 4233514395, "table_properties": {"data_size": 40322160, "index_size": 232320, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588600, "raw_average_key_size": 20, "raw_value_size": 131629533, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129430, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732363493, "oldest_key_time": 0, "file_creation_time": 1732363493, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 278539, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-20:04:55.938403 139957534086720 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278540.sst) /dev/shm/ToplingTemp/Topling-174721-KCHAAM 2024/11/23-20:04:56.546717 139957534086720 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278540.sst): first pass time = 0.61's, 220.654'MB/sec 2024/11/23-20:04:57.438181 139957534086720 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278540.sst): old prealloc_size = 147639500, real_size = 40820112 2024/11/23-20:04:57.438343 139957534086720 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278540.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129429 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.76 raw-val = 0.1316 GB zip-val = 0.0406 GB avg-val =1017.00 avg-zval = 313.37 2024/11/23-20:04:57.438522 139957534086720 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278540.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-20:04:57.628854 139957534086720 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278540.sst): second pass time = 0.89's, 147.783'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.19's, 223.719'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1677.211'MB/sec (index lex order gen) rebuild zvType time = 0.14's, 0.229'MB/sec write SST data time = 0.05's, 864.905'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.379'MB, throughput = 46735.998'MB/sec zip my value time = 0.89's, unzip length = 0.132'GB zip my value throughput = 147.783'MB/sec zip pipeline throughput = 147.783'MB/sec entries = 129429 avg-key = 20.00 avg-zkey = 1.76 avg-val = 1017.00 avg-zval = 313.37 usrkeys = 129429 avg-key = 12.00 avg-zkey = 1.76 avg-val = 1024.00 avg-zval = 313.37 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129429 bytes = 485376 } seq expand size = 906003 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0406 GB dict = 1.38 MB all = 0.0427 GB } UnZip/Zip{ index = 6.7996 value = 3.2454 dict = 1.00 all = 3.1467 } Zip/UnZip{ index = 0.1471 value = 0.3081 dict = 1.00 all = 0.3178 } ---------------------------- total value len = 9.776369 GB avg = 0.184 KB (by entry num) total key len = 1.458942 GB avg = 0.027 KB total ukey len = 1.008750 GB avg = 0.015 KB total ukey num = 0.066456459 Billion total entry num = 0.053264188 Billion write speed all = 0.279586775 MB/sec (with seq num) write speed all = 0.268983089 MB/sec (without seq num) 2024/11/23-20:04:57.684336 139957534086720 [compaction_job.cc:1948] [default] [JOB 34819] Generated table #278540: 129429 keys, 42653404 bytes, temperature: kWarm 2024/11/23-20:04:57.684402 139957534086720 EVENT_LOG_v1 {"time_micros": 1732363497684368, "cf_name": "default", "job": 34819, "event": "table_file_creation", "file_number": 278540, "file_size": 42653404, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237885133, "largest_seqno": 4233505980, "table_properties": {"data_size": 40559168, "index_size": 228416, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588580, "raw_average_key_size": 20, "raw_value_size": 131629591, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129429, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732363495, "oldest_key_time": 0, "file_creation_time": 1732363495, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 278540, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-20:04:57.723577 139957534086720 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278541.sst) /dev/shm/ToplingTemp/Topling-174721-TaFfZN 2024/11/23-20:04:58.294507 139957534086720 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278541.sst): first pass time = 0.57's, 235.106'MB/sec 2024/11/23-20:04:59.187893 139957534086720 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278541.sst): old prealloc_size = 147639500, real_size = 40991136 2024/11/23-20:04:59.188032 139957534086720 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278541.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129427 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.73 raw-val = 0.1316 GB zip-val = 0.0407 GB avg-val =1017.02 avg-zval = 314.73 2024/11/23-20:04:59.188200 139957534086720 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278541.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-20:04:59.429807 139957534086720 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278541.sst): second pass time = 0.89's, 147.609'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.24's, 177.048'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1939.562'MB/sec (index lex order gen) rebuild zvType time = 0.17's, 0.185'MB/sec write SST data time = 0.07's, 640.595'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 42770.062'MB/sec zip my value time = 0.89's, unzip length = 0.132'GB zip my value throughput = 147.609'MB/sec zip pipeline throughput = 147.609'MB/sec entries = 129427 avg-key = 20.00 avg-zkey = 1.73 avg-val = 1017.02 avg-zval = 314.73 usrkeys = 129427 avg-key = 12.00 avg-zkey = 1.73 avg-val = 1024.02 avg-zval = 314.73 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129427 bytes = 485360 } seq expand size = 905989 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0407 GB dict = 1.38 MB all = 0.0428 GB } UnZip/Zip{ index = 6.9395 value = 3.2314 dict = 1.00 all = 3.1342 } Zip/UnZip{ index = 0.1441 value = 0.3095 dict = 1.00 all = 0.3191 } ---------------------------- total value len = 9.908904 GB avg = 0.186 KB (by entry num) total key len = 1.461530 GB avg = 0.027 KB total ukey len = 1.010303 GB avg = 0.015 KB total ukey num = 0.066585886 Billion total entry num = 0.053393615 Billion write speed all = 0.282936611 MB/sec (with seq num) write speed all = 0.272307636 MB/sec (without seq num) 2024/11/23-20:04:59.486720 139957534086720 [compaction_job.cc:1948] [default] [JOB 34819] Generated table #278541: 129427 keys, 42823575 bytes, temperature: kWarm 2024/11/23-20:04:59.486812 139957534086720 EVENT_LOG_v1 {"time_micros": 1732363499486763, "cf_name": "default", "job": 34819, "event": "table_file_creation", "file_number": 278541, "file_size": 42823575, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237880987, "largest_seqno": 4233510639, "table_properties": {"data_size": 40734800, "index_size": 223808, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588540, "raw_average_key_size": 20, "raw_value_size": 131629578, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129427, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732363497, "oldest_key_time": 0, "file_creation_time": 1732363497, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 278541, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-20:04:59.557257 139957534086720 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278542.sst) /dev/shm/ToplingTemp/Topling-174721-0TDEcL 2024/11/23-20:05:00.199827 139957534086720 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278542.sst): first pass time = 0.64's, 208.892'MB/sec 2024/11/23-20:05:01.065533 139957534086720 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278542.sst): old prealloc_size = 147639500, real_size = 41020896 2024/11/23-20:05:01.065651 139957534086720 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278542.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129430 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.71 raw-val = 0.1316 GB zip-val = 0.0408 GB avg-val =1016.99 avg-zval = 314.98 2024/11/23-20:05:01.065811 139957534086720 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278542.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-20:05:01.230950 139957534086720 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278542.sst): second pass time = 0.86's, 152.188'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.17's, 259.105'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2331.450'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.273'MB/sec write SST data time = 0.05's, 919.992'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 44615.611'MB/sec zip my value time = 0.86's, unzip length = 0.132'GB zip my value throughput = 152.188'MB/sec zip pipeline throughput = 152.188'MB/sec entries = 129430 avg-key = 20.00 avg-zkey = 1.71 avg-val = 1016.99 avg-zval = 314.98 usrkeys = 129430 avg-key = 12.00 avg-zkey = 1.71 avg-val = 1023.99 avg-zval = 314.98 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129430 bytes = 485376 } seq expand size = 906010 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0408 GB dict = 1.38 MB all = 0.0429 GB } UnZip/Zip{ index = 7.0342 value = 3.2288 dict = 1.00 all = 3.1320 } Zip/UnZip{ index = 0.1422 value = 0.3097 dict = 1.00 all = 0.3193 } ---------------------------- total value len = 10.041440 GB avg = 0.188 KB (by entry num) total key len = 1.464119 GB avg = 0.027 KB total ukey len = 1.011857 GB avg = 0.015 KB total ukey num = 0.066715316 Billion total entry num = 0.053523045 Billion write speed all = 0.286286139 MB/sec (with seq num) write speed all = 0.275631876 MB/sec (without seq num) 2024/11/23-20:05:01.284031 139957534086720 [compaction_job.cc:1948] [default] [JOB 34819] Generated table #278542: 129430 keys, 42853734 bytes, temperature: kWarm 2024/11/23-20:05:01.284101 139957534086720 EVENT_LOG_v1 {"time_micros": 1732363501284065, "cf_name": "default", "job": 34819, "event": "table_file_creation", "file_number": 278542, "file_size": 42853734, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237868290, "largest_seqno": 4233517974, "table_properties": {"data_size": 40767568, "index_size": 220800, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588600, "raw_average_key_size": 20, "raw_value_size": 131629252, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129430, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732363499, "oldest_key_time": 0, "file_creation_time": 1732363499, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 278542, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-20:05:01.328230 139957534086720 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278543.sst) /dev/shm/ToplingTemp/Topling-174721-tbbsDL 2024/11/23-20:05:01.941546 139957534086720 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278543.sst): first pass time = 0.61's, 218.859'MB/sec 2024/11/23-20:05:02.758872 139957534086720 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278543.sst): old prealloc_size = 147639500, real_size = 40797552 2024/11/23-20:05:02.759018 139957534086720 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278543.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129432 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.76 raw-val = 0.1316 GB zip-val = 0.0405 GB avg-val =1016.98 avg-zval = 313.19 2024/11/23-20:05:02.759184 139957534086720 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278543.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-20:05:02.925565 139957534086720 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278543.sst): second pass time = 0.82's, 161.184'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.17's, 255.776'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1825.573'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.272'MB/sec write SST data time = 0.05's, 894.167'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 45489.551'MB/sec zip my value time = 0.82's, unzip length = 0.132'GB zip my value throughput = 161.184'MB/sec zip pipeline throughput = 161.184'MB/sec entries = 129432 avg-key = 20.00 avg-zkey = 1.76 avg-val = 1016.98 avg-zval = 313.19 usrkeys = 129432 avg-key = 12.00 avg-zkey = 1.76 avg-val = 1023.98 avg-zval = 313.19 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129432 bytes = 485392 } seq expand size = 906024 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0405 GB dict = 1.38 MB all = 0.0426 GB } UnZip/Zip{ index = 6.8055 value = 3.2472 dict = 1.00 all = 3.1484 } Zip/UnZip{ index = 0.1469 value = 0.3080 dict = 1.00 all = 0.3176 } ---------------------------- total value len = 10.173975 GB avg = 0.190 KB (by entry num) total key len = 1.466707 GB avg = 0.027 KB total ukey len = 1.013410 GB avg = 0.015 KB total ukey num = 0.066844748 Billion total entry num = 0.053652477 Billion write speed all = 0.289636136 MB/sec (with seq num) write speed all = 0.278956559 MB/sec (without seq num) 2024/11/23-20:05:02.980918 139957534086720 [compaction_job.cc:1948] [default] [JOB 34819] Generated table #278543: 129432 keys, 42630275 bytes, temperature: kWarm 2024/11/23-20:05:02.981021 139957534086720 EVENT_LOG_v1 {"time_micros": 1732363502980960, "cf_name": "default", "job": 34819, "event": "table_file_creation", "file_number": 278543, "file_size": 42630275, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237874127, "largest_seqno": 4233517981, "table_properties": {"data_size": 40536800, "index_size": 228224, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588640, "raw_average_key_size": 20, "raw_value_size": 131629231, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129432, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732363501, "oldest_key_time": 0, "file_creation_time": 1732363501, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 278543, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-20:05:03.042173 139957534086720 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278544.sst) /dev/shm/ToplingTemp/Topling-174721-n5HzjL 2024/11/23-20:05:03.739649 139957534086720 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278544.sst): first pass time = 0.70's, 192.448'MB/sec 2024/11/23-20:05:04.517055 139957534086720 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278544.sst): old prealloc_size = 147639500, real_size = 40589328 2024/11/23-20:05:04.517174 139957534086720 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278544.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129431 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.79 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1016.98 avg-zval = 311.55 2024/11/23-20:05:04.517334 139957534086720 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278544.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-20:05:04.679738 139957534086720 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278544.sst): second pass time = 0.78's, 169.696'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 260.810'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2410.759'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.275'MB/sec write SST data time = 0.04's, 944.034'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 44904.289'MB/sec zip my value time = 0.78's, unzip length = 0.132'GB zip my value throughput = 169.696'MB/sec zip pipeline throughput = 169.696'MB/sec entries = 129431 avg-key = 20.00 avg-zkey = 1.79 avg-val = 1016.98 avg-zval = 311.55 usrkeys = 129431 avg-key = 12.00 avg-zkey = 1.79 avg-val = 1023.98 avg-zval = 311.55 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129431 bytes = 485376 } seq expand size = 906017 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0424 GB } UnZip/Zip{ index = 6.6855 value = 3.2642 dict = 1.00 all = 3.1639 } Zip/UnZip{ index = 0.1496 value = 0.3063 dict = 1.00 all = 0.3161 } ---------------------------- total value len = 10.306510 GB avg = 0.192 KB (by entry num) total key len = 1.469296 GB avg = 0.027 KB total ukey len = 1.014963 GB avg = 0.015 KB total ukey num = 0.066974179 Billion total entry num = 0.053781908 Billion write speed all = 0.292985413 MB/sec (with seq num) write speed all = 0.282280539 MB/sec (without seq num) 2024/11/23-20:05:04.730626 139957534086720 [compaction_job.cc:1948] [default] [JOB 34819] Generated table #278544: 129431 keys, 42422028 bytes, temperature: kWarm 2024/11/23-20:05:04.730685 139957534086720 EVENT_LOG_v1 {"time_micros": 1732363504730654, "cf_name": "default", "job": 34819, "event": "table_file_creation", "file_number": 278544, "file_size": 42422028, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237873877, "largest_seqno": 4233506562, "table_properties": {"data_size": 40324480, "index_size": 232320, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588620, "raw_average_key_size": 20, "raw_value_size": 131629137, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129431, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732363503, "oldest_key_time": 0, "file_creation_time": 1732363503, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 278544, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-20:05:04.771688 139957534086720 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278545.sst) /dev/shm/ToplingTemp/Topling-174721-HYqqeN 2024/11/23-20:05:05.346393 139957534086720 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278545.sst): first pass time = 0.57's, 233.561'MB/sec 2024/11/23-20:05:06.166607 139957534086720 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278545.sst): old prealloc_size = 147639500, real_size = 40583648 2024/11/23-20:05:06.166732 139957534086720 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278545.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129427 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.79 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1017.02 avg-zval = 311.52 2024/11/23-20:05:06.166898 139957534086720 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278545.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-20:05:06.329007 139957534086720 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278545.sst): second pass time = 0.82's, 160.628'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 261.255'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2244.139'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.276'MB/sec write SST data time = 0.05's, 940.161'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 47172.691'MB/sec zip my value time = 0.82's, unzip length = 0.132'GB zip my value throughput = 160.628'MB/sec zip pipeline throughput = 160.628'MB/sec entries = 129427 avg-key = 20.00 avg-zkey = 1.79 avg-val = 1017.02 avg-zval = 311.52 usrkeys = 129427 avg-key = 12.00 avg-zkey = 1.79 avg-val = 1024.02 avg-zval = 311.52 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129427 bytes = 485360 } seq expand size = 905989 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0424 GB } UnZip/Zip{ index = 6.6853 value = 3.2647 dict = 1.00 all = 3.1643 } Zip/UnZip{ index = 0.1496 value = 0.3063 dict = 1.00 all = 0.3160 } ---------------------------- total value len = 10.439045 GB avg = 0.194 KB (by entry num) total key len = 1.471885 GB avg = 0.027 KB total ukey len = 1.016516 GB avg = 0.015 KB total ukey num = 0.067103606 Billion total entry num = 0.053911335 Billion write speed all = 0.296335170 MB/sec (with seq num) write speed all = 0.285604976 MB/sec (without seq num) 2024/11/23-20:05:06.381265 139957534086720 [compaction_job.cc:1948] [default] [JOB 34819] Generated table #278545: 129427 keys, 42416438 bytes, temperature: kWarm 2024/11/23-20:05:06.381337 139957534086720 EVENT_LOG_v1 {"time_micros": 1732363506381300, "cf_name": "default", "job": 34819, "event": "table_file_creation", "file_number": 278545, "file_size": 42416438, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237872082, "largest_seqno": 4233513041, "table_properties": {"data_size": 40318800, "index_size": 232320, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588540, "raw_average_key_size": 20, "raw_value_size": 131629204, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129427, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732363504, "oldest_key_time": 0, "file_creation_time": 1732363504, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 278545, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-20:05:06.418911 139957534086720 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278546.sst) /dev/shm/ToplingTemp/Topling-174721-ACXjqL 2024/11/23-20:05:07.051480 139957534086720 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278546.sst): first pass time = 0.63's, 212.194'MB/sec 2024/11/23-20:05:07.908943 139957534086720 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278546.sst): old prealloc_size = 147639500, real_size = 41029712 2024/11/23-20:05:07.909079 139957534086720 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278546.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129430 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.73 raw-val = 0.1316 GB zip-val = 0.0408 GB avg-val =1016.99 avg-zval = 315.02 2024/11/23-20:05:07.909239 139957534086720 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278546.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-20:05:08.070655 139957534086720 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278546.sst): second pass time = 0.86's, 153.721'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 265.096'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2311.420'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.271'MB/sec write SST data time = 0.04's, 1020.910'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 44824.310'MB/sec zip my value time = 0.86's, unzip length = 0.132'GB zip my value throughput = 153.721'MB/sec zip pipeline throughput = 153.721'MB/sec entries = 129430 avg-key = 20.00 avg-zkey = 1.73 avg-val = 1016.99 avg-zval = 315.02 usrkeys = 129430 avg-key = 12.00 avg-zkey = 1.73 avg-val = 1023.99 avg-zval = 315.02 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129430 bytes = 485376 } seq expand size = 906010 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0408 GB dict = 1.38 MB all = 0.0429 GB } UnZip/Zip{ index = 6.9457 value = 3.2283 dict = 1.00 all = 3.1314 } Zip/UnZip{ index = 0.1440 value = 0.3098 dict = 1.00 all = 0.3193 } ---------------------------- total value len = 10.571580 GB avg = 0.196 KB (by entry num) total key len = 1.474473 GB avg = 0.027 KB total ukey len = 1.018069 GB avg = 0.015 KB total ukey num = 0.067233036 Billion total entry num = 0.054040765 Billion write speed all = 0.299683966 MB/sec (with seq num) write speed all = 0.288928477 MB/sec (without seq num) 2024/11/23-20:05:08.121908 139957534086720 [compaction_job.cc:1948] [default] [JOB 34819] Generated table #278546: 129430 keys, 42862199 bytes, temperature: kWarm 2024/11/23-20:05:08.121985 139957534086720 EVENT_LOG_v1 {"time_micros": 1732363508121941, "cf_name": "default", "job": 34819, "event": "table_file_creation", "file_number": 278546, "file_size": 42862199, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237888398, "largest_seqno": 4233516512, "table_properties": {"data_size": 40773568, "index_size": 223616, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588600, "raw_average_key_size": 20, "raw_value_size": 131629227, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129430, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732363506, "oldest_key_time": 0, "file_creation_time": 1732363506, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 278546, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-20:05:08.164862 139957534086720 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278547.sst) /dev/shm/ToplingTemp/Topling-174721-wEymjO 2024/11/23-20:05:08.815330 139957534086720 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278547.sst): first pass time = 0.65's, 206.353'MB/sec 2024/11/23-20:05:09.634444 139957534086720 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278547.sst): old prealloc_size = 147639500, real_size = 40690400 2024/11/23-20:05:09.634569 139957534086720 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278547.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129424 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.78 raw-val = 0.1316 GB zip-val = 0.0404 GB avg-val =1017.04 avg-zval = 312.36 2024/11/23-20:05:09.634719 139957534086720 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278547.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-20:05:09.799619 139957534086720 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278547.sst): second pass time = 0.82's, 160.830'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.17's, 257.477'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2296.041'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.270'MB/sec write SST data time = 0.05's, 936.177'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 48752.503'MB/sec zip my value time = 0.82's, unzip length = 0.132'GB zip my value throughput = 160.830'MB/sec zip pipeline throughput = 160.830'MB/sec entries = 129424 avg-key = 20.00 avg-zkey = 1.78 avg-val = 1017.04 avg-zval = 312.36 usrkeys = 129424 avg-key = 12.00 avg-zkey = 1.78 avg-val = 1024.04 avg-zval = 312.36 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129424 bytes = 485360 } seq expand size = 905968 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0404 GB dict = 1.38 MB all = 0.0425 GB } UnZip/Zip{ index = 6.7315 value = 3.2560 dict = 1.00 all = 3.1564 } Zip/UnZip{ index = 0.1486 value = 0.3071 dict = 1.00 all = 0.3168 } ---------------------------- total value len = 10.704116 GB avg = 0.198 KB (by entry num) total key len = 1.477062 GB avg = 0.027 KB total ukey len = 1.019622 GB avg = 0.015 KB total ukey num = 0.067362460 Billion total entry num = 0.054170189 Billion write speed all = 0.303032575 MB/sec (with seq num) write speed all = 0.292251791 MB/sec (without seq num) 2024/11/23-20:05:09.851610 139957534086720 [compaction_job.cc:1948] [default] [JOB 34819] Generated table #278547: 129424 keys, 42522979 bytes, temperature: kWarm 2024/11/23-20:05:09.851679 139957534086720 EVENT_LOG_v1 {"time_micros": 1732363509851642, "cf_name": "default", "job": 34819, "event": "table_file_creation", "file_number": 278547, "file_size": 42522979, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237871365, "largest_seqno": 4233512624, "table_properties": {"data_size": 40427152, "index_size": 230720, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588480, "raw_average_key_size": 20, "raw_value_size": 131629689, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129424, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732363508, "oldest_key_time": 0, "file_creation_time": 1732363508, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 278547, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-20:05:09.893754 139957534086720 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278548.sst) /dev/shm/ToplingTemp/Topling-174721-9DWlwM 2024/11/23-20:05:10.696751 139957534086720 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278548.sst): first pass time = 0.80's, 167.153'MB/sec 2024/11/23-20:05:11.490379 139957534086720 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278548.sst): old prealloc_size = 147639500, real_size = 40533888 2024/11/23-20:05:11.490506 139957534086720 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278548.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129430 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.74 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1016.99 avg-zval = 311.18 2024/11/23-20:05:11.490650 139957534086720 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278548.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-20:05:11.653023 139957534086720 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278548.sst): second pass time = 0.79's, 166.208'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 259.280'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2169.345'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.274'MB/sec write SST data time = 0.04's, 952.023'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 45593.483'MB/sec zip my value time = 0.79's, unzip length = 0.132'GB zip my value throughput = 166.208'MB/sec zip pipeline throughput = 166.208'MB/sec entries = 129430 avg-key = 20.00 avg-zkey = 1.74 avg-val = 1016.99 avg-zval = 311.18 usrkeys = 129430 avg-key = 12.00 avg-zkey = 1.74 avg-val = 1020.70 avg-zval = 311.18 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 68590 bytes = 257232 } seq expand size = 480130 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0422 GB } UnZip/Zip{ index = 6.8865 value = 3.2682 dict = 1.00 all = 3.1836 } Zip/UnZip{ index = 0.1452 value = 0.3060 dict = 1.00 all = 0.3141 } ---------------------------- total value len = 10.836226 GB avg = 0.200 KB (by entry num) total key len = 1.479650 GB avg = 0.027 KB total ukey len = 1.021175 GB avg = 0.015 KB total ukey num = 0.067491890 Billion total entry num = 0.054299619 Billion write speed all = 0.306369354 MB/sec (with seq num) write speed all = 0.295563309 MB/sec (without seq num) 2024/11/23-20:05:11.704261 139957534086720 [compaction_job.cc:1948] [default] [JOB 34819] Generated table #278548: 129430 keys, 42159090 bytes, temperature: kWarm 2024/11/23-20:05:11.704331 139957534086720 EVENT_LOG_v1 {"time_micros": 1732363511704295, "cf_name": "default", "job": 34819, "event": "table_file_creation", "file_number": 278548, "file_size": 42159090, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4233470086, "table_properties": {"data_size": 40275824, "index_size": 225536, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588600, "raw_average_key_size": 20, "raw_value_size": 131629547, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129430, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732363509, "oldest_key_time": 0, "file_creation_time": 1732363509, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 278548, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-20:05:11.745482 139957534086720 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278549.sst) /dev/shm/ToplingTemp/Topling-174721-IQOUVK 2024/11/23-20:05:12.365491 139957534086720 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278549.sst): first pass time = 0.62's, 216.494'MB/sec 2024/11/23-20:05:13.198960 139957534086720 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278549.sst): old prealloc_size = 147639500, real_size = 40617136 2024/11/23-20:05:13.199104 139957534086720 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278549.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129427 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.73 raw-val = 0.1316 GB zip-val = 0.0404 GB avg-val =1017.02 avg-zval = 311.84 2024/11/23-20:05:13.199219 139957534086720 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278549.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-20:05:13.362424 139957534086720 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278549.sst): second pass time = 0.83's, 158.072'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 258.387'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2128.396'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.272'MB/sec write SST data time = 0.04's, 950.641'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 45595.441'MB/sec zip my value time = 0.83's, unzip length = 0.132'GB zip my value throughput = 158.072'MB/sec zip pipeline throughput = 158.072'MB/sec entries = 129427 avg-key = 20.00 avg-zkey = 1.73 avg-val = 1017.02 avg-zval = 311.84 usrkeys = 129427 avg-key = 12.00 avg-zkey = 1.73 avg-val = 1020.58 avg-zval = 311.84 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 65707 bytes = 246416 } seq expand size = 459949 multi value expand size = 0 cnt WriteAppend = 15 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0404 GB dict = 1.38 MB all = 0.0422 GB } UnZip/Zip{ index = 6.9217 value = 3.2614 dict = 1.00 all = 3.1782 } Zip/UnZip{ index = 0.1445 value = 0.3066 dict = 1.00 all = 0.3146 } ---------------------------- total value len = 10.968316 GB avg = 0.202 KB (by entry num) total key len = 1.482239 GB avg = 0.027 KB total ukey len = 1.022729 GB avg = 0.015 KB total ukey num = 0.067621317 Billion total entry num = 0.054429046 Billion write speed all = 0.309706443 MB/sec (with seq num) write speed all = 0.298875101 MB/sec (without seq num) 2024/11/23-20:05:13.414703 139957534086720 [compaction_job.cc:1948] [default] [JOB 34819] Generated table #278549: 129427 keys, 42231278 bytes, temperature: kWarm 2024/11/23-20:05:13.414775 139957534086720 EVENT_LOG_v1 {"time_micros": 1732363513414738, "cf_name": "default", "job": 34819, "event": "table_file_creation", "file_number": 278549, "file_size": 42231278, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4233516715, "table_properties": {"data_size": 40360224, "index_size": 224384, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588540, "raw_average_key_size": 20, "raw_value_size": 131630014, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129427, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732363511, "oldest_key_time": 0, "file_creation_time": 1732363511, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 278549, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-20:05:13.454922 139957534086720 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278550.sst) /dev/shm/ToplingTemp/Topling-174721-TaR4yN 2024/11/23-20:05:14.240149 139957534086720 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278550.sst): first pass time = 0.79's, 170.937'MB/sec 2024/11/23-20:05:15.208174 139957534086720 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278550.sst): old prealloc_size = 147639500, real_size = 41070544 2024/11/23-20:05:15.208315 139957534086720 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278550.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129425 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.71 raw-val = 0.1316 GB zip-val = 0.0408 GB avg-val =1017.03 avg-zval = 315.37 2024/11/23-20:05:15.208503 139957534086720 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278550.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-20:05:15.372812 139957534086720 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278550.sst): second pass time = 0.95's, 138.008'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 260.572'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1877.174'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.267'MB/sec write SST data time = 0.04's, 989.015'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 45561.118'MB/sec zip my value time = 0.95's, unzip length = 0.132'GB zip my value throughput = 138.008'MB/sec zip pipeline throughput = 138.008'MB/sec entries = 129425 avg-key = 20.00 avg-zkey = 1.71 avg-val = 1017.03 avg-zval = 315.37 usrkeys = 129425 avg-key = 12.00 avg-zkey = 1.71 avg-val = 1023.61 avg-zval = 315.37 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 121563 bytes = 455872 } seq expand size = 850941 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0408 GB dict = 1.38 MB all = 0.0429 GB } UnZip/Zip{ index = 7.0035 value = 3.2249 dict = 1.00 all = 3.1291 } Zip/UnZip{ index = 0.1428 value = 0.3101 dict = 1.00 all = 0.3196 } ---------------------------- total value len = 11.100796 GB avg = 0.203 KB (by entry num) total key len = 1.484827 GB avg = 0.027 KB total ukey len = 1.024282 GB avg = 0.015 KB total ukey num = 0.067750742 Billion total entry num = 0.054558471 Billion write speed all = 0.313050615 MB/sec (with seq num) write speed all = 0.302194061 MB/sec (without seq num) 2024/11/23-20:05:15.425501 139957534086720 [compaction_job.cc:1948] [default] [JOB 34819] Generated table #278550: 129425 keys, 42894091 bytes, temperature: kWarm 2024/11/23-20:05:15.425571 139957534086720 EVENT_LOG_v1 {"time_micros": 1732363515425534, "cf_name": "default", "job": 34819, "event": "table_file_creation", "file_number": 278550, "file_size": 42894091, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4233458176, "table_properties": {"data_size": 40816256, "index_size": 221760, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588500, "raw_average_key_size": 20, "raw_value_size": 131629487, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129425, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732363513, "oldest_key_time": 0, "file_creation_time": 1732363513, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 278550, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-20:05:15.468986 139957534086720 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278551.sst) /dev/shm/ToplingTemp/Topling-174721-lEactL 2024/11/23-20:05:16.101992 139957534086720 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278551.sst): first pass time = 0.63's, 212.047'MB/sec 2024/11/23-20:05:16.898634 139957534086720 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278551.sst): old prealloc_size = 147639500, real_size = 40563648 2024/11/23-20:05:16.898758 139957534086720 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278551.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129430 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.77 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1017.00 avg-zval = 311.39 2024/11/23-20:05:16.898894 139957534086720 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278551.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-20:05:17.060330 139957534086720 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278551.sst): second pass time = 0.80's, 165.491'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 261.435'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2250.192'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.276'MB/sec write SST data time = 0.04's, 948.914'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 27907.769'MB/sec zip my value time = 0.80's, unzip length = 0.132'GB zip my value throughput = 165.491'MB/sec zip pipeline throughput = 165.491'MB/sec entries = 129430 avg-key = 20.00 avg-zkey = 1.77 avg-val = 1017.00 avg-zval = 311.39 usrkeys = 129430 avg-key = 12.00 avg-zkey = 1.77 avg-val = 1021.85 avg-zval = 311.39 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 89635 bytes = 336144 } seq expand size = 627445 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0423 GB } UnZip/Zip{ index = 6.7978 value = 3.2660 dict = 1.00 all = 3.1755 } Zip/UnZip{ index = 0.1471 value = 0.3062 dict = 1.00 all = 0.3149 } ---------------------------- total value len = 11.233054 GB avg = 0.205 KB (by entry num) total key len = 1.487416 GB avg = 0.027 KB total ukey len = 1.025835 GB avg = 0.015 KB total ukey num = 0.067880172 Billion total entry num = 0.054687901 Billion write speed all = 0.316391450 MB/sec (with seq num) write speed all = 0.305509598 MB/sec (without seq num) 2024/11/23-20:05:17.111730 139957534086720 [compaction_job.cc:1948] [default] [JOB 34819] Generated table #278551: 129430 keys, 42267573 bytes, temperature: kWarm 2024/11/23-20:05:17.111801 139957534086720 EVENT_LOG_v1 {"time_micros": 1732363517111765, "cf_name": "default", "job": 34819, "event": "table_file_creation", "file_number": 278551, "file_size": 42267573, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4233514604, "table_properties": {"data_size": 40302640, "index_size": 228480, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588600, "raw_average_key_size": 20, "raw_value_size": 131629981, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129430, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732363515, "oldest_key_time": 0, "file_creation_time": 1732363515, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 278551, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-20:05:17.154006 139957534086720 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278552.sst) /dev/shm/ToplingTemp/Topling-174721-TMjhnM 2024/11/23-20:05:17.969623 139957534086720 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278552.sst): first pass time = 0.82's, 164.570'MB/sec 2024/11/23-20:05:18.812793 139957534086720 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278552.sst): old prealloc_size = 147639500, real_size = 40518384 2024/11/23-20:05:18.812920 139957534086720 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278552.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129428 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.72 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1017.01 avg-zval = 311.09 2024/11/23-20:05:18.813020 139957534086720 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278552.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-20:05:18.973114 139957534086720 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278552.sst): second pass time = 0.84's, 156.252'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 262.083'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2127.611'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.274'MB/sec write SST data time = 0.04's, 993.648'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 41498.916'MB/sec zip my value time = 0.84's, unzip length = 0.132'GB zip my value throughput = 156.252'MB/sec zip pipeline throughput = 156.252'MB/sec entries = 129428 avg-key = 20.00 avg-zkey = 1.72 avg-val = 1017.01 avg-zval = 311.09 usrkeys = 129428 avg-key = 12.00 avg-zkey = 1.72 avg-val = 1018.86 avg-zval = 311.09 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 34162 bytes = 128128 } seq expand size = 239134 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0420 GB } UnZip/Zip{ index = 6.9936 value = 3.2692 dict = 1.00 all = 3.1946 } Zip/UnZip{ index = 0.1430 value = 0.3059 dict = 1.00 all = 0.3130 } ---------------------------- total value len = 11.364922 GB avg = 0.207 KB (by entry num) total key len = 1.490004 GB avg = 0.027 KB total ukey len = 1.027388 GB avg = 0.015 KB total ukey num = 0.068009600 Billion total entry num = 0.054817329 Billion write speed all = 0.319720540 MB/sec (with seq num) write speed all = 0.308813452 MB/sec (without seq num) 2024/11/23-20:05:19.025725 139957534086720 [compaction_job.cc:1948] [default] [JOB 34819] Generated table #278552: 129428 keys, 42014070 bytes, temperature: kWarm 2024/11/23-20:05:19.025793 139957534086720 EVENT_LOG_v1 {"time_micros": 1732363519025757, "cf_name": "default", "job": 34819, "event": "table_file_creation", "file_number": 278552, "file_size": 42014070, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4233514605, "table_properties": {"data_size": 40263776, "index_size": 222080, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588560, "raw_average_key_size": 20, "raw_value_size": 131629386, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129428, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732363517, "oldest_key_time": 0, "file_creation_time": 1732363517, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 278552, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-20:05:19.062412 139957534086720 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278553.sst) /dev/shm/ToplingTemp/Topling-174721-ynwojK 2024/11/23-20:05:19.782643 139957534086720 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278553.sst): first pass time = 0.72's, 186.363'MB/sec 2024/11/23-20:05:20.581183 139957534086720 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278553.sst): old prealloc_size = 147639500, real_size = 40572160 2024/11/23-20:05:20.581325 139957534086720 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278553.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129426 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.72 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1017.03 avg-zval = 311.51 2024/11/23-20:05:20.581416 139957534086720 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278553.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-20:05:20.748281 139957534086720 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278553.sst): second pass time = 0.80's, 164.988'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.17's, 251.800'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1850.574'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.267'MB/sec write SST data time = 0.05's, 917.251'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 46329.445'MB/sec zip my value time = 0.80's, unzip length = 0.132'GB zip my value throughput = 164.988'MB/sec zip pipeline throughput = 164.988'MB/sec entries = 129426 avg-key = 20.00 avg-zkey = 1.72 avg-val = 1017.03 avg-zval = 311.51 usrkeys = 129426 avg-key = 12.00 avg-zkey = 1.72 avg-val = 1018.86 avg-zval = 311.51 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 33916 bytes = 127200 } seq expand size = 237412 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0421 GB } UnZip/Zip{ index = 6.9935 value = 3.2648 dict = 1.00 all = 3.1906 } Zip/UnZip{ index = 0.1430 value = 0.3063 dict = 1.00 all = 0.3134 } ---------------------------- total value len = 11.496789 GB avg = 0.209 KB (by entry num) total key len = 1.492593 GB avg = 0.027 KB total ukey len = 1.028941 GB avg = 0.015 KB total ukey num = 0.068139026 Billion total entry num = 0.054946755 Billion write speed all = 0.323050380 MB/sec (with seq num) write speed all = 0.312118023 MB/sec (without seq num) 2024/11/23-20:05:20.800039 139957534086720 [compaction_job.cc:1948] [default] [JOB 34819] Generated table #278553: 129426 keys, 42067249 bytes, temperature: kWarm 2024/11/23-20:05:20.800109 139957534086720 EVENT_LOG_v1 {"time_micros": 1732363520800073, "cf_name": "default", "job": 34819, "event": "table_file_creation", "file_number": 278553, "file_size": 42067249, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4233510640, "table_properties": {"data_size": 40317552, "index_size": 222080, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588520, "raw_average_key_size": 20, "raw_value_size": 131629606, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129426, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732363519, "oldest_key_time": 0, "file_creation_time": 1732363519, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 278553, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-20:05:20.855959 139957534086720 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278554.sst) /dev/shm/ToplingTemp/Topling-174721-OF70BO 2024/11/23-20:05:21.620366 139957534086720 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278554.sst): first pass time = 0.76's, 175.598'MB/sec 2024/11/23-20:05:22.492150 139957534086720 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278554.sst): old prealloc_size = 147639500, real_size = 40470720 2024/11/23-20:05:22.492277 139957534086720 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278554.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129432 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.72 raw-val = 0.1316 GB zip-val = 0.0402 GB avg-val =1016.98 avg-zval = 310.71 2024/11/23-20:05:22.492359 139957534086720 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278554.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-20:05:22.650173 139957534086720 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278554.sst): second pass time = 0.87's, 151.096'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 265.588'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2068.323'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.277'MB/sec write SST data time = 0.04's, 1023.072'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 45650.220'MB/sec zip my value time = 0.87's, unzip length = 0.132'GB zip my value throughput = 151.096'MB/sec zip pipeline throughput = 151.096'MB/sec entries = 129432 avg-key = 20.00 avg-zkey = 1.72 avg-val = 1016.98 avg-zval = 310.71 usrkeys = 129432 avg-key = 12.00 avg-zkey = 1.72 avg-val = 1018.77 avg-zval = 310.71 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 33198 bytes = 124512 } seq expand size = 232386 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0402 GB dict = 1.38 MB all = 0.0420 GB } UnZip/Zip{ index = 6.9938 value = 3.2731 dict = 1.00 all = 3.1985 } Zip/UnZip{ index = 0.1430 value = 0.3055 dict = 1.00 all = 0.3126 } ---------------------------- total value len = 11.628651 GB avg = 0.211 KB (by entry num) total key len = 1.495182 GB avg = 0.027 KB total ukey len = 1.030494 GB avg = 0.015 KB total ukey num = 0.068268458 Billion total entry num = 0.055076187 Billion write speed all = 0.326378776 MB/sec (with seq num) write speed all = 0.315421186 MB/sec (without seq num) 2024/11/23-20:05:22.704168 139957534086720 [compaction_job.cc:1948] [default] [JOB 34819] Generated table #278554: 129432 keys, 41962637 bytes, temperature: kWarm 2024/11/23-20:05:22.704238 139957534086720 EVENT_LOG_v1 {"time_micros": 1732363522704204, "cf_name": "default", "job": 34819, "event": "table_file_creation", "file_number": 278554, "file_size": 41962637, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4233511914, "table_properties": {"data_size": 40216112, "index_size": 222080, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588640, "raw_average_key_size": 20, "raw_value_size": 131629670, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129432, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732363520, "oldest_key_time": 0, "file_creation_time": 1732363520, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 278554, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-20:05:22.751820 139957534086720 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278555.sst) /dev/shm/ToplingTemp/Topling-174721-2s4VpN 2024/11/23-20:05:23.334908 139957534086720 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278555.sst): first pass time = 0.58's, 230.201'MB/sec 2024/11/23-20:05:24.193998 139957534086720 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278555.sst): old prealloc_size = 147639500, real_size = 41026976 2024/11/23-20:05:24.194117 139957534086720 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278555.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129432 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.72 raw-val = 0.1316 GB zip-val = 0.0408 GB avg-val =1016.98 avg-zval = 315.01 2024/11/23-20:05:24.194281 139957534086720 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278555.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-20:05:24.354694 139957534086720 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278555.sst): second pass time = 0.86's, 153.348'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 266.557'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2286.842'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.276'MB/sec write SST data time = 0.04's, 989.317'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 45211.214'MB/sec zip my value time = 0.86's, unzip length = 0.132'GB zip my value throughput = 153.348'MB/sec zip pipeline throughput = 153.348'MB/sec entries = 129432 avg-key = 20.00 avg-zkey = 1.72 avg-val = 1016.98 avg-zval = 315.01 usrkeys = 129432 avg-key = 12.00 avg-zkey = 1.72 avg-val = 1023.29 avg-zval = 315.01 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 116654 bytes = 437472 } seq expand size = 816578 multi value expand size = 0 cnt WriteAppend = 11 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0408 GB dict = 1.38 MB all = 0.0428 GB } UnZip/Zip{ index = 6.9797 value = 3.2284 dict = 1.00 all = 3.1336 } Zip/UnZip{ index = 0.1433 value = 0.3097 dict = 1.00 all = 0.3191 } ---------------------------- total value len = 11.761098 GB avg = 0.213 KB (by entry num) total key len = 1.497770 GB avg = 0.027 KB total ukey len = 1.032047 GB avg = 0.015 KB total ukey num = 0.068397890 Billion total entry num = 0.055205619 Billion write speed all = 0.329723007 MB/sec (with seq num) write speed all = 0.318740131 MB/sec (without seq num) 2024/11/23-20:05:24.407895 139957534086720 [compaction_job.cc:1948] [default] [JOB 34819] Generated table #278555: 129432 keys, 42832226 bytes, temperature: kWarm 2024/11/23-20:05:24.407964 139957534086720 EVENT_LOG_v1 {"time_micros": 1732363524407928, "cf_name": "default", "job": 34819, "event": "table_file_creation", "file_number": 278555, "file_size": 42832226, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4233517938, "table_properties": {"data_size": 40771920, "index_size": 222528, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588640, "raw_average_key_size": 20, "raw_value_size": 131629754, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129432, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732363522, "oldest_key_time": 0, "file_creation_time": 1732363522, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 278555, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-20:05:24.445592 139957534086720 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278556.sst) /dev/shm/ToplingTemp/Topling-174721-ypf6iO 2024/11/23-20:05:24.452203 139957534086720 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278556.sst): first pass time = 0.01's, 246.331'MB/sec 2024/11/23-20:05:24.478943 139957534086720 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278556.sst): old prealloc_size = 147639500, real_size = 515528 2024/11/23-20:05:24.478994 139957534086720 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278556.sst): index type = UintIndex_IL_256_32 , store type = DictZipBlobStore usrkeys = 1562 prefix = 4 raw-key = 0.0000 GB zip-key = 0.0000 GB avg-key = 8.00 avg-zkey = 0.38 raw-val = 0.0016 GB zip-val = 0.0005 GB avg-val =1017.07 avg-zval = 329.28 2024/11/23-20:05:24.481131 139957534086720 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00/278556.sst): second pass time = 0.03's, 60.538'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.00's, 251.264'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 17.330'MB/sec (index lex order gen) rebuild zvType time = 0.00's, 0.292'MB/sec write SST data time = 0.00's, 685.549'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.024'MB, throughput = 920.181'MB/sec zip my value time = 0.03's, unzip length = 0.002'GB zip my value throughput = 60.538'MB/sec zip pipeline throughput = 60.538'MB/sec entries = 1562 avg-key = 20.00 avg-zkey = 0.41 avg-val = 1017.07 avg-zval = 329.28 usrkeys = 1562 avg-key = 12.00 avg-zkey = 0.41 avg-val = 1024.07 avg-zval = 329.28 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 1562 bytes = 4896 } seq expand size = 10934 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0000 GB value = 0.0016 GB dict = 0.02 MB all = 0.0016 GB } __ZipSize{ index = 0.0000 GB value = 0.0005 GB dict = 0.02 MB all = 0.0005 GB } UnZip/Zip{ index = 29.2875 value = 3.0888 dict = 1.00 all = 2.9697 } Zip/UnZip{ index = 0.0341 value = 0.3238 dict = 1.00 all = 0.3367 } ---------------------------- total value len = 11.762697 GB avg = 0.213 KB (by entry num) total key len = 1.497801 GB avg = 0.027 KB total ukey len = 1.032066 GB avg = 0.015 KB total ukey num = 0.068399452 Billion total entry num = 0.055207181 Billion write speed all = 0.329762525 MB/sec (with seq num) write speed all = 0.318779373 MB/sec (without seq num) 2024/11/23-20:05:24.488460 139957534086720 [compaction_job.cc:1948] [default] [JOB 34819] Generated table #278556: 1562 keys, 545482 bytes, temperature: kWarm 2024/11/23-20:05:24.488506 139957534086720 EVENT_LOG_v1 {"time_micros": 1732363524488479, "cf_name": "default", "job": 34819, "event": "table_file_creation", "file_number": 278556, "file_size": 545482, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4205745709, "largest_seqno": 4233518007, "table_properties": {"data_size": 514336, "index_size": 640, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 31240, "raw_average_key_size": 20, "raw_value_size": 1588660, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 1562, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-UintIndex_IL_256_32-DictZipBlobStore", "creation_time": 1732363524, "oldest_key_time": 0, "file_creation_time": 1732363524, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 278556, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-20:05:24.498374 139957534086720 [compaction_job.cc:703] job-34819: subcompact[0], size: 0.935244 G, files: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-34819/att-00 [278534,278535,278536,278537,278538,278539,278540,278541,278542,278543,278544,278545,278546,278547,278548,278549,278550,278551,278552,278553,278554,278555,278556] 2024/11/23-20:05:24.637627 139957534086720 (Original Log Time 2024/11/23-20:04:40.907533) EVENT_LOG_v1 {"time_micros": 1732363480907490, "job": 34819, "event": "compaction_started", "compaction_reason": "FilesMarkedForCompaction", "files_L2": [278526], "files_L3": [278444, 278445, 278446, 278447, 278448, 278449, 278450, 278451, 278452, 278453, 278454, 278455, 278456, 278457, 278458, 278459, 278460, 278461, 278462, 278463, 278464, 278529], "score": 0.999782, "input_data_size": 967419051, "oldest_snapshot_seqno": 4233581405} 2024/11/23-20:05:24.637631 139957534086720 (Original Log Time 2024/11/23-20:05:24.635988) [compaction_job.cc:2022] [default] [JOB 34819] Compacted 1@2 + 22@3 files to L3 => 935243533 bytes 2024/11/23-20:05:24.637632 139957534086720 (Original Log Time 2024/11/23-20:05:24.637555) [compaction_job.cc:1224] [default] compacted to: files[0 0 0 23 0 0 0] max score 0.03, MB/sec: 22.2 rd, 21.5 wr, level 3, files in(1, 22) out(23 +0 blob) MB in(31.2, 891.4 +0.0 blob) out(891.9 +0.0 blob), read-write-amplify(58.1) write-amplify(28.6) OK, records in: 2879392, records dropped: 30375 output_compression: Snappy 2024/11/23-20:05:24.637636 139957534086720 (Original Log Time 2024/11/23-20:05:24.637602) EVENT_LOG_v1 {"time_micros": 1732363524637580, "cf": "default", "job": 34819, "event": "compaction_finished", "compaction_time_micros": 43590844, "compaction_time_cpu_micros": 8690673, "output_level": 3, "num_output_files": 23, "total_output_size": 935243533, "num_input_records": 2879392, "num_output_records": 2849017, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "file_write_nanos": 792573618, "file_range_sync_nanos": 0, "file_fsync_nanos": 17265, "file_prepare_write_nanos": 53075, "lsm_state": [0, 0, 0, 23, 0, 0, 0]} 2024/11/23-20:05:24.766844 139957534086720 DEBG dcompact_worker.cpp:240: HttpPost: 200 OK: url = http://nlb-7zny4kaa1poal01o64.cn-shenzhen.nlb.aliyuncs.com:8443, body = {"instanceId":"nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137","labourId":"","dbId":"d89b4006-2803-486e-b7a2-759bcf348921","dbStarts":1732256054,"starts":1732363480,"executesMs":43871,"compactionJobId":34819,"attempt":0,"compactionInputRawBytes":2985918505,"compactionInputZipBytes":967419051,"compactionOutputRawBytes":0,"compactionOutputZipBytes":935243533,"headers":{"Accept":"*/*","Connection":"close","Host":"aliyun-topling-saas.topling.cn:18443","RemoteIp":"120.24.192.169","X-Forwarded-For":"120.24.192.169","region":"cn-shenzhen","token":"e6474c481bd4415abc537135cc03626b","instance-token":"e6474c481bd4415abc537135cc03626b","provider":"aliyun","CloudMarketInstanceId":"si-59c0ae5c955845588903","MeteringAssit":"","Transfer-Encoding":"chunked","traceparent":"00-33ae1745452eb94f343571bbfef39385-70cc735dae2cdb84-00"}}, response = 2024/11/23-20:05:24.766933 139957534086720 INFO dcompact_worker.cpp:1459: finish /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-34819/att-00: olev 3, work 43.872 s, result 7.763 ms, install 1.675 ms, input{raw 2.781 GiB zip 922.603 MiB}