2024/11/23-15:38:50.761718 139957584442944 DEBG dcompact_worker.cpp:2214: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00: fork to child time = 0.008401 sec 2024/11/23-15:38:50.762489 139957584442944 DEBG dcompact_worker.cpp:1013: Beg SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00 2024/11/23-15:38:50.770223 139957584442944 DEBG dcompact_worker.cpp:1033: End SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00 2024/11/23-15:38:50.771141 139957584442944 TRAC dcompact_worker.cpp:1083: INFO_LOG_LEVEL: rpc = INFO_LEVEL, env_var = undefined 2024/11/23-15:38:50.771412 139957584442944 [WARN] [column_family.cc:386] multiple cf_paths/db_paths and level_compaction_dynamic_level_bytes can't be used together 2024/11/23-15:38:50.824515 139957584442944 [version_set.cc:6208] Recovering from manifest file: /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-29541/att-00/MANIFEST-206347 2024/11/23-15:38:50.858841 139957584442944 [version_set.cc:6251] Recovered from manifest file:/worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-29541/att-00/MANIFEST-206347 succeeded,manifest_file_number is 206347, next_file_number is 267086, last_sequence is 4075911660, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 266953 2024/11/23-15:38:50.858849 139957584442944 [version_set.cc:6266] Column family [default] (ID 0), log number is 0 2024/11/23-15:38:50.859002 139957584442944 [version_set.cc:5721] Creating manifest 267086 2024/11/23-15:38:50.902061 139957584442944 DEBG dcompact_worker.cpp:1218: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00: bottommost_level: fake = 1, rpc = 0 2024/11/23-15:38:50.924252 139957584442944 [compaction_job.cc:2437] [default] [JOB 29541] Compacting 1@2 + 21@3 files to L3, score 1.00, subcompactions 1 : 1 2024/11/23-15:38:50.924271 139957584442944 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 22080 Base level 2, inputs: [267081(31MB)], [267001(40MB) 267002(40MB) 267003(40MB) 267004(40MB) 267005(40MB) 267006(40MB) 267007(40MB) 267008(40MB) 267009(40MB) 267010(40MB) 267011(40MB) 267012(40MB) 267013(40MB) 267014(40MB) 267015(40MB) 267016(40MB) 267017(40MB) 267018(40MB) 267019(40MB) 267020(40MB) 267021(40MB)] 2024/11/23-15:38:50.932323 139957584442944 [top_zip_table.cc:59] core git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-15:38:50.932353 139957584442944 [top_zip_table.cc:60] fsa git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-15:38:50.932372 139957584442944 [top_zip_table.cc:61] zbs git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-15:38:50.932378 139957584442944 [top_zip_table.cc:62] topling-zip_table_reader: git_version_hash_info_is: commit a4a382006cb82713acf5b3425835f22711877681 Author: leipeng Date: 2024-04-11 19:44:14 +0800 fixed_len_hole_index.cc: Add env bool FixedLenHoleIndexUseAVX512 for ut & debug 1. FixedLenHoleIndexUseAVX512 is only in unit tests or debug 2. In release mode, use avx512 by compile options(-march=) g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/23-15:38:50.932388 139957584442944 [top_zip_table.cc:64] topling-rocks git_version_hash_info_is: commit feab587e468621ba0204d47b4ffacc52e7c4290d Author: leipeng Date: 2024-03-22 13:35:06 +0800 ToplingZipTableBuilder::Add: immediately return after error This function returns void, and caller does not check builder->status() after calling this function and graceful abandon. So immediately return after error, and return error status in Finish(). g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/23-15:38:51.703871 139957584442944 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267087.sst) /dev/shm/ToplingTemp/Topling-98098-VG7XTT 2024/11/23-15:38:52.010062 139957584442944 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267087.sst): first pass time = 0.31's, 438.431'MB/sec 2024/11/23-15:38:53.013635 139957584442944 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267087.sst): old prealloc_size = 147639500, real_size = 40650400 2024/11/23-15:38:53.013802 139957584442944 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267087.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129431 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.81 raw-val = 0.1316 GB zip-val = 0.0404 GB avg-val =1016.99 avg-zval = 312.01 2024/11/23-15:38:53.014065 139957584442944 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267087.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-15:38:53.219213 139957584442944 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267087.sst): second pass time = 1.00's, 131.268'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.21's, 206.652'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1622.430'MB/sec (index lex order gen) rebuild zvType time = 0.16's, 0.208'MB/sec write SST data time = 0.05's, 853.513'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 46898.237'MB/sec zip my value time = 1.00's, unzip length = 0.132'GB zip my value throughput = 131.268'MB/sec zip pipeline throughput = 172.675'MB/sec entries = 129431 avg-key = 20.00 avg-zkey = 1.81 avg-val = 1016.99 avg-zval = 312.01 usrkeys = 129431 avg-key = 12.00 avg-zkey = 1.81 avg-val = 1023.99 avg-zval = 312.01 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129431 bytes = 485376 } seq expand size = 906017 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0404 GB dict = 1.38 MB all = 0.0425 GB } UnZip/Zip{ index = 6.6470 value = 3.2594 dict = 1.00 all = 3.1593 } Zip/UnZip{ index = 0.1504 value = 0.3068 dict = 1.00 all = 0.3165 } ---------------------------- total value len = 8.981155 GB avg = 0.171 KB (by entry num) total key len = 1.443410 GB avg = 0.028 KB total ukey len = 0.999431 GB avg = 0.015 KB total ukey num = 0.065679866 Billion total entry num = 0.052487595 Billion write speed all = 0.430393582 MB/sec (with seq num) write speed all = 0.413057358 MB/sec (without seq num) 2024/11/23-15:38:53.273415 139957584442944 [compaction_job.cc:1948] [default] [JOB 29541] Generated table #267087: 129431 keys, 42483115 bytes, temperature: kWarm 2024/11/23-15:38:53.273504 139957584442944 EVENT_LOG_v1 {"time_micros": 1732347533273447, "cf_name": "default", "job": 29541, "event": "table_file_creation", "file_number": 267087, "file_size": 42483115, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237877277, "largest_seqno": 4075876879, "table_properties": {"data_size": 40384208, "index_size": 233664, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588620, "raw_average_key_size": 20, "raw_value_size": 131629390, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129431, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732347531, "oldest_key_time": 0, "file_creation_time": 1732347531, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 267087, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-15:38:53.313953 139957584442944 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267088.sst) /dev/shm/ToplingTemp/Topling-98098-gORX3T 2024/11/23-15:38:53.865542 139957584442944 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267088.sst): first pass time = 0.55's, 243.350'MB/sec 2024/11/23-15:38:54.869217 139957584442944 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267088.sst): old prealloc_size = 147639500, real_size = 40838784 2024/11/23-15:38:54.869337 139957584442944 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267088.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129431 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.75 raw-val = 0.1316 GB zip-val = 0.0406 GB avg-val =1016.99 avg-zval = 313.52 2024/11/23-15:38:54.869501 139957584442944 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267088.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-15:38:55.036887 139957584442944 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267088.sst): second pass time = 1.00's, 131.244'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.17's, 254.503'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2291.136'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.268'MB/sec write SST data time = 0.05's, 913.969'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 30437.871'MB/sec zip my value time = 1.00's, unzip length = 0.132'GB zip my value throughput = 131.244'MB/sec zip pipeline throughput = 131.247'MB/sec entries = 129431 avg-key = 20.00 avg-zkey = 1.75 avg-val = 1016.99 avg-zval = 313.52 usrkeys = 129431 avg-key = 12.00 avg-zkey = 1.75 avg-val = 1023.99 avg-zval = 313.52 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129431 bytes = 485376 } seq expand size = 906017 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0406 GB dict = 1.38 MB all = 0.0427 GB } UnZip/Zip{ index = 6.8419 value = 3.2438 dict = 1.00 all = 3.1454 } Zip/UnZip{ index = 0.1462 value = 0.3083 dict = 1.00 all = 0.3179 } ---------------------------- total value len = 9.113691 GB avg = 0.173 KB (by entry num) total key len = 1.445998 GB avg = 0.027 KB total ukey len = 1.000984 GB avg = 0.015 KB total ukey num = 0.065809297 Billion total entry num = 0.052617026 Billion write speed all = 0.435939671 MB/sec (with seq num) write speed all = 0.418562001 MB/sec (without seq num) 2024/11/23-15:38:55.090055 139957584442944 [compaction_job.cc:1948] [default] [JOB 29541] Generated table #267088: 129431 keys, 42671459 bytes, temperature: kWarm 2024/11/23-15:38:55.090126 139957584442944 EVENT_LOG_v1 {"time_micros": 1732347535090090, "cf_name": "default", "job": 29541, "event": "table_file_creation", "file_number": 267088, "file_size": 42671459, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237868195, "largest_seqno": 4075871745, "table_properties": {"data_size": 40579248, "index_size": 227008, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588620, "raw_average_key_size": 20, "raw_value_size": 131629622, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129431, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732347533, "oldest_key_time": 0, "file_creation_time": 1732347533, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 267088, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-15:38:55.135357 139957584442944 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267089.sst) /dev/shm/ToplingTemp/Topling-98098-2zGbqS 2024/11/23-15:38:55.720335 139957584442944 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267089.sst): first pass time = 0.58's, 229.457'MB/sec 2024/11/23-15:38:56.769188 139957584442944 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267089.sst): old prealloc_size = 147639500, real_size = 40628000 2024/11/23-15:38:56.769332 139957584442944 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267089.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129433 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.81 raw-val = 0.1316 GB zip-val = 0.0404 GB avg-val =1016.97 avg-zval = 311.83 2024/11/23-15:38:56.769508 139957584442944 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267089.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-15:38:57.202222 139957584442944 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267089.sst): second pass time = 1.05's, 125.714'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.43's, 98.065'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1863.761'MB/sec (index lex order gen) rebuild zvType time = 0.32's, 0.100'MB/sec write SST data time = 0.11's, 388.589'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.379'MB, throughput = 46215.775'MB/sec zip my value time = 1.05's, unzip length = 0.132'GB zip my value throughput = 125.714'MB/sec zip pipeline throughput = 125.714'MB/sec entries = 129433 avg-key = 20.00 avg-zkey = 1.81 avg-val = 1016.97 avg-zval = 311.83 usrkeys = 129433 avg-key = 12.00 avg-zkey = 1.81 avg-val = 1023.97 avg-zval = 311.83 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129433 bytes = 485392 } seq expand size = 906031 multi value expand size = 0 cnt WriteAppend = 11 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0404 GB dict = 1.38 MB all = 0.0425 GB } UnZip/Zip{ index = 6.6326 value = 3.2613 dict = 1.00 all = 3.1610 } Zip/UnZip{ index = 0.1508 value = 0.3066 dict = 1.00 all = 0.3164 } ---------------------------- total value len = 9.246227 GB avg = 0.175 KB (by entry num) total key len = 1.448587 GB avg = 0.027 KB total ukey len = 1.002538 GB avg = 0.015 KB total ukey num = 0.065938730 Billion total entry num = 0.052746459 Billion write speed all = 0.441478610 MB/sec (with seq num) write speed all = 0.424059750 MB/sec (without seq num) 2024/11/23-15:38:57.258068 139957584442944 [compaction_job.cc:1948] [default] [JOB 29541] Generated table #267089: 129433 keys, 42461460 bytes, temperature: kWarm 2024/11/23-15:38:57.258216 139957584442944 EVENT_LOG_v1 {"time_micros": 1732347537258109, "cf_name": "default", "job": 29541, "event": "table_file_creation", "file_number": 267089, "file_size": 42461460, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237873554, "largest_seqno": 4075870512, "table_properties": {"data_size": 40361296, "index_size": 234176, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588660, "raw_average_key_size": 20, "raw_value_size": 131629989, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129433, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732347535, "oldest_key_time": 0, "file_creation_time": 1732347535, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 267089, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-15:38:57.338952 139957584442944 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267090.sst) /dev/shm/ToplingTemp/Topling-98098-t53FsT 2024/11/23-15:38:58.122709 139957584442944 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267090.sst): first pass time = 0.78's, 171.265'MB/sec 2024/11/23-15:38:59.129397 139957584442944 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267090.sst): old prealloc_size = 147639500, real_size = 40850064 2024/11/23-15:38:59.129523 139957584442944 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267090.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129434 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.75 raw-val = 0.1316 GB zip-val = 0.0406 GB avg-val =1016.96 avg-zval = 313.60 2024/11/23-15:38:59.129703 139957584442944 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267090.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-15:38:59.303159 139957584442944 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267090.sst): second pass time = 1.00's, 130.978'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.17's, 245.672'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2226.355'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.263'MB/sec write SST data time = 0.05's, 846.386'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 37860.930'MB/sec zip my value time = 1.00's, unzip length = 0.132'GB zip my value throughput = 130.978'MB/sec zip pipeline throughput = 130.978'MB/sec entries = 129434 avg-key = 20.00 avg-zkey = 1.75 avg-val = 1016.96 avg-zval = 313.60 usrkeys = 129434 avg-key = 12.00 avg-zkey = 1.75 avg-val = 1023.96 avg-zval = 313.60 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129434 bytes = 485392 } seq expand size = 906038 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0406 GB dict = 1.38 MB all = 0.0427 GB } UnZip/Zip{ index = 6.8576 value = 3.2428 dict = 1.00 all = 3.1445 } Zip/UnZip{ index = 0.1458 value = 0.3084 dict = 1.00 all = 0.3180 } ---------------------------- total value len = 9.378762 GB avg = 0.177 KB (by entry num) total key len = 1.451176 GB avg = 0.027 KB total ukey len = 1.004091 GB avg = 0.015 KB total ukey num = 0.066068164 Billion total entry num = 0.052875893 Billion write speed all = 0.447017728 MB/sec (with seq num) write speed all = 0.429557638 MB/sec (without seq num) 2024/11/23-15:38:59.402207 139957584442944 [compaction_job.cc:1948] [default] [JOB 29541] Generated table #267090: 129434 keys, 42682931 bytes, temperature: kWarm 2024/11/23-15:38:59.402279 139957584442944 EVENT_LOG_v1 {"time_micros": 1732347539402243, "cf_name": "default", "job": 29541, "event": "table_file_creation", "file_number": 267090, "file_size": 42682931, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237868596, "largest_seqno": 4075869688, "table_properties": {"data_size": 40591040, "index_size": 226496, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588680, "raw_average_key_size": 20, "raw_value_size": 131629500, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129434, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732347537, "oldest_key_time": 0, "file_creation_time": 1732347537, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 267090, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-15:38:59.444825 139957584442944 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267091.sst) /dev/shm/ToplingTemp/Topling-98098-mHflUV 2024/11/23-15:38:59.974236 139957584442944 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267091.sst): first pass time = 0.53's, 253.541'MB/sec 2024/11/23-15:39:00.801176 139957584442944 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267091.sst): old prealloc_size = 147639500, real_size = 40597904 2024/11/23-15:39:00.801305 139957584442944 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267091.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129430 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.82 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1017.00 avg-zval = 311.60 2024/11/23-15:39:00.801461 139957584442944 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267091.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-15:39:00.967951 139957584442944 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267091.sst): second pass time = 0.83's, 159.463'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.17's, 254.449'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2247.384'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.273'MB/sec write SST data time = 0.05's, 883.459'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 55219.287'MB/sec zip my value time = 0.83's, unzip length = 0.132'GB zip my value throughput = 159.463'MB/sec zip pipeline throughput = 159.463'MB/sec entries = 129430 avg-key = 20.00 avg-zkey = 1.82 avg-val = 1017.00 avg-zval = 311.60 usrkeys = 129430 avg-key = 12.00 avg-zkey = 1.82 avg-val = 1024.00 avg-zval = 311.60 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129430 bytes = 485376 } seq expand size = 906010 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0424 GB } UnZip/Zip{ index = 6.6036 value = 3.2638 dict = 1.00 all = 3.1633 } Zip/UnZip{ index = 0.1514 value = 0.3064 dict = 1.00 all = 0.3161 } ---------------------------- total value len = 9.511298 GB avg = 0.179 KB (by entry num) total key len = 1.453764 GB avg = 0.027 KB total ukey len = 1.005644 GB avg = 0.015 KB total ukey num = 0.066197594 Billion total entry num = 0.053005323 Billion write speed all = 0.452564043 MB/sec (with seq num) write speed all = 0.435062417 MB/sec (without seq num) 2024/11/23-15:39:01.020879 139957584442944 [compaction_job.cc:1948] [default] [JOB 29541] Generated table #267091: 129430 keys, 42430337 bytes, temperature: kWarm 2024/11/23-15:39:01.020950 139957584442944 EVENT_LOG_v1 {"time_micros": 1732347541020916, "cf_name": "default", "job": 29541, "event": "table_file_creation", "file_number": 267091, "file_size": 42430337, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237869923, "largest_seqno": 4075868058, "table_properties": {"data_size": 40330176, "index_size": 235200, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588600, "raw_average_key_size": 20, "raw_value_size": 131629890, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129430, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732347539, "oldest_key_time": 0, "file_creation_time": 1732347539, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 267091, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-15:39:01.060021 139957584442944 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267092.sst) /dev/shm/ToplingTemp/Topling-98098-9kzuNS 2024/11/23-15:39:01.842003 139957584442944 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267092.sst): first pass time = 0.78's, 171.649'MB/sec 2024/11/23-15:39:03.340012 139957584442944 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267092.sst): old prealloc_size = 147639500, real_size = 40774928 2024/11/23-15:39:03.340140 139957584442944 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267092.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129429 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.79 raw-val = 0.1316 GB zip-val = 0.0405 GB avg-val =1017.00 avg-zval = 313.00 2024/11/23-15:39:03.340294 139957584442944 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267092.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-15:39:03.504325 139957584442944 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267092.sst): second pass time = 1.50's, 87.909'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 259.321'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2192.553'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.275'MB/sec write SST data time = 0.05's, 918.253'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 44360.712'MB/sec zip my value time = 1.50's, unzip length = 0.132'GB zip my value throughput = 87.909'MB/sec zip pipeline throughput = 116.836'MB/sec entries = 129429 avg-key = 20.00 avg-zkey = 1.79 avg-val = 1017.00 avg-zval = 313.00 usrkeys = 129429 avg-key = 12.00 avg-zkey = 1.79 avg-val = 1024.00 avg-zval = 313.00 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129429 bytes = 485376 } seq expand size = 906003 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0405 GB dict = 1.38 MB all = 0.0426 GB } UnZip/Zip{ index = 6.7113 value = 3.2492 dict = 1.00 all = 3.1501 } Zip/UnZip{ index = 0.1490 value = 0.3078 dict = 1.00 all = 0.3174 } ---------------------------- total value len = 9.643834 GB avg = 0.181 KB (by entry num) total key len = 1.456353 GB avg = 0.027 KB total ukey len = 1.007197 GB avg = 0.015 KB total ukey num = 0.066327023 Billion total entry num = 0.053134752 Billion write speed all = 0.458093109 MB/sec (with seq num) write speed all = 0.440550584 MB/sec (without seq num) 2024/11/23-15:39:03.557933 139957584442944 [compaction_job.cc:1948] [default] [JOB 29541] Generated table #267092: 129429 keys, 42607450 bytes, temperature: kWarm 2024/11/23-15:39:03.558016 139957584442944 EVENT_LOG_v1 {"time_micros": 1732347543557967, "cf_name": "default", "job": 29541, "event": "table_file_creation", "file_number": 267092, "file_size": 42607450, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237881756, "largest_seqno": 4075876382, "table_properties": {"data_size": 40510976, "index_size": 231424, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588580, "raw_average_key_size": 20, "raw_value_size": 131629684, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129429, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732347541, "oldest_key_time": 0, "file_creation_time": 1732347541, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 267092, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-15:39:03.600858 139957584442944 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267093.sst) /dev/shm/ToplingTemp/Topling-98098-gLuUzU 2024/11/23-15:39:04.314548 139957584442944 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267093.sst): first pass time = 0.71's, 188.072'MB/sec 2024/11/23-15:39:05.180016 139957584442944 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267093.sst): old prealloc_size = 147639500, real_size = 41024192 2024/11/23-15:39:05.180146 139957584442944 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267093.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129427 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.73 raw-val = 0.1316 GB zip-val = 0.0408 GB avg-val =1017.02 avg-zval = 314.99 2024/11/23-15:39:05.180305 139957584442944 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267093.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-15:39:05.345791 139957584442944 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267093.sst): second pass time = 0.86's, 152.221'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.17's, 258.528'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2083.873'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.272'MB/sec write SST data time = 0.05's, 916.050'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 49332.605'MB/sec zip my value time = 0.86's, unzip length = 0.132'GB zip my value throughput = 152.221'MB/sec zip pipeline throughput = 152.221'MB/sec entries = 129427 avg-key = 20.00 avg-zkey = 1.73 avg-val = 1017.02 avg-zval = 314.99 usrkeys = 129427 avg-key = 12.00 avg-zkey = 1.73 avg-val = 1024.02 avg-zval = 314.99 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129427 bytes = 485360 } seq expand size = 905989 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0408 GB dict = 1.38 MB all = 0.0429 GB } UnZip/Zip{ index = 6.9395 value = 3.2288 dict = 1.00 all = 3.1318 } Zip/UnZip{ index = 0.1441 value = 0.3097 dict = 1.00 all = 0.3193 } ---------------------------- total value len = 9.776370 GB avg = 0.184 KB (by entry num) total key len = 1.458941 GB avg = 0.027 KB total ukey len = 1.008750 GB avg = 0.015 KB total ukey num = 0.066456450 Billion total entry num = 0.053264179 Billion write speed all = 0.463634309 MB/sec (with seq num) write speed all = 0.446050389 MB/sec (without seq num) 2024/11/23-15:39:05.397790 139957584442944 [compaction_job.cc:1948] [default] [JOB 29541] Generated table #267093: 129427 keys, 42856968 bytes, temperature: kWarm 2024/11/23-15:39:05.397857 139957584442944 EVENT_LOG_v1 {"time_micros": 1732347545397825, "cf_name": "default", "job": 29541, "event": "table_file_creation", "file_number": 267093, "file_size": 42856968, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237880987, "largest_seqno": 4075877801, "table_properties": {"data_size": 40767856, "index_size": 223808, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588540, "raw_average_key_size": 20, "raw_value_size": 131629648, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129427, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732347543, "oldest_key_time": 0, "file_creation_time": 1732347543, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 267093, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-15:39:05.436536 139957584442944 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267094.sst) /dev/shm/ToplingTemp/Topling-98098-lk7zFT 2024/11/23-15:39:06.437142 139957584442944 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267094.sst): first pass time = 1.00's, 134.142'MB/sec 2024/11/23-15:39:07.885159 139957584442944 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267094.sst): old prealloc_size = 147639500, real_size = 40977664 2024/11/23-15:39:07.885295 139957584442944 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267094.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129431 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.71 raw-val = 0.1316 GB zip-val = 0.0407 GB avg-val =1016.99 avg-zval = 314.64 2024/11/23-15:39:07.885480 139957584442944 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267094.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-15:39:08.065214 139957584442944 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267094.sst): second pass time = 1.45's, 91.000'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.18's, 237.782'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1976.518'MB/sec (index lex order gen) rebuild zvType time = 0.13's, 0.241'MB/sec write SST data time = 0.05's, 934.937'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.379'MB, throughput = 25175.642'MB/sec zip my value time = 1.45's, unzip length = 0.132'GB zip my value throughput = 91.000'MB/sec zip pipeline throughput = 114.435'MB/sec entries = 129431 avg-key = 20.00 avg-zkey = 1.71 avg-val = 1016.99 avg-zval = 314.64 usrkeys = 129431 avg-key = 12.00 avg-zkey = 1.71 avg-val = 1023.99 avg-zval = 314.64 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129431 bytes = 485376 } seq expand size = 906017 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0407 GB dict = 1.38 MB all = 0.0428 GB } UnZip/Zip{ index = 7.0323 value = 3.2322 dict = 1.00 all = 3.1351 } Zip/UnZip{ index = 0.1422 value = 0.3094 dict = 1.00 all = 0.3190 } ---------------------------- total value len = 9.908905 GB avg = 0.186 KB (by entry num) total key len = 1.461530 GB avg = 0.027 KB total ukey len = 1.010303 GB avg = 0.015 KB total ukey num = 0.066585881 Billion total entry num = 0.053393610 Billion write speed all = 0.469157664 MB/sec (with seq num) write speed all = 0.451532994 MB/sec (without seq num) 2024/11/23-15:39:08.118961 139957584442944 [compaction_job.cc:1948] [default] [JOB 29541] Generated table #267094: 129431 keys, 42811040 bytes, temperature: kWarm 2024/11/23-15:39:08.119039 139957584442944 EVENT_LOG_v1 {"time_micros": 1732347548119004, "cf_name": "default", "job": 29541, "event": "table_file_creation", "file_number": 267094, "file_size": 42811040, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237868290, "largest_seqno": 4075878797, "table_properties": {"data_size": 40724272, "index_size": 220864, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588620, "raw_average_key_size": 20, "raw_value_size": 131629402, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129431, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732347545, "oldest_key_time": 0, "file_creation_time": 1732347545, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 267094, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-15:39:08.156512 139957584442944 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267095.sst) /dev/shm/ToplingTemp/Topling-98098-a1DGPS 2024/11/23-15:39:08.790738 139957584442944 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267095.sst): first pass time = 0.63's, 211.638'MB/sec 2024/11/23-15:39:09.625719 139957584442944 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267095.sst): old prealloc_size = 147639500, real_size = 40724784 2024/11/23-15:39:09.625871 139957584442944 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267095.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129433 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.79 raw-val = 0.1316 GB zip-val = 0.0405 GB avg-val =1016.97 avg-zval = 312.60 2024/11/23-15:39:09.626068 139957584442944 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267095.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-15:39:09.810685 139957584442944 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267095.sst): second pass time = 0.83's, 157.795'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.18's, 230.124'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1865.433'MB/sec (index lex order gen) rebuild zvType time = 0.13's, 0.245'MB/sec write SST data time = 0.05's, 808.962'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 49197.701'MB/sec zip my value time = 0.83's, unzip length = 0.132'GB zip my value throughput = 157.795'MB/sec zip pipeline throughput = 157.795'MB/sec entries = 129433 avg-key = 20.00 avg-zkey = 1.79 avg-val = 1016.97 avg-zval = 312.60 usrkeys = 129433 avg-key = 12.00 avg-zkey = 1.79 avg-val = 1023.97 avg-zval = 312.60 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129433 bytes = 485392 } seq expand size = 906031 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0405 GB dict = 1.38 MB all = 0.0426 GB } UnZip/Zip{ index = 6.7004 value = 3.2533 dict = 1.00 all = 3.1538 } Zip/UnZip{ index = 0.1492 value = 0.3074 dict = 1.00 all = 0.3171 } ---------------------------- total value len = 10.041441 GB avg = 0.188 KB (by entry num) total key len = 1.464119 GB avg = 0.027 KB total ukey len = 1.011857 GB avg = 0.015 KB total ukey num = 0.066715314 Billion total entry num = 0.053523043 Billion write speed all = 0.474698871 MB/sec (with seq num) write speed all = 0.457032749 MB/sec (without seq num) 2024/11/23-15:39:09.864505 139957584442944 [compaction_job.cc:1948] [default] [JOB 29541] Generated table #267095: 129433 keys, 42557463 bytes, temperature: kWarm 2024/11/23-15:39:09.864609 139957584442944 EVENT_LOG_v1 {"time_micros": 1732347549864551, "cf_name": "default", "job": 29541, "event": "table_file_creation", "file_number": 267095, "file_size": 42557463, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237874127, "largest_seqno": 4075878800, "table_properties": {"data_size": 40460448, "index_size": 231808, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588660, "raw_average_key_size": 20, "raw_value_size": 131629737, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129433, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732347548, "oldest_key_time": 0, "file_creation_time": 1732347548, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 267095, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-15:39:09.948822 139957584442944 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267096.sst) /dev/shm/ToplingTemp/Topling-98098-qAK2YU 2024/11/23-15:39:10.873078 139957584442944 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267096.sst): first pass time = 0.92's, 145.228'MB/sec 2024/11/23-15:39:11.690169 139957584442944 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267096.sst): old prealloc_size = 147639500, real_size = 40588384 2024/11/23-15:39:11.690308 139957584442944 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267096.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129430 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.82 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1017.00 avg-zval = 311.53 2024/11/23-15:39:11.690474 139957584442944 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267096.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-15:39:11.857375 139957584442944 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267096.sst): second pass time = 0.82's, 161.433'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.17's, 253.725'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2182.568'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.267'MB/sec write SST data time = 0.05's, 921.726'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 43678.319'MB/sec zip my value time = 0.82's, unzip length = 0.132'GB zip my value throughput = 161.433'MB/sec zip pipeline throughput = 161.433'MB/sec entries = 129430 avg-key = 20.00 avg-zkey = 1.82 avg-val = 1017.00 avg-zval = 311.53 usrkeys = 129430 avg-key = 12.00 avg-zkey = 1.82 avg-val = 1024.00 avg-zval = 311.53 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129430 bytes = 485376 } seq expand size = 906010 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0424 GB } UnZip/Zip{ index = 6.6090 value = 3.2646 dict = 1.00 all = 3.1639 } Zip/UnZip{ index = 0.1513 value = 0.3063 dict = 1.00 all = 0.3161 } ---------------------------- total value len = 10.173977 GB avg = 0.190 KB (by entry num) total key len = 1.466707 GB avg = 0.027 KB total ukey len = 1.013410 GB avg = 0.015 KB total ukey num = 0.066844744 Billion total entry num = 0.053652473 Billion write speed all = 0.480233307 MB/sec (with seq num) write speed all = 0.462525959 MB/sec (without seq num) 2024/11/23-15:39:11.915315 139957584442944 [compaction_job.cc:1948] [default] [JOB 29541] Generated table #267096: 129430 keys, 42421317 bytes, temperature: kWarm 2024/11/23-15:39:11.915389 139957584442944 EVENT_LOG_v1 {"time_micros": 1732347551915349, "cf_name": "default", "job": 29541, "event": "table_file_creation", "file_number": 267096, "file_size": 42421317, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237873605, "largest_seqno": 4075873834, "table_properties": {"data_size": 40320848, "index_size": 235008, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588600, "raw_average_key_size": 20, "raw_value_size": 131629716, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129430, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732347549, "oldest_key_time": 0, "file_creation_time": 1732347549, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 267096, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-15:39:11.955178 139957584442944 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267097.sst) /dev/shm/ToplingTemp/Topling-98098-bfDfYV 2024/11/23-15:39:12.676016 139957584442944 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267097.sst): first pass time = 0.72's, 186.206'MB/sec 2024/11/23-15:39:13.476901 139957584442944 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267097.sst): old prealloc_size = 147639500, real_size = 40800944 2024/11/23-15:39:13.477052 139957584442944 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267097.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129432 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.79 raw-val = 0.1316 GB zip-val = 0.0405 GB avg-val =1016.98 avg-zval = 313.19 2024/11/23-15:39:13.477212 139957584442944 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267097.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-15:39:13.638875 139957584442944 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267097.sst): second pass time = 0.80's, 164.508'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 263.248'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1762.736'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.276'MB/sec write SST data time = 0.04's, 953.514'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 48264.266'MB/sec zip my value time = 0.80's, unzip length = 0.132'GB zip my value throughput = 164.508'MB/sec zip pipeline throughput = 164.508'MB/sec entries = 129432 avg-key = 20.00 avg-zkey = 1.79 avg-val = 1016.98 avg-zval = 313.19 usrkeys = 129432 avg-key = 12.00 avg-zkey = 1.79 avg-val = 1023.98 avg-zval = 313.19 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129432 bytes = 485392 } seq expand size = 906024 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0405 GB dict = 1.38 MB all = 0.0426 GB } UnZip/Zip{ index = 6.7226 value = 3.2471 dict = 1.00 all = 3.1482 } Zip/UnZip{ index = 0.1488 value = 0.3080 dict = 1.00 all = 0.3176 } ---------------------------- total value len = 10.306512 GB avg = 0.192 KB (by entry num) total key len = 1.469296 GB avg = 0.027 KB total ukey len = 1.014963 GB avg = 0.015 KB total ukey num = 0.066974176 Billion total entry num = 0.053781905 Billion write speed all = 0.485772132 MB/sec (with seq num) write speed all = 0.468023371 MB/sec (without seq num) 2024/11/23-15:39:13.691403 139957584442944 [compaction_job.cc:1948] [default] [JOB 29541] Generated table #267097: 129432 keys, 42633543 bytes, temperature: kWarm 2024/11/23-15:39:13.691473 139957584442944 EVENT_LOG_v1 {"time_micros": 1732347553691437, "cf_name": "default", "job": 29541, "event": "table_file_creation", "file_number": 267097, "file_size": 42633543, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237872082, "largest_seqno": 4075878535, "table_properties": {"data_size": 40537376, "index_size": 231040, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588640, "raw_average_key_size": 20, "raw_value_size": 131629861, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129432, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732347551, "oldest_key_time": 0, "file_creation_time": 1732347551, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 267097, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-15:39:13.727968 139957584442944 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267098.sst) /dev/shm/ToplingTemp/Topling-98098-xovpKT 2024/11/23-15:39:14.356155 139957584442944 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267098.sst): first pass time = 0.63's, 213.680'MB/sec 2024/11/23-15:39:15.223627 139957584442944 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267098.sst): old prealloc_size = 147639500, real_size = 40952624 2024/11/23-15:39:15.223749 139957584442944 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267098.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129427 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.75 raw-val = 0.1316 GB zip-val = 0.0407 GB avg-val =1017.02 avg-zval = 314.41 2024/11/23-15:39:15.223911 139957584442944 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267098.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-15:39:15.387297 139957584442944 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267098.sst): second pass time = 0.87's, 152.032'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 261.430'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2266.149'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.273'MB/sec write SST data time = 0.05's, 946.172'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 45828.704'MB/sec zip my value time = 0.87's, unzip length = 0.132'GB zip my value throughput = 152.032'MB/sec zip pipeline throughput = 152.032'MB/sec entries = 129427 avg-key = 20.00 avg-zkey = 1.75 avg-val = 1017.02 avg-zval = 314.41 usrkeys = 129427 avg-key = 12.00 avg-zkey = 1.75 avg-val = 1024.02 avg-zval = 314.41 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129427 bytes = 485360 } seq expand size = 905989 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0407 GB dict = 1.38 MB all = 0.0428 GB } UnZip/Zip{ index = 6.8456 value = 3.2347 dict = 1.00 all = 3.1370 } Zip/UnZip{ index = 0.1461 value = 0.3092 dict = 1.00 all = 0.3188 } ---------------------------- total value len = 10.439048 GB avg = 0.194 KB (by entry num) total key len = 1.471884 GB avg = 0.027 KB total ukey len = 1.016516 GB avg = 0.015 KB total ukey num = 0.067103603 Billion total entry num = 0.053911332 Billion write speed all = 0.491310785 MB/sec (with seq num) write speed all = 0.473520595 MB/sec (without seq num) 2024/11/23-15:39:15.440840 139957584442944 [compaction_job.cc:1948] [default] [JOB 29541] Generated table #267098: 129427 keys, 42785199 bytes, temperature: kWarm 2024/11/23-15:39:15.440907 139957584442944 EVENT_LOG_v1 {"time_micros": 1732347555440874, "cf_name": "default", "job": 29541, "event": "table_file_creation", "file_number": 267098, "file_size": 42785199, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237871365, "largest_seqno": 4075867738, "table_properties": {"data_size": 40693216, "index_size": 226880, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588540, "raw_average_key_size": 20, "raw_value_size": 131629335, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129427, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732347553, "oldest_key_time": 0, "file_creation_time": 1732347553, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 267098, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-15:39:15.480112 139957584442944 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267099.sst) /dev/shm/ToplingTemp/Topling-98098-yWoquV 2024/11/23-15:39:16.291870 139957584442944 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267099.sst): first pass time = 0.81's, 165.352'MB/sec 2024/11/23-15:39:17.101334 139957584442944 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267099.sst): old prealloc_size = 147639500, real_size = 40560912 2024/11/23-15:39:17.101456 139957584442944 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267099.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129428 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.77 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1017.01 avg-zval = 311.36 2024/11/23-15:39:17.101614 139957584442944 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267099.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-15:39:17.262150 139957584442944 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267099.sst): second pass time = 0.81's, 162.868'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 262.790'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2355.937'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.277'MB/sec write SST data time = 0.04's, 958.514'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 49186.313'MB/sec zip my value time = 0.81's, unzip length = 0.132'GB zip my value throughput = 162.868'MB/sec zip pipeline throughput = 162.868'MB/sec entries = 129428 avg-key = 20.00 avg-zkey = 1.77 avg-val = 1017.01 avg-zval = 311.36 usrkeys = 129428 avg-key = 12.00 avg-zkey = 1.77 avg-val = 1021.73 avg-zval = 311.36 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 87162 bytes = 326880 } seq expand size = 610134 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0423 GB } UnZip/Zip{ index = 6.7692 value = 3.2663 dict = 1.00 all = 3.1764 } Zip/UnZip{ index = 0.1477 value = 0.3062 dict = 1.00 all = 0.3148 } ---------------------------- total value len = 10.571288 GB avg = 0.196 KB (by entry num) total key len = 1.474473 GB avg = 0.027 KB total ukey len = 1.018069 GB avg = 0.015 KB total ukey num = 0.067233031 Billion total entry num = 0.054040760 Billion write speed all = 0.496833868 MB/sec (with seq num) write speed all = 0.479002347 MB/sec (without seq num) 2024/11/23-15:39:17.313864 139957584442944 [compaction_job.cc:1948] [default] [JOB 29541] Generated table #267099: 129428 keys, 42255310 bytes, temperature: kWarm 2024/11/23-15:39:17.313934 139957584442944 EVENT_LOG_v1 {"time_micros": 1732347557313899, "cf_name": "default", "job": 29541, "event": "table_file_creation", "file_number": 267099, "file_size": 42255310, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4075877321, "table_properties": {"data_size": 40298944, "index_size": 229440, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588560, "raw_average_key_size": 20, "raw_value_size": 131629861, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129428, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732347555, "oldest_key_time": 0, "file_creation_time": 1732347555, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 267099, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-15:39:17.351079 139957584442944 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267100.sst) /dev/shm/ToplingTemp/Topling-98098-chvp6V 2024/11/23-15:39:17.952237 139957584442944 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267100.sst): first pass time = 0.60's, 223.280'MB/sec 2024/11/23-15:39:18.776617 139957584442944 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267100.sst): old prealloc_size = 147639500, real_size = 40783952 2024/11/23-15:39:18.776734 139957584442944 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267100.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129432 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.70 raw-val = 0.1316 GB zip-val = 0.0405 GB avg-val =1016.98 avg-zval = 313.15 2024/11/23-15:39:18.776845 139957584442944 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267100.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-15:39:18.936685 139957584442944 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267100.sst): second pass time = 0.82's, 159.809'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 264.954'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2284.980'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.278'MB/sec write SST data time = 0.04's, 977.559'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 46318.105'MB/sec zip my value time = 0.82's, unzip length = 0.132'GB zip my value throughput = 159.809'MB/sec zip pipeline throughput = 159.809'MB/sec entries = 129432 avg-key = 20.00 avg-zkey = 1.70 avg-val = 1016.98 avg-zval = 313.15 usrkeys = 129432 avg-key = 12.00 avg-zkey = 1.70 avg-val = 1020.69 avg-zval = 313.15 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 68777 bytes = 257936 } seq expand size = 481439 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0405 GB dict = 1.38 MB all = 0.0424 GB } UnZip/Zip{ index = 7.0466 value = 3.2476 dict = 1.00 all = 3.1648 } Zip/UnZip{ index = 0.1419 value = 0.3079 dict = 1.00 all = 0.3160 } ---------------------------- total value len = 10.703398 GB avg = 0.198 KB (by entry num) total key len = 1.477062 GB avg = 0.027 KB total ukey len = 1.019622 GB avg = 0.015 KB total ukey num = 0.067362463 Billion total entry num = 0.054170192 Billion write speed all = 0.502354913 MB/sec (with seq num) write speed all = 0.484481918 MB/sec (without seq num) 2024/11/23-15:39:18.988619 139957584442944 [compaction_job.cc:1948] [default] [JOB 29541] Generated table #267100: 129432 keys, 42409422 bytes, temperature: kWarm 2024/11/23-15:39:18.988688 139957584442944 EVENT_LOG_v1 {"time_micros": 1732347558988652, "cf_name": "default", "job": 29541, "event": "table_file_creation", "file_number": 267100, "file_size": 42409422, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4075856758, "table_properties": {"data_size": 40531008, "index_size": 220416, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588640, "raw_average_key_size": 20, "raw_value_size": 131629126, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129432, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732347557, "oldest_key_time": 0, "file_creation_time": 1732347557, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 267100, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-15:39:19.030166 139957584442944 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267101.sst) /dev/shm/ToplingTemp/Topling-98098-ACEBFV 2024/11/23-15:39:19.790865 139957584442944 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267101.sst): first pass time = 0.76's, 176.450'MB/sec 2024/11/23-15:39:20.669951 139957584442944 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267101.sst): old prealloc_size = 147639500, real_size = 40794240 2024/11/23-15:39:20.670082 139957584442944 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267101.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129427 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.73 raw-val = 0.1316 GB zip-val = 0.0405 GB avg-val =1017.02 avg-zval = 313.21 2024/11/23-15:39:20.670204 139957584442944 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267101.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-15:39:20.831417 139957584442944 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267101.sst): second pass time = 0.87's, 150.633'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 263.062'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2300.613'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.276'MB/sec write SST data time = 0.04's, 966.971'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 49016.328'MB/sec zip my value time = 0.87's, unzip length = 0.132'GB zip my value throughput = 150.633'MB/sec zip pipeline throughput = 150.633'MB/sec entries = 129427 avg-key = 20.00 avg-zkey = 1.73 avg-val = 1017.02 avg-zval = 313.21 usrkeys = 129427 avg-key = 12.00 avg-zkey = 1.73 avg-val = 1021.46 avg-zval = 313.21 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 82040 bytes = 307664 } seq expand size = 574280 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0405 GB dict = 1.38 MB all = 0.0425 GB } UnZip/Zip{ index = 6.9515 value = 3.2471 dict = 1.00 all = 3.1604 } Zip/UnZip{ index = 0.1439 value = 0.3080 dict = 1.00 all = 0.3164 } ---------------------------- total value len = 10.835603 GB avg = 0.200 KB (by entry num) total key len = 1.479650 GB avg = 0.027 KB total ukey len = 1.021175 GB avg = 0.015 KB total ukey num = 0.067491890 Billion total entry num = 0.054299619 Billion write speed all = 0.507874451 MB/sec (with seq num) write speed all = 0.489960153 MB/sec (without seq num) 2024/11/23-15:39:20.882618 139957584442944 [compaction_job.cc:1948] [default] [JOB 29541] Generated table #267101: 129427 keys, 42469481 bytes, temperature: kWarm 2024/11/23-15:39:20.882680 139957584442944 EVENT_LOG_v1 {"time_micros": 1732347560882644, "cf_name": "default", "job": 29541, "event": "table_file_creation", "file_number": 267101, "file_size": 42469481, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4075875789, "table_properties": {"data_size": 40538288, "index_size": 223424, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588540, "raw_average_key_size": 20, "raw_value_size": 131630175, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129427, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732347559, "oldest_key_time": 0, "file_creation_time": 1732347559, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 267101, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-15:39:20.920295 139957584442944 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267102.sst) /dev/shm/ToplingTemp/Topling-98098-kvlzZV 2024/11/23-15:39:21.660464 139957584442944 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267102.sst): first pass time = 0.74's, 181.345'MB/sec 2024/11/23-15:39:22.506971 139957584442944 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267102.sst): old prealloc_size = 147639500, real_size = 41064160 2024/11/23-15:39:22.507104 139957584442944 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267102.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129427 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.72 raw-val = 0.1316 GB zip-val = 0.0408 GB avg-val =1017.02 avg-zval = 315.31 2024/11/23-15:39:22.507257 139957584442944 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267102.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-15:39:22.669452 139957584442944 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267102.sst): second pass time = 0.85's, 155.757'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 263.940'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2317.631'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.277'MB/sec write SST data time = 0.05's, 940.548'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 43083.724'MB/sec zip my value time = 0.85's, unzip length = 0.132'GB zip my value throughput = 155.757'MB/sec zip pipeline throughput = 155.757'MB/sec entries = 129427 avg-key = 20.00 avg-zkey = 1.72 avg-val = 1017.02 avg-zval = 315.31 usrkeys = 129427 avg-key = 12.00 avg-zkey = 1.72 avg-val = 1023.47 avg-zval = 315.31 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 119216 bytes = 447072 } seq expand size = 834512 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0408 GB dict = 1.38 MB all = 0.0429 GB } UnZip/Zip{ index = 6.9935 value = 3.2255 dict = 1.00 all = 3.1302 } Zip/UnZip{ index = 0.1430 value = 0.3100 dict = 1.00 all = 0.3195 } ---------------------------- total value len = 10.968067 GB avg = 0.202 KB (by entry num) total key len = 1.482239 GB avg = 0.027 KB total ukey len = 1.022729 GB avg = 0.015 KB total ukey num = 0.067621317 Billion total entry num = 0.054429046 Billion write speed all = 0.513405055 MB/sec (with seq num) write speed all = 0.495449418 MB/sec (without seq num) 2024/11/23-15:39:22.720549 139957584442944 [compaction_job.cc:1948] [default] [JOB 29541] Generated table #267102: 129427 keys, 42879003 bytes, temperature: kWarm 2024/11/23-15:39:22.720629 139957584442944 EVENT_LOG_v1 {"time_micros": 1732347562720584, "cf_name": "default", "job": 29541, "event": "table_file_creation", "file_number": 267102, "file_size": 42879003, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4075876596, "table_properties": {"data_size": 40809552, "index_size": 222080, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588540, "raw_average_key_size": 20, "raw_value_size": 131630087, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129427, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732347560, "oldest_key_time": 0, "file_creation_time": 1732347560, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 267102, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-15:39:22.760242 139957584442944 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267103.sst) /dev/shm/ToplingTemp/Topling-98098-uSFwZS 2024/11/23-15:39:23.468524 139957584442944 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267103.sst): first pass time = 0.71's, 189.509'MB/sec 2024/11/23-15:39:24.321442 139957584442944 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267103.sst): old prealloc_size = 147639500, real_size = 40552816 2024/11/23-15:39:24.321555 139957584442944 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267103.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129428 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.77 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1017.01 avg-zval = 311.30 2024/11/23-15:39:24.321680 139957584442944 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267103.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-15:39:24.481685 139957584442944 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267103.sst): second pass time = 0.85's, 154.433'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 263.436'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2488.842'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.275'MB/sec write SST data time = 0.04's, 992.399'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 50023.090'MB/sec zip my value time = 0.85's, unzip length = 0.132'GB zip my value throughput = 154.433'MB/sec zip pipeline throughput = 154.433'MB/sec entries = 129428 avg-key = 20.00 avg-zkey = 1.77 avg-val = 1017.01 avg-zval = 311.30 usrkeys = 129428 avg-key = 12.00 avg-zkey = 1.77 avg-val = 1021.15 avg-zval = 311.30 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 76649 bytes = 287456 } seq expand size = 536543 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0422 GB } UnZip/Zip{ index = 6.7863 value = 3.2669 dict = 1.00 all = 3.1799 } Zip/UnZip{ index = 0.1474 value = 0.3061 dict = 1.00 all = 0.3145 } ---------------------------- total value len = 11.100233 GB avg = 0.203 KB (by entry num) total key len = 1.484827 GB avg = 0.027 KB total ukey len = 1.024282 GB avg = 0.015 KB total ukey num = 0.067750745 Billion total entry num = 0.054558474 Billion write speed all = 0.518923053 MB/sec (with seq num) write speed all = 0.500926063 MB/sec (without seq num) 2024/11/23-15:39:24.533447 139957584442944 [compaction_job.cc:1948] [default] [JOB 29541] Generated table #267103: 129428 keys, 42207979 bytes, temperature: kWarm 2024/11/23-15:39:24.533516 139957584442944 EVENT_LOG_v1 {"time_micros": 1732347564533483, "cf_name": "default", "job": 29541, "event": "table_file_creation", "file_number": 267103, "file_size": 42207979, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4075862240, "table_properties": {"data_size": 40291424, "index_size": 228864, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588560, "raw_average_key_size": 20, "raw_value_size": 131629269, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129428, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732347562, "oldest_key_time": 0, "file_creation_time": 1732347562, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 267103, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-15:39:24.571791 139957584442944 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267104.sst) /dev/shm/ToplingTemp/Topling-98098-uZ8OrT 2024/11/23-15:39:25.223865 139957584442944 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267104.sst): first pass time = 0.65's, 205.845'MB/sec 2024/11/23-15:39:26.049103 139957584442944 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267104.sst): old prealloc_size = 147639500, real_size = 40582688 2024/11/23-15:39:26.049228 139957584442944 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267104.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129428 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.72 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1017.01 avg-zval = 311.59 2024/11/23-15:39:26.049305 139957584442944 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267104.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-15:39:26.207014 139957584442944 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267104.sst): second pass time = 0.82's, 159.820'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 266.398'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2250.745'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.278'MB/sec write SST data time = 0.04's, 1014.746'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 45716.855'MB/sec zip my value time = 0.82's, unzip length = 0.132'GB zip my value throughput = 159.820'MB/sec zip pipeline throughput = 159.820'MB/sec entries = 129428 avg-key = 20.00 avg-zkey = 1.72 avg-val = 1017.01 avg-zval = 311.59 usrkeys = 129428 avg-key = 12.00 avg-zkey = 1.72 avg-val = 1018.58 avg-zval = 311.59 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 29038 bytes = 108912 } seq expand size = 203266 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0421 GB } UnZip/Zip{ index = 6.9916 value = 3.2640 dict = 1.00 all = 3.1912 } Zip/UnZip{ index = 0.1430 value = 0.3064 dict = 1.00 all = 0.3134 } ---------------------------- total value len = 11.232066 GB avg = 0.205 KB (by entry num) total key len = 1.487416 GB avg = 0.027 KB total ukey len = 1.025835 GB avg = 0.015 KB total ukey num = 0.067880173 Billion total entry num = 0.054687902 Billion write speed all = 0.524428392 MB/sec (with seq num) write speed all = 0.506389992 MB/sec (without seq num) 2024/11/23-15:39:26.261584 139957584442944 [compaction_job.cc:1948] [default] [JOB 29541] Generated table #267104: 129428 keys, 42058865 bytes, temperature: kWarm 2024/11/23-15:39:26.261658 139957584442944 EVENT_LOG_v1 {"time_micros": 1732347566261624, "cf_name": "default", "job": 29541, "event": "table_file_creation", "file_number": 267104, "file_size": 42058865, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4075833254, "table_properties": {"data_size": 40328016, "index_size": 222144, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588560, "raw_average_key_size": 20, "raw_value_size": 131629943, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129428, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732347564, "oldest_key_time": 0, "file_creation_time": 1732347564, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 267104, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-15:39:26.299266 139957584442944 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267105.sst) /dev/shm/ToplingTemp/Topling-98098-VYTHyW 2024/11/23-15:39:27.046252 139957584442944 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267105.sst): first pass time = 0.75's, 179.689'MB/sec 2024/11/23-15:39:27.931336 139957584442944 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267105.sst): old prealloc_size = 147639500, real_size = 40493088 2024/11/23-15:39:27.931450 139957584442944 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267105.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129430 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.73 raw-val = 0.1316 GB zip-val = 0.0402 GB avg-val =1016.99 avg-zval = 310.88 2024/11/23-15:39:27.931534 139957584442944 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267105.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-15:39:28.090914 139957584442944 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267105.sst): second pass time = 0.88's, 148.994'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 263.236'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2338.377'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.275'MB/sec write SST data time = 0.04's, 1004.045'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 48659.487'MB/sec zip my value time = 0.88's, unzip length = 0.132'GB zip my value throughput = 148.994'MB/sec zip pipeline throughput = 148.994'MB/sec entries = 129430 avg-key = 20.00 avg-zkey = 1.73 avg-val = 1016.99 avg-zval = 310.88 usrkeys = 129430 avg-key = 12.00 avg-zkey = 1.73 avg-val = 1019.01 avg-zval = 310.88 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 37272 bytes = 139792 } seq expand size = 260904 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0402 GB dict = 1.38 MB all = 0.0420 GB } UnZip/Zip{ index = 6.9496 value = 3.2714 dict = 1.00 all = 3.1956 } Zip/UnZip{ index = 0.1439 value = 0.3057 dict = 1.00 all = 0.3129 } ---------------------------- total value len = 11.363957 GB avg = 0.207 KB (by entry num) total key len = 1.490004 GB avg = 0.027 KB total ukey len = 1.027388 GB avg = 0.015 KB total ukey num = 0.068009603 Billion total entry num = 0.054817332 Billion write speed all = 0.529931848 MB/sec (with seq num) write speed all = 0.511852161 MB/sec (without seq num) 2024/11/23-15:39:28.147082 139957584442944 [compaction_job.cc:1948] [default] [JOB 29541] Generated table #267105: 129430 keys, 42000515 bytes, temperature: kWarm 2024/11/23-15:39:28.147146 139957584442944 EVENT_LOG_v1 {"time_micros": 1732347568147114, "cf_name": "default", "job": 29541, "event": "table_file_creation", "file_number": 267105, "file_size": 42000515, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4075857627, "table_properties": {"data_size": 40237072, "index_size": 223488, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588600, "raw_average_key_size": 20, "raw_value_size": 131629622, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129430, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732347566, "oldest_key_time": 0, "file_creation_time": 1732347566, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 267105, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-15:39:28.185075 139957584442944 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267106.sst) /dev/shm/ToplingTemp/Topling-98098-64BuPV 2024/11/23-15:39:28.685582 139957584442944 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267106.sst): first pass time = 0.50's, 268.186'MB/sec 2024/11/23-15:39:29.495541 139957584442944 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267106.sst): old prealloc_size = 147639500, real_size = 40476384 2024/11/23-15:39:29.495671 139957584442944 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267106.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129430 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.72 raw-val = 0.1316 GB zip-val = 0.0402 GB avg-val =1016.99 avg-zval = 310.75 2024/11/23-15:39:29.495754 139957584442944 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267106.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-15:39:29.655388 139957584442944 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267106.sst): second pass time = 0.81's, 162.818'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 262.631'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2077.647'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.276'MB/sec write SST data time = 0.04's, 985.273'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 48710.675'MB/sec zip my value time = 0.81's, unzip length = 0.132'GB zip my value throughput = 162.818'MB/sec zip pipeline throughput = 162.818'MB/sec entries = 129430 avg-key = 20.00 avg-zkey = 1.72 avg-val = 1016.99 avg-zval = 310.75 usrkeys = 129430 avg-key = 12.00 avg-zkey = 1.72 avg-val = 1018.87 avg-zval = 310.75 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 34759 bytes = 130368 } seq expand size = 243313 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0402 GB dict = 1.38 MB all = 0.0420 GB } UnZip/Zip{ index = 6.9616 value = 3.2727 dict = 1.00 all = 3.1976 } Zip/UnZip{ index = 0.1436 value = 0.3056 dict = 1.00 all = 0.3127 } ---------------------------- total value len = 11.495830 GB avg = 0.209 KB (by entry num) total key len = 1.492593 GB avg = 0.027 KB total ukey len = 1.028941 GB avg = 0.015 KB total ukey num = 0.068139033 Billion total entry num = 0.054946762 Billion write speed all = 0.535440776 MB/sec (with seq num) write speed all = 0.517319570 MB/sec (without seq num) 2024/11/23-15:39:29.707700 139957584442944 [compaction_job.cc:1948] [default] [JOB 29541] Generated table #267106: 129430 keys, 41974440 bytes, temperature: kWarm 2024/11/23-15:39:29.707769 139957584442944 EVENT_LOG_v1 {"time_micros": 1732347569707735, "cf_name": "default", "job": 29541, "event": "table_file_creation", "file_number": 267106, "file_size": 41974440, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4075848442, "table_properties": {"data_size": 40220752, "index_size": 223104, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588600, "raw_average_key_size": 20, "raw_value_size": 131629642, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129430, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732347568, "oldest_key_time": 0, "file_creation_time": 1732347568, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 267106, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-15:39:29.745791 139957584442944 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267107.sst) /dev/shm/ToplingTemp/Topling-98098-KWAAaW 2024/11/23-15:39:30.278798 139957584442944 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267107.sst): first pass time = 0.53's, 251.829'MB/sec 2024/11/23-15:39:31.320227 139957584442944 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267107.sst): old prealloc_size = 147639500, real_size = 40901440 2024/11/23-15:39:31.320348 139957584442944 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267107.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129429 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.70 raw-val = 0.1316 GB zip-val = 0.0406 GB avg-val =1017.00 avg-zval = 314.06 2024/11/23-15:39:31.320486 139957584442944 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267107.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-15:39:31.479568 139957584442944 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267107.sst): second pass time = 1.04's, 126.480'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 267.735'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2262.430'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.275'MB/sec write SST data time = 0.04's, 1026.122'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 46885.509'MB/sec zip my value time = 1.04's, unzip length = 0.132'GB zip my value throughput = 126.480'MB/sec zip pipeline throughput = 184.929'MB/sec entries = 129429 avg-key = 20.00 avg-zkey = 1.70 avg-val = 1017.00 avg-zval = 314.06 usrkeys = 129429 avg-key = 12.00 avg-zkey = 1.70 avg-val = 1022.58 avg-zval = 314.06 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 103169 bytes = 386896 } seq expand size = 722183 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0406 GB dict = 1.38 MB all = 0.0427 GB } UnZip/Zip{ index = 7.0567 value = 3.2382 dict = 1.00 all = 3.1465 } Zip/UnZip{ index = 0.1417 value = 0.3088 dict = 1.00 all = 0.3178 } ---------------------------- total value len = 11.628181 GB avg = 0.211 KB (by entry num) total key len = 1.495182 GB avg = 0.027 KB total ukey len = 1.030494 GB avg = 0.015 KB total ukey num = 0.068268462 Billion total entry num = 0.055076191 Billion write speed all = 0.540962930 MB/sec (with seq num) write speed all = 0.522800404 MB/sec (without seq num) 2024/11/23-15:39:31.534833 139957584442944 [compaction_job.cc:1948] [default] [JOB 29541] Generated table #267107: 129429 keys, 42656027 bytes, temperature: kWarm 2024/11/23-15:39:31.534900 139957584442944 EVENT_LOG_v1 {"time_micros": 1732347571534865, "cf_name": "default", "job": 29541, "event": "table_file_creation", "file_number": 267107, "file_size": 42656027, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4075878487, "table_properties": {"data_size": 40648816, "index_size": 220096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588580, "raw_average_key_size": 20, "raw_value_size": 131629366, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129429, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732347569, "oldest_key_time": 0, "file_creation_time": 1732347569, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 267107, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-15:39:31.575575 139957584442944 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267108.sst) /dev/shm/ToplingTemp/Topling-98098-ZbNqnV 2024/11/23-15:39:31.584326 139957584442944 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267108.sst): first pass time = 0.01's, 390.156'MB/sec 2024/11/23-15:39:31.616834 139957584442944 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267108.sst): old prealloc_size = 147639500, real_size = 1079312 2024/11/23-15:39:31.616874 139957584442944 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267108.sst): index type = UintIndex_IL_256_32 , store type = DictZipBlobStore usrkeys = 3276 prefix = 4 raw-key = 0.0000 GB zip-key = 0.0000 GB avg-key = 8.00 avg-zkey = 0.24 raw-val = 0.0033 GB zip-val = 0.0011 GB avg-val =1017.13 avg-zval = 328.92 2024/11/23-15:39:31.622798 139957584442944 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00/267108.sst): second pass time = 0.03's, 104.075'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.01's, 189.827'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 33.436'MB/sec (index lex order gen) rebuild zvType time = 0.00's, 0.166'MB/sec write SST data time = 0.00's, 1138.833'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.038'MB, throughput = 1778.753'MB/sec zip my value time = 0.03's, unzip length = 0.003'GB zip my value throughput = 104.075'MB/sec zip pipeline throughput = 104.075'MB/sec entries = 3276 avg-key = 20.00 avg-zkey = 0.25 avg-val = 1017.13 avg-zval = 328.92 usrkeys = 3276 avg-key = 12.00 avg-zkey = 0.25 avg-val = 1024.13 avg-zval = 328.92 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 3276 bytes = 12304 } seq expand size = 22932 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0000 GB value = 0.0033 GB dict = 0.04 MB all = 0.0034 GB } __ZipSize{ index = 0.0000 GB value = 0.0011 GB dict = 0.04 MB all = 0.0011 GB } UnZip/Zip{ index = 47.2500 value = 3.0924 dict = 1.00 all = 3.0078 } Zip/UnZip{ index = 0.0212 value = 0.3234 dict = 1.00 all = 0.3325 } ---------------------------- total value len = 11.631536 GB avg = 0.211 KB (by entry num) total key len = 1.495247 GB avg = 0.027 KB total ukey len = 1.030534 GB avg = 0.015 KB total ukey num = 0.068271738 Billion total entry num = 0.055079467 Billion write speed all = 0.541100736 MB/sec (with seq num) write speed all = 0.522937237 MB/sec (without seq num) 2024/11/23-15:39:31.630683 139957584442944 [compaction_job.cc:1948] [default] [JOB 29541] Generated table #267108: 3276 keys, 1129595 bytes, temperature: kWarm 2024/11/23-15:39:31.630728 139957584442944 EVENT_LOG_v1 {"time_micros": 1732347571630703, "cf_name": "default", "job": 29541, "event": "table_file_creation", "file_number": 267108, "file_size": 1129595, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3426790602, "largest_seqno": 4074367583, "table_properties": {"data_size": 1077536, "index_size": 832, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 65520, "raw_average_key_size": 20, "raw_value_size": 3332130, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 3276, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-UintIndex_IL_256_32-DictZipBlobStore", "creation_time": 1732347571, "oldest_key_time": 0, "file_creation_time": 1732347571, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 267108, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-15:39:31.638845 139957584442944 [compaction_job.cc:703] job-29541: subcompact[0], size: 0.893443 G, files: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-29541/att-00 [267087,267088,267089,267090,267091,267092,267093,267094,267095,267096,267097,267098,267099,267100,267101,267102,267103,267104,267105,267106,267107,267108] 2024/11/23-15:39:31.772337 139957584442944 (Original Log Time 2024/11/23-15:38:50.924331) EVENT_LOG_v1 {"time_micros": 1732347530924287, "job": 29541, "event": "compaction_started", "compaction_reason": "FilesMarkedForCompaction", "files_L2": [267081], "files_L3": [267001, 267002, 267003, 267004, 267005, 267006, 267007, 267008, 267009, 267010, 267011, 267012, 267013, 267014, 267015, 267016, 267017, 267018, 267019, 267020, 267021], "score": 0.997978, "input_data_size": 925056555, "oldest_snapshot_seqno": 4075911650} 2024/11/23-15:39:31.772341 139957584442944 (Original Log Time 2024/11/23-15:39:31.770749) [compaction_job.cc:2022] [default] [JOB 29541] Compacted 1@2 + 21@3 files to L3 => 893442919 bytes 2024/11/23-15:39:31.772342 139957584442944 (Original Log Time 2024/11/23-15:39:31.772268) [compaction_job.cc:1224] [default] compacted to: files[0 0 0 22 0 0 0] max score 0.03, MB/sec: 22.7 rd, 21.9 wr, level 3, files in(1, 21) out(22 +0 blob) MB in(31.2, 851.0 +0.0 blob) out(852.1 +0.0 blob), read-write-amplify(55.6) write-amplify(27.3) OK, records in: 2749934, records dropped: 28631 output_compression: Snappy 2024/11/23-15:39:31.772345 139957584442944 (Original Log Time 2024/11/23-15:39:31.772311) EVENT_LOG_v1 {"time_micros": 1732347571772292, "cf": "default", "job": 29541, "event": "compaction_finished", "compaction_time_micros": 40714518, "compaction_time_cpu_micros": 8499135, "output_level": 3, "num_output_files": 22, "total_output_size": 893442919, "num_input_records": 2749934, "num_output_records": 2721303, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "file_write_nanos": 650124437, "file_range_sync_nanos": 0, "file_fsync_nanos": 16871, "file_prepare_write_nanos": 47342, "lsm_state": [0, 0, 0, 22, 0, 0, 0]} 2024/11/23-15:39:31.904612 139957584442944 DEBG dcompact_worker.cpp:240: HttpPost: 200 OK: url = http://nlb-7zny4kaa1poal01o64.cn-shenzhen.nlb.aliyuncs.com:8443, body = {"instanceId":"nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137","labourId":"","dbId":"d89b4006-2803-486e-b7a2-759bcf348921","dbStarts":1732256054,"starts":1732347530,"executesMs":41001,"compactionJobId":29541,"attempt":0,"compactionInputRawBytes":2851671032,"compactionInputZipBytes":925056555,"compactionOutputRawBytes":0,"compactionOutputZipBytes":893442919,"headers":{"Accept":"*/*","Connection":"close","Host":"aliyun-topling-saas.topling.cn:18443","RemoteIp":"120.24.192.169","X-Forwarded-For":"120.24.192.169","region":"cn-shenzhen","token":"e6474c481bd4415abc537135cc03626b","instance-token":"e6474c481bd4415abc537135cc03626b","provider":"aliyun","CloudMarketInstanceId":"si-59c0ae5c955845588903","MeteringAssit":"","Transfer-Encoding":"chunked","traceparent":"00-9a3fbfcc1cea29445c224d99e21eece8-4b124e2fc0ec0218-00"}}, response = 2024/11/23-15:39:31.904687 139957584442944 INFO dcompact_worker.cpp:1459: finish /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-29541/att-00: olev 3, work 41.001 s, result 7.765 ms, install 1.614 ms, input{raw 2.656 GiB zip 882.203 MiB}