2024/11/23-16:00:50.388101 139957282305600 DEBG dcompact_worker.cpp:2214: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00: fork to child time = 0.024801 sec 2024/11/23-16:00:50.389056 139957282305600 DEBG dcompact_worker.cpp:1013: Beg SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00 2024/11/23-16:00:50.398473 139957282305600 DEBG dcompact_worker.cpp:1033: End SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00 2024/11/23-16:00:50.407895 139957282305600 TRAC dcompact_worker.cpp:1083: INFO_LOG_LEVEL: rpc = INFO_LEVEL, env_var = undefined 2024/11/23-16:00:50.408268 139957282305600 [WARN] [column_family.cc:386] multiple cf_paths/db_paths and level_compaction_dynamic_level_bytes can't be used together 2024/11/23-16:00:50.466371 139957282305600 [version_set.cc:6208] Recovering from manifest file: /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-30058/att-00/MANIFEST-206347 2024/11/23-16:00:50.501398 139957282305600 [version_set.cc:6251] Recovered from manifest file:/worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-30058/att-00/MANIFEST-206347 succeeded,manifest_file_number is 206347, next_file_number is 268186, last_sequence is 4091182940, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 268027 2024/11/23-16:00:50.501415 139957282305600 [version_set.cc:6266] Column family [default] (ID 0), log number is 0 2024/11/23-16:00:50.501630 139957282305600 [version_set.cc:5721] Creating manifest 268186 2024/11/23-16:00:50.535507 139957282305600 DEBG dcompact_worker.cpp:1218: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00: bottommost_level: fake = 1, rpc = 0 2024/11/23-16:00:50.559243 139957282305600 [compaction_job.cc:2437] [default] [JOB 30058] Compacting 1@2 + 21@3 files to L3, score 0.99, subcompactions 1 : 1 2024/11/23-16:00:50.559267 139957282305600 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 22474 Base level 2, inputs: [268168(31MB)], [268079(40MB) 268080(40MB) 268081(40MB) 268082(40MB) 268083(40MB) 268084(40MB) 268085(40MB) 268086(40MB) 268087(40MB) 268088(40MB) 268089(40MB) 268090(40MB) 268091(40MB) 268092(40MB) 268093(40MB) 268094(40MB) 268095(40MB) 268096(39MB) 268097(40MB) 268098(39MB) 268183(40MB)] 2024/11/23-16:00:50.568595 139957282305600 [top_zip_table.cc:59] core git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-16:00:50.568635 139957282305600 [top_zip_table.cc:60] fsa git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-16:00:50.568662 139957282305600 [top_zip_table.cc:61] zbs git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-16:00:50.568671 139957282305600 [top_zip_table.cc:62] topling-zip_table_reader: git_version_hash_info_is: commit a4a382006cb82713acf5b3425835f22711877681 Author: leipeng Date: 2024-04-11 19:44:14 +0800 fixed_len_hole_index.cc: Add env bool FixedLenHoleIndexUseAVX512 for ut & debug 1. FixedLenHoleIndexUseAVX512 is only in unit tests or debug 2. In release mode, use avx512 by compile options(-march=) g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/23-16:00:50.568687 139957282305600 [top_zip_table.cc:64] topling-rocks git_version_hash_info_is: commit feab587e468621ba0204d47b4ffacc52e7c4290d Author: leipeng Date: 2024-03-22 13:35:06 +0800 ToplingZipTableBuilder::Add: immediately return after error This function returns void, and caller does not check builder->status() after calling this function and graceful abandon. So immediately return after error, and return error status in Finish(). g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/23-16:00:51.213017 139957282305600 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268187.sst) /dev/shm/ToplingTemp/Topling-105511-ZUFXas 2024/11/23-16:00:51.388949 139957282305600 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268187.sst): first pass time = 0.18's, 763.093'MB/sec 2024/11/23-16:00:52.247112 139957282305600 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268187.sst): old prealloc_size = 147639500, real_size = 40639136 2024/11/23-16:00:52.247245 139957282305600 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268187.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129431 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.81 raw-val = 0.1316 GB zip-val = 0.0404 GB avg-val =1016.99 avg-zval = 311.93 2024/11/23-16:00:52.247457 139957282305600 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268187.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:00:52.411650 139957282305600 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268187.sst): second pass time = 0.86's, 153.636'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 258.137'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2126.615'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.271'MB/sec write SST data time = 0.04's, 946.775'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 48263.440'MB/sec zip my value time = 0.86's, unzip length = 0.132'GB zip my value throughput = 153.636'MB/sec zip pipeline throughput = 153.636'MB/sec entries = 129431 avg-key = 20.00 avg-zkey = 1.81 avg-val = 1016.99 avg-zval = 311.93 usrkeys = 129431 avg-key = 12.00 avg-zkey = 1.81 avg-val = 1023.99 avg-zval = 311.93 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129431 bytes = 485376 } seq expand size = 906017 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0404 GB dict = 1.38 MB all = 0.0425 GB } UnZip/Zip{ index = 6.6470 value = 3.2603 dict = 1.00 all = 3.1602 } Zip/UnZip{ index = 0.1504 value = 0.3067 dict = 1.00 all = 0.3164 } ---------------------------- total value len = 8.981155 GB avg = 0.171 KB (by entry num) total key len = 1.443410 GB avg = 0.028 KB total ukey len = 0.999431 GB avg = 0.015 KB total ukey num = 0.065679866 Billion total entry num = 0.052487595 Billion write speed all = 0.408163069 MB/sec (with seq num) write speed all = 0.391722289 MB/sec (without seq num) 2024/11/23-16:00:52.464332 139957282305600 [compaction_job.cc:1948] [default] [JOB 30058] Generated table #268187: 129431 keys, 42471953 bytes, temperature: kWarm 2024/11/23-16:00:52.464438 139957282305600 EVENT_LOG_v1 {"time_micros": 1732348852464374, "cf_name": "default", "job": 30058, "event": "table_file_creation", "file_number": 268187, "file_size": 42471953, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237877277, "largest_seqno": 4090991107, "table_properties": {"data_size": 40372944, "index_size": 233664, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588620, "raw_average_key_size": 20, "raw_value_size": 131629674, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129431, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732348851, "oldest_key_time": 0, "file_creation_time": 1732348851, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 268187, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:00:52.503602 139957282305600 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268188.sst) /dev/shm/ToplingTemp/Topling-105511-QFUe5t 2024/11/23-16:00:53.053255 139957282305600 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268188.sst): first pass time = 0.55's, 244.211'MB/sec 2024/11/23-16:00:53.914355 139957282305600 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268188.sst): old prealloc_size = 147639500, real_size = 40844000 2024/11/23-16:00:53.914481 139957282305600 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268188.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129432 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.75 raw-val = 0.1316 GB zip-val = 0.0406 GB avg-val =1016.98 avg-zval = 313.56 2024/11/23-16:00:53.914655 139957282305600 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268188.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:00:54.080397 139957282305600 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268188.sst): second pass time = 0.86's, 152.995'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.17's, 257.046'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1988.520'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.273'MB/sec write SST data time = 0.05's, 903.369'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 44255.972'MB/sec zip my value time = 0.86's, unzip length = 0.132'GB zip my value throughput = 152.995'MB/sec zip pipeline throughput = 152.995'MB/sec entries = 129432 avg-key = 20.00 avg-zkey = 1.75 avg-val = 1016.98 avg-zval = 313.56 usrkeys = 129432 avg-key = 12.00 avg-zkey = 1.75 avg-val = 1023.98 avg-zval = 313.56 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129432 bytes = 485392 } seq expand size = 906024 multi value expand size = 0 cnt WriteAppend = 11 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0406 GB dict = 1.38 MB all = 0.0427 GB } UnZip/Zip{ index = 6.8555 value = 3.2433 dict = 1.00 all = 3.1450 } Zip/UnZip{ index = 0.1459 value = 0.3083 dict = 1.00 all = 0.3180 } ---------------------------- total value len = 9.113692 GB avg = 0.173 KB (by entry num) total key len = 1.445998 GB avg = 0.027 KB total ukey len = 1.000984 GB avg = 0.015 KB total ukey num = 0.065809298 Billion total entry num = 0.052617027 Billion write speed all = 0.413426724 MB/sec (with seq num) write speed all = 0.396946478 MB/sec (without seq num) 2024/11/23-16:00:54.132244 139957282305600 [compaction_job.cc:1948] [default] [JOB 30058] Generated table #268188: 129432 keys, 42677059 bytes, temperature: kWarm 2024/11/23-16:00:54.132315 139957282305600 EVENT_LOG_v1 {"time_micros": 1732348854132277, "cf_name": "default", "job": 30058, "event": "table_file_creation", "file_number": 268188, "file_size": 42677059, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237868195, "largest_seqno": 4091003560, "table_properties": {"data_size": 40584912, "index_size": 226560, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588640, "raw_average_key_size": 20, "raw_value_size": 131630026, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129432, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732348852, "oldest_key_time": 0, "file_creation_time": 1732348852, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 268188, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:00:54.171819 139957282305600 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268189.sst) /dev/shm/ToplingTemp/Topling-105511-cj0h8p 2024/11/23-16:00:54.710615 139957282305600 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268189.sst): first pass time = 0.54's, 249.128'MB/sec 2024/11/23-16:00:55.715258 139957282305600 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268189.sst): old prealloc_size = 147639500, real_size = 40598752 2024/11/23-16:00:55.715377 139957282305600 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268189.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129432 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.81 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1016.98 avg-zval = 311.60 2024/11/23-16:00:55.715540 139957282305600 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268189.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:00:55.878921 139957282305600 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268189.sst): second pass time = 1.00's, 131.227'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 259.276'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2392.267'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.273'MB/sec write SST data time = 0.04's, 944.186'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 39487.059'MB/sec zip my value time = 1.00's, unzip length = 0.132'GB zip my value throughput = 131.227'MB/sec zip pipeline throughput = 174.117'MB/sec entries = 129432 avg-key = 20.00 avg-zkey = 1.81 avg-val = 1016.98 avg-zval = 311.60 usrkeys = 129432 avg-key = 12.00 avg-zkey = 1.81 avg-val = 1023.98 avg-zval = 311.60 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129432 bytes = 485392 } seq expand size = 906024 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0424 GB } UnZip/Zip{ index = 6.6199 value = 3.2637 dict = 1.00 all = 3.1632 } Zip/UnZip{ index = 0.1511 value = 0.3064 dict = 1.00 all = 0.3161 } ---------------------------- total value len = 9.246227 GB avg = 0.175 KB (by entry num) total key len = 1.448587 GB avg = 0.027 KB total ukey len = 1.002538 GB avg = 0.015 KB total ukey num = 0.065938730 Billion total entry num = 0.052746459 Billion write speed all = 0.418687545 MB/sec (with seq num) write speed all = 0.402167923 MB/sec (without seq num) 2024/11/23-16:00:55.931310 139957282305600 [compaction_job.cc:1948] [default] [JOB 30058] Generated table #268189: 129432 keys, 42431167 bytes, temperature: kWarm 2024/11/23-16:00:55.931375 139957282305600 EVENT_LOG_v1 {"time_micros": 1732348855931343, "cf_name": "default", "job": 30058, "event": "table_file_creation", "file_number": 268189, "file_size": 42431167, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237873554, "largest_seqno": 4091003315, "table_properties": {"data_size": 40331600, "index_size": 234624, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588640, "raw_average_key_size": 20, "raw_value_size": 131629544, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129432, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732348854, "oldest_key_time": 0, "file_creation_time": 1732348854, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 268189, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:00:55.970214 139957282305600 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268190.sst) /dev/shm/ToplingTemp/Topling-105511-SHkbYq 2024/11/23-16:00:56.842008 139957282305600 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268190.sst): first pass time = 0.87's, 153.963'MB/sec 2024/11/23-16:00:57.716549 139957282305600 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268190.sst): old prealloc_size = 147639500, real_size = 40865216 2024/11/23-16:00:57.716694 139957282305600 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268190.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129435 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.74 raw-val = 0.1316 GB zip-val = 0.0406 GB avg-val =1016.95 avg-zval = 313.73 2024/11/23-16:00:57.716871 139957282305600 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268190.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:00:57.894948 139957282305600 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268190.sst): second pass time = 0.87's, 150.776'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.18's, 239.359'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1925.996'MB/sec (index lex order gen) rebuild zvType time = 0.13's, 0.249'MB/sec write SST data time = 0.05's, 885.702'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 45763.643'MB/sec zip my value time = 0.87's, unzip length = 0.132'GB zip my value throughput = 150.776'MB/sec zip pipeline throughput = 150.776'MB/sec entries = 129435 avg-key = 20.00 avg-zkey = 1.74 avg-val = 1016.95 avg-zval = 313.73 usrkeys = 129435 avg-key = 12.00 avg-zkey = 1.74 avg-val = 1023.95 avg-zval = 313.73 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129435 bytes = 485392 } seq expand size = 906045 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0406 GB dict = 1.38 MB all = 0.0427 GB } UnZip/Zip{ index = 6.8868 value = 3.2415 dict = 1.00 all = 3.1434 } Zip/UnZip{ index = 0.1452 value = 0.3085 dict = 1.00 all = 0.3181 } ---------------------------- total value len = 9.378762 GB avg = 0.177 KB (by entry num) total key len = 1.451176 GB avg = 0.027 KB total ukey len = 1.004091 GB avg = 0.015 KB total ukey num = 0.066068165 Billion total entry num = 0.052875894 Billion write speed all = 0.423944005 MB/sec (with seq num) write speed all = 0.407385152 MB/sec (without seq num) 2024/11/23-16:00:57.948466 139957282305600 [compaction_job.cc:1948] [default] [JOB 30058] Generated table #268190: 129435 keys, 42697805 bytes, temperature: kWarm 2024/11/23-16:00:57.948541 139957282305600 EVENT_LOG_v1 {"time_micros": 1732348857948506, "cf_name": "default", "job": 30058, "event": "table_file_creation", "file_number": 268190, "file_size": 42697805, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237868596, "largest_seqno": 4091003514, "table_properties": {"data_size": 40607152, "index_size": 225536, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588700, "raw_average_key_size": 20, "raw_value_size": 131629184, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129435, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732348855, "oldest_key_time": 0, "file_creation_time": 1732348855, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 268190, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:00:57.985950 139957282305600 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268191.sst) /dev/shm/ToplingTemp/Topling-105511-ClS93t 2024/11/23-16:00:58.729630 139957282305600 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268191.sst): first pass time = 0.74's, 180.492'MB/sec 2024/11/23-16:00:59.692449 139957282305600 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268191.sst): old prealloc_size = 147639500, real_size = 40590160 2024/11/23-16:00:59.692582 139957282305600 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268191.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129429 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.81 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1017.00 avg-zval = 311.54 2024/11/23-16:00:59.692742 139957282305600 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268191.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:00:59.855406 139957282305600 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268191.sst): second pass time = 0.96's, 136.835'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 260.368'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2124.493'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.277'MB/sec write SST data time = 0.05's, 924.183'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.379'MB, throughput = 40649.702'MB/sec zip my value time = 0.96's, unzip length = 0.132'GB zip my value throughput = 136.835'MB/sec zip pipeline throughput = 136.835'MB/sec entries = 129429 avg-key = 20.00 avg-zkey = 1.81 avg-val = 1017.00 avg-zval = 311.54 usrkeys = 129429 avg-key = 12.00 avg-zkey = 1.81 avg-val = 1024.00 avg-zval = 311.54 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129429 bytes = 485376 } seq expand size = 906003 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0424 GB } UnZip/Zip{ index = 6.6143 value = 3.2644 dict = 1.00 all = 3.1638 } Zip/UnZip{ index = 0.1512 value = 0.3063 dict = 1.00 all = 0.3161 } ---------------------------- total value len = 9.511298 GB avg = 0.179 KB (by entry num) total key len = 1.453764 GB avg = 0.027 KB total ukey len = 1.005644 GB avg = 0.015 KB total ukey num = 0.066197594 Billion total entry num = 0.053005323 Billion write speed all = 0.429200576 MB/sec (with seq num) write speed all = 0.412602465 MB/sec (without seq num) 2024/11/23-16:00:59.907504 139957282305600 [compaction_job.cc:1948] [default] [JOB 30058] Generated table #268191: 129429 keys, 42423521 bytes, temperature: kWarm 2024/11/23-16:00:59.907573 139957282305600 EVENT_LOG_v1 {"time_micros": 1732348859907540, "cf_name": "default", "job": 30058, "event": "table_file_creation", "file_number": 268191, "file_size": 42423521, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237869923, "largest_seqno": 4091003297, "table_properties": {"data_size": 40322816, "index_size": 234816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588580, "raw_average_key_size": 20, "raw_value_size": 131629537, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129429, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732348857, "oldest_key_time": 0, "file_creation_time": 1732348857, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 268191, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:00:59.944203 139957282305600 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268192.sst) /dev/shm/ToplingTemp/Topling-105511-tGAUAq 2024/11/23-16:01:00.787351 139957282305600 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268192.sst): first pass time = 0.84's, 159.196'MB/sec 2024/11/23-16:01:01.636380 139957282305600 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268192.sst): old prealloc_size = 147639500, real_size = 40712400 2024/11/23-16:01:01.636518 139957282305600 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268192.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129430 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.80 raw-val = 0.1316 GB zip-val = 0.0404 GB avg-val =1016.99 avg-zval = 312.50 2024/11/23-16:01:01.636688 139957282305600 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268192.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:01:01.803176 139957282305600 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268192.sst): second pass time = 0.85's, 155.164'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.17's, 255.103'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2055.399'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.271'MB/sec write SST data time = 0.05's, 899.628'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 39117.483'MB/sec zip my value time = 0.85's, unzip length = 0.132'GB zip my value throughput = 155.164'MB/sec zip pipeline throughput = 155.164'MB/sec entries = 129430 avg-key = 20.00 avg-zkey = 1.80 avg-val = 1016.99 avg-zval = 312.50 usrkeys = 129430 avg-key = 12.00 avg-zkey = 1.80 avg-val = 1023.99 avg-zval = 312.50 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129430 bytes = 485376 } seq expand size = 906010 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0404 GB dict = 1.38 MB all = 0.0425 GB } UnZip/Zip{ index = 6.6744 value = 3.2544 dict = 1.00 all = 3.1547 } Zip/UnZip{ index = 0.1498 value = 0.3073 dict = 1.00 all = 0.3170 } ---------------------------- total value len = 9.643833 GB avg = 0.181 KB (by entry num) total key len = 1.456353 GB avg = 0.027 KB total ukey len = 1.007197 GB avg = 0.015 KB total ukey num = 0.066327024 Billion total entry num = 0.053134753 Billion write speed all = 0.434456555 MB/sec (with seq num) write speed all = 0.417819183 MB/sec (without seq num) 2024/11/23-16:01:01.856419 139957282305600 [compaction_job.cc:1948] [default] [JOB 30058] Generated table #268192: 129430 keys, 42545628 bytes, temperature: kWarm 2024/11/23-16:01:01.856493 139957282305600 EVENT_LOG_v1 {"time_micros": 1732348861856453, "cf_name": "default", "job": 30058, "event": "table_file_creation", "file_number": 268192, "file_size": 42545628, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237881756, "largest_seqno": 4091004084, "table_properties": {"data_size": 40447168, "index_size": 232704, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588600, "raw_average_key_size": 20, "raw_value_size": 131629477, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129430, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732348859, "oldest_key_time": 0, "file_creation_time": 1732348859, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 268192, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:01:01.895706 139957282305600 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268193.sst) /dev/shm/ToplingTemp/Topling-105511-zYXzOt 2024/11/23-16:01:02.675099 139957282305600 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268193.sst): first pass time = 0.78's, 172.217'MB/sec 2024/11/23-16:01:03.676250 139957282305600 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268193.sst): old prealloc_size = 147639500, real_size = 41037600 2024/11/23-16:01:03.676365 139957282305600 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268193.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129428 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.73 raw-val = 0.1316 GB zip-val = 0.0408 GB avg-val =1017.01 avg-zval = 315.09 2024/11/23-16:01:03.676525 139957282305600 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268193.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:01:03.835432 139957282305600 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268193.sst): second pass time = 1.00's, 131.574'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 269.362'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2381.519'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.277'MB/sec write SST data time = 0.04's, 1010.190'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 46387.750'MB/sec zip my value time = 1.00's, unzip length = 0.132'GB zip my value throughput = 131.574'MB/sec zip pipeline throughput = 131.574'MB/sec entries = 129428 avg-key = 20.00 avg-zkey = 1.73 avg-val = 1017.01 avg-zval = 315.09 usrkeys = 129428 avg-key = 12.00 avg-zkey = 1.73 avg-val = 1024.01 avg-zval = 315.09 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129428 bytes = 485376 } seq expand size = 905996 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0408 GB dict = 1.38 MB all = 0.0429 GB } UnZip/Zip{ index = 6.9396 value = 3.2277 dict = 1.00 all = 3.1308 } Zip/UnZip{ index = 0.1441 value = 0.3098 dict = 1.00 all = 0.3194 } ---------------------------- total value len = 9.776369 GB avg = 0.184 KB (by entry num) total key len = 1.458941 GB avg = 0.027 KB total ukey len = 1.008750 GB avg = 0.015 KB total ukey num = 0.066456452 Billion total entry num = 0.053264181 Billion write speed all = 0.439710279 MB/sec (with seq num) write speed all = 0.423033707 MB/sec (without seq num) 2024/11/23-16:01:03.887445 139957282305600 [compaction_job.cc:1948] [default] [JOB 30058] Generated table #268193: 129428 keys, 42870763 bytes, temperature: kWarm 2024/11/23-16:01:03.887516 139957282305600 EVENT_LOG_v1 {"time_micros": 1732348863887474, "cf_name": "default", "job": 30058, "event": "table_file_creation", "file_number": 268193, "file_size": 42870763, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237880987, "largest_seqno": 4091000258, "table_properties": {"data_size": 40781264, "index_size": 223808, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588560, "raw_average_key_size": 20, "raw_value_size": 131629540, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129428, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732348861, "oldest_key_time": 0, "file_creation_time": 1732348861, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 268193, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:01:03.925537 139957282305600 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268194.sst) /dev/shm/ToplingTemp/Topling-105511-RTa7Ws 2024/11/23-16:01:04.598695 139957282305600 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268194.sst): first pass time = 0.67's, 199.395'MB/sec 2024/11/23-16:01:05.460645 139957282305600 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268194.sst): old prealloc_size = 147639500, real_size = 40983552 2024/11/23-16:01:05.460779 139957282305600 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268194.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129430 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.71 raw-val = 0.1316 GB zip-val = 0.0407 GB avg-val =1016.99 avg-zval = 314.69 2024/11/23-16:01:05.460941 139957282305600 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268194.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:01:05.626217 139957282305600 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268194.sst): second pass time = 0.86's, 152.842'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.17's, 258.627'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2112.904'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.272'MB/sec write SST data time = 0.05's, 918.643'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 46432.298'MB/sec zip my value time = 0.86's, unzip length = 0.132'GB zip my value throughput = 152.842'MB/sec zip pipeline throughput = 152.842'MB/sec entries = 129430 avg-key = 20.00 avg-zkey = 1.71 avg-val = 1016.99 avg-zval = 314.69 usrkeys = 129430 avg-key = 12.00 avg-zkey = 1.71 avg-val = 1023.99 avg-zval = 314.69 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129430 bytes = 485376 } seq expand size = 906010 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0407 GB dict = 1.38 MB all = 0.0428 GB } UnZip/Zip{ index = 7.0322 value = 3.2317 dict = 1.00 all = 3.1348 } Zip/UnZip{ index = 0.1422 value = 0.3094 dict = 1.00 all = 0.3190 } ---------------------------- total value len = 9.908904 GB avg = 0.186 KB (by entry num) total key len = 1.461530 GB avg = 0.027 KB total ukey len = 1.010303 GB avg = 0.015 KB total ukey num = 0.066585882 Billion total entry num = 0.053393611 Billion write speed all = 0.444967369 MB/sec (with seq num) write speed all = 0.428251445 MB/sec (without seq num) 2024/11/23-16:01:05.685017 139957282305600 [compaction_job.cc:1948] [default] [JOB 30058] Generated table #268194: 129430 keys, 42816167 bytes, temperature: kWarm 2024/11/23-16:01:05.685085 139957282305600 EVENT_LOG_v1 {"time_micros": 1732348865685050, "cf_name": "default", "job": 30058, "event": "table_file_creation", "file_number": 268194, "file_size": 42816167, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237868290, "largest_seqno": 4091004372, "table_properties": {"data_size": 40730160, "index_size": 220864, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588600, "raw_average_key_size": 20, "raw_value_size": 131629389, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129430, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732348863, "oldest_key_time": 0, "file_creation_time": 1732348863, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 268194, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:01:05.723172 139957282305600 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268195.sst) /dev/shm/ToplingTemp/Topling-105511-9JlLxr 2024/11/23-16:01:06.533012 139957282305600 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268195.sst): first pass time = 0.81's, 165.743'MB/sec 2024/11/23-16:01:07.320991 139957282305600 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268195.sst): old prealloc_size = 147639500, real_size = 40782960 2024/11/23-16:01:07.321110 139957282305600 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268195.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129432 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.77 raw-val = 0.1316 GB zip-val = 0.0405 GB avg-val =1016.98 avg-zval = 313.07 2024/11/23-16:01:07.321269 139957282305600 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268195.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:01:07.485632 139957282305600 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268195.sst): second pass time = 0.79's, 167.330'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 258.846'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2334.208'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.266'MB/sec write SST data time = 0.04's, 990.340'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 49698.063'MB/sec zip my value time = 0.79's, unzip length = 0.132'GB zip my value throughput = 167.330'MB/sec zip pipeline throughput = 167.330'MB/sec entries = 129432 avg-key = 20.00 avg-zkey = 1.77 avg-val = 1016.98 avg-zval = 313.07 usrkeys = 129432 avg-key = 12.00 avg-zkey = 1.77 avg-val = 1023.98 avg-zval = 313.07 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129432 bytes = 485392 } seq expand size = 906024 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0405 GB dict = 1.38 MB all = 0.0426 GB } UnZip/Zip{ index = 6.7676 value = 3.2484 dict = 1.00 all = 3.1495 } Zip/UnZip{ index = 0.1478 value = 0.3078 dict = 1.00 all = 0.3175 } ---------------------------- total value len = 10.041440 GB avg = 0.188 KB (by entry num) total key len = 1.464119 GB avg = 0.027 KB total ukey len = 1.011857 GB avg = 0.015 KB total ukey num = 0.066715314 Billion total entry num = 0.053523043 Billion write speed all = 0.450222511 MB/sec (with seq num) write speed all = 0.433467284 MB/sec (without seq num) 2024/11/23-16:01:07.544016 139957282305600 [compaction_job.cc:1948] [default] [JOB 30058] Generated table #268195: 129432 keys, 42615439 bytes, temperature: kWarm 2024/11/23-16:01:07.544086 139957282305600 EVENT_LOG_v1 {"time_micros": 1732348867544049, "cf_name": "default", "job": 30058, "event": "table_file_creation", "file_number": 268195, "file_size": 42615439, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237874127, "largest_seqno": 4091004377, "table_properties": {"data_size": 40520928, "index_size": 229504, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588640, "raw_average_key_size": 20, "raw_value_size": 131629284, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129432, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732348865, "oldest_key_time": 0, "file_creation_time": 1732348865, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 268195, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:01:07.583192 139957282305600 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268196.sst) /dev/shm/ToplingTemp/Topling-105511-jrrMis 2024/11/23-16:01:08.308009 139957282305600 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268196.sst): first pass time = 0.72's, 185.184'MB/sec 2024/11/23-16:01:09.130344 139957282305600 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268196.sst): old prealloc_size = 147639500, real_size = 40585376 2024/11/23-16:01:09.130477 139957282305600 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268196.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129431 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.81 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1016.99 avg-zval = 311.50 2024/11/23-16:01:09.130642 139957282305600 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268196.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:01:09.293448 139957282305600 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268196.sst): second pass time = 0.82's, 160.215'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 260.079'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2037.431'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.274'MB/sec write SST data time = 0.05's, 940.546'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 37690.446'MB/sec zip my value time = 0.82's, unzip length = 0.132'GB zip my value throughput = 160.215'MB/sec zip pipeline throughput = 160.215'MB/sec entries = 129431 avg-key = 20.00 avg-zkey = 1.81 avg-val = 1016.99 avg-zval = 311.50 usrkeys = 129431 avg-key = 12.00 avg-zkey = 1.81 avg-val = 1023.99 avg-zval = 311.50 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129431 bytes = 485376 } seq expand size = 906017 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0424 GB } UnZip/Zip{ index = 6.6144 value = 3.2648 dict = 1.00 all = 3.1642 } Zip/UnZip{ index = 0.1512 value = 0.3063 dict = 1.00 all = 0.3160 } ---------------------------- total value len = 10.173975 GB avg = 0.190 KB (by entry num) total key len = 1.466707 GB avg = 0.027 KB total ukey len = 1.013410 GB avg = 0.015 KB total ukey num = 0.066844745 Billion total entry num = 0.053652474 Billion write speed all = 0.455477826 MB/sec (with seq num) write speed all = 0.438683270 MB/sec (without seq num) 2024/11/23-16:01:09.350293 139957282305600 [compaction_job.cc:1948] [default] [JOB 30058] Generated table #268196: 129431 keys, 42418052 bytes, temperature: kWarm 2024/11/23-16:01:09.350359 139957282305600 EVENT_LOG_v1 {"time_micros": 1732348869350327, "cf_name": "default", "job": 30058, "event": "table_file_creation", "file_number": 268196, "file_size": 42418052, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237873605, "largest_seqno": 4090994995, "table_properties": {"data_size": 40318032, "index_size": 234816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588620, "raw_average_key_size": 20, "raw_value_size": 131629809, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129431, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732348867, "oldest_key_time": 0, "file_creation_time": 1732348867, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 268196, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:01:09.392444 139957282305600 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268197.sst) /dev/shm/ToplingTemp/Topling-105511-qX5FVr 2024/11/23-16:01:10.154637 139957282305600 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268197.sst): first pass time = 0.76's, 176.109'MB/sec 2024/11/23-16:01:10.975670 139957282305600 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268197.sst): old prealloc_size = 147639500, real_size = 40668544 2024/11/23-16:01:10.975800 139957282305600 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268197.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129430 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.80 raw-val = 0.1316 GB zip-val = 0.0404 GB avg-val =1016.99 avg-zval = 312.16 2024/11/23-16:01:10.975951 139957282305600 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268197.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:01:11.138235 139957282305600 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268197.sst): second pass time = 0.82's, 160.603'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 261.476'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2314.942'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.273'MB/sec write SST data time = 0.04's, 971.322'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 49232.492'MB/sec zip my value time = 0.82's, unzip length = 0.132'GB zip my value throughput = 160.603'MB/sec zip pipeline throughput = 160.603'MB/sec entries = 129430 avg-key = 20.00 avg-zkey = 1.80 avg-val = 1016.99 avg-zval = 312.16 usrkeys = 129430 avg-key = 12.00 avg-zkey = 1.80 avg-val = 1023.99 avg-zval = 312.16 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129430 bytes = 485376 } seq expand size = 906010 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0404 GB dict = 1.38 MB all = 0.0425 GB } UnZip/Zip{ index = 6.6506 value = 3.2580 dict = 1.00 all = 3.1580 } Zip/UnZip{ index = 0.1504 value = 0.3069 dict = 1.00 all = 0.3167 } ---------------------------- total value len = 10.306511 GB avg = 0.192 KB (by entry num) total key len = 1.469296 GB avg = 0.027 KB total ukey len = 1.014963 GB avg = 0.015 KB total ukey num = 0.066974175 Billion total entry num = 0.053781904 Billion write speed all = 0.460731725 MB/sec (with seq num) write speed all = 0.443897869 MB/sec (without seq num) 2024/11/23-16:01:11.194500 139957282305600 [compaction_job.cc:1948] [default] [JOB 30058] Generated table #268197: 129430 keys, 42501246 bytes, temperature: kWarm 2024/11/23-16:01:11.194570 139957282305600 EVENT_LOG_v1 {"time_micros": 1732348871194534, "cf_name": "default", "job": 30058, "event": "table_file_creation", "file_number": 268197, "file_size": 42501246, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237872082, "largest_seqno": 4091001428, "table_properties": {"data_size": 40402480, "index_size": 233536, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588600, "raw_average_key_size": 20, "raw_value_size": 131629623, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129430, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732348869, "oldest_key_time": 0, "file_creation_time": 1732348869, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 268197, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:01:11.237033 139957282305600 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268198.sst) /dev/shm/ToplingTemp/Topling-105511-kllF6t 2024/11/23-16:01:11.867475 139957282305600 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268198.sst): first pass time = 0.63's, 212.908'MB/sec 2024/11/23-16:01:12.735105 139957282305600 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268198.sst): old prealloc_size = 147639500, real_size = 41033840 2024/11/23-16:01:12.735240 139957282305600 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268198.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129430 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.73 raw-val = 0.1316 GB zip-val = 0.0408 GB avg-val =1017.00 avg-zval = 315.05 2024/11/23-16:01:12.735405 139957282305600 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268198.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:01:12.897786 139957282305600 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268198.sst): second pass time = 0.87's, 151.958'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 263.534'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1981.459'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.275'MB/sec write SST data time = 0.04's, 954.257'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.379'MB, throughput = 44564.912'MB/sec zip my value time = 0.87's, unzip length = 0.132'GB zip my value throughput = 151.958'MB/sec zip pipeline throughput = 151.958'MB/sec entries = 129430 avg-key = 20.00 avg-zkey = 1.73 avg-val = 1017.00 avg-zval = 315.05 usrkeys = 129430 avg-key = 12.00 avg-zkey = 1.73 avg-val = 1024.00 avg-zval = 315.05 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 129430 bytes = 485376 } seq expand size = 906010 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0408 GB dict = 1.38 MB all = 0.0429 GB } UnZip/Zip{ index = 6.9337 value = 3.2280 dict = 1.00 all = 3.1310 } Zip/UnZip{ index = 0.1442 value = 0.3098 dict = 1.00 all = 0.3194 } ---------------------------- total value len = 10.439047 GB avg = 0.194 KB (by entry num) total key len = 1.471884 GB avg = 0.027 KB total ukey len = 1.016516 GB avg = 0.015 KB total ukey num = 0.067103605 Billion total entry num = 0.053911334 Billion write speed all = 0.465986423 MB/sec (with seq num) write speed all = 0.449113217 MB/sec (without seq num) 2024/11/23-16:01:12.952835 139957282305600 [compaction_job.cc:1948] [default] [JOB 30058] Generated table #268198: 129430 keys, 42867210 bytes, temperature: kWarm 2024/11/23-16:01:12.952895 139957282305600 EVENT_LOG_v1 {"time_micros": 1732348872952864, "cf_name": "default", "job": 30058, "event": "table_file_creation", "file_number": 268198, "file_size": 42867210, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237923059, "largest_seqno": 4090993762, "table_properties": {"data_size": 40777312, "index_size": 224000, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588600, "raw_average_key_size": 20, "raw_value_size": 131629761, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129430, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732348871, "oldest_key_time": 0, "file_creation_time": 1732348871, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 268198, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:01:12.992239 139957282305600 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268199.sst) /dev/shm/ToplingTemp/Topling-105511-AN7Wfs 2024/11/23-16:01:13.798747 139957282305600 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268199.sst): first pass time = 0.81's, 166.427'MB/sec 2024/11/23-16:01:14.575661 139957282305600 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268199.sst): old prealloc_size = 147639500, real_size = 40585072 2024/11/23-16:01:14.575784 139957282305600 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268199.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129427 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.80 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1017.02 avg-zval = 311.53 2024/11/23-16:01:14.575938 139957282305600 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268199.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:01:14.736932 139957282305600 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268199.sst): second pass time = 0.78's, 169.703'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 262.770'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2352.855'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.276'MB/sec write SST data time = 0.04's, 961.388'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.379'MB, throughput = 48716.270'MB/sec zip my value time = 0.78's, unzip length = 0.132'GB zip my value throughput = 169.703'MB/sec zip pipeline throughput = 169.703'MB/sec entries = 129427 avg-key = 20.00 avg-zkey = 1.80 avg-val = 1017.02 avg-zval = 311.53 usrkeys = 129427 avg-key = 12.00 avg-zkey = 1.80 avg-val = 1023.05 avg-zval = 311.53 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 111455 bytes = 417968 } seq expand size = 780185 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0424 GB } UnZip/Zip{ index = 6.6816 value = 3.2646 dict = 1.00 all = 3.1677 } Zip/UnZip{ index = 0.1497 value = 0.3063 dict = 1.00 all = 0.3157 } ---------------------------- total value len = 10.571457 GB avg = 0.196 KB (by entry num) total key len = 1.474473 GB avg = 0.027 KB total ukey len = 1.018069 GB avg = 0.015 KB total ukey num = 0.067233032 Billion total entry num = 0.054040761 Billion write speed all = 0.471234023 MB/sec (with seq num) write speed all = 0.454321526 MB/sec (without seq num) 2024/11/23-16:01:14.790434 139957282305600 [compaction_job.cc:1948] [default] [JOB 30058] Generated table #268199: 129427 keys, 42371340 bytes, temperature: kWarm 2024/11/23-16:01:14.790513 139957282305600 EVENT_LOG_v1 {"time_micros": 1732348874790470, "cf_name": "default", "job": 30058, "event": "table_file_creation", "file_number": 268199, "file_size": 42371340, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4091002331, "table_properties": {"data_size": 40320096, "index_size": 232448, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588540, "raw_average_key_size": 20, "raw_value_size": 131630184, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129427, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732348872, "oldest_key_time": 0, "file_creation_time": 1732348872, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 268199, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:01:14.835698 139957282305600 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268200.sst) /dev/shm/ToplingTemp/Topling-105511-RF6P2q 2024/11/23-16:01:15.483393 139957282305600 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268200.sst): first pass time = 0.65's, 207.237'MB/sec 2024/11/23-16:01:16.306277 139957282305600 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268200.sst): old prealloc_size = 147639500, real_size = 40627376 2024/11/23-16:01:16.306392 139957282305600 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268200.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129432 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.70 raw-val = 0.1316 GB zip-val = 0.0404 GB avg-val =1016.98 avg-zval = 311.94 2024/11/23-16:01:16.306506 139957282305600 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268200.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:01:16.467139 139957282305600 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268200.sst): second pass time = 0.82's, 160.134'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 262.139'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2353.363'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.276'MB/sec write SST data time = 0.04's, 966.721'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 48900.142'MB/sec zip my value time = 0.82's, unzip length = 0.132'GB zip my value throughput = 160.134'MB/sec zip pipeline throughput = 160.134'MB/sec entries = 129432 avg-key = 20.00 avg-zkey = 1.70 avg-val = 1016.98 avg-zval = 311.94 usrkeys = 129432 avg-key = 12.00 avg-zkey = 1.70 avg-val = 1019.39 avg-zval = 311.94 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 44599 bytes = 167264 } seq expand size = 312193 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0404 GB dict = 1.38 MB all = 0.0422 GB } UnZip/Zip{ index = 7.0466 value = 3.2602 dict = 1.00 all = 3.1834 } Zip/UnZip{ index = 0.1419 value = 0.3067 dict = 1.00 all = 0.3141 } ---------------------------- total value len = 10.703399 GB avg = 0.198 KB (by entry num) total key len = 1.477062 GB avg = 0.027 KB total ukey len = 1.019622 GB avg = 0.015 KB total ukey num = 0.067362464 Billion total entry num = 0.054170193 Billion write speed all = 0.476464569 MB/sec (with seq num) write speed all = 0.459512712 MB/sec (without seq num) 2024/11/23-16:01:16.520956 139957282305600 [compaction_job.cc:1948] [default] [JOB 30058] Generated table #268200: 129432 keys, 42162389 bytes, temperature: kWarm 2024/11/23-16:01:16.521032 139957282305600 EVENT_LOG_v1 {"time_micros": 1732348876520999, "cf_name": "default", "job": 30058, "event": "table_file_creation", "file_number": 268200, "file_size": 42162389, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4091003670, "table_properties": {"data_size": 40374432, "index_size": 220416, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588640, "raw_average_key_size": 20, "raw_value_size": 131629489, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129432, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732348874, "oldest_key_time": 0, "file_creation_time": 1732348874, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 268200, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:01:16.558668 139957282305600 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268201.sst) /dev/shm/ToplingTemp/Topling-105511-lnkSLp 2024/11/23-16:01:17.355599 139957282305600 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268201.sst): first pass time = 0.80's, 168.427'MB/sec 2024/11/23-16:01:18.229181 139957282305600 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268201.sst): old prealloc_size = 147639500, real_size = 40945040 2024/11/23-16:01:18.229301 139957282305600 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268201.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129428 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.73 raw-val = 0.1316 GB zip-val = 0.0407 GB avg-val =1017.01 avg-zval = 314.38 2024/11/23-16:01:18.229438 139957282305600 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268201.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:01:18.395225 139957282305600 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268201.sst): second pass time = 0.87's, 150.788'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.17's, 257.278'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2256.443'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.266'MB/sec write SST data time = 0.04's, 967.405'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 49863.325'MB/sec zip my value time = 0.87's, unzip length = 0.132'GB zip my value throughput = 150.788'MB/sec zip pipeline throughput = 150.788'MB/sec entries = 129428 avg-key = 20.00 avg-zkey = 1.73 avg-val = 1017.01 avg-zval = 314.38 usrkeys = 129428 avg-key = 12.00 avg-zkey = 1.73 avg-val = 1022.82 avg-zval = 314.38 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 107357 bytes = 402608 } seq expand size = 751499 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0407 GB dict = 1.38 MB all = 0.0427 GB } UnZip/Zip{ index = 6.9515 value = 3.2350 dict = 1.00 all = 3.1422 } Zip/UnZip{ index = 0.1439 value = 0.3091 dict = 1.00 all = 0.3183 } ---------------------------- total value len = 10.835780 GB avg = 0.200 KB (by entry num) total key len = 1.479650 GB avg = 0.027 KB total ukey len = 1.021175 GB avg = 0.015 KB total ukey num = 0.067491892 Billion total entry num = 0.054299621 Billion write speed all = 0.481707856 MB/sec (with seq num) write speed all = 0.464716778 MB/sec (without seq num) 2024/11/23-16:01:18.448166 139957282305600 [compaction_job.cc:1948] [default] [JOB 30058] Generated table #268201: 129428 keys, 42715316 bytes, temperature: kWarm 2024/11/23-16:01:18.448232 139957282305600 EVENT_LOG_v1 {"time_micros": 1732348878448198, "cf_name": "default", "job": 30058, "event": "table_file_creation", "file_number": 268201, "file_size": 42715316, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4090972248, "table_properties": {"data_size": 40689088, "index_size": 223424, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588560, "raw_average_key_size": 20, "raw_value_size": 131629443, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129428, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732348876, "oldest_key_time": 0, "file_creation_time": 1732348876, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 268201, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:01:18.491786 139957282305600 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268202.sst) /dev/shm/ToplingTemp/Topling-105511-3lK6Ms 2024/11/23-16:01:19.228784 139957282305600 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268202.sst): first pass time = 0.74's, 182.123'MB/sec 2024/11/23-16:01:20.081196 139957282305600 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268202.sst): old prealloc_size = 147639500, real_size = 40952912 2024/11/23-16:01:20.081316 139957282305600 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268202.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129427 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.71 raw-val = 0.1316 GB zip-val = 0.0407 GB avg-val =1017.02 avg-zval = 314.45 2024/11/23-16:01:20.081456 139957282305600 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268202.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:01:20.245644 139957282305600 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268202.sst): second pass time = 0.85's, 154.679'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 259.644'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2274.048'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.268'MB/sec write SST data time = 0.04's, 976.345'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.377'MB, throughput = 43362.411'MB/sec zip my value time = 0.85's, unzip length = 0.132'GB zip my value throughput = 154.679'MB/sec zip pipeline throughput = 154.679'MB/sec entries = 129427 avg-key = 20.00 avg-zkey = 1.71 avg-val = 1017.02 avg-zval = 314.45 usrkeys = 129427 avg-key = 12.00 avg-zkey = 1.71 avg-val = 1022.40 avg-zval = 314.45 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 99561 bytes = 373376 } seq expand size = 696927 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0407 GB dict = 1.38 MB all = 0.0427 GB } UnZip/Zip{ index = 6.9996 value = 3.2343 dict = 1.00 all = 3.1438 } Zip/UnZip{ index = 0.1429 value = 0.3092 dict = 1.00 all = 0.3181 } ---------------------------- total value len = 10.968107 GB avg = 0.202 KB (by entry num) total key len = 1.482239 GB avg = 0.027 KB total ukey len = 1.022729 GB avg = 0.015 KB total ukey num = 0.067621319 Billion total entry num = 0.054429048 Billion write speed all = 0.486949714 MB/sec (with seq num) write speed all = 0.469919369 MB/sec (without seq num) 2024/11/23-16:01:20.300396 139957282305600 [compaction_job.cc:1948] [default] [JOB 30058] Generated table #268202: 129427 keys, 42693374 bytes, temperature: kWarm 2024/11/23-16:01:20.300451 139957282305600 EVENT_LOG_v1 {"time_micros": 1732348880300420, "cf_name": "default", "job": 30058, "event": "table_file_creation", "file_number": 268202, "file_size": 42693374, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4090982869, "table_properties": {"data_size": 40698496, "index_size": 221888, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588540, "raw_average_key_size": 20, "raw_value_size": 131629873, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129427, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732348878, "oldest_key_time": 0, "file_creation_time": 1732348878, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 268202, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:01:20.338581 139957282305600 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268203.sst) /dev/shm/ToplingTemp/Topling-105511-wRIHgr 2024/11/23-16:01:20.845556 139957282305600 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268203.sst): first pass time = 0.51's, 264.764'MB/sec 2024/11/23-16:01:21.838600 139957282305600 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268203.sst): old prealloc_size = 147639500, real_size = 40703360 2024/11/23-16:01:21.838729 139957282305600 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268203.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129429 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.77 raw-val = 0.1316 GB zip-val = 0.0404 GB avg-val =1017.00 avg-zval = 312.46 2024/11/23-16:01:21.838866 139957282305600 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268203.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:01:22.004207 139957282305600 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268203.sst): second pass time = 0.99's, 132.650'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.17's, 256.302'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2111.187'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.264'MB/sec write SST data time = 0.04's, 988.228'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 38031.856'MB/sec zip my value time = 0.99's, unzip length = 0.132'GB zip my value throughput = 132.650'MB/sec zip pipeline throughput = 149.342'MB/sec entries = 129429 avg-key = 20.00 avg-zkey = 1.77 avg-val = 1017.00 avg-zval = 312.46 usrkeys = 129429 avg-key = 12.00 avg-zkey = 1.77 avg-val = 1022.32 avg-zval = 312.46 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 98332 bytes = 368752 } seq expand size = 688324 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0404 GB dict = 1.38 MB all = 0.0424 GB } UnZip/Zip{ index = 6.7825 value = 3.2548 dict = 1.00 all = 3.1626 } Zip/UnZip{ index = 0.1474 value = 0.3072 dict = 1.00 all = 0.3162 } ---------------------------- total value len = 11.100425 GB avg = 0.203 KB (by entry num) total key len = 1.484827 GB avg = 0.027 KB total ukey len = 1.024282 GB avg = 0.015 KB total ukey num = 0.067750748 Billion total entry num = 0.054558477 Billion write speed all = 0.492192242 MB/sec (with seq num) write speed all = 0.475122574 MB/sec (without seq num) 2024/11/23-16:01:22.055878 139957282305600 [compaction_job.cc:1948] [default] [JOB 30058] Generated table #268203: 129429 keys, 42439693 bytes, temperature: kWarm 2024/11/23-16:01:22.055947 139957282305600 EVENT_LOG_v1 {"time_micros": 1732348882055911, "cf_name": "default", "job": 30058, "event": "table_file_creation", "file_number": 268203, "file_size": 42439693, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4091000757, "table_properties": {"data_size": 40441840, "index_size": 228992, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588580, "raw_average_key_size": 20, "raw_value_size": 131629752, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129429, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732348880, "oldest_key_time": 0, "file_creation_time": 1732348880, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 268203, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:01:22.097693 139957282305600 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268204.sst) /dev/shm/ToplingTemp/Topling-105511-9AnxYs 2024/11/23-16:01:22.671125 139957282305600 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268204.sst): first pass time = 0.57's, 234.077'MB/sec 2024/11/23-16:01:23.476935 139957282305600 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268204.sst): old prealloc_size = 147639500, real_size = 40460208 2024/11/23-16:01:23.477071 139957282305600 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268204.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129429 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.72 raw-val = 0.1316 GB zip-val = 0.0402 GB avg-val =1017.00 avg-zval = 310.64 2024/11/23-16:01:23.477152 139957282305600 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268204.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:01:23.635283 139957282305600 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268204.sst): second pass time = 0.81's, 163.510'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 264.875'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1953.554'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.277'MB/sec write SST data time = 0.04's, 1009.107'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 48455.879'MB/sec zip my value time = 0.81's, unzip length = 0.132'GB zip my value throughput = 163.510'MB/sec zip pipeline throughput = 163.510'MB/sec entries = 129429 avg-key = 20.00 avg-zkey = 1.72 avg-val = 1017.00 avg-zval = 310.64 usrkeys = 129429 avg-key = 12.00 avg-zkey = 1.72 avg-val = 1018.56 avg-zval = 310.64 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 28822 bytes = 108096 } seq expand size = 201754 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0402 GB dict = 1.38 MB all = 0.0419 GB } UnZip/Zip{ index = 6.9936 value = 3.2739 dict = 1.00 all = 3.2006 } Zip/UnZip{ index = 0.1430 value = 0.3054 dict = 1.00 all = 0.3124 } ---------------------------- total value len = 11.232256 GB avg = 0.205 KB (by entry num) total key len = 1.487416 GB avg = 0.027 KB total ukey len = 1.025835 GB avg = 0.015 KB total ukey num = 0.067880177 Billion total entry num = 0.054687906 Billion write speed all = 0.497417494 MB/sec (with seq num) write speed all = 0.480308423 MB/sec (without seq num) 2024/11/23-16:01:23.687021 139957282305600 [compaction_job.cc:1948] [default] [JOB 30058] Generated table #268204: 129429 keys, 41935761 bytes, temperature: kWarm 2024/11/23-16:01:23.687092 139957282305600 EVENT_LOG_v1 {"time_micros": 1732348883687058, "cf_name": "default", "job": 30058, "event": "table_file_creation", "file_number": 268204, "file_size": 41935761, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4090991438, "table_properties": {"data_size": 40205600, "index_size": 222080, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588580, "raw_average_key_size": 20, "raw_value_size": 131629601, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129429, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732348882, "oldest_key_time": 0, "file_creation_time": 1732348882, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 268204, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:01:23.729268 139957282305600 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268205.sst) /dev/shm/ToplingTemp/Topling-105511-Ed3cSt 2024/11/23-16:01:24.226702 139957282305600 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268205.sst): first pass time = 0.50's, 269.844'MB/sec 2024/11/23-16:01:25.177586 139957282305600 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268205.sst): old prealloc_size = 147639500, real_size = 40593024 2024/11/23-16:01:25.177743 139957282305600 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268205.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129427 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.72 raw-val = 0.1316 GB zip-val = 0.0403 GB avg-val =1017.02 avg-zval = 311.67 2024/11/23-16:01:25.177852 139957282305600 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268205.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:01:25.349328 139957282305600 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268205.sst): second pass time = 0.95's, 138.547'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.17's, 244.966'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1698.145'MB/sec (index lex order gen) rebuild zvType time = 0.13's, 0.255'MB/sec write SST data time = 0.04's, 945.119'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 47942.554'MB/sec zip my value time = 0.95's, unzip length = 0.132'GB zip my value throughput = 138.547'MB/sec zip pipeline throughput = 198.380'MB/sec entries = 129427 avg-key = 20.00 avg-zkey = 1.72 avg-val = 1017.02 avg-zval = 311.67 usrkeys = 129427 avg-key = 12.00 avg-zkey = 1.72 avg-val = 1018.56 avg-zval = 311.67 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 28566 bytes = 107136 } seq expand size = 199962 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0403 GB dict = 1.38 MB all = 0.0421 GB } UnZip/Zip{ index = 6.9935 value = 3.2631 dict = 1.00 all = 3.1905 } Zip/UnZip{ index = 0.1430 value = 0.3065 dict = 1.00 all = 0.3134 } ---------------------------- total value len = 11.364086 GB avg = 0.207 KB (by entry num) total key len = 1.490004 GB avg = 0.027 KB total ukey len = 1.027388 GB avg = 0.015 KB total ukey num = 0.068009604 Billion total entry num = 0.054817333 Billion write speed all = 0.502640382 MB/sec (with seq num) write speed all = 0.485491969 MB/sec (without seq num) 2024/11/23-16:01:25.403172 139957282305600 [compaction_job.cc:1948] [default] [JOB 30058] Generated table #268205: 129427 keys, 42067724 bytes, temperature: kWarm 2024/11/23-16:01:25.403242 139957282305600 EVENT_LOG_v1 {"time_micros": 1732348885403207, "cf_name": "default", "job": 30058, "event": "table_file_creation", "file_number": 268205, "file_size": 42067724, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4090999386, "table_properties": {"data_size": 40338416, "index_size": 222080, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588540, "raw_average_key_size": 20, "raw_value_size": 131629707, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129427, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732348883, "oldest_key_time": 0, "file_creation_time": 1732348883, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 268205, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:01:25.444999 139957282305600 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268206.sst) /dev/shm/ToplingTemp/Topling-105511-RvNKft 2024/11/23-16:01:26.018317 139957282305600 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268206.sst): first pass time = 0.57's, 234.126'MB/sec 2024/11/23-16:01:26.827111 139957282305600 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268206.sst): old prealloc_size = 147639500, real_size = 40457232 2024/11/23-16:01:26.827233 139957282305600 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268206.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129431 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.72 raw-val = 0.1316 GB zip-val = 0.0402 GB avg-val =1016.99 avg-zval = 310.61 2024/11/23-16:01:26.827316 139957282305600 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268206.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:01:26.989072 139957282305600 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268206.sst): second pass time = 0.81's, 163.060'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 258.923'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2225.853'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.272'MB/sec write SST data time = 0.04's, 977.708'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 49474.512'MB/sec zip my value time = 0.81's, unzip length = 0.132'GB zip my value throughput = 163.060'MB/sec zip pipeline throughput = 163.060'MB/sec entries = 129431 avg-key = 20.00 avg-zkey = 1.72 avg-val = 1016.99 avg-zval = 310.61 usrkeys = 129431 avg-key = 12.00 avg-zkey = 1.72 avg-val = 1018.49 avg-zval = 310.61 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 27803 bytes = 104272 } seq expand size = 194621 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0402 GB dict = 1.38 MB all = 0.0419 GB } UnZip/Zip{ index = 6.9938 value = 3.2742 dict = 1.00 all = 3.2011 } Zip/UnZip{ index = 0.1430 value = 0.3054 dict = 1.00 all = 0.3124 } ---------------------------- total value len = 11.495910 GB avg = 0.209 KB (by entry num) total key len = 1.492593 GB avg = 0.027 KB total ukey len = 1.028941 GB avg = 0.015 KB total ukey num = 0.068139035 Billion total entry num = 0.054946764 Billion write speed all = 0.507863853 MB/sec (with seq num) write speed all = 0.490676052 MB/sec (without seq num) 2024/11/23-16:01:27.043484 139957282305600 [compaction_job.cc:1948] [default] [JOB 30058] Generated table #268206: 129431 keys, 41929329 bytes, temperature: kWarm 2024/11/23-16:01:27.043555 139957282305600 EVENT_LOG_v1 {"time_micros": 1732348887043519, "cf_name": "default", "job": 30058, "event": "table_file_creation", "file_number": 268206, "file_size": 41929329, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4090926808, "table_properties": {"data_size": 40202624, "index_size": 222080, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588620, "raw_average_key_size": 20, "raw_value_size": 131630042, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129431, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732348885, "oldest_key_time": 0, "file_creation_time": 1732348885, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 268206, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:01:27.087922 139957282305600 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268207.sst) /dev/shm/ToplingTemp/Topling-105511-8bVzDt 2024/11/23-16:01:27.737344 139957282305600 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268207.sst): first pass time = 0.65's, 206.686'MB/sec 2024/11/23-16:01:28.617956 139957282305600 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268207.sst): old prealloc_size = 147639500, real_size = 40828576 2024/11/23-16:01:28.618098 139957282305600 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268207.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129428 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.72 raw-val = 0.1316 GB zip-val = 0.0406 GB avg-val =1017.01 avg-zval = 313.49 2024/11/23-16:01:28.618259 139957282305600 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268207.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:01:28.881381 139957282305600 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268207.sst): second pass time = 0.88's, 149.635'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.26's, 161.522'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2005.780'MB/sec (index lex order gen) rebuild zvType time = 0.21's, 0.155'MB/sec write SST data time = 0.05's, 781.431'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 43056.913'MB/sec zip my value time = 0.88's, unzip length = 0.132'GB zip my value throughput = 149.635'MB/sec zip pipeline throughput = 149.635'MB/sec entries = 129428 avg-key = 20.00 avg-zkey = 1.72 avg-val = 1017.01 avg-zval = 313.49 usrkeys = 129428 avg-key = 12.00 avg-zkey = 1.72 avg-val = 1022.02 avg-zval = 313.49 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 92666 bytes = 347520 } seq expand size = 648662 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0406 GB dict = 1.38 MB all = 0.0425 GB } UnZip/Zip{ index = 6.9936 value = 3.2442 dict = 1.00 all = 3.1548 } Zip/UnZip{ index = 0.1430 value = 0.3082 dict = 1.00 all = 0.3170 } ---------------------------- total value len = 11.628189 GB avg = 0.211 KB (by entry num) total key len = 1.495182 GB avg = 0.027 KB total ukey len = 1.030494 GB avg = 0.015 KB total ukey num = 0.068268463 Billion total entry num = 0.055076192 Billion write speed all = 0.513099334 MB/sec (with seq num) write speed all = 0.495872322 MB/sec (without seq num) 2024/11/23-16:01:28.935027 139957282305600 [compaction_job.cc:1948] [default] [JOB 30058] Generated table #268207: 129428 keys, 42544183 bytes, temperature: kWarm 2024/11/23-16:01:28.935096 139957282305600 EVENT_LOG_v1 {"time_micros": 1732348888935061, "cf_name": "default", "job": 30058, "event": "table_file_creation", "file_number": 268207, "file_size": 42544183, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4091004255, "table_properties": {"data_size": 40573968, "index_size": 222080, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588560, "raw_average_key_size": 20, "raw_value_size": 131629972, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129428, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732348887, "oldest_key_time": 0, "file_creation_time": 1732348887, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 268207, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:01:28.972194 139957282305600 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268208.sst) /dev/shm/ToplingTemp/Topling-105511-0zgbZq 2024/11/23-16:01:28.980606 139957282305600 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268208.sst): first pass time = 0.01's, 375.227'MB/sec 2024/11/23-16:01:29.013276 139957282305600 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268208.sst): old prealloc_size = 147639500, real_size = 996840 2024/11/23-16:01:29.013315 139957282305600 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268208.sst): index type = UintIndex_IL_256_32 , store type = DictZipBlobStore usrkeys = 3031 prefix = 4 raw-key = 0.0000 GB zip-key = 0.0000 GB avg-key = 8.00 avg-zkey = 0.28 raw-val = 0.0031 GB zip-val = 0.0010 GB avg-val =1017.10 avg-zval = 328.30 2024/11/23-16:01:29.016706 139957282305600 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00/268208.sst): second pass time = 0.03's, 99.407'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.00's, 305.135'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 36.168'MB/sec (index lex order gen) rebuild zvType time = 0.00's, 0.316'MB/sec write SST data time = 0.00's, 1050.699'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.033'MB, throughput = 1562.788'MB/sec zip my value time = 0.03's, unzip length = 0.003'GB zip my value throughput = 99.407'MB/sec zip pipeline throughput = 99.407'MB/sec entries = 3031 avg-key = 20.00 avg-zkey = 0.30 avg-val = 1017.10 avg-zval = 328.30 usrkeys = 3031 avg-key = 12.00 avg-zkey = 0.30 avg-val = 1024.10 avg-zval = 328.30 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 3031 bytes = 11376 } seq expand size = 21217 multi value expand size = 0 cnt WriteAppend = 11 UnZipSize{ index = 0.0000 GB value = 0.0031 GB dict = 0.03 MB all = 0.0031 GB } __ZipSize{ index = 0.0000 GB value = 0.0010 GB dict = 0.03 MB all = 0.0010 GB } UnZip/Zip{ index = 40.5938 value = 3.0981 dict = 1.00 all = 3.0194 } Zip/UnZip{ index = 0.0246 value = 0.3228 dict = 1.00 all = 0.3312 } ---------------------------- total value len = 11.631293 GB avg = 0.211 KB (by entry num) total key len = 1.495242 GB avg = 0.027 KB total ukey len = 1.030531 GB avg = 0.015 KB total ukey num = 0.068271494 Billion total entry num = 0.055079223 Billion write speed all = 0.513220351 MB/sec (with seq num) write speed all = 0.495992483 MB/sec (without seq num) 2024/11/23-16:01:29.025380 139957282305600 [compaction_job.cc:1948] [default] [JOB 30058] Generated table #268208: 3031 keys, 1041094 bytes, temperature: kWarm 2024/11/23-16:01:29.025427 139957282305600 EVENT_LOG_v1 {"time_micros": 1732348889025401, "cf_name": "default", "job": 30058, "event": "table_file_creation", "file_number": 268208, "file_size": 1041094, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3454830439, "largest_seqno": 4091003324, "table_properties": {"data_size": 995088, "index_size": 896, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 60620, "raw_average_key_size": 20, "raw_value_size": 3082845, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 3031, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-UintIndex_IL_256_32-DictZipBlobStore", "creation_time": 1732348888, "oldest_key_time": 0, "file_creation_time": 1732348888, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 268208, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:01:29.034242 139957282305600 [compaction_job.cc:703] job-30058: subcompact[0], size: 0.893236 G, files: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30058/att-00 [268187,268188,268189,268190,268191,268192,268193,268194,268195,268196,268197,268198,268199,268200,268201,268202,268203,268204,268205,268206,268207,268208] 2024/11/23-16:01:29.195968 139957282305600 (Original Log Time 2024/11/23-16:00:50.559344) EVENT_LOG_v1 {"time_micros": 1732348850559288, "job": 30058, "event": "compaction_started", "compaction_reason": "FilesMarkedForCompaction", "files_L2": [268168], "files_L3": [268079, 268080, 268081, 268082, 268083, 268084, 268085, 268086, 268087, 268088, 268089, 268090, 268091, 268092, 268093, 268094, 268095, 268096, 268097, 268098, 268183], "score": 0.991354, "input_data_size": 924926731, "oldest_snapshot_seqno": 4091182935} 2024/11/23-16:01:29.195987 139957282305600 (Original Log Time 2024/11/23-16:01:29.193923) [compaction_job.cc:2022] [default] [JOB 30058] Compacted 1@2 + 21@3 files to L3 => 893236213 bytes 2024/11/23-16:01:29.195989 139957282305600 (Original Log Time 2024/11/23-16:01:29.195488) [compaction_job.cc:1224] [default] compacted to: files[0 0 0 22 0 0 0] max score 0.03, MB/sec: 24.0 rd, 23.2 wr, level 3, files in(1, 21) out(22 +0 blob) MB in(31.2, 850.9 +0.0 blob) out(851.9 +0.0 blob), read-write-amplify(55.6) write-amplify(27.3) OK, records in: 2749934, records dropped: 28875 output_compression: Snappy 2024/11/23-16:01:29.195993 139957282305600 (Original Log Time 2024/11/23-16:01:29.195941) EVENT_LOG_v1 {"time_micros": 1732348889195511, "cf": "default", "job": 30058, "event": "compaction_finished", "compaction_time_micros": 38474901, "compaction_time_cpu_micros": 8036696, "output_level": 3, "num_output_files": 22, "total_output_size": 893236213, "num_input_records": 2749934, "num_output_records": 2721059, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "file_write_nanos": 632256652, "file_range_sync_nanos": 0, "file_fsync_nanos": 21068, "file_prepare_write_nanos": 51122, "lsm_state": [0, 0, 0, 22, 0, 0, 0]} 2024/11/23-16:01:29.326037 139957282305600 DEBG dcompact_worker.cpp:240: HttpPost: 200 OK: url = http://nlb-7zny4kaa1poal01o64.cn-shenzhen.nlb.aliyuncs.com:8443, body = {"instanceId":"nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137","labourId":"","dbId":"d89b4006-2803-486e-b7a2-759bcf348921","dbStarts":1732256054,"starts":1732348850,"executesMs":38797,"compactionJobId":30058,"attempt":0,"compactionInputRawBytes":2851670239,"compactionInputZipBytes":924926731,"compactionOutputRawBytes":0,"compactionOutputZipBytes":893236213,"headers":{"Accept":"*/*","Connection":"close","Host":"aliyun-topling-saas.topling.cn:18443","RemoteIp":"120.24.192.169","X-Forwarded-For":"120.24.192.169","region":"cn-shenzhen","token":"e6474c481bd4415abc537135cc03626b","instance-token":"e6474c481bd4415abc537135cc03626b","provider":"aliyun","CloudMarketInstanceId":"si-59c0ae5c955845588903","MeteringAssit":"","Transfer-Encoding":"chunked","traceparent":"00-2213c911786c70577998d5adab23e1ac-61a599c0c7908357-00"}}, response = 2024/11/23-16:01:29.326102 139957282305600 INFO dcompact_worker.cpp:1459: finish /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-30058/att-00: olev 3, work 38.798 s, result 7.764 ms, install 2.085 ms, input{raw 2.656 GiB zip 882.079 MiB}