2024/11/24-06:28:06.439060 139957349447232 DEBG dcompact_worker.cpp:2214: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00: fork to child time = 0.008299 sec 2024/11/24-06:28:06.439887 139957349447232 DEBG dcompact_worker.cpp:1013: Beg SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00 2024/11/24-06:28:06.446661 139957349447232 DEBG dcompact_worker.cpp:1033: End SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00 2024/11/24-06:28:06.447544 139957349447232 TRAC dcompact_worker.cpp:1083: INFO_LOG_LEVEL: rpc = INFO_LEVEL, env_var = undefined 2024/11/24-06:28:06.447754 139957349447232 [WARN] [column_family.cc:386] multiple cf_paths/db_paths and level_compaction_dynamic_level_bytes can't be used together 2024/11/24-06:28:06.498655 139957349447232 [version_set.cc:6208] Recovering from manifest file: /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-42827/att-00/MANIFEST-206347 2024/11/24-06:28:06.519940 139957349447232 [version_set.cc:6251] Recovered from manifest file:/worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-42827/att-00/MANIFEST-206347 succeeded,manifest_file_number is 206347, next_file_number is 294964, last_sequence is 4478912294, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 294762 2024/11/24-06:28:06.519947 139957349447232 [version_set.cc:6266] Column family [default] (ID 0), log number is 0 2024/11/24-06:28:06.520095 139957349447232 [version_set.cc:5721] Creating manifest 294964 2024/11/24-06:28:06.554636 139957349447232 DEBG dcompact_worker.cpp:1218: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00: bottommost_level: fake = 1, rpc = 0 2024/11/24-06:28:06.573360 139957349447232 [compaction_job.cc:2437] [default] [JOB 42827] Compacting 1@2 + 22@3 files to L3, score 0.96, subcompactions 1 : 1 2024/11/24-06:28:06.573383 139957349447232 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 32103 Base level 2, inputs: [294900(27MB)], [294935(34MB) 294936(6717KB) 294850(33MB) 294851(14MB) 294852(33MB) 294853(35MB) 294854(33MB) 294855(35MB) 294856(33MB) 294857(35MB) 294858(33MB) 294859(33MB) 294860(35MB) 294861(33MB) 294862(35MB) 294863(33MB) 294864(35MB) 294865(33MB) 294866(33MB) 294867(35MB) 294868(33MB) 294937(35MB)] 2024/11/24-06:28:06.580259 139957349447232 [top_zip_table.cc:59] core git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/24-06:28:06.580289 139957349447232 [top_zip_table.cc:60] fsa git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/24-06:28:06.580308 139957349447232 [top_zip_table.cc:61] zbs git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/24-06:28:06.580313 139957349447232 [top_zip_table.cc:62] topling-zip_table_reader: git_version_hash_info_is: commit a4a382006cb82713acf5b3425835f22711877681 Author: leipeng Date: 2024-04-11 19:44:14 +0800 fixed_len_hole_index.cc: Add env bool FixedLenHoleIndexUseAVX512 for ut & debug 1. FixedLenHoleIndexUseAVX512 is only in unit tests or debug 2. In release mode, use avx512 by compile options(-march=) g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/24-06:28:06.580324 139957349447232 [top_zip_table.cc:64] topling-rocks git_version_hash_info_is: commit feab587e468621ba0204d47b4ffacc52e7c4290d Author: leipeng Date: 2024-03-22 13:35:06 +0800 ToplingZipTableBuilder::Add: immediately return after error This function returns void, and caller does not check builder->status() after calling this function and graceful abandon. So immediately return after error, and return error status in Finish(). g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/24-06:28:07.142656 139957349447232 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294965.sst) /dev/shm/ToplingTemp/Topling-289065-aQsAZV 2024/11/24-06:28:07.733431 139957349447232 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294965.sst): first pass time = 0.59's, 227.207'MB/sec 2024/11/24-06:28:09.346074 139957349447232 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294965.sst): old prealloc_size = 147639500, real_size = 32206000 2024/11/24-06:28:09.346630 139957349447232 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294965.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927907 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0302 GB avg-val = 116.65 avg-zval = 32.56 2024/11/24-06:28:09.347447 139957349447232 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294965.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-06:28:10.421948 139957349447232 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294965.sst): second pass time = 1.61's, 67.196'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.08's, 33.747'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3302.935'MB/sec (index lex order gen) rebuild zvType time = 0.94's, 0.246'MB/sec write SST data time = 0.13's, 273.169'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 36222.699'MB/sec zip my value time = 1.61's, unzip length = 0.108'GB zip my value throughput = 67.196'MB/sec zip pipeline throughput = 67.196'MB/sec entries = 927907 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.65 avg-zval = 32.56 usrkeys = 927907 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.65 avg-zval = 32.56 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 927907 bytes = 3247696 } seq expand size = 6495349 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0302 GB dict = 1.08 MB all = 0.0363 GB } UnZip/Zip{ index = 10.5123 value = 3.5830 dict = 1.00 all = 3.6967 } Zip/UnZip{ index = 0.0951 value = 0.2791 dict = 1.00 all = 0.2705 } ---------------------------- total value len = 2251.440305 GB avg = 0.200 KB (by entry num) total key len = 306.908944 GB avg = 0.027 KB total ukey len = 237.373285 GB avg = 0.015 KB total ukey num = 15.739589070 Billion total entry num = 11.280903018 Billion write speed all = 32.977679403 MB/sec (with seq num) write speed all = 31.814373014 MB/sec (without seq num) 2024/11/24-06:28:10.472317 139957349447232 [compaction_job.cc:1948] [default] [JOB 42827] Generated table #294965: 927907 keys, 36307616 bytes, temperature: kWarm 2024/11/24-06:28:10.472406 139957349447232 EVENT_LOG_v1 {"time_micros": 1732400890472344, "cf_name": "default", "job": 42827, "event": "table_file_creation", "file_number": 294965, "file_size": 36307616, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4261178599, "largest_seqno": 4478441051, "table_properties": {"data_size": 30208480, "index_size": 1765376, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25981396, "raw_average_key_size": 28, "raw_value_size": 108236446, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927907, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732400887, "oldest_key_time": 0, "file_creation_time": 1732400887, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 294965, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-06:28:10.509099 139957349447232 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294966.sst) /dev/shm/ToplingTemp/Topling-289065-eq5ehY 2024/11/24-06:28:11.576749 139957349447232 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294966.sst): first pass time = 1.07's, 125.717'MB/sec 2024/11/24-06:28:12.877642 139957349447232 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294966.sst): old prealloc_size = 147639500, real_size = 31425600 2024/11/24-06:28:12.878203 139957349447232 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294966.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 919300 prefix = 4 raw-key = 0.0147 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.93 raw-val = 0.1085 GB zip-val = 0.0294 GB avg-val = 118.00 avg-zval = 32.01 2024/11/24-06:28:12.878965 139957349447232 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294966.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-06:28:13.692431 139957349447232 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294966.sst): second pass time = 1.30's, 83.440'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.81's, 43.574'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3307.922'MB/sec (index lex order gen) rebuild zvType time = 0.69's, 0.335'MB/sec write SST data time = 0.13's, 278.345'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.085'MB, throughput = 25571.163'MB/sec zip my value time = 1.30's, unzip length = 0.108'GB zip my value throughput = 83.440'MB/sec zip pipeline throughput = 83.440'MB/sec entries = 919300 avg-key = 28.00 avg-zkey = 1.93 avg-val = 118.00 avg-zval = 32.01 usrkeys = 919300 avg-key = 20.00 avg-zkey = 1.93 avg-val = 125.00 avg-zval = 32.01 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 919300 bytes = 3217568 } seq expand size = 6435100 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0184 GB value = 0.1085 GB dict = 1.09 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0294 GB dict = 1.09 MB all = 0.0355 GB } UnZip/Zip{ index = 10.3772 value = 3.6867 dict = 1.00 all = 3.7805 } Zip/UnZip{ index = 0.0964 value = 0.2712 dict = 1.00 all = 0.2645 } ---------------------------- total value len = 2251.555217 GB avg = 0.200 KB (by entry num) total key len = 306.934684 GB avg = 0.027 KB total ukey len = 237.391671 GB avg = 0.015 KB total ukey num = 15.740508370 Billion total entry num = 11.281822318 Billion write speed all = 32.978102189 MB/sec (with seq num) write speed all = 31.814750044 MB/sec (without seq num) 2024/11/24-06:28:13.736424 139957349447232 [compaction_job.cc:1948] [default] [JOB 42827] Generated table #294966: 919300 keys, 35502194 bytes, temperature: kWarm 2024/11/24-06:28:13.736491 139957349447232 EVENT_LOG_v1 {"time_micros": 1732400893736455, "cf_name": "default", "job": 42827, "event": "table_file_creation", "file_number": 294966, "file_size": 35502194, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4287209206, "largest_seqno": 4439183620, "table_properties": {"data_size": 29423792, "index_size": 1771776, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25740400, "raw_average_key_size": 28, "raw_value_size": 108477400, "raw_average_value_size": 118, "num_data_blocks": 1, "num_entries": 919300, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 118, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732400890, "oldest_key_time": 0, "file_creation_time": 1732400890, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 294966, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-06:28:13.775211 139957349447232 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294967.sst) /dev/shm/ToplingTemp/Topling-289065-lrj7tX 2024/11/24-06:28:14.768780 139957349447232 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294967.sst): first pass time = 0.99's, 80.851'MB/sec 2024/11/24-06:28:15.551432 139957349447232 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294967.sst): old prealloc_size = 147639500, real_size = 19450048 2024/11/24-06:28:15.551775 139957349447232 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294967.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 558835 prefix = 4 raw-key = 0.0089 GB zip-key = 0.0011 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.0647 GB zip-val = 0.0182 GB avg-val = 115.74 avg-zval = 32.64 2024/11/24-06:28:15.552251 139957349447232 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294967.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0014 GB, waited 0.000 sec, Key+Value = 0.080 GB 2024/11/24-06:28:16.071321 139957349447232 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294967.sst): second pass time = 0.78's, 82.759'MB/sec, value only(80.5% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.52's, 41.894'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3328.265'MB/sec (index lex order gen) rebuild zvType time = 0.44's, 0.316'MB/sec write SST data time = 0.08's, 280.590'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.650'MB, throughput = 21191.091'MB/sec zip my value time = 0.78's, unzip length = 0.065'GB zip my value throughput = 82.759'MB/sec zip pipeline throughput = 82.759'MB/sec entries = 558835 avg-key = 28.00 avg-zkey = 1.92 avg-val = 115.74 avg-zval = 32.64 usrkeys = 558835 avg-key = 20.00 avg-zkey = 1.92 avg-val = 122.74 avg-zval = 32.64 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 558835 bytes = 1816224 } seq expand size = 3911845 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0112 GB value = 0.0647 GB dict = 0.65 MB all = 0.0803 GB } __ZipSize{ index = 0.0011 GB value = 0.0182 GB dict = 0.65 MB all = 0.0218 GB } UnZip/Zip{ index = 10.4416 value = 3.5461 dict = 1.00 all = 3.6882 } Zip/UnZip{ index = 0.0958 value = 0.2820 dict = 1.00 all = 0.2711 } ---------------------------- total value len = 2251.623809 GB avg = 0.200 KB (by entry num) total key len = 306.950332 GB avg = 0.027 KB total ukey len = 237.402848 GB avg = 0.015 KB total ukey num = 15.741067205 Billion total entry num = 11.282381153 Billion write speed all = 32.978176782 MB/sec (with seq num) write speed all = 31.814802684 MB/sec (without seq num) 2024/11/24-06:28:16.100500 139957349447232 [compaction_job.cc:1948] [default] [JOB 42827] Generated table #294967: 558835 keys, 21779269 bytes, temperature: kWarm 2024/11/24-06:28:16.100571 139957349447232 EVENT_LOG_v1 {"time_micros": 1732400896100535, "cf_name": "default", "job": 42827, "event": "table_file_creation", "file_number": 294967, "file_size": 21779269, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4432457321, "largest_seqno": 4478441250, "table_properties": {"data_size": 18239728, "index_size": 1070400, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 15647380, "raw_average_key_size": 28, "raw_value_size": 64679726, "raw_average_value_size": 115, "num_data_blocks": 1, "num_entries": 558835, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732400893, "oldest_key_time": 0, "file_creation_time": 1732400893, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 294967, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-06:28:16.129242 139957349447232 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294968.sst) /dev/shm/ToplingTemp/Topling-289065-c9OfxX 2024/11/24-06:28:17.105800 139957349447232 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294968.sst): first pass time = 0.98's, 137.445'MB/sec 2024/11/24-06:28:18.411568 139957349447232 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294968.sst): old prealloc_size = 147639500, real_size = 31398672 2024/11/24-06:28:18.412151 139957349447232 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294968.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 919300 prefix = 4 raw-key = 0.0147 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1085 GB zip-val = 0.0294 GB avg-val = 118.00 avg-zval = 31.99 2024/11/24-06:28:18.412924 139957349447232 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294968.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-06:28:19.225617 139957349447232 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294968.sst): second pass time = 1.30's, 83.128'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.81's, 43.580'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3166.017'MB/sec (index lex order gen) rebuild zvType time = 0.69's, 0.335'MB/sec write SST data time = 0.13's, 278.285'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.085'MB, throughput = 32824.384'MB/sec zip my value time = 1.30's, unzip length = 0.108'GB zip my value throughput = 83.128'MB/sec zip pipeline throughput = 83.128'MB/sec entries = 919300 avg-key = 28.00 avg-zkey = 1.91 avg-val = 118.00 avg-zval = 31.99 usrkeys = 919300 avg-key = 20.00 avg-zkey = 1.91 avg-val = 125.00 avg-zval = 31.99 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 919300 bytes = 3217568 } seq expand size = 6435100 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0184 GB value = 0.1085 GB dict = 1.09 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0294 GB dict = 1.09 MB all = 0.0355 GB } UnZip/Zip{ index = 10.4458 value = 3.6886 dict = 1.00 all = 3.7834 } Zip/UnZip{ index = 0.0957 value = 0.2711 dict = 1.00 all = 0.2643 } ---------------------------- total value len = 2251.738722 GB avg = 0.200 KB (by entry num) total key len = 306.976072 GB avg = 0.027 KB total ukey len = 237.421234 GB avg = 0.015 KB total ukey num = 15.741986505 Billion total entry num = 11.283300453 Billion write speed all = 32.978648899 MB/sec (with seq num) write speed all = 31.815227309 MB/sec (without seq num) 2024/11/24-06:28:19.269369 139957349447232 [compaction_job.cc:1948] [default] [JOB 42827] Generated table #294968: 919300 keys, 35475378 bytes, temperature: kWarm 2024/11/24-06:28:19.269452 139957349447232 EVENT_LOG_v1 {"time_micros": 1732400899269413, "cf_name": "default", "job": 42827, "event": "table_file_creation", "file_number": 294968, "file_size": 35475378, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4261178645, "largest_seqno": 4414357721, "table_properties": {"data_size": 29408512, "index_size": 1760128, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25740400, "raw_average_key_size": 28, "raw_value_size": 108477400, "raw_average_value_size": 118, "num_data_blocks": 1, "num_entries": 919300, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 118, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732400896, "oldest_key_time": 0, "file_creation_time": 1732400896, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 294968, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-06:28:19.305878 139957349447232 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294969.sst) /dev/shm/ToplingTemp/Topling-289065-KbxwAY 2024/11/24-06:28:19.857871 139957349447232 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294969.sst): first pass time = 0.55's, 243.168'MB/sec 2024/11/24-06:28:21.196017 139957349447232 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294969.sst): old prealloc_size = 147639500, real_size = 32670096 2024/11/24-06:28:21.196536 139957349447232 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294969.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927852 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0307 GB avg-val = 116.65 avg-zval = 33.06 2024/11/24-06:28:21.197320 139957349447232 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294969.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-06:28:22.040426 139957349447232 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294969.sst): second pass time = 1.34's, 80.932'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.84's, 43.548'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3613.318'MB/sec (index lex order gen) rebuild zvType time = 0.71's, 0.325'MB/sec write SST data time = 0.13's, 284.764'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 34906.376'MB/sec zip my value time = 1.34's, unzip length = 0.108'GB zip my value throughput = 80.932'MB/sec zip pipeline throughput = 80.932'MB/sec entries = 927852 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.65 avg-zval = 33.06 usrkeys = 927852 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.65 avg-zval = 33.06 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 927852 bytes = 3247504 } seq expand size = 6494964 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0307 GB dict = 1.08 MB all = 0.0368 GB } UnZip/Zip{ index = 10.5120 value = 3.5288 dict = 1.00 all = 3.6500 } Zip/UnZip{ index = 0.0951 value = 0.2834 dict = 1.00 all = 0.2740 } ---------------------------- total value len = 2251.853455 GB avg = 0.200 KB (by entry num) total key len = 307.002052 GB avg = 0.027 KB total ukey len = 237.439791 GB avg = 0.015 KB total ukey num = 15.742914357 Billion total entry num = 11.284228305 Billion write speed all = 32.979266048 MB/sec (with seq num) write speed all = 31.815790997 MB/sec (without seq num) 2024/11/24-06:28:22.086530 139957349447232 [compaction_job.cc:1948] [default] [JOB 42827] Generated table #294969: 927852 keys, 36771580 bytes, temperature: kWarm 2024/11/24-06:28:22.086602 139957349447232 EVENT_LOG_v1 {"time_micros": 1732400902086566, "cf_name": "default", "job": 42827, "event": "table_file_creation", "file_number": 294969, "file_size": 36771580, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4261178655, "largest_seqno": 4478441291, "table_properties": {"data_size": 30672640, "index_size": 1765312, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25979856, "raw_average_key_size": 28, "raw_value_size": 108238008, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927852, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732400899, "oldest_key_time": 0, "file_creation_time": 1732400899, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 294969, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-06:28:22.124397 139957349447232 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294970.sst) /dev/shm/ToplingTemp/Topling-289065-WxVNqW 2024/11/24-06:28:23.055141 139957349447232 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294970.sst): first pass time = 0.93's, 144.211'MB/sec 2024/11/24-06:28:24.418699 139957349447232 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294970.sst): old prealloc_size = 147639500, real_size = 31414016 2024/11/24-06:28:24.419263 139957349447232 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294970.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 919300 prefix = 4 raw-key = 0.0147 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1085 GB zip-val = 0.0294 GB avg-val = 118.00 avg-zval = 32.01 2024/11/24-06:28:24.420050 139957349447232 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294970.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-06:28:25.232805 139957349447232 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294970.sst): second pass time = 1.36's, 79.599'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.81's, 43.596'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3256.222'MB/sec (index lex order gen) rebuild zvType time = 0.69's, 0.335'MB/sec write SST data time = 0.13's, 278.164'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.085'MB, throughput = 33260.070'MB/sec zip my value time = 1.36's, unzip length = 0.108'GB zip my value throughput = 79.599'MB/sec zip pipeline throughput = 79.599'MB/sec entries = 919300 avg-key = 28.00 avg-zkey = 1.91 avg-val = 118.00 avg-zval = 32.01 usrkeys = 919300 avg-key = 20.00 avg-zkey = 1.91 avg-val = 125.00 avg-zval = 32.01 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 919300 bytes = 3217568 } seq expand size = 6435100 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0184 GB value = 0.1085 GB dict = 1.09 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0294 GB dict = 1.09 MB all = 0.0355 GB } UnZip/Zip{ index = 10.4458 value = 3.6867 dict = 1.00 all = 3.7818 } Zip/UnZip{ index = 0.0957 value = 0.2712 dict = 1.00 all = 0.2644 } ---------------------------- total value len = 2251.968367 GB avg = 0.200 KB (by entry num) total key len = 307.027792 GB avg = 0.027 KB total ukey len = 237.458177 GB avg = 0.015 KB total ukey num = 15.743833657 Billion total entry num = 11.285147605 Billion write speed all = 32.979721892 MB/sec (with seq num) write speed all = 31.816199928 MB/sec (without seq num) 2024/11/24-06:28:25.275463 139957349447232 [compaction_job.cc:1948] [default] [JOB 42827] Generated table #294970: 919300 keys, 35490738 bytes, temperature: kWarm 2024/11/24-06:28:25.275538 139957349447232 EVENT_LOG_v1 {"time_micros": 1732400905275500, "cf_name": "default", "job": 42827, "event": "table_file_creation", "file_number": 294970, "file_size": 35490738, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4298800976, "largest_seqno": 4450344956, "table_properties": {"data_size": 29423856, "index_size": 1760128, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25740400, "raw_average_key_size": 28, "raw_value_size": 108477400, "raw_average_value_size": 118, "num_data_blocks": 1, "num_entries": 919300, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 118, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732400902, "oldest_key_time": 0, "file_creation_time": 1732400902, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 294970, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-06:28:25.311076 139957349447232 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294971.sst) /dev/shm/ToplingTemp/Topling-289065-xVqxTU 2024/11/24-06:28:26.341940 139957349447232 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294971.sst): first pass time = 1.03's, 130.205'MB/sec 2024/11/24-06:28:27.691313 139957349447232 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294971.sst): old prealloc_size = 147639500, real_size = 33411200 2024/11/24-06:28:27.691840 139957349447232 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294971.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927530 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1082 GB zip-val = 0.0314 GB avg-val = 116.70 avg-zval = 33.86 2024/11/24-06:28:27.692637 139957349447232 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294971.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-06:28:28.548475 139957349447232 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294971.sst): second pass time = 1.35's, 80.293'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.86's, 43.764'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3513.258'MB/sec (index lex order gen) rebuild zvType time = 0.73's, 0.318'MB/sec write SST data time = 0.13's, 296.776'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 27538.697'MB/sec zip my value time = 1.35's, unzip length = 0.108'GB zip my value throughput = 80.293'MB/sec zip pipeline throughput = 80.293'MB/sec entries = 927530 avg-key = 28.00 avg-zkey = 1.92 avg-val = 116.70 avg-zval = 33.86 usrkeys = 927530 avg-key = 20.00 avg-zkey = 1.92 avg-val = 123.70 avg-zval = 33.86 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 927530 bytes = 3246368 } seq expand size = 6492710 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0314 GB dict = 1.08 MB all = 0.0375 GB } UnZip/Zip{ index = 10.4429 value = 3.4471 dict = 1.00 all = 3.5780 } Zip/UnZip{ index = 0.0958 value = 0.2901 dict = 1.00 all = 0.2795 } ---------------------------- total value len = 2252.083107 GB avg = 0.200 KB (by entry num) total key len = 307.053763 GB avg = 0.027 KB total ukey len = 237.476728 GB avg = 0.015 KB total ukey num = 15.744761187 Billion total entry num = 11.286075135 Billion write speed all = 32.980126042 MB/sec (with seq num) write speed all = 31.816558169 MB/sec (without seq num) 2024/11/24-06:28:28.594745 139957349447232 [compaction_job.cc:1948] [default] [JOB 42827] Generated table #294971: 927530 keys, 37512150 bytes, temperature: kWarm 2024/11/24-06:28:28.594815 139957349447232 EVENT_LOG_v1 {"time_micros": 1732400908594780, "cf_name": "default", "job": 42827, "event": "table_file_creation", "file_number": 294971, "file_size": 37512150, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4261178675, "largest_seqno": 4478440625, "table_properties": {"data_size": 31402736, "index_size": 1776384, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25970840, "raw_average_key_size": 28, "raw_value_size": 108246932, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927530, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732400905, "oldest_key_time": 0, "file_creation_time": 1732400905, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 294971, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-06:28:28.637003 139957349447232 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294972.sst) /dev/shm/ToplingTemp/Topling-289065-uG6U5T 2024/11/24-06:28:29.638971 139957349447232 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294972.sst): first pass time = 1.00's, 133.959'MB/sec 2024/11/24-06:28:30.964245 139957349447232 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294972.sst): old prealloc_size = 147639500, real_size = 31270480 2024/11/24-06:28:30.964785 139957349447232 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294972.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 921024 prefix = 4 raw-key = 0.0147 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1084 GB zip-val = 0.0293 GB avg-val = 117.73 avg-zval = 31.79 2024/11/24-06:28:30.965560 139957349447232 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294972.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-06:28:31.776006 139957349447232 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294972.sst): second pass time = 1.32's, 81.895'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.81's, 43.552'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3438.334'MB/sec (index lex order gen) rebuild zvType time = 0.69's, 0.335'MB/sec write SST data time = 0.12's, 285.323'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.084'MB, throughput = 33787.892'MB/sec zip my value time = 1.32's, unzip length = 0.108'GB zip my value throughput = 81.895'MB/sec zip pipeline throughput = 81.895'MB/sec entries = 921024 avg-key = 28.00 avg-zkey = 1.92 avg-val = 117.73 avg-zval = 31.79 usrkeys = 921024 avg-key = 20.00 avg-zkey = 1.92 avg-val = 124.73 avg-zval = 31.79 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 921024 bytes = 3223600 } seq expand size = 6447168 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0184 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0293 GB dict = 1.08 MB all = 0.0354 GB } UnZip/Zip{ index = 10.4438 value = 3.7036 dict = 1.00 all = 3.7966 } Zip/UnZip{ index = 0.0958 value = 0.2700 dict = 1.00 all = 0.2634 } ---------------------------- total value len = 2252.197983 GB avg = 0.200 KB (by entry num) total key len = 307.079552 GB avg = 0.027 KB total ukey len = 237.495148 GB avg = 0.015 KB total ukey num = 15.745682211 Billion total entry num = 11.286996159 Billion write speed all = 32.980567041 MB/sec (with seq num) write speed all = 31.816952612 MB/sec (without seq num) 2024/11/24-06:28:31.820700 139957349447232 [compaction_job.cc:1948] [default] [JOB 42827] Generated table #294972: 921024 keys, 35351640 bytes, temperature: kWarm 2024/11/24-06:28:31.820770 139957349447232 EVENT_LOG_v1 {"time_micros": 1732400911820734, "cf_name": "default", "job": 42827, "event": "table_file_creation", "file_number": 294972, "file_size": 35351640, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4337842767, "largest_seqno": 4478440640, "table_properties": {"data_size": 29276288, "index_size": 1763776, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25788672, "raw_average_key_size": 28, "raw_value_size": 108429108, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 921024, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732400908, "oldest_key_time": 0, "file_creation_time": 1732400908, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 294972, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-06:28:31.859116 139957349447232 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294973.sst) /dev/shm/ToplingTemp/Topling-289065-bPd0RX 2024/11/24-06:28:32.826675 139957349447232 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294973.sst): first pass time = 0.97's, 138.723'MB/sec 2024/11/24-06:28:34.173509 139957349447232 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294973.sst): old prealloc_size = 147639500, real_size = 33215504 2024/11/24-06:28:34.174082 139957349447232 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294973.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 926006 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1083 GB zip-val = 0.0312 GB avg-val = 116.94 avg-zval = 33.70 2024/11/24-06:28:34.174831 139957349447232 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294973.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-06:28:35.023037 139957349447232 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294973.sst): second pass time = 1.35's, 80.474'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.85's, 43.922'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3211.167'MB/sec (index lex order gen) rebuild zvType time = 0.72's, 0.321'MB/sec write SST data time = 0.13's, 293.208'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 35235.592'MB/sec zip my value time = 1.35's, unzip length = 0.108'GB zip my value throughput = 80.474'MB/sec zip pipeline throughput = 80.474'MB/sec entries = 926006 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.94 avg-zval = 33.70 usrkeys = 926006 avg-key = 20.00 avg-zkey = 1.91 avg-val = 123.94 avg-zval = 33.70 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 926006 bytes = 3241040 } seq expand size = 6482042 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0312 GB dict = 1.08 MB all = 0.0373 GB } UnZip/Zip{ index = 10.4446 value = 3.4696 dict = 1.00 all = 3.5973 } Zip/UnZip{ index = 0.0957 value = 0.2882 dict = 1.00 all = 0.2780 } ---------------------------- total value len = 2252.312755 GB avg = 0.200 KB (by entry num) total key len = 307.105480 GB avg = 0.027 KB total ukey len = 237.513668 GB avg = 0.015 KB total ukey num = 15.746608217 Billion total entry num = 11.287922165 Billion write speed all = 32.981000154 MB/sec (with seq num) write speed all = 31.817338951 MB/sec (without seq num) 2024/11/24-06:28:35.071325 139957349447232 [compaction_job.cc:1948] [default] [JOB 42827] Generated table #294973: 926006 keys, 37311088 bytes, temperature: kWarm 2024/11/24-06:28:35.071402 139957349447232 EVENT_LOG_v1 {"time_micros": 1732400915071360, "cf_name": "default", "job": 42827, "event": "table_file_creation", "file_number": 294973, "file_size": 37311088, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4261178686, "largest_seqno": 4478440039, "table_properties": {"data_size": 31210624, "index_size": 1773184, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25928168, "raw_average_key_size": 28, "raw_value_size": 108289600, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 926006, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732400911, "oldest_key_time": 0, "file_creation_time": 1732400911, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 294973, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-06:28:35.108244 139957349447232 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294974.sst) /dev/shm/ToplingTemp/Topling-289065-IAxezX 2024/11/24-06:28:36.105239 139957349447232 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294974.sst): first pass time = 1.00's, 134.628'MB/sec 2024/11/24-06:28:37.415536 139957349447232 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294974.sst): old prealloc_size = 147639500, real_size = 30622080 2024/11/24-06:28:37.416097 139957349447232 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294974.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927413 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1083 GB zip-val = 0.0286 GB avg-val = 116.72 avg-zval = 30.85 2024/11/24-06:28:37.416862 139957349447232 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294974.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-06:28:38.236882 139957349447232 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294974.sst): second pass time = 1.31's, 82.668'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.82's, 42.133'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3310.522'MB/sec (index lex order gen) rebuild zvType time = 0.70's, 0.333'MB/sec write SST data time = 0.13's, 276.698'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 34976.303'MB/sec zip my value time = 1.31's, unzip length = 0.108'GB zip my value throughput = 82.668'MB/sec zip pipeline throughput = 82.668'MB/sec entries = 927413 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.72 avg-zval = 30.85 usrkeys = 927413 avg-key = 20.00 avg-zkey = 1.91 avg-val = 123.72 avg-zval = 30.85 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 927413 bytes = 3130032 } seq expand size = 6491891 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0286 GB dict = 1.08 MB all = 0.0346 GB } UnZip/Zip{ index = 10.4442 value = 3.7831 dict = 1.00 all = 3.8786 } Zip/UnZip{ index = 0.0957 value = 0.2643 dict = 1.00 all = 0.2578 } ---------------------------- total value len = 2252.427497 GB avg = 0.200 KB (by entry num) total key len = 307.131448 GB avg = 0.027 KB total ukey len = 237.532217 GB avg = 0.015 KB total ukey num = 15.747535630 Billion total entry num = 11.288849578 Billion write speed all = 32.981447455 MB/sec (with seq num) write speed all = 31.817738841 MB/sec (without seq num) 2024/11/24-06:28:38.283039 139957349447232 [compaction_job.cc:1948] [default] [JOB 42827] Generated table #294974: 927413 keys, 34604658 bytes, temperature: kWarm 2024/11/24-06:28:38.283112 139957349447232 EVENT_LOG_v1 {"time_micros": 1732400918283076, "cf_name": "default", "job": 42827, "event": "table_file_creation", "file_number": 294974, "file_size": 34604658, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4375459999, "largest_seqno": 4478440657, "table_properties": {"data_size": 28614128, "index_size": 1775936, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25967564, "raw_average_key_size": 28, "raw_value_size": 108250222, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927413, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732400915, "oldest_key_time": 0, "file_creation_time": 1732400915, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 294974, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-06:28:38.321561 139957349447232 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294975.sst) /dev/shm/ToplingTemp/Topling-289065-N4ZPJU 2024/11/24-06:28:39.300469 139957349447232 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294975.sst): first pass time = 0.98's, 137.116'MB/sec 2024/11/24-06:28:40.614256 139957349447232 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294975.sst): old prealloc_size = 147639500, real_size = 31601776 2024/11/24-06:28:40.614810 139957349447232 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294975.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 919677 prefix = 4 raw-key = 0.0147 GB zip-key = 0.0017 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1085 GB zip-val = 0.0296 GB avg-val = 117.94 avg-zval = 32.21 2024/11/24-06:28:40.615632 139957349447232 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294975.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-06:28:41.429569 139957349447232 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294975.sst): second pass time = 1.31's, 82.632'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.82's, 43.765'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3295.447'MB/sec (index lex order gen) rebuild zvType time = 0.69's, 0.334'MB/sec write SST data time = 0.13's, 282.889'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.085'MB, throughput = 31263.962'MB/sec zip my value time = 1.31's, unzip length = 0.108'GB zip my value throughput = 82.632'MB/sec zip pipeline throughput = 82.632'MB/sec entries = 919677 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.94 avg-zval = 32.21 usrkeys = 919677 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.94 avg-zval = 32.21 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 919677 bytes = 3218880 } seq expand size = 6437739 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0184 GB value = 0.1085 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0017 GB value = 0.0296 GB dict = 1.08 MB all = 0.0357 GB } UnZip/Zip{ index = 10.5147 value = 3.6617 dict = 1.00 all = 3.7616 } Zip/UnZip{ index = 0.0951 value = 0.2731 dict = 1.00 all = 0.2658 } ---------------------------- total value len = 2252.542401 GB avg = 0.200 KB (by entry num) total key len = 307.157199 GB avg = 0.027 KB total ukey len = 237.550610 GB avg = 0.015 KB total ukey num = 15.748455307 Billion total entry num = 11.289769255 Billion write speed all = 32.981903021 MB/sec (with seq num) write speed all = 31.818147478 MB/sec (without seq num) 2024/11/24-06:28:41.473116 139957349447232 [compaction_job.cc:1948] [default] [JOB 42827] Generated table #294975: 919677 keys, 35681482 bytes, temperature: kWarm 2024/11/24-06:28:41.473191 139957349447232 EVENT_LOG_v1 {"time_micros": 1732400921473156, "cf_name": "default", "job": 42827, "event": "table_file_creation", "file_number": 294975, "file_size": 35681482, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4261178700, "largest_seqno": 4478440783, "table_properties": {"data_size": 29622368, "index_size": 1749312, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25750956, "raw_average_key_size": 28, "raw_value_size": 108466874, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 919677, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732400918, "oldest_key_time": 0, "file_creation_time": 1732400918, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 294975, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-06:28:41.510450 139957349447232 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294976.sst) /dev/shm/ToplingTemp/Topling-289065-blBZMV 2024/11/24-06:28:42.484189 139957349447232 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294976.sst): first pass time = 0.97's, 137.843'MB/sec 2024/11/24-06:28:43.837084 139957349447232 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294976.sst): old prealloc_size = 147639500, real_size = 32569104 2024/11/24-06:28:43.837652 139957349447232 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294976.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927822 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0306 GB avg-val = 116.66 avg-zval = 32.95 2024/11/24-06:28:43.838436 139957349447232 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294976.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-06:28:44.681154 139957349447232 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294976.sst): second pass time = 1.35's, 80.099'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.84's, 43.446'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3238.711'MB/sec (index lex order gen) rebuild zvType time = 0.72's, 0.323'MB/sec write SST data time = 0.13's, 291.859'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 35235.803'MB/sec zip my value time = 1.35's, unzip length = 0.108'GB zip my value throughput = 80.099'MB/sec zip pipeline throughput = 80.099'MB/sec entries = 927822 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.66 avg-zval = 32.95 usrkeys = 927822 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.66 avg-zval = 32.95 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 927822 bytes = 3247392 } seq expand size = 6494754 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0306 GB dict = 1.08 MB all = 0.0367 GB } UnZip/Zip{ index = 10.5128 value = 3.5405 dict = 1.00 all = 3.6601 } Zip/UnZip{ index = 0.0951 value = 0.2824 dict = 1.00 all = 0.2732 } ---------------------------- total value len = 2252.657135 GB avg = 0.200 KB (by entry num) total key len = 307.183178 GB avg = 0.027 KB total ukey len = 237.569167 GB avg = 0.015 KB total ukey num = 15.749383129 Billion total entry num = 11.290697077 Billion write speed all = 32.982334256 MB/sec (with seq num) write speed all = 31.818531832 MB/sec (without seq num) 2024/11/24-06:28:44.725775 139957349447232 [compaction_job.cc:1948] [default] [JOB 42827] Generated table #294976: 927822 keys, 36670576 bytes, temperature: kWarm 2024/11/24-06:28:44.725846 139957349447232 EVENT_LOG_v1 {"time_micros": 1732400924725810, "cf_name": "default", "job": 42827, "event": "table_file_creation", "file_number": 294976, "file_size": 36670576, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4261178719, "largest_seqno": 4478440871, "table_properties": {"data_size": 30571840, "index_size": 1765120, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25979016, "raw_average_key_size": 28, "raw_value_size": 108238840, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927822, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732400921, "oldest_key_time": 0, "file_creation_time": 1732400921, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 294976, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-06:28:44.762541 139957349447232 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294977.sst) /dev/shm/ToplingTemp/Topling-289065-0esIoW 2024/11/24-06:28:45.673770 139957349447232 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294977.sst): first pass time = 0.91's, 147.300'MB/sec 2024/11/24-06:28:46.996617 139957349447232 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294977.sst): old prealloc_size = 147639500, real_size = 31374064 2024/11/24-06:28:46.997178 139957349447232 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294977.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 919300 prefix = 4 raw-key = 0.0147 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.93 raw-val = 0.1085 GB zip-val = 0.0294 GB avg-val = 118.00 avg-zval = 31.95 2024/11/24-06:28:46.997947 139957349447232 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294977.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-06:28:47.809294 139957349447232 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294977.sst): second pass time = 1.32's, 82.053'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.81's, 43.624'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3290.174'MB/sec (index lex order gen) rebuild zvType time = 0.69's, 0.334'MB/sec write SST data time = 0.12's, 285.085'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.085'MB, throughput = 28176.223'MB/sec zip my value time = 1.32's, unzip length = 0.108'GB zip my value throughput = 82.053'MB/sec zip pipeline throughput = 82.053'MB/sec entries = 919300 avg-key = 28.00 avg-zkey = 1.93 avg-val = 118.00 avg-zval = 31.95 usrkeys = 919300 avg-key = 20.00 avg-zkey = 1.93 avg-val = 125.00 avg-zval = 31.95 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 919300 bytes = 3217568 } seq expand size = 6435100 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0184 GB value = 0.1085 GB dict = 1.09 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0294 GB dict = 1.09 MB all = 0.0355 GB } UnZip/Zip{ index = 10.3749 value = 3.6932 dict = 1.00 all = 3.7860 } Zip/UnZip{ index = 0.0964 value = 0.2708 dict = 1.00 all = 0.2641 } ---------------------------- total value len = 2252.772047 GB avg = 0.200 KB (by entry num) total key len = 307.208918 GB avg = 0.027 KB total ukey len = 237.587553 GB avg = 0.015 KB total ukey num = 15.750302429 Billion total entry num = 11.291616377 Billion write speed all = 32.982817143 MB/sec (with seq num) write speed all = 31.818966869 MB/sec (without seq num) 2024/11/24-06:28:47.852918 139957349447232 [compaction_job.cc:1948] [default] [JOB 42827] Generated table #294977: 919300 keys, 35450866 bytes, temperature: kWarm 2024/11/24-06:28:47.853003 139957349447232 EVENT_LOG_v1 {"time_micros": 1732400927852954, "cf_name": "default", "job": 42827, "event": "table_file_creation", "file_number": 294977, "file_size": 35450866, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4296592748, "largest_seqno": 4448565589, "table_properties": {"data_size": 29371872, "index_size": 1772160, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25740400, "raw_average_key_size": 28, "raw_value_size": 108477400, "raw_average_value_size": 118, "num_data_blocks": 1, "num_entries": 919300, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 118, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732400924, "oldest_key_time": 0, "file_creation_time": 1732400924, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 294977, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-06:28:47.896413 139957349447232 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294978.sst) /dev/shm/ToplingTemp/Topling-289065-ZmVW3T 2024/11/24-06:28:48.930549 139957349447232 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294978.sst): first pass time = 1.03's, 129.791'MB/sec 2024/11/24-06:28:50.278323 139957349447232 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294978.sst): old prealloc_size = 147639500, real_size = 33241184 2024/11/24-06:28:50.278869 139957349447232 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294978.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 928162 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0312 GB avg-val = 116.61 avg-zval = 33.66 2024/11/24-06:28:50.279666 139957349447232 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294978.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-06:28:51.133744 139957349447232 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294978.sst): second pass time = 1.35's, 80.354'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.86's, 43.656'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3377.674'MB/sec (index lex order gen) rebuild zvType time = 0.73's, 0.318'MB/sec write SST data time = 0.12's, 299.185'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 33182.547'MB/sec zip my value time = 1.35's, unzip length = 0.108'GB zip my value throughput = 80.354'MB/sec zip pipeline throughput = 80.354'MB/sec entries = 928162 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.61 avg-zval = 33.66 usrkeys = 928162 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.61 avg-zval = 33.66 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 928162 bytes = 3248576 } seq expand size = 6497134 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0312 GB dict = 1.08 MB all = 0.0373 GB } UnZip/Zip{ index = 10.5129 value = 3.4641 dict = 1.00 all = 3.5941 } Zip/UnZip{ index = 0.0951 value = 0.2887 dict = 1.00 all = 0.2782 } ---------------------------- total value len = 2252.886774 GB avg = 0.200 KB (by entry num) total key len = 307.234906 GB avg = 0.027 KB total ukey len = 237.606116 GB avg = 0.015 KB total ukey num = 15.751230591 Billion total entry num = 11.292544539 Billion write speed all = 32.983217370 MB/sec (with seq num) write speed all = 31.819321282 MB/sec (without seq num) 2024/11/24-06:28:51.178518 139957349447232 [compaction_job.cc:1948] [default] [JOB 42827] Generated table #294978: 928162 keys, 37343494 bytes, temperature: kWarm 2024/11/24-06:28:51.178589 139957349447232 EVENT_LOG_v1 {"time_micros": 1732400931178554, "cf_name": "default", "job": 42827, "event": "table_file_creation", "file_number": 294978, "file_size": 37343494, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4261178730, "largest_seqno": 4478440687, "table_properties": {"data_size": 31243216, "index_size": 1765760, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25988536, "raw_average_key_size": 28, "raw_value_size": 108229256, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 928162, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732400927, "oldest_key_time": 0, "file_creation_time": 1732400927, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 294978, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-06:28:51.220353 139957349447232 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294979.sst) /dev/shm/ToplingTemp/Topling-289065-ihQufV 2024/11/24-06:28:52.223930 139957349447232 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294979.sst): first pass time = 1.00's, 133.746'MB/sec 2024/11/24-06:28:53.536807 139957349447232 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294979.sst): old prealloc_size = 147639500, real_size = 31381712 2024/11/24-06:28:53.537420 139957349447232 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294979.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 920017 prefix = 4 raw-key = 0.0147 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1085 GB zip-val = 0.0294 GB avg-val = 117.89 avg-zval = 31.95 2024/11/24-06:28:53.538231 139957349447232 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294979.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-06:28:54.351464 139957349447232 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294979.sst): second pass time = 1.31's, 82.662'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.81's, 43.529'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3004.255'MB/sec (index lex order gen) rebuild zvType time = 0.69's, 0.334'MB/sec write SST data time = 0.13's, 281.339'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.084'MB, throughput = 34916.192'MB/sec zip my value time = 1.31's, unzip length = 0.108'GB zip my value throughput = 82.662'MB/sec zip pipeline throughput = 82.662'MB/sec entries = 920017 avg-key = 28.00 avg-zkey = 1.91 avg-val = 117.89 avg-zval = 31.95 usrkeys = 920017 avg-key = 20.00 avg-zkey = 1.91 avg-val = 124.89 avg-zval = 31.95 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 920017 bytes = 3220080 } seq expand size = 6440119 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0184 GB value = 0.1085 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0294 GB dict = 1.08 MB all = 0.0355 GB } UnZip/Zip{ index = 10.4456 value = 3.6903 dict = 1.00 all = 3.7850 } Zip/UnZip{ index = 0.0957 value = 0.2710 dict = 1.00 all = 0.2642 } ---------------------------- total value len = 2253.001671 GB avg = 0.199 KB (by entry num) total key len = 307.260667 GB avg = 0.027 KB total ukey len = 237.624516 GB avg = 0.015 KB total ukey num = 15.752150608 Billion total entry num = 11.293464556 Billion write speed all = 32.983662181 MB/sec (with seq num) write speed all = 31.819719520 MB/sec (without seq num) 2024/11/24-06:28:54.394512 139957349447232 [compaction_job.cc:1948] [default] [JOB 42827] Generated table #294979: 920017 keys, 35460222 bytes, temperature: kWarm 2024/11/24-06:28:54.394587 139957349447232 EVENT_LOG_v1 {"time_micros": 1732400934394551, "cf_name": "default", "job": 42827, "event": "table_file_creation", "file_number": 294979, "file_size": 35460222, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4332107421, "largest_seqno": 4478440705, "table_properties": {"data_size": 29390016, "index_size": 1761536, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25760476, "raw_average_key_size": 28, "raw_value_size": 108457330, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 920017, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732400931, "oldest_key_time": 0, "file_creation_time": 1732400931, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 294979, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-06:28:54.428138 139957349447232 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294980.sst) /dev/shm/ToplingTemp/Topling-289065-j9WhwV 2024/11/24-06:28:55.452721 139957349447232 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294980.sst): first pass time = 1.02's, 131.003'MB/sec 2024/11/24-06:28:56.756789 139957349447232 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294980.sst): old prealloc_size = 147639500, real_size = 33056288 2024/11/24-06:28:56.757365 139957349447232 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294980.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927010 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0311 GB avg-val = 116.79 avg-zval = 33.51 2024/11/24-06:28:56.758174 139957349447232 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294980.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-06:28:57.612231 139957349447232 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294980.sst): second pass time = 1.30's, 83.068'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.86's, 43.435'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3136.989'MB/sec (index lex order gen) rebuild zvType time = 0.73's, 0.318'MB/sec write SST data time = 0.13's, 297.158'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 34218.892'MB/sec zip my value time = 1.30's, unzip length = 0.108'GB zip my value throughput = 83.068'MB/sec zip pipeline throughput = 83.068'MB/sec entries = 927010 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.79 avg-zval = 33.51 usrkeys = 927010 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.79 avg-zval = 33.51 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 927010 bytes = 3244544 } seq expand size = 6489070 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0311 GB dict = 1.08 MB all = 0.0372 GB } UnZip/Zip{ index = 10.5128 value = 3.4855 dict = 1.00 all = 3.6124 } Zip/UnZip{ index = 0.0951 value = 0.2869 dict = 1.00 all = 0.2768 } ---------------------------- total value len = 2253.116422 GB avg = 0.199 KB (by entry num) total key len = 307.286623 GB avg = 0.027 KB total ukey len = 237.643056 GB avg = 0.015 KB total ukey num = 15.753077618 Billion total entry num = 11.294391566 Billion write speed all = 32.984089294 MB/sec (with seq num) write speed all = 31.820099990 MB/sec (without seq num) 2024/11/24-06:28:57.658017 139957349447232 [compaction_job.cc:1948] [default] [JOB 42827] Generated table #294980: 927010 keys, 37154810 bytes, temperature: kWarm 2024/11/24-06:28:57.658092 139957349447232 EVENT_LOG_v1 {"time_micros": 1732400937658053, "cf_name": "default", "job": 42827, "event": "table_file_creation", "file_number": 294980, "file_size": 37154810, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4265680186, "largest_seqno": 4478440091, "table_properties": {"data_size": 31060752, "index_size": 1763584, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25956280, "raw_average_key_size": 28, "raw_value_size": 108261572, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927010, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732400934, "oldest_key_time": 0, "file_creation_time": 1732400934, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 294980, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-06:28:57.693579 139957349447232 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294981.sst) /dev/shm/ToplingTemp/Topling-289065-deiCZT 2024/11/24-06:28:58.702685 139957349447232 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294981.sst): first pass time = 1.01's, 133.012'MB/sec 2024/11/24-06:29:00.005191 139957349447232 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294981.sst): old prealloc_size = 147639500, real_size = 30686768 2024/11/24-06:29:00.005738 139957349447232 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294981.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927091 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.93 raw-val = 0.1083 GB zip-val = 0.0287 GB avg-val = 116.77 avg-zval = 30.92 2024/11/24-06:29:00.006469 139957349447232 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294981.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-06:29:00.821781 139957349447232 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294981.sst): second pass time = 1.30's, 83.166'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.82's, 42.456'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3421.027'MB/sec (index lex order gen) rebuild zvType time = 0.69's, 0.336'MB/sec write SST data time = 0.13's, 274.695'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 32097.909'MB/sec zip my value time = 1.30's, unzip length = 0.108'GB zip my value throughput = 83.166'MB/sec zip pipeline throughput = 83.166'MB/sec entries = 927091 avg-key = 28.00 avg-zkey = 1.93 avg-val = 116.77 avg-zval = 30.92 usrkeys = 927091 avg-key = 20.00 avg-zkey = 1.93 avg-val = 123.77 avg-zval = 30.92 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 927091 bytes = 3128944 } seq expand size = 6489637 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0287 GB dict = 1.08 MB all = 0.0347 GB } UnZip/Zip{ index = 10.3796 value = 3.7763 dict = 1.00 all = 3.8715 } Zip/UnZip{ index = 0.0963 value = 0.2648 dict = 1.00 all = 0.2583 } ---------------------------- total value len = 2253.231171 GB avg = 0.199 KB (by entry num) total key len = 307.312582 GB avg = 0.027 KB total ukey len = 237.661598 GB avg = 0.015 KB total ukey num = 15.754004709 Billion total entry num = 11.295318657 Billion write speed all = 32.984538142 MB/sec (with seq num) write speed all = 31.820501422 MB/sec (without seq num) 2024/11/24-06:29:00.864548 139957349447232 [compaction_job.cc:1948] [default] [JOB 42827] Generated table #294981: 927091 keys, 34668400 bytes, temperature: kWarm 2024/11/24-06:29:00.864621 139957349447232 EVENT_LOG_v1 {"time_micros": 1732400940864585, "cf_name": "default", "job": 42827, "event": "table_file_creation", "file_number": 294981, "file_size": 34668400, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4373904597, "largest_seqno": 4478440724, "table_properties": {"data_size": 28668448, "index_size": 1786368, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25958548, "raw_average_key_size": 28, "raw_value_size": 108259282, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927091, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732400937, "oldest_key_time": 0, "file_creation_time": 1732400937, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 294981, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-06:29:00.901662 139957349447232 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294982.sst) /dev/shm/ToplingTemp/Topling-289065-kvUskW 2024/11/24-06:29:01.817679 139957349447232 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294982.sst): first pass time = 0.92's, 146.531'MB/sec 2024/11/24-06:29:03.112771 139957349447232 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294982.sst): old prealloc_size = 147639500, real_size = 31733360 2024/11/24-06:29:03.113335 139957349447232 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294982.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 920069 prefix = 4 raw-key = 0.0147 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1085 GB zip-val = 0.0298 GB avg-val = 117.88 avg-zval = 32.34 2024/11/24-06:29:03.115382 139957349447232 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294982.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-06:29:03.927680 139957349447232 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294982.sst): second pass time = 1.29's, 83.794'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.81's, 43.950'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3253.189'MB/sec (index lex order gen) rebuild zvType time = 0.69's, 0.334'MB/sec write SST data time = 0.13's, 282.729'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.084'MB, throughput = 31849.443'MB/sec zip my value time = 1.29's, unzip length = 0.108'GB zip my value throughput = 83.794'MB/sec zip pipeline throughput = 83.794'MB/sec entries = 920069 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.88 avg-zval = 32.34 usrkeys = 920069 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.88 avg-zval = 32.34 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 920069 bytes = 3220256 } seq expand size = 6440483 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0184 GB value = 0.1085 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0298 GB dict = 1.08 MB all = 0.0358 GB } UnZip/Zip{ index = 10.5119 value = 3.6453 dict = 1.00 all = 3.7477 } Zip/UnZip{ index = 0.0951 value = 0.2743 dict = 1.00 all = 0.2668 } ---------------------------- total value len = 2253.346067 GB avg = 0.199 KB (by entry num) total key len = 307.338344 GB avg = 0.027 KB total ukey len = 237.680000 GB avg = 0.015 KB total ukey num = 15.754924778 Billion total entry num = 11.296238726 Billion write speed all = 32.985030359 MB/sec (with seq num) write speed all = 31.820945396 MB/sec (without seq num) 2024/11/24-06:29:03.974990 139957349447232 [compaction_job.cc:1948] [default] [JOB 42827] Generated table #294982: 920069 keys, 35813802 bytes, temperature: kWarm 2024/11/24-06:29:03.975063 139957349447232 EVENT_LOG_v1 {"time_micros": 1732400943975027, "cf_name": "default", "job": 42827, "event": "table_file_creation", "file_number": 294982, "file_size": 35813802, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4265680199, "largest_seqno": 4478440889, "table_properties": {"data_size": 29752608, "index_size": 1750528, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25761932, "raw_average_key_size": 28, "raw_value_size": 108455910, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 920069, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732400940, "oldest_key_time": 0, "file_creation_time": 1732400940, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 294982, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-06:29:04.011190 139957349447232 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294983.sst) /dev/shm/ToplingTemp/Topling-289065-Hr8mZV 2024/11/24-06:29:05.038576 139957349447232 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294983.sst): first pass time = 1.03's, 130.645'MB/sec 2024/11/24-06:29:06.374705 139957349447232 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294983.sst): old prealloc_size = 147639500, real_size = 32803968 2024/11/24-06:29:06.375302 139957349447232 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294983.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927556 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0308 GB avg-val = 116.70 avg-zval = 33.21 2024/11/24-06:29:06.377324 139957349447232 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294983.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-06:29:07.221464 139957349447232 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294983.sst): second pass time = 1.34's, 81.063'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.85's, 43.585'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3094.486'MB/sec (index lex order gen) rebuild zvType time = 0.72's, 0.323'MB/sec write SST data time = 0.13's, 289.537'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 33442.137'MB/sec zip my value time = 1.34's, unzip length = 0.108'GB zip my value throughput = 81.063'MB/sec zip pipeline throughput = 81.063'MB/sec entries = 927556 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.70 avg-zval = 33.21 usrkeys = 927556 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.70 avg-zval = 33.21 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 927556 bytes = 3246464 } seq expand size = 6492892 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0308 GB dict = 1.08 MB all = 0.0369 GB } UnZip/Zip{ index = 10.5156 value = 3.5136 dict = 1.00 all = 3.6369 } Zip/UnZip{ index = 0.0951 value = 0.2846 dict = 1.00 all = 0.2750 } ---------------------------- total value len = 2253.460806 GB avg = 0.199 KB (by entry num) total key len = 307.364315 GB avg = 0.027 KB total ukey len = 237.698551 GB avg = 0.015 KB total ukey num = 15.755852334 Billion total entry num = 11.297166282 Billion write speed all = 32.985443383 MB/sec (with seq num) write speed all = 31.821312226 MB/sec (without seq num) 2024/11/24-06:29:07.273007 139957349447232 [compaction_job.cc:1948] [default] [JOB 42827] Generated table #294983: 927556 keys, 36904882 bytes, temperature: kWarm 2024/11/24-06:29:07.273078 139957349447232 EVENT_LOG_v1 {"time_micros": 1732400947273043, "cf_name": "default", "job": 42827, "event": "table_file_creation", "file_number": 294983, "file_size": 36904882, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4265680212, "largest_seqno": 4478440814, "table_properties": {"data_size": 30807728, "index_size": 1764160, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25971568, "raw_average_key_size": 28, "raw_value_size": 108246160, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927556, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732400944, "oldest_key_time": 0, "file_creation_time": 1732400944, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 294983, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-06:29:07.317886 139957349447232 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294984.sst) /dev/shm/ToplingTemp/Topling-289065-kbXGGW 2024/11/24-06:29:08.317642 139957349447232 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294984.sst): first pass time = 1.00's, 134.256'MB/sec 2024/11/24-06:29:09.609304 139957349447232 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294984.sst): old prealloc_size = 147639500, real_size = 31438144 2024/11/24-06:29:09.609889 139957349447232 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294984.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 919300 prefix = 4 raw-key = 0.0147 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1085 GB zip-val = 0.0294 GB avg-val = 118.00 avg-zval = 32.03 2024/11/24-06:29:09.612010 139957349447232 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294984.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-06:29:10.427582 139957349447232 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294984.sst): second pass time = 1.29's, 84.036'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.82's, 43.403'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3148.513'MB/sec (index lex order gen) rebuild zvType time = 0.69's, 0.333'MB/sec write SST data time = 0.13's, 278.734'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.085'MB, throughput = 35596.273'MB/sec zip my value time = 1.29's, unzip length = 0.108'GB zip my value throughput = 84.036'MB/sec zip pipeline throughput = 84.036'MB/sec entries = 919300 avg-key = 28.00 avg-zkey = 1.91 avg-val = 118.00 avg-zval = 32.03 usrkeys = 919300 avg-key = 20.00 avg-zkey = 1.91 avg-val = 125.00 avg-zval = 32.03 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 919300 bytes = 3217568 } seq expand size = 6435100 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0184 GB value = 0.1085 GB dict = 1.09 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0294 GB dict = 1.09 MB all = 0.0355 GB } UnZip/Zip{ index = 10.4443 value = 3.6837 dict = 1.00 all = 3.7792 } Zip/UnZip{ index = 0.0957 value = 0.2715 dict = 1.00 all = 0.2646 } ---------------------------- total value len = 2253.575719 GB avg = 0.199 KB (by entry num) total key len = 307.390056 GB avg = 0.027 KB total ukey len = 237.716937 GB avg = 0.015 KB total ukey num = 15.756771634 Billion total entry num = 11.298085582 Billion write speed all = 32.985892873 MB/sec (with seq num) write speed all = 31.821715064 MB/sec (without seq num) 2024/11/24-06:29:10.473395 139957349447232 [compaction_job.cc:1948] [default] [JOB 42827] Generated table #294984: 919300 keys, 35514866 bytes, temperature: kWarm 2024/11/24-06:29:10.473467 139957349447232 EVENT_LOG_v1 {"time_micros": 1732400950473432, "cf_name": "default", "job": 42827, "event": "table_file_creation", "file_number": 294984, "file_size": 35514866, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4304743487, "largest_seqno": 4456248734, "table_properties": {"data_size": 29447728, "index_size": 1760384, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25740400, "raw_average_key_size": 28, "raw_value_size": 108477400, "raw_average_value_size": 118, "num_data_blocks": 1, "num_entries": 919300, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 118, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732400947, "oldest_key_time": 0, "file_creation_time": 1732400947, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 294984, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-06:29:10.512389 139957349447232 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294985.sst) /dev/shm/ToplingTemp/Topling-289065-SfA2VX 2024/11/24-06:29:11.393161 139957349447232 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294985.sst): first pass time = 0.88's, 152.393'MB/sec 2024/11/24-06:29:12.756265 139957349447232 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294985.sst): old prealloc_size = 147639500, real_size = 33623088 2024/11/24-06:29:12.756815 139957349447232 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294985.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927948 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1082 GB zip-val = 0.0316 GB avg-val = 116.64 avg-zval = 34.07 2024/11/24-06:29:12.758855 139957349447232 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294985.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-06:29:13.607033 139957349447232 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294985.sst): second pass time = 1.36's, 79.449'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.85's, 44.349'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3374.928'MB/sec (index lex order gen) rebuild zvType time = 0.72's, 0.321'MB/sec write SST data time = 0.13's, 295.513'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 33320.416'MB/sec zip my value time = 1.36's, unzip length = 0.108'GB zip my value throughput = 79.449'MB/sec zip pipeline throughput = 79.449'MB/sec entries = 927948 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.64 avg-zval = 34.07 usrkeys = 927948 avg-key = 20.00 avg-zkey = 1.91 avg-val = 123.64 avg-zval = 34.07 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 927948 bytes = 3247840 } seq expand size = 6495636 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0316 GB dict = 1.08 MB all = 0.0377 GB } UnZip/Zip{ index = 10.4457 value = 3.4236 dict = 1.00 all = 3.5575 } Zip/UnZip{ index = 0.0957 value = 0.2921 dict = 1.00 all = 0.2811 } ---------------------------- total value len = 2253.690450 GB avg = 0.199 KB (by entry num) total key len = 307.416038 GB avg = 0.027 KB total ukey len = 237.735496 GB avg = 0.015 KB total ukey num = 15.757699582 Billion total entry num = 11.299013530 Billion write speed all = 32.986354445 MB/sec (with seq num) write speed all = 31.822128695 MB/sec (without seq num) 2024/11/24-06:29:13.654267 139957349447232 [compaction_job.cc:1948] [default] [JOB 42827] Generated table #294985: 927948 keys, 37728476 bytes, temperature: kWarm 2024/11/24-06:29:13.654338 139957349447232 EVENT_LOG_v1 {"time_micros": 1732400953654303, "cf_name": "default", "job": 42827, "event": "table_file_creation", "file_number": 294985, "file_size": 37728476, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4265679834, "largest_seqno": 4478440761, "table_properties": {"data_size": 31614240, "index_size": 1776704, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25982544, "raw_average_key_size": 28, "raw_value_size": 108235308, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927948, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732400950, "oldest_key_time": 0, "file_creation_time": 1732400950, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 294985, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-06:29:13.690865 139957349447232 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294986.sst) /dev/shm/ToplingTemp/Topling-289065-4WgMlW 2024/11/24-06:29:13.752613 139957349447232 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294986.sst): first pass time = 0.06's, 237.699'MB/sec 2024/11/24-06:29:13.884904 139957349447232 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294986.sst): old prealloc_size = 147639500, real_size = 4457584 2024/11/24-06:29:13.885046 139957349447232 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294986.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 100467 prefix = 4 raw-key = 0.0016 GB zip-key = 0.0002 GB avg-key = 16.00 avg-zkey = 1.93 raw-val = 0.0119 GB zip-val = 0.0042 GB avg-val = 118.00 avg-zval = 42.19 2024/11/24-06:29:13.885169 139957349447232 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294986.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0002 GB, waited 0.000 sec, Key+Value = 0.015 GB 2024/11/24-06:29:13.973438 139957349447232 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00/294986.sst): second pass time = 0.13's, 90.033'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.09's, 55.036'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1616.596'MB/sec (index lex order gen) rebuild zvType time = 0.07's, 0.338'MB/sec write SST data time = 0.01's, 343.881'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.123'MB, throughput = 4480.087'MB/sec zip my value time = 0.13's, unzip length = 0.012'GB zip my value throughput = 90.033'MB/sec zip pipeline throughput = 90.033'MB/sec entries = 100467 avg-key = 28.00 avg-zkey = 1.93 avg-val = 118.00 avg-zval = 42.19 usrkeys = 100467 avg-key = 20.00 avg-zkey = 1.93 avg-val = 125.00 avg-zval = 42.19 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 100467 bytes = 313968 } seq expand size = 703269 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0020 GB value = 0.0119 GB dict = 0.12 MB all = 0.0147 GB } __ZipSize{ index = 0.0002 GB value = 0.0042 GB dict = 0.12 MB all = 0.0049 GB } UnZip/Zip{ index = 10.3720 value = 2.7970 dict = 1.00 all = 3.0114 } Zip/UnZip{ index = 0.0964 value = 0.3575 dict = 1.00 all = 0.3321 } ---------------------------- total value len = 2253.703008 GB avg = 0.199 KB (by entry num) total key len = 307.418851 GB avg = 0.027 KB total ukey len = 237.737505 GB avg = 0.015 KB total ukey num = 15.757800049 Billion total entry num = 11.299113997 Billion write speed all = 32.986396749 MB/sec (with seq num) write speed all = 31.822166142 MB/sec (without seq num) 2024/11/24-06:29:13.985645 139957349447232 [compaction_job.cc:1948] [default] [JOB 42827] Generated table #294986: 100467 keys, 4870827 bytes, temperature: kWarm 2024/11/24-06:29:13.985697 139957349447232 EVENT_LOG_v1 {"time_micros": 1732400953985668, "cf_name": "default", "job": 42827, "event": "table_file_creation", "file_number": 294986, "file_size": 4870827, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4390208384, "largest_seqno": 4418760800, "table_properties": {"data_size": 4238560, "index_size": 193728, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2813076, "raw_average_key_size": 28, "raw_value_size": 11855106, "raw_average_value_size": 118, "num_data_blocks": 1, "num_entries": 100467, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 118, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732400953, "oldest_key_time": 0, "file_creation_time": 1732400953, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 294986, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-06:29:13.998743 139957349447232 [compaction_job.cc:703] job-42827: subcompact[0], size: 0.749369 G, files: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42827/att-00 [294965,294966,294967,294968,294969,294970,294971,294972,294973,294974,294975,294976,294977,294978,294979,294980,294981,294982,294983,294984,294985,294986] 2024/11/24-06:29:14.122200 139957349447232 (Original Log Time 2024/11/24-06:28:06.573421) EVENT_LOG_v1 {"time_micros": 1732400886573393, "job": 42827, "event": "compaction_started", "compaction_reason": "FilesMarkedForCompaction", "files_L2": [294900], "files_L3": [294935, 294936, 294850, 294851, 294852, 294853, 294854, 294855, 294856, 294857, 294858, 294859, 294860, 294861, 294862, 294863, 294864, 294865, 294866, 294867, 294868, 294937], "score": 0.963878, "input_data_size": 774810634, "oldest_snapshot_seqno": 4478911995} 2024/11/24-06:29:14.122203 139957349447232 (Original Log Time 2024/11/24-06:29:14.120626) [compaction_job.cc:2022] [default] [JOB 42827] Compacted 1@2 + 22@3 files to L3 => 749369014 bytes 2024/11/24-06:29:14.122205 139957349447232 (Original Log Time 2024/11/24-06:29:14.122128) [compaction_job.cc:1224] [default] compacted to: files[0 0 0 22 0 0 0] max score 0.03, MB/sec: 11.5 rd, 11.1 wr, level 3, files in(1, 22) out(22 +0 blob) MB in(27.2, 711.7 +0.0 blob) out(714.7 +0.0 blob), read-write-amplify(53.5) write-amplify(26.3) OK, records in: 19251158, records dropped: 112272 output_compression: Snappy 2024/11/24-06:29:14.122208 139957349447232 (Original Log Time 2024/11/24-06:29:14.122174) EVENT_LOG_v1 {"time_micros": 1732400954122153, "cf": "default", "job": 42827, "event": "compaction_finished", "compaction_time_micros": 67425328, "compaction_time_cpu_micros": 28789411, "output_level": 3, "num_output_files": 22, "total_output_size": 749369014, "num_input_records": 19251158, "num_output_records": 19138886, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "file_write_nanos": 515543050, "file_range_sync_nanos": 0, "file_fsync_nanos": 15422, "file_prepare_write_nanos": 57796, "lsm_state": [0, 0, 0, 22, 0, 0, 0]} 2024/11/24-06:29:14.264086 139957349447232 DEBG dcompact_worker.cpp:240: HttpPost: 200 OK: url = http://nlb-7zny4kaa1poal01o64.cn-shenzhen.nlb.aliyuncs.com:8443, body = {"instanceId":"nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137","labourId":"","dbId":"d89b4006-2803-486e-b7a2-759bcf348921","dbStarts":1732256054,"starts":1732400886,"executesMs":67673,"compactionJobId":42827,"attempt":0,"compactionInputRawBytes":2795294112,"compactionInputZipBytes":774810634,"compactionOutputRawBytes":0,"compactionOutputZipBytes":749369014,"headers":{"Accept":"*/*","Connection":"close","Host":"aliyun-topling-saas.topling.cn:18443","RemoteIp":"120.24.192.169","X-Forwarded-For":"120.24.192.169","region":"cn-shenzhen","token":"e6474c481bd4415abc537135cc03626b","instance-token":"e6474c481bd4415abc537135cc03626b","provider":"aliyun","CloudMarketInstanceId":"si-59c0ae5c955845588903","MeteringAssit":"","Transfer-Encoding":"chunked","traceparent":"00-8f81313801a54ea12ecfd0bd1f69b1e5-bb91ae67abd7ea1b-00"}}, response = 2024/11/24-06:29:14.264161 139957349447232 INFO dcompact_worker.cpp:1459: finish /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-42827/att-00: olev 3, work 67.674 s, result 7.784 ms, install 1.596 ms, input{raw 2.603 GiB zip 738.917 MiB}