2024/11/24-07:43:22.000863 139957206771264 DEBG dcompact_worker.cpp:2214: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00: fork to child time = 0.007718 sec 2024/11/24-07:43:22.001747 139957206771264 DEBG dcompact_worker.cpp:1013: Beg SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00 2024/11/24-07:43:22.006864 139957206771264 DEBG dcompact_worker.cpp:1033: End SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00 2024/11/24-07:43:22.007751 139957206771264 TRAC dcompact_worker.cpp:1083: INFO_LOG_LEVEL: rpc = INFO_LEVEL, env_var = undefined 2024/11/24-07:43:22.007941 139957206771264 [WARN] [column_family.cc:386] multiple cf_paths/db_paths and level_compaction_dynamic_level_bytes can't be used together 2024/11/24-07:43:22.059860 139957206771264 [version_set.cc:6208] Recovering from manifest file: /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-43564/att-00/MANIFEST-206347 2024/11/24-07:43:22.089025 139957206771264 [version_set.cc:6251] Recovered from manifest file:/worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-43564/att-00/MANIFEST-206347 succeeded,manifest_file_number is 206347, next_file_number is 296649, last_sequence is 4501321039, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 296507 2024/11/24-07:43:22.089031 139957206771264 [version_set.cc:6266] Column family [default] (ID 0), log number is 0 2024/11/24-07:43:22.089131 139957206771264 [version_set.cc:5721] Creating manifest 296649 2024/11/24-07:43:22.124621 139957206771264 DEBG dcompact_worker.cpp:1218: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00: bottommost_level: fake = 1, rpc = 0 2024/11/24-07:43:22.144906 139957206771264 [compaction_job.cc:2437] [default] [JOB 43564] Compacting 1@2 + 18@3 files to L3, score 0.89, subcompactions 1 : 1 2024/11/24-07:43:22.144918 139957206771264 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 32653 Base level 2, inputs: [296586(22MB)], [296625(17MB) 296513(34MB) 296514(34MB) 296515(32MB) 296516(34MB) 296517(34MB) 296518(33MB) 296519(34MB) 296520(33MB) 296521(35MB) 296522(33MB) 296523(35MB) 296538(32MB) 296539(30MB) 296540(33MB) 296541(33MB) 296542(32MB) 296626(34MB)] 2024/11/24-07:43:22.151357 139957206771264 [top_zip_table.cc:59] core git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/24-07:43:22.151380 139957206771264 [top_zip_table.cc:60] fsa git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/24-07:43:22.151395 139957206771264 [top_zip_table.cc:61] zbs git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/24-07:43:22.151400 139957206771264 [top_zip_table.cc:62] topling-zip_table_reader: git_version_hash_info_is: commit a4a382006cb82713acf5b3425835f22711877681 Author: leipeng Date: 2024-04-11 19:44:14 +0800 fixed_len_hole_index.cc: Add env bool FixedLenHoleIndexUseAVX512 for ut & debug 1. FixedLenHoleIndexUseAVX512 is only in unit tests or debug 2. In release mode, use avx512 by compile options(-march=) g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/24-07:43:22.151409 139957206771264 [top_zip_table.cc:64] topling-rocks git_version_hash_info_is: commit feab587e468621ba0204d47b4ffacc52e7c4290d Author: leipeng Date: 2024-03-22 13:35:06 +0800 ToplingZipTableBuilder::Add: immediately return after error This function returns void, and caller does not check builder->status() after calling this function and graceful abandon. So immediately return after error, and return error status in Finish(). g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/24-07:43:22.502973 139957206771264 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296650.sst) /dev/shm/ToplingTemp/Topling-299830-wYY3aV 2024/11/24-07:43:23.593967 139957206771264 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296650.sst): first pass time = 1.09's, 123.030'MB/sec 2024/11/24-07:43:25.113162 139957206771264 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296650.sst): old prealloc_size = 147639500, real_size = 34932048 2024/11/24-07:43:25.113749 139957206771264 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296650.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 922534 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1084 GB zip-val = 0.0329 GB avg-val = 117.49 avg-zval = 35.71 2024/11/24-07:43:25.114554 139957206771264 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296650.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-07:43:26.166479 139957206771264 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296650.sst): second pass time = 1.52's, 71.391'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.05's, 37.045'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3103.722'MB/sec (index lex order gen) rebuild zvType time = 0.92's, 0.250'MB/sec write SST data time = 0.13's, 295.802'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.083'MB, throughput = 31316.351'MB/sec zip my value time = 1.52's, unzip length = 0.108'GB zip my value throughput = 71.391'MB/sec zip pipeline throughput = 71.391'MB/sec entries = 922534 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.49 avg-zval = 35.71 usrkeys = 922534 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.49 avg-zval = 35.71 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 922534 bytes = 3228880 } seq expand size = 6457738 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0329 GB dict = 1.08 MB all = 0.0390 GB } UnZip/Zip{ index = 10.5124 value = 3.2898 dict = 1.00 all = 3.4398 } Zip/UnZip{ index = 0.0951 value = 0.3040 dict = 1.00 all = 0.2907 } ---------------------------- total value len = 2251.440418 GB avg = 0.200 KB (by entry num) total key len = 306.908793 GB avg = 0.027 KB total ukey len = 237.373178 GB avg = 0.015 KB total ukey num = 15.739583697 Billion total entry num = 11.280897645 Billion write speed all = 31.163674721 MB/sec (with seq num) write speed all = 30.064358887 MB/sec (without seq num) 2024/11/24-07:43:26.217500 139957206771264 [compaction_job.cc:1948] [default] [JOB 43564] Generated table #296650: 922534 keys, 39019220 bytes, temperature: kWarm 2024/11/24-07:43:26.217591 139957206771264 EVENT_LOG_v1 {"time_micros": 1732405406217536, "cf_name": "default", "job": 43564, "event": "table_file_creation", "file_number": 296650, "file_size": 39019220, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4310565389, "largest_seqno": 4500938607, "table_properties": {"data_size": 32946112, "index_size": 1755136, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25830952, "raw_average_key_size": 28, "raw_value_size": 108386804, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 922534, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732405402, "oldest_key_time": 0, "file_creation_time": 1732405402, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 296650, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-07:43:26.253101 139957206771264 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296651.sst) /dev/shm/ToplingTemp/Topling-299830-cmOtfX 2024/11/24-07:43:27.328170 139957206771264 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296651.sst): first pass time = 1.08's, 124.850'MB/sec 2024/11/24-07:43:28.677185 139957206771264 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296651.sst): old prealloc_size = 147639500, real_size = 33306288 2024/11/24-07:43:28.677714 139957206771264 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296651.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 928234 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0313 GB avg-val = 116.59 avg-zval = 33.73 2024/11/24-07:43:28.678510 139957206771264 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296651.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-07:43:29.536441 139957206771264 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296651.sst): second pass time = 1.35's, 80.307'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.86's, 43.538'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3413.701'MB/sec (index lex order gen) rebuild zvType time = 0.73's, 0.319'MB/sec write SST data time = 0.13's, 286.215'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 34961.601'MB/sec zip my value time = 1.35's, unzip length = 0.108'GB zip my value throughput = 80.307'MB/sec zip pipeline throughput = 80.307'MB/sec entries = 928234 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.59 avg-zval = 33.73 usrkeys = 928234 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.59 avg-zval = 33.73 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 928234 bytes = 3248832 } seq expand size = 6497638 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0313 GB dict = 1.08 MB all = 0.0374 GB } UnZip/Zip{ index = 10.5126 value = 3.4568 dict = 1.00 all = 3.5879 } Zip/UnZip{ index = 0.0951 value = 0.2893 dict = 1.00 all = 0.2787 } ---------------------------- total value len = 2251.555143 GB avg = 0.200 KB (by entry num) total key len = 306.934784 GB avg = 0.027 KB total ukey len = 237.391743 GB avg = 0.015 KB total ukey num = 15.740511931 Billion total entry num = 11.281825879 Billion write speed all = 31.164109510 MB/sec (with seq num) write speed all = 30.064748349 MB/sec (without seq num) 2024/11/24-07:43:29.584676 139957206771264 [compaction_job.cc:1948] [default] [JOB 43564] Generated table #296651: 928234 keys, 37408736 bytes, temperature: kWarm 2024/11/24-07:43:29.584756 139957206771264 EVENT_LOG_v1 {"time_micros": 1732405409584711, "cf_name": "default", "job": 43564, "event": "table_file_creation", "file_number": 296651, "file_size": 37408736, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4261178719, "largest_seqno": 4500938261, "table_properties": {"data_size": 31308064, "index_size": 1765952, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25990552, "raw_average_key_size": 28, "raw_value_size": 108227200, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 928234, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732405406, "oldest_key_time": 0, "file_creation_time": 1732405406, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 296651, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-07:43:29.622582 139957206771264 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296652.sst) /dev/shm/ToplingTemp/Topling-299830-z5pjvX 2024/11/24-07:43:30.596705 139957206771264 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296652.sst): first pass time = 0.97's, 137.789'MB/sec 2024/11/24-07:43:31.940390 139957206771264 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296652.sst): old prealloc_size = 147639500, real_size = 31502144 2024/11/24-07:43:31.940966 139957206771264 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296652.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 919300 prefix = 4 raw-key = 0.0147 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1085 GB zip-val = 0.0295 GB avg-val = 118.00 avg-zval = 32.10 2024/11/24-07:43:31.941741 139957206771264 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296652.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-07:43:32.758868 139957206771264 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296652.sst): second pass time = 1.34's, 80.782'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.82's, 43.471'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3069.761'MB/sec (index lex order gen) rebuild zvType time = 0.69's, 0.334'MB/sec write SST data time = 0.13's, 275.501'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.085'MB, throughput = 33241.728'MB/sec zip my value time = 1.34's, unzip length = 0.108'GB zip my value throughput = 80.782'MB/sec zip pipeline throughput = 80.782'MB/sec entries = 919300 avg-key = 28.00 avg-zkey = 1.92 avg-val = 118.00 avg-zval = 32.10 usrkeys = 919300 avg-key = 20.00 avg-zkey = 1.92 avg-val = 125.00 avg-zval = 32.10 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 919300 bytes = 3217568 } seq expand size = 6435100 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0184 GB value = 0.1085 GB dict = 1.09 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0295 GB dict = 1.09 MB all = 0.0356 GB } UnZip/Zip{ index = 10.4428 value = 3.6758 dict = 1.00 all = 3.7724 } Zip/UnZip{ index = 0.0958 value = 0.2721 dict = 1.00 all = 0.2651 } ---------------------------- total value len = 2251.670055 GB avg = 0.200 KB (by entry num) total key len = 306.960524 GB avg = 0.027 KB total ukey len = 237.410129 GB avg = 0.015 KB total ukey num = 15.741431231 Billion total entry num = 11.282745179 Billion write speed all = 31.164599504 MB/sec (with seq num) write speed all = 30.065191914 MB/sec (without seq num) 2024/11/24-07:43:32.804868 139957206771264 [compaction_job.cc:1948] [default] [JOB 43564] Generated table #296652: 919300 keys, 35578866 bytes, temperature: kWarm 2024/11/24-07:43:32.804940 139957206771264 EVENT_LOG_v1 {"time_micros": 1732405412804903, "cf_name": "default", "job": 43564, "event": "table_file_creation", "file_number": 296652, "file_size": 35578866, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4325987029, "largest_seqno": 4476888276, "table_properties": {"data_size": 29511472, "index_size": 1760640, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25740400, "raw_average_key_size": 28, "raw_value_size": 108477400, "raw_average_value_size": 118, "num_data_blocks": 1, "num_entries": 919300, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 118, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732405409, "oldest_key_time": 0, "file_creation_time": 1732405409, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 296652, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-07:43:32.842056 139957206771264 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296653.sst) /dev/shm/ToplingTemp/Topling-299830-0WxxeX 2024/11/24-07:43:33.699490 139957206771264 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296653.sst): first pass time = 0.86's, 156.541'MB/sec 2024/11/24-07:43:35.054446 139957206771264 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296653.sst): old prealloc_size = 147639500, real_size = 33258368 2024/11/24-07:43:35.055029 139957206771264 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296653.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 928556 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0313 GB avg-val = 116.54 avg-zval = 33.66 2024/11/24-07:43:35.055789 139957206771264 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296653.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-07:43:35.916113 139957206771264 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296653.sst): second pass time = 1.35's, 79.910'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.86's, 43.362'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3126.261'MB/sec (index lex order gen) rebuild zvType time = 0.73's, 0.317'MB/sec write SST data time = 0.13's, 288.898'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 33563.104'MB/sec zip my value time = 1.35's, unzip length = 0.108'GB zip my value throughput = 79.910'MB/sec zip pipeline throughput = 79.910'MB/sec entries = 928556 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.54 avg-zval = 33.66 usrkeys = 928556 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.54 avg-zval = 33.66 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 928556 bytes = 3249968 } seq expand size = 6499892 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0313 GB dict = 1.08 MB all = 0.0374 GB } UnZip/Zip{ index = 10.5135 value = 3.4619 dict = 1.00 all = 3.5924 } Zip/UnZip{ index = 0.0951 value = 0.2889 dict = 1.00 all = 0.2784 } ---------------------------- total value len = 2251.784773 GB avg = 0.200 KB (by entry num) total key len = 306.986524 GB avg = 0.027 KB total ukey len = 237.428700 GB avg = 0.015 KB total ukey num = 15.742359787 Billion total entry num = 11.283673735 Billion write speed all = 31.165114992 MB/sec (with seq num) write speed all = 30.065659203 MB/sec (without seq num) 2024/11/24-07:43:35.963343 139957206771264 [compaction_job.cc:1948] [default] [JOB 43564] Generated table #296653: 928556 keys, 37361960 bytes, temperature: kWarm 2024/11/24-07:43:35.963411 139957206771264 EVENT_LOG_v1 {"time_micros": 1732405415963376, "cf_name": "default", "job": 43564, "event": "table_file_creation", "file_number": 296653, "file_size": 37361960, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4261178730, "largest_seqno": 4500938539, "table_properties": {"data_size": 31259632, "index_size": 1766400, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25999568, "raw_average_key_size": 28, "raw_value_size": 108218272, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 928556, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732405412, "oldest_key_time": 0, "file_creation_time": 1732405412, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 296653, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-07:43:36.000676 139957206771264 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296654.sst) /dev/shm/ToplingTemp/Topling-299830-kcKdZX 2024/11/24-07:43:36.991536 139957206771264 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296654.sst): first pass time = 0.99's, 135.461'MB/sec 2024/11/24-07:43:38.331903 139957206771264 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296654.sst): old prealloc_size = 147639500, real_size = 31483776 2024/11/24-07:43:38.332491 139957206771264 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296654.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 919300 prefix = 4 raw-key = 0.0147 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1085 GB zip-val = 0.0295 GB avg-val = 118.00 avg-zval = 32.08 2024/11/24-07:43:38.333269 139957206771264 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296654.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-07:43:39.153327 139957206771264 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296654.sst): second pass time = 1.34's, 80.983'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.82's, 43.293'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3130.315'MB/sec (index lex order gen) rebuild zvType time = 0.69's, 0.332'MB/sec write SST data time = 0.13's, 275.948'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.085'MB, throughput = 33614.536'MB/sec zip my value time = 1.34's, unzip length = 0.108'GB zip my value throughput = 80.983'MB/sec zip pipeline throughput = 80.983'MB/sec entries = 919300 avg-key = 28.00 avg-zkey = 1.91 avg-val = 118.00 avg-zval = 32.08 usrkeys = 919300 avg-key = 20.00 avg-zkey = 1.91 avg-val = 125.00 avg-zval = 32.08 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 919300 bytes = 3217568 } seq expand size = 6435100 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0184 GB value = 0.1085 GB dict = 1.09 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0295 GB dict = 1.09 MB all = 0.0356 GB } UnZip/Zip{ index = 10.4455 value = 3.6780 dict = 1.00 all = 3.7744 } Zip/UnZip{ index = 0.0957 value = 0.2719 dict = 1.00 all = 0.2649 } ---------------------------- total value len = 2251.899686 GB avg = 0.200 KB (by entry num) total key len = 307.012264 GB avg = 0.027 KB total ukey len = 237.447086 GB avg = 0.015 KB total ukey num = 15.743279087 Billion total entry num = 11.284593035 Billion write speed all = 31.165599296 MB/sec (with seq num) write speed all = 30.066097284 MB/sec (without seq num) 2024/11/24-07:43:39.197086 139957206771264 [compaction_job.cc:1948] [default] [JOB 43564] Generated table #296654: 919300 keys, 35560498 bytes, temperature: kWarm 2024/11/24-07:43:39.197158 139957206771264 EVENT_LOG_v1 {"time_micros": 1732405419197124, "cf_name": "default", "job": 43564, "event": "table_file_creation", "file_number": 296654, "file_size": 35560498, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4335273168, "largest_seqno": 4485647920, "table_properties": {"data_size": 29493552, "index_size": 1760192, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25740400, "raw_average_key_size": 28, "raw_value_size": 108477400, "raw_average_value_size": 118, "num_data_blocks": 1, "num_entries": 919300, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 118, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732405415, "oldest_key_time": 0, "file_creation_time": 1732405415, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 296654, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-07:43:39.236130 139957206771264 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296655.sst) /dev/shm/ToplingTemp/Topling-299830-onF0yY 2024/11/24-07:43:40.234814 139957206771264 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296655.sst): first pass time = 1.00's, 134.400'MB/sec 2024/11/24-07:43:41.584220 139957206771264 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296655.sst): old prealloc_size = 147639500, real_size = 33170720 2024/11/24-07:43:41.584791 139957206771264 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296655.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 928143 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0312 GB avg-val = 116.61 avg-zval = 33.59 2024/11/24-07:43:41.585593 139957206771264 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296655.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-07:43:42.446219 139957206771264 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296655.sst): second pass time = 1.35's, 80.279'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.86's, 43.241'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3225.996'MB/sec (index lex order gen) rebuild zvType time = 0.73's, 0.317'MB/sec write SST data time = 0.13's, 286.572'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 34726.220'MB/sec zip my value time = 1.35's, unzip length = 0.108'GB zip my value throughput = 80.279'MB/sec zip pipeline throughput = 80.279'MB/sec entries = 928143 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.61 avg-zval = 33.59 usrkeys = 928143 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.61 avg-zval = 33.59 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 928143 bytes = 3248512 } seq expand size = 6497001 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0312 GB dict = 1.08 MB all = 0.0373 GB } UnZip/Zip{ index = 10.5138 value = 3.4719 dict = 1.00 all = 3.6010 } Zip/UnZip{ index = 0.0951 value = 0.2880 dict = 1.00 all = 0.2777 } ---------------------------- total value len = 2252.014412 GB avg = 0.200 KB (by entry num) total key len = 307.038252 GB avg = 0.027 KB total ukey len = 237.465649 GB avg = 0.015 KB total ukey num = 15.744207230 Billion total entry num = 11.285521178 Billion write speed all = 31.166063181 MB/sec (with seq num) write speed all = 30.066514833 MB/sec (without seq num) 2024/11/24-07:43:42.492562 139957206771264 [compaction_job.cc:1948] [default] [JOB 43564] Generated table #296655: 928143 keys, 37272574 bytes, temperature: kWarm 2024/11/24-07:43:42.492636 139957206771264 EVENT_LOG_v1 {"time_micros": 1732405422492599, "cf_name": "default", "job": 43564, "event": "table_file_creation", "file_number": 296655, "file_size": 37272574, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4265680186, "largest_seqno": 4500938647, "table_properties": {"data_size": 31172944, "index_size": 1765568, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25988004, "raw_average_key_size": 28, "raw_value_size": 108229742, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 928143, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732405419, "oldest_key_time": 0, "file_creation_time": 1732405419, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 296655, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-07:43:42.530742 139957206771264 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296656.sst) /dev/shm/ToplingTemp/Topling-299830-K4M6jW 2024/11/24-07:43:43.432784 139957206771264 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296656.sst): first pass time = 0.90's, 148.800'MB/sec 2024/11/24-07:43:44.796388 139957206771264 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296656.sst): old prealloc_size = 147639500, real_size = 31424016 2024/11/24-07:43:44.796921 139957206771264 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296656.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 919300 prefix = 4 raw-key = 0.0147 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1085 GB zip-val = 0.0294 GB avg-val = 118.00 avg-zval = 32.02 2024/11/24-07:43:44.797685 139957206771264 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296656.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-07:43:45.613370 139957206771264 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296656.sst): second pass time = 1.36's, 79.621'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.82's, 43.455'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3445.150'MB/sec (index lex order gen) rebuild zvType time = 0.69's, 0.334'MB/sec write SST data time = 0.13's, 275.844'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.085'MB, throughput = 33944.750'MB/sec zip my value time = 1.36's, unzip length = 0.108'GB zip my value throughput = 79.621'MB/sec zip pipeline throughput = 79.621'MB/sec entries = 919300 avg-key = 28.00 avg-zkey = 1.91 avg-val = 118.00 avg-zval = 32.02 usrkeys = 919300 avg-key = 20.00 avg-zkey = 1.91 avg-val = 125.00 avg-zval = 32.02 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 919300 bytes = 3217568 } seq expand size = 6435100 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0184 GB value = 0.1085 GB dict = 1.09 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0294 GB dict = 1.09 MB all = 0.0355 GB } UnZip/Zip{ index = 10.4474 value = 3.6854 dict = 1.00 all = 3.7807 } Zip/UnZip{ index = 0.0957 value = 0.2713 dict = 1.00 all = 0.2645 } ---------------------------- total value len = 2252.129325 GB avg = 0.200 KB (by entry num) total key len = 307.063993 GB avg = 0.027 KB total ukey len = 237.484035 GB avg = 0.015 KB total ukey num = 15.745126530 Billion total entry num = 11.286440478 Billion write speed all = 31.166574004 MB/sec (with seq num) write speed all = 30.066978503 MB/sec (without seq num) 2024/11/24-07:43:45.658328 139957206771264 [compaction_job.cc:1948] [default] [JOB 43564] Generated table #296656: 919300 keys, 35500722 bytes, temperature: kWarm 2024/11/24-07:43:45.658401 139957206771264 EVENT_LOG_v1 {"time_micros": 1732405425658365, "cf_name": "default", "job": 43564, "event": "table_file_creation", "file_number": 296656, "file_size": 35500722, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4351151589, "largest_seqno": 4500754434, "table_properties": {"data_size": 29434112, "index_size": 1759872, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25740400, "raw_average_key_size": 28, "raw_value_size": 108477400, "raw_average_value_size": 118, "num_data_blocks": 1, "num_entries": 919300, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 118, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732405422, "oldest_key_time": 0, "file_creation_time": 1732405422, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 296656, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-07:43:45.693967 139957206771264 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296657.sst) /dev/shm/ToplingTemp/Topling-299830-nwCryW 2024/11/24-07:43:46.686509 139957206771264 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296657.sst): first pass time = 0.99's, 135.234'MB/sec 2024/11/24-07:43:48.045359 139957206771264 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296657.sst): old prealloc_size = 147639500, real_size = 33068912 2024/11/24-07:43:48.045927 139957206771264 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296657.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 928307 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0311 GB avg-val = 116.58 avg-zval = 33.47 2024/11/24-07:43:48.046695 139957206771264 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296657.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-07:43:48.905887 139957206771264 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296657.sst): second pass time = 1.36's, 79.717'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.86's, 43.197'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3252.120'MB/sec (index lex order gen) rebuild zvType time = 0.73's, 0.318'MB/sec write SST data time = 0.13's, 285.899'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 36564.865'MB/sec zip my value time = 1.36's, unzip length = 0.108'GB zip my value throughput = 79.717'MB/sec zip pipeline throughput = 79.717'MB/sec entries = 928307 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.58 avg-zval = 33.47 usrkeys = 928307 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.58 avg-zval = 33.47 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 928307 bytes = 3249088 } seq expand size = 6498149 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0311 GB dict = 1.08 MB all = 0.0372 GB } UnZip/Zip{ index = 10.5115 value = 3.4832 dict = 1.00 all = 3.6108 } Zip/UnZip{ index = 0.0951 value = 0.2871 dict = 1.00 all = 0.2769 } ---------------------------- total value len = 2252.244048 GB avg = 0.200 KB (by entry num) total key len = 307.089985 GB avg = 0.027 KB total ukey len = 237.502601 GB avg = 0.015 KB total ukey num = 15.746054837 Billion total entry num = 11.287368785 Billion write speed all = 31.167037972 MB/sec (with seq num) write speed all = 30.067396122 MB/sec (without seq num) 2024/11/24-07:43:48.953029 139957206771264 [compaction_job.cc:1948] [default] [JOB 43564] Generated table #296657: 928307 keys, 37171004 bytes, temperature: kWarm 2024/11/24-07:43:48.953105 139957206771264 EVENT_LOG_v1 {"time_micros": 1732405428953067, "cf_name": "default", "job": 43564, "event": "table_file_creation", "file_number": 296657, "file_size": 37171004, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4265680199, "largest_seqno": 4500938309, "table_properties": {"data_size": 31070368, "index_size": 1766272, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25992596, "raw_average_key_size": 28, "raw_value_size": 108225270, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 928307, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732405425, "oldest_key_time": 0, "file_creation_time": 1732405425, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 296657, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-07:43:48.990657 139957206771264 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296658.sst) /dev/shm/ToplingTemp/Topling-299830-4ou0DW 2024/11/24-07:43:50.005089 139957206771264 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296658.sst): first pass time = 1.01's, 132.314'MB/sec 2024/11/24-07:43:51.305445 139957206771264 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296658.sst): old prealloc_size = 147639500, real_size = 31134768 2024/11/24-07:43:51.305996 139957206771264 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296658.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 921817 prefix = 4 raw-key = 0.0147 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1084 GB zip-val = 0.0291 GB avg-val = 117.60 avg-zval = 31.61 2024/11/24-07:43:51.306758 139957206771264 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296658.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-07:43:52.118232 139957206771264 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296658.sst): second pass time = 1.30's, 83.418'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.81's, 43.332'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3357.015'MB/sec (index lex order gen) rebuild zvType time = 0.68's, 0.337'MB/sec write SST data time = 0.13's, 272.683'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.084'MB, throughput = 35649.548'MB/sec zip my value time = 1.30's, unzip length = 0.108'GB zip my value throughput = 83.418'MB/sec zip pipeline throughput = 83.418'MB/sec entries = 921817 avg-key = 28.00 avg-zkey = 1.91 avg-val = 117.60 avg-zval = 31.61 usrkeys = 921817 avg-key = 20.00 avg-zkey = 1.91 avg-val = 124.60 avg-zval = 31.61 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 921817 bytes = 3226368 } seq expand size = 6452719 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0184 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0291 GB dict = 1.08 MB all = 0.0352 GB } UnZip/Zip{ index = 10.4475 value = 3.7203 dict = 1.00 all = 3.8110 } Zip/UnZip{ index = 0.0957 value = 0.2688 dict = 1.00 all = 0.2624 } ---------------------------- total value len = 2252.358908 GB avg = 0.200 KB (by entry num) total key len = 307.115796 GB avg = 0.027 KB total ukey len = 237.521037 GB avg = 0.015 KB total ukey num = 15.746976654 Billion total entry num = 11.288290602 Billion write speed all = 31.167531779 MB/sec (with seq num) write speed all = 30.067843142 MB/sec (without seq num) 2024/11/24-07:43:52.162419 139957206771264 [compaction_job.cc:1948] [default] [JOB 43564] Generated table #296658: 921817 keys, 35218304 bytes, temperature: kWarm 2024/11/24-07:43:52.162492 139957206771264 EVENT_LOG_v1 {"time_micros": 1732405432162456, "cf_name": "default", "job": 43564, "event": "table_file_creation", "file_number": 296658, "file_size": 35218304, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4366237017, "largest_seqno": 4500938328, "table_properties": {"data_size": 29139488, "index_size": 1764672, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25810876, "raw_average_key_size": 28, "raw_value_size": 108406974, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 921817, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732405428, "oldest_key_time": 0, "file_creation_time": 1732405428, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 296658, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-07:43:52.204817 139957206771264 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296659.sst) /dev/shm/ToplingTemp/Topling-299830-M9Q75W 2024/11/24-07:43:53.209236 139957206771264 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296659.sst): first pass time = 1.00's, 133.634'MB/sec 2024/11/24-07:43:54.564942 139957206771264 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296659.sst): old prealloc_size = 147639500, real_size = 33015984 2024/11/24-07:43:54.565527 139957206771264 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296659.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 925429 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0310 GB avg-val = 117.03 avg-zval = 33.52 2024/11/24-07:43:54.566304 139957206771264 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296659.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-07:43:55.411249 139957206771264 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296659.sst): second pass time = 1.35's, 79.952'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.85's, 43.850'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3259.037'MB/sec (index lex order gen) rebuild zvType time = 0.72's, 0.323'MB/sec write SST data time = 0.13's, 287.329'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 31596.081'MB/sec zip my value time = 1.35's, unzip length = 0.108'GB zip my value throughput = 79.952'MB/sec zip pipeline throughput = 79.952'MB/sec entries = 925429 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.03 avg-zval = 33.52 usrkeys = 925429 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.03 avg-zval = 33.52 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 925429 bytes = 3239024 } seq expand size = 6478003 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0310 GB dict = 1.08 MB all = 0.0371 GB } UnZip/Zip{ index = 10.5143 value = 3.4910 dict = 1.00 all = 3.6168 } Zip/UnZip{ index = 0.0951 value = 0.2864 dict = 1.00 all = 0.2765 } ---------------------------- total value len = 2252.473692 GB avg = 0.200 KB (by entry num) total key len = 307.141708 GB avg = 0.027 KB total ukey len = 237.539546 GB avg = 0.015 KB total ukey num = 15.747902083 Billion total entry num = 11.289216031 Billion write speed all = 31.167995235 MB/sec (with seq num) write speed all = 30.068260544 MB/sec (without seq num) 2024/11/24-07:43:55.458783 139957206771264 [compaction_job.cc:1948] [default] [JOB 43564] Generated table #296659: 925429 keys, 37109726 bytes, temperature: kWarm 2024/11/24-07:43:55.458855 139957206771264 EVENT_LOG_v1 {"time_micros": 1732405435458819, "cf_name": "default", "job": 43564, "event": "table_file_creation", "file_number": 296659, "file_size": 37109726, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4265680212, "largest_seqno": 4500937658, "table_properties": {"data_size": 31024096, "index_size": 1760320, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25912012, "raw_average_key_size": 28, "raw_value_size": 108305738, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 925429, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732405432, "oldest_key_time": 0, "file_creation_time": 1732405432, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 296659, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-07:43:55.497222 139957206771264 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296660.sst) /dev/shm/ToplingTemp/Topling-299830-YGRjdU 2024/11/24-07:43:56.504130 139957206771264 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296660.sst): first pass time = 1.01's, 133.302'MB/sec 2024/11/24-07:43:57.835829 139957206771264 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296660.sst): old prealloc_size = 147639500, real_size = 30933840 2024/11/24-07:43:57.836413 139957206771264 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296660.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 924724 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1083 GB zip-val = 0.0289 GB avg-val = 117.14 avg-zval = 31.29 2024/11/24-07:43:57.837153 139957206771264 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296660.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-07:43:58.650324 139957206771264 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296660.sst): second pass time = 1.33's, 81.391'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.81's, 42.861'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3154.949'MB/sec (index lex order gen) rebuild zvType time = 0.68's, 0.338'MB/sec write SST data time = 0.13's, 270.611'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 31693.660'MB/sec zip my value time = 1.33's, unzip length = 0.108'GB zip my value throughput = 81.391'MB/sec zip pipeline throughput = 81.391'MB/sec entries = 924724 avg-key = 28.00 avg-zkey = 1.91 avg-val = 117.14 avg-zval = 31.29 usrkeys = 924724 avg-key = 20.00 avg-zkey = 1.91 avg-val = 124.14 avg-zval = 31.29 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 924724 bytes = 3120960 } seq expand size = 6473068 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0289 GB dict = 1.08 MB all = 0.0349 GB } UnZip/Zip{ index = 10.4440 value = 3.7442 dict = 1.00 all = 3.8448 } Zip/UnZip{ index = 0.0957 value = 0.2671 dict = 1.00 all = 0.2601 } ---------------------------- total value len = 2252.588490 GB avg = 0.200 KB (by entry num) total key len = 307.167601 GB avg = 0.027 KB total ukey len = 237.558040 GB avg = 0.015 KB total ukey num = 15.748826807 Billion total entry num = 11.290140755 Billion write speed all = 31.168479066 MB/sec (with seq num) write speed all = 30.068697671 MB/sec (without seq num) 2024/11/24-07:43:58.694481 139957206771264 [compaction_job.cc:1948] [default] [JOB 43564] Generated table #296660: 924724 keys, 34908956 bytes, temperature: kWarm 2024/11/24-07:43:58.694564 139957206771264 EVENT_LOG_v1 {"time_micros": 1732405438694520, "cf_name": "default", "job": 43564, "event": "table_file_creation", "file_number": 296660, "file_size": 34908956, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4383078006, "largest_seqno": 4500938346, "table_properties": {"data_size": 28931648, "index_size": 1770816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25892272, "raw_average_key_size": 28, "raw_value_size": 108325460, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 924724, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732405435, "oldest_key_time": 0, "file_creation_time": 1732405435, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 296660, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-07:43:58.733630 139957206771264 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296661.sst) /dev/shm/ToplingTemp/Topling-299830-hLv35X 2024/11/24-07:43:59.692097 139957206771264 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296661.sst): first pass time = 0.96's, 140.040'MB/sec 2024/11/24-07:44:01.033187 139957206771264 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296661.sst): old prealloc_size = 147639500, real_size = 32835568 2024/11/24-07:44:01.033771 139957206771264 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296661.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 922919 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1084 GB zip-val = 0.0308 GB avg-val = 117.43 avg-zval = 33.41 2024/11/24-07:44:01.034712 139957206771264 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296661.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-07:44:01.873756 139957206771264 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296661.sst): second pass time = 1.34's, 80.862'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.84's, 43.933'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3169.506'MB/sec (index lex order gen) rebuild zvType time = 0.71's, 0.325'MB/sec write SST data time = 0.13's, 284.250'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.083'MB, throughput = 33864.690'MB/sec zip my value time = 1.34's, unzip length = 0.108'GB zip my value throughput = 80.862'MB/sec zip pipeline throughput = 80.862'MB/sec entries = 922919 avg-key = 28.00 avg-zkey = 1.91 avg-val = 117.43 avg-zval = 33.41 usrkeys = 922919 avg-key = 20.00 avg-zkey = 1.91 avg-val = 124.43 avg-zval = 33.41 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 922919 bytes = 3230224 } seq expand size = 6460433 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0308 GB dict = 1.08 MB all = 0.0369 GB } UnZip/Zip{ index = 10.4456 value = 3.5144 dict = 1.00 all = 3.6347 } Zip/UnZip{ index = 0.0957 value = 0.2845 dict = 1.00 all = 0.2751 } ---------------------------- total value len = 2252.703327 GB avg = 0.200 KB (by entry num) total key len = 307.193442 GB avg = 0.027 KB total ukey len = 237.576499 GB avg = 0.015 KB total ukey num = 15.749749726 Billion total entry num = 11.291063674 Billion write speed all = 31.168968643 MB/sec (with seq num) write speed all = 30.069140513 MB/sec (without seq num) 2024/11/24-07:44:01.919851 139957206771264 [compaction_job.cc:1948] [default] [JOB 43564] Generated table #296661: 922919 keys, 36927248 bytes, temperature: kWarm 2024/11/24-07:44:01.919925 139957206771264 EVENT_LOG_v1 {"time_micros": 1732405441919887, "cf_name": "default", "job": 43564, "event": "table_file_creation", "file_number": 296661, "file_size": 36927248, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4265679834, "largest_seqno": 4500937389, "table_properties": {"data_size": 30837536, "index_size": 1767104, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25841732, "raw_average_key_size": 28, "raw_value_size": 108376050, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 922919, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732405438, "oldest_key_time": 0, "file_creation_time": 1732405438, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 296661, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-07:44:01.958253 139957206771264 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296662.sst) /dev/shm/ToplingTemp/Topling-299830-uzsWVW 2024/11/24-07:44:02.913751 139957206771264 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296662.sst): first pass time = 0.96's, 140.477'MB/sec 2024/11/24-07:44:04.165049 139957206771264 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296662.sst): old prealloc_size = 147639500, real_size = 28106736 2024/11/24-07:44:04.165620 139957206771264 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296662.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 943830 prefix = 4 raw-key = 0.0151 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1078 GB zip-val = 0.0261 GB avg-val = 114.21 avg-zval = 27.61 2024/11/24-07:44:04.166428 139957206771264 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296662.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0024 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-07:44:05.001935 139957206771264 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296662.sst): second pass time = 1.25's, 86.230'MB/sec, value only(80.3% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.84's, 38.540'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3288.728'MB/sec (index lex order gen) rebuild zvType time = 0.71's, 0.334'MB/sec write SST data time = 0.13's, 247.160'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.074'MB, throughput = 31038.580'MB/sec zip my value time = 1.25's, unzip length = 0.108'GB zip my value throughput = 86.230'MB/sec zip pipeline throughput = 86.230'MB/sec entries = 943830 avg-key = 28.00 avg-zkey = 1.91 avg-val = 114.21 avg-zval = 27.61 usrkeys = 943830 avg-key = 20.00 avg-zkey = 1.91 avg-val = 121.21 avg-zval = 27.61 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 943830 bytes = 3303424 } seq expand size = 6606810 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0189 GB value = 0.1078 GB dict = 1.07 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0261 GB dict = 1.07 MB all = 0.0323 GB } UnZip/Zip{ index = 10.4443 value = 4.1357 dict = 1.00 all = 4.1615 } Zip/UnZip{ index = 0.0957 value = 0.2418 dict = 1.00 all = 0.2403 } ---------------------------- total value len = 2252.817724 GB avg = 0.200 KB (by entry num) total key len = 307.219869 GB avg = 0.027 KB total ukey len = 237.595375 GB avg = 0.015 KB total ukey num = 15.750693556 Billion total entry num = 11.292007504 Billion write speed all = 31.169496110 MB/sec (with seq num) write speed all = 30.069617937 MB/sec (without seq num) 2024/11/24-07:44:05.042797 139957206771264 [compaction_job.cc:1948] [default] [JOB 43564] Generated table #296662: 943830 keys, 32252348 bytes, temperature: kWarm 2024/11/24-07:44:05.042868 139957206771264 EVENT_LOG_v1 {"time_micros": 1732405445042832, "cf_name": "default", "job": 43564, "event": "table_file_creation", "file_number": 296662, "file_size": 32252348, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4265680463, "largest_seqno": 4500937408, "table_properties": {"data_size": 26063264, "index_size": 1807360, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26427240, "raw_average_key_size": 28, "raw_value_size": 107790536, "raw_average_value_size": 114, "num_data_blocks": 1, "num_entries": 943830, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732405441, "oldest_key_time": 0, "file_creation_time": 1732405441, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 296662, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-07:44:05.078538 139957206771264 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296663.sst) /dev/shm/ToplingTemp/Topling-299830-KCRTkW 2024/11/24-07:44:06.036776 139957206771264 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296663.sst): first pass time = 0.96's, 140.073'MB/sec 2024/11/24-07:44:07.329480 139957206771264 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296663.sst): old prealloc_size = 147639500, real_size = 27743808 2024/11/24-07:44:07.330069 139957206771264 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296663.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 945196 prefix = 4 raw-key = 0.0151 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.93 raw-val = 0.1078 GB zip-val = 0.0257 GB avg-val = 114.00 avg-zval = 27.18 2024/11/24-07:44:07.331159 139957206771264 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296663.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0024 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-07:44:08.165845 139957206771264 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296663.sst): second pass time = 1.29's, 83.431'MB/sec, value only(80.3% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.84's, 37.993'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3223.215'MB/sec (index lex order gen) rebuild zvType time = 0.71's, 0.335'MB/sec write SST data time = 0.13's, 243.976'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.073'MB, throughput = 36468.846'MB/sec zip my value time = 1.29's, unzip length = 0.108'GB zip my value throughput = 83.431'MB/sec zip pipeline throughput = 83.431'MB/sec entries = 945196 avg-key = 28.00 avg-zkey = 1.93 avg-val = 114.00 avg-zval = 27.18 usrkeys = 945196 avg-key = 20.00 avg-zkey = 1.93 avg-val = 121.00 avg-zval = 27.18 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 945196 bytes = 3190048 } seq expand size = 6616372 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0189 GB value = 0.1078 GB dict = 1.07 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0257 GB dict = 1.07 MB all = 0.0318 GB } UnZip/Zip{ index = 10.3778 value = 4.1950 dict = 1.00 all = 4.2240 } Zip/UnZip{ index = 0.0964 value = 0.2384 dict = 1.00 all = 0.2367 } ---------------------------- total value len = 2252.932093 GB avg = 0.199 KB (by entry num) total key len = 307.246335 GB avg = 0.027 KB total ukey len = 237.614279 GB avg = 0.015 KB total ukey num = 15.751638752 Billion total entry num = 11.292952700 Billion write speed all = 31.170010096 MB/sec (with seq num) write speed all = 30.070082229 MB/sec (without seq num) 2024/11/24-07:44:08.205473 139957206771264 [compaction_job.cc:1948] [default] [JOB 43564] Generated table #296663: 945196 keys, 31774896 bytes, temperature: kWarm 2024/11/24-07:44:08.205543 139957206771264 EVENT_LOG_v1 {"time_micros": 1732405448205508, "cf_name": "default", "job": 43564, "event": "table_file_creation", "file_number": 296663, "file_size": 31774896, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4360126997, "largest_seqno": 4463883173, "table_properties": {"data_size": 25685744, "index_size": 1821568, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26465488, "raw_average_key_size": 28, "raw_value_size": 107752344, "raw_average_value_size": 114, "num_data_blocks": 1, "num_entries": 945196, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 114, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732405445, "oldest_key_time": 0, "file_creation_time": 1732405445, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 296663, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-07:44:08.243599 139957206771264 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296664.sst) /dev/shm/ToplingTemp/Topling-299830-MjqSsW 2024/11/24-07:44:09.197938 139957206771264 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296664.sst): first pass time = 0.95's, 140.644'MB/sec 2024/11/24-07:44:10.530826 139957206771264 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296664.sst): old prealloc_size = 147639500, real_size = 33195568 2024/11/24-07:44:10.531369 139957206771264 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296664.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 928389 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0312 GB avg-val = 116.57 avg-zval = 33.60 2024/11/24-07:44:10.532147 139957206771264 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296664.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-07:44:11.387991 139957206771264 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296664.sst): second pass time = 1.33's, 81.236'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.86's, 43.515'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3400.152'MB/sec (index lex order gen) rebuild zvType time = 0.73's, 0.318'MB/sec write SST data time = 0.13's, 291.745'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 32052.571'MB/sec zip my value time = 1.33's, unzip length = 0.108'GB zip my value throughput = 81.236'MB/sec zip pipeline throughput = 81.236'MB/sec entries = 928389 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.57 avg-zval = 33.60 usrkeys = 928389 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.57 avg-zval = 33.60 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 928389 bytes = 3249376 } seq expand size = 6498723 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0312 GB dict = 1.08 MB all = 0.0373 GB } UnZip/Zip{ index = 10.5113 value = 3.4690 dict = 1.00 all = 3.5985 } Zip/UnZip{ index = 0.0951 value = 0.2883 dict = 1.00 all = 0.2779 } ---------------------------- total value len = 2253.046814 GB avg = 0.199 KB (by entry num) total key len = 307.272330 GB avg = 0.027 KB total ukey len = 237.632847 GB avg = 0.015 KB total ukey num = 15.752567141 Billion total entry num = 11.293881089 Billion write speed all = 31.170500516 MB/sec (with seq num) write speed all = 30.070525375 MB/sec (without seq num) 2024/11/24-07:44:11.433279 139957206771264 [compaction_job.cc:1948] [default] [JOB 43564] Generated table #296664: 928389 keys, 37297882 bytes, temperature: kWarm 2024/11/24-07:44:11.433349 139957206771264 EVENT_LOG_v1 {"time_micros": 1732405451433313, "cf_name": "default", "job": 43564, "event": "table_file_creation", "file_number": 296664, "file_size": 37297882, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4265679848, "largest_seqno": 4500937113, "table_properties": {"data_size": 31196832, "index_size": 1766464, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25994892, "raw_average_key_size": 28, "raw_value_size": 108222842, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 928389, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732405448, "oldest_key_time": 0, "file_creation_time": 1732405448, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 296664, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-07:44:11.470242 139957206771264 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296665.sst) /dev/shm/ToplingTemp/Topling-299830-B1R57V 2024/11/24-07:44:12.446552 139957206771264 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296665.sst): first pass time = 0.98's, 137.480'MB/sec 2024/11/24-07:44:13.776222 139957206771264 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296665.sst): old prealloc_size = 147639500, real_size = 31354624 2024/11/24-07:44:13.776770 139957206771264 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296665.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 921101 prefix = 4 raw-key = 0.0147 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.93 raw-val = 0.1084 GB zip-val = 0.0293 GB avg-val = 117.71 avg-zval = 31.86 2024/11/24-07:44:13.777536 139957206771264 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296665.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-07:44:14.616194 139957206771264 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296665.sst): second pass time = 1.33's, 81.619'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.84's, 42.188'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3380.479'MB/sec (index lex order gen) rebuild zvType time = 0.71's, 0.324'MB/sec write SST data time = 0.13's, 277.430'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.084'MB, throughput = 33139.345'MB/sec zip my value time = 1.33's, unzip length = 0.108'GB zip my value throughput = 81.619'MB/sec zip pipeline throughput = 81.619'MB/sec entries = 921101 avg-key = 28.00 avg-zkey = 1.93 avg-val = 117.71 avg-zval = 31.86 usrkeys = 921101 avg-key = 20.00 avg-zkey = 1.93 avg-val = 124.71 avg-zval = 31.86 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 921101 bytes = 3223872 } seq expand size = 6447707 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0184 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0293 GB dict = 1.08 MB all = 0.0354 GB } UnZip/Zip{ index = 10.3765 value = 3.6944 dict = 1.00 all = 3.7876 } Zip/UnZip{ index = 0.0964 value = 0.2707 dict = 1.00 all = 0.2640 } ---------------------------- total value len = 2253.161689 GB avg = 0.199 KB (by entry num) total key len = 307.298121 GB avg = 0.027 KB total ukey len = 237.651269 GB avg = 0.015 KB total ukey num = 15.753488242 Billion total entry num = 11.294802190 Billion write speed all = 31.170987966 MB/sec (with seq num) write speed all = 30.070966347 MB/sec (without seq num) 2024/11/24-07:44:14.659669 139957206771264 [compaction_job.cc:1948] [default] [JOB 43564] Generated table #296665: 921101 keys, 35435964 bytes, temperature: kWarm 2024/11/24-07:44:14.659749 139957206771264 EVENT_LOG_v1 {"time_micros": 1732405454659714, "cf_name": "default", "job": 43564, "event": "table_file_creation", "file_number": 296665, "file_size": 35435964, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4356813921, "largest_seqno": 4500938391, "table_properties": {"data_size": 29348784, "index_size": 1775360, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25790828, "raw_average_key_size": 28, "raw_value_size": 108426978, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 921101, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732405451, "oldest_key_time": 0, "file_creation_time": 1732405451, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 296665, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-07:44:14.702816 139957206771264 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296666.sst) /dev/shm/ToplingTemp/Topling-299830-qCc7EV 2024/11/24-07:44:15.676548 139957206771264 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296666.sst): first pass time = 0.97's, 137.845'MB/sec 2024/11/24-07:44:16.944739 139957206771264 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296666.sst): old prealloc_size = 147639500, real_size = 27742320 2024/11/24-07:44:16.945309 139957206771264 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296666.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 945196 prefix = 4 raw-key = 0.0151 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.93 raw-val = 0.1078 GB zip-val = 0.0257 GB avg-val = 114.00 avg-zval = 27.17 2024/11/24-07:44:16.946056 139957206771264 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296666.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0024 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-07:44:17.786209 139957206771264 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296666.sst): second pass time = 1.27's, 85.057'MB/sec, value only(80.3% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.84's, 37.761'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3333.111'MB/sec (index lex order gen) rebuild zvType time = 0.71's, 0.333'MB/sec write SST data time = 0.13's, 241.492'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.073'MB, throughput = 35113.641'MB/sec zip my value time = 1.27's, unzip length = 0.108'GB zip my value throughput = 85.057'MB/sec zip pipeline throughput = 85.057'MB/sec entries = 945196 avg-key = 28.00 avg-zkey = 1.93 avg-val = 114.00 avg-zval = 27.17 usrkeys = 945196 avg-key = 20.00 avg-zkey = 1.93 avg-val = 121.00 avg-zval = 27.17 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 945196 bytes = 3190048 } seq expand size = 6616372 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0189 GB value = 0.1078 GB dict = 1.07 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0257 GB dict = 1.07 MB all = 0.0318 GB } UnZip/Zip{ index = 10.3775 value = 4.1953 dict = 1.00 all = 4.2242 } Zip/UnZip{ index = 0.0964 value = 0.2384 dict = 1.00 all = 0.2367 } ---------------------------- total value len = 2253.276058 GB avg = 0.199 KB (by entry num) total key len = 307.324586 GB avg = 0.027 KB total ukey len = 237.670173 GB avg = 0.015 KB total ukey num = 15.754433438 Billion total entry num = 11.295747386 Billion write speed all = 31.171499518 MB/sec (with seq num) write speed all = 30.071428298 MB/sec (without seq num) 2024/11/24-07:44:17.828661 139957206771264 [compaction_job.cc:1948] [default] [JOB 43564] Generated table #296666: 945196 keys, 31773552 bytes, temperature: kWarm 2024/11/24-07:44:17.828739 139957206771264 EVENT_LOG_v1 {"time_micros": 1732405457828703, "cf_name": "default", "job": 43564, "event": "table_file_creation", "file_number": 296666, "file_size": 31773552, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4368210957, "largest_seqno": 4471904400, "table_properties": {"data_size": 25684192, "index_size": 1821632, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26465488, "raw_average_key_size": 28, "raw_value_size": 107752344, "raw_average_value_size": 114, "num_data_blocks": 1, "num_entries": 945196, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 114, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732405454, "oldest_key_time": 0, "file_creation_time": 1732405454, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 296666, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-07:44:17.871860 139957206771264 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296667.sst) /dev/shm/ToplingTemp/Topling-299830-JDRY7W 2024/11/24-07:44:18.186139 139957206771264 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296667.sst): first pass time = 0.31's, 249.449'MB/sec 2024/11/24-07:44:18.990241 139957206771264 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296667.sst): old prealloc_size = 147639500, real_size = 20651312 2024/11/24-07:44:18.990600 139957206771264 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296667.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 544066 prefix = 4 raw-key = 0.0087 GB zip-key = 0.0010 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.0632 GB zip-val = 0.0195 GB avg-val = 116.08 avg-zval = 35.80 2024/11/24-07:44:18.991118 139957206771264 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296667.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0014 GB, waited 0.000 sec, Key+Value = 0.078 GB 2024/11/24-07:44:19.480722 139957206771264 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00/296667.sst): second pass time = 0.80's, 78.615'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.49's, 47.013'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3086.075'MB/sec (index lex order gen) rebuild zvType time = 0.42's, 0.328'MB/sec write SST data time = 0.07's, 307.475'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.634'MB, throughput = 21240.070'MB/sec zip my value time = 0.80's, unzip length = 0.063'GB zip my value throughput = 78.615'MB/sec zip pipeline throughput = 78.615'MB/sec entries = 544066 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.08 avg-zval = 35.80 usrkeys = 544066 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.08 avg-zval = 35.80 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 544066 bytes = 1904240 } seq expand size = 3808462 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0109 GB value = 0.0632 GB dict = 0.63 MB all = 0.0784 GB } __ZipSize{ index = 0.0010 GB value = 0.0195 GB dict = 0.63 MB all = 0.0231 GB } UnZip/Zip{ index = 10.5081 value = 3.2420 dict = 1.00 all = 3.3996 } Zip/UnZip{ index = 0.0952 value = 0.3085 dict = 1.00 all = 0.2942 } ---------------------------- total value len = 2253.343019 GB avg = 0.199 KB (by entry num) total key len = 307.339820 GB avg = 0.027 KB total ukey len = 237.681054 GB avg = 0.015 KB total ukey num = 15.754977504 Billion total entry num = 11.296291452 Billion write speed all = 31.171857104 MB/sec (with seq num) write speed all = 30.071755592 MB/sec (without seq num) 2024/11/24-07:44:19.511945 139957206771264 [compaction_job.cc:1948] [default] [JOB 43564] Generated table #296667: 544066 keys, 23057625 bytes, temperature: kWarm 2024/11/24-07:44:19.512022 139957206771264 EVENT_LOG_v1 {"time_micros": 1732405459511987, "cf_name": "default", "job": 43564, "event": "table_file_creation", "file_number": 296667, "file_size": 23057625, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4265679865, "largest_seqno": 4500939187, "table_properties": {"data_size": 19479584, "index_size": 1035520, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 15233848, "raw_average_key_size": 28, "raw_value_size": 63152748, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 544066, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732405457, "oldest_key_time": 0, "file_creation_time": 1732405457, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 296667, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-07:44:19.532179 139957206771264 [compaction_job.cc:703] job-43564: subcompact[0], size: 0.630630 G, files: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43564/att-00 [296650,296651,296652,296653,296654,296655,296656,296657,296658,296659,296660,296661,296662,296663,296664,296665,296666,296667] 2024/11/24-07:44:19.640159 139957206771264 (Original Log Time 2024/11/24-07:43:22.144949) EVENT_LOG_v1 {"time_micros": 1732405402144925, "job": 43564, "event": "compaction_started", "compaction_reason": "FilesMarkedForCompaction", "files_L2": [296586], "files_L3": [296625, 296513, 296514, 296515, 296516, 296517, 296518, 296519, 296520, 296521, 296522, 296523, 296538, 296539, 296540, 296541, 296542, 296626], "score": 0.888284, "input_data_size": 642941557, "oldest_snapshot_seqno": 4501321002} 2024/11/24-07:44:19.640164 139957206771264 (Original Log Time 2024/11/24-07:44:19.638712) [compaction_job.cc:2022] [default] [JOB 43564] Compacted 1@2 + 18@3 files to L3 => 630630081 bytes 2024/11/24-07:44:19.640166 139957206771264 (Original Log Time 2024/11/24-07:44:19.640095) [compaction_job.cc:1224] [default] compacted to: files[0 0 0 18 0 0 0] max score 0.02, MB/sec: 11.2 rd, 11.0 wr, level 3, files in(1, 18) out(18 +0 blob) MB in(22.1, 591.0 +0.0 blob) out(601.4 +0.0 blob), read-write-amplify(54.9) write-amplify(27.2) OK, records in: 16380185, records dropped: 63844 output_compression: Snappy 2024/11/24-07:44:19.640174 139957206771264 (Original Log Time 2024/11/24-07:44:19.640139) EVENT_LOG_v1 {"time_micros": 1732405459640118, "cf": "default", "job": 43564, "event": "compaction_finished", "compaction_time_micros": 57387239, "compaction_time_cpu_micros": 24699041, "output_level": 3, "num_output_files": 18, "total_output_size": 630630081, "num_input_records": 16380185, "num_output_records": 16316341, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "file_write_nanos": 432294303, "file_range_sync_nanos": 0, "file_fsync_nanos": 13325, "file_prepare_write_nanos": 46667, "lsm_state": [0, 0, 0, 18, 0, 0, 0]} 2024/11/24-07:44:19.749223 139957206771264 DEBG dcompact_worker.cpp:240: HttpPost: 200 OK: url = http://nlb-7zny4kaa1poal01o64.cn-shenzhen.nlb.aliyuncs.com:8443, body = {"instanceId":"nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137","labourId":"","dbId":"d89b4006-2803-486e-b7a2-759bcf348921","dbStarts":1732256054,"starts":1732405401,"executesMs":57629,"compactionJobId":43564,"attempt":0,"compactionInputRawBytes":2369154898,"compactionInputZipBytes":642941557,"compactionOutputRawBytes":0,"compactionOutputZipBytes":630630081,"headers":{"Accept":"*/*","Connection":"close","Host":"aliyun-topling-saas.topling.cn:18443","RemoteIp":"120.24.192.169","X-Forwarded-For":"120.24.192.169","region":"cn-shenzhen","token":"e6474c481bd4415abc537135cc03626b","instance-token":"e6474c481bd4415abc537135cc03626b","provider":"aliyun","CloudMarketInstanceId":"si-59c0ae5c955845588903","MeteringAssit":"","Transfer-Encoding":"chunked","traceparent":"00-1b634f054d2b6d00bb08cb805789441f-0d5b9e119fd3cd27-00"}}, response = 2024/11/24-07:44:19.749285 139957206771264 INFO dcompact_worker.cpp:1459: finish /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-43564/att-00: olev 3, work 57.630 s, result 7.733 ms, install 1.480 ms, input{raw 2.206 GiB zip 613.157 MiB}