2024/11/23-08:11:58.788215 140024810575424 DEBG dcompact_worker.cpp:2214: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22483/att-00: fork to child time = 0.021219 sec 2024/11/23-08:11:58.789175 140024810575424 DEBG dcompact_worker.cpp:1013: Beg SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22483/att-00 2024/11/23-08:11:58.798319 140024810575424 DEBG dcompact_worker.cpp:1033: End SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22483/att-00 2024/11/23-08:11:58.799765 140024810575424 TRAC dcompact_worker.cpp:1083: INFO_LOG_LEVEL: rpc = INFO_LEVEL, env_var = undefined 2024/11/23-08:11:58.800143 140024810575424 [WARN] [column_family.cc:386] multiple cf_paths/db_paths and level_compaction_dynamic_level_bytes can't be used together 2024/11/23-08:11:58.846611 140024810575424 [version_set.cc:6208] Recovering from manifest file: /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-22483/att-00/MANIFEST-206347 2024/11/23-08:11:58.877665 140024810575424 [version_set.cc:6251] Recovered from manifest file:/worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-22483/att-00/MANIFEST-206347 succeeded,manifest_file_number is 206347, next_file_number is 251883, last_sequence is 3877726144, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 251720 2024/11/23-08:11:58.877678 140024810575424 [version_set.cc:6266] Column family [default] (ID 0), log number is 0 2024/11/23-08:11:58.877933 140024810575424 [version_set.cc:5721] Creating manifest 251883 2024/11/23-08:11:58.913210 140024810575424 DEBG dcompact_worker.cpp:1218: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22483/att-00: bottommost_level: fake = 1, rpc = 0 2024/11/23-08:11:58.934433 140024810575424 [compaction_job.cc:2437] [default] [JOB 22483] Compacting 1@2 + 11@3 files to L3, score 0.99, subcompactions 1 : 1 2024/11/23-08:11:58.934463 140024810575424 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 16881 Base level 2, inputs: [251876(19MB)], [251812(33MB) 251813(36MB) 251814(35MB) 251815(35MB) 251816(34MB) 251817(34MB) 251818(35MB) 251819(35MB) 251820(35MB) 251821(11MB) 251747(364KB)] 2024/11/23-08:11:58.943071 140024810575424 [top_zip_table.cc:59] core git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-08:11:58.943125 140024810575424 [top_zip_table.cc:60] fsa git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-08:11:58.943157 140024810575424 [top_zip_table.cc:61] zbs git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-08:11:58.943167 140024810575424 [top_zip_table.cc:62] topling-zip_table_reader: git_version_hash_info_is: commit a4a382006cb82713acf5b3425835f22711877681 Author: leipeng Date: 2024-04-11 19:44:14 +0800 fixed_len_hole_index.cc: Add env bool FixedLenHoleIndexUseAVX512 for ut & debug 1. FixedLenHoleIndexUseAVX512 is only in unit tests or debug 2. In release mode, use avx512 by compile options(-march=) g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/23-08:11:58.943180 140024810575424 [top_zip_table.cc:64] topling-rocks git_version_hash_info_is: commit feab587e468621ba0204d47b4ffacc52e7c4290d Author: leipeng Date: 2024-03-22 13:35:06 +0800 ToplingZipTableBuilder::Add: immediately return after error This function returns void, and caller does not check builder->status() after calling this function and graceful abandon. So immediately return after error, and return error status in Finish(). g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/23-08:11:59.380857 140024810575424 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22483/att-00/251884.sst) /dev/shm/ToplingTemp/Topling-456915-Bsjo4Y 2024/11/23-08:12:00.368692 140024810575424 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22483/att-00/251884.sst): first pass time = 0.99's, 135.878'MB/sec 2024/11/23-08:12:04.099949 140024810575424 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22483/att-00/251884.sst): old prealloc_size = 147639500, real_size = 30899360 2024/11/23-08:12:04.100557 140024810575424 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22483/att-00/251884.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 930171 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0289 GB avg-val = 116.29 avg-zval = 31.07 2024/11/23-08:12:04.101361 140024810575424 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22483/att-00/251884.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-08:12:05.118046 140024810575424 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22483/att-00/251884.sst): second pass time = 3.73's, 28.997'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.02's, 34.341'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2997.381'MB/sec (index lex order gen) rebuild zvType time = 0.80's, 0.290'MB/sec write SST data time = 0.22's, 161.286'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 26005.931'MB/sec zip my value time = 3.73's, unzip length = 0.108'GB zip my value throughput = 28.997'MB/sec zip pipeline throughput = 92.632'MB/sec entries = 930171 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.29 avg-zval = 31.07 usrkeys = 930171 avg-key = 20.00 avg-zkey = 1.90 avg-val = 122.87 avg-zval = 31.07 TagRS{ kinds = RS_Key0_TagN bytes = 145440 } TagArray{ size = 874428 bytes = 3060512 } seq expand size = 6120996 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0289 GB dict = 1.08 MB all = 0.0350 GB } UnZip/Zip{ index = 10.5151 value = 3.7433 dict = 1.00 all = 3.8390 } Zip/UnZip{ index = 0.0951 value = 0.2671 dict = 1.00 all = 0.2605 } ---------------------------- total value len = 0.114294 GB avg = 0.123 KB (by entry num) total key len = 0.026045 GB avg = 0.028 KB total ukey len = 0.018603 GB avg = 0.020 KB total ukey num = 0.000930171 Billion total entry num = 0.000930171 Billion write speed all = 0.001671058 MB/sec (with seq num) write speed all = 0.001582452 MB/sec (without seq num) 2024/11/23-08:12:05.152125 140024810575424 [compaction_job.cc:1948] [default] [JOB 22483] Generated table #251884: 930171 keys, 34961352 bytes, temperature: kWarm 2024/11/23-08:12:05.152228 140024810575424 EVENT_LOG_v1 {"time_micros": 1732320725152164, "cf_name": "default", "job": 22483, "event": "table_file_creation", "file_number": 251884, "file_size": 34961352, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3877687076, "table_properties": {"data_size": 28897424, "index_size": 1769216, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26044788, "raw_average_key_size": 28, "raw_value_size": 108173066, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 930171, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732320719, "oldest_key_time": 0, "file_creation_time": 1732320719, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 251884, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-08:12:05.208947 140024810575424 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22483/att-00/251885.sst) /dev/shm/ToplingTemp/Topling-456915-FU2k7Z 2024/11/23-08:12:06.518606 140024810575424 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22483/att-00/251885.sst): first pass time = 1.31's, 102.486'MB/sec 2024/11/23-08:12:08.438576 140024810575424 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22483/att-00/251885.sst): old prealloc_size = 147639500, real_size = 34732704 2024/11/23-08:12:08.439172 140024810575424 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22483/att-00/251885.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 926499 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1083 GB zip-val = 0.0327 GB avg-val = 116.87 avg-zval = 35.32 2024/11/23-08:12:08.439900 140024810575424 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22483/att-00/251885.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-08:12:09.558586 140024810575424 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22483/att-00/251885.sst): second pass time = 1.92's, 56.425'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.12's, 34.584'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3083.279'MB/sec (index lex order gen) rebuild zvType time = 0.87's, 0.265'MB/sec write SST data time = 0.24's, 158.448'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 35961.591'MB/sec zip my value time = 1.92's, unzip length = 0.108'GB zip my value throughput = 56.425'MB/sec zip pipeline throughput = 56.425'MB/sec entries = 926499 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.87 avg-zval = 35.32 usrkeys = 926499 avg-key = 20.00 avg-zkey = 1.91 avg-val = 122.90 avg-zval = 35.32 TagRS{ kinds = RS_Key0_TagN bytes = 144880 } TagArray{ size = 799245 bytes = 2997184 } seq expand size = 5594715 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0327 GB dict = 1.08 MB all = 0.0387 GB } UnZip/Zip{ index = 10.4456 value = 3.3085 dict = 1.00 all = 3.4652 } Zip/UnZip{ index = 0.0957 value = 0.3023 dict = 1.00 all = 0.2886 } ---------------------------- total value len = 0.228165 GB avg = 0.123 KB (by entry num) total key len = 0.051987 GB avg = 0.028 KB total ukey len = 0.037133 GB avg = 0.020 KB total ukey num = 0.001856670 Billion total entry num = 0.001856670 Billion write speed all = 0.003335672 MB/sec (with seq num) write speed all = 0.003158818 MB/sec (without seq num) 2024/11/23-08:12:09.598407 140024810575424 [compaction_job.cc:1948] [default] [JOB 22483] Generated table #251885: 926499 keys, 38733090 bytes, temperature: kWarm 2024/11/23-08:12:09.598490 140024810575424 EVENT_LOG_v1 {"time_micros": 1732320729598446, "cf_name": "default", "job": 22483, "event": "table_file_creation", "file_number": 251885, "file_size": 38733090, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3877684990, "table_properties": {"data_size": 32726928, "index_size": 1773952, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25941972, "raw_average_key_size": 28, "raw_value_size": 108275786, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 926499, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732320725, "oldest_key_time": 0, "file_creation_time": 1732320725, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 251885, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-08:12:09.673289 140024810575424 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22483/att-00/251886.sst) /dev/shm/ToplingTemp/Topling-456915-sBihPX 2024/11/23-08:12:10.928386 140024810575424 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22483/att-00/251886.sst): first pass time = 1.26's, 106.943'MB/sec 2024/11/23-08:12:12.291644 140024810575424 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22483/att-00/251886.sst): old prealloc_size = 147639500, real_size = 32979264 2024/11/23-08:12:12.292199 140024810575424 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22483/att-00/251886.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 928986 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0310 GB avg-val = 116.48 avg-zval = 33.35 2024/11/23-08:12:12.293006 140024810575424 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22483/att-00/251886.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-08:12:13.256541 140024810575424 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22483/att-00/251886.sst): second pass time = 1.36's, 79.444'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.96's, 38.553'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3325.749'MB/sec (index lex order gen) rebuild zvType time = 0.84's, 0.278'MB/sec write SST data time = 0.13's, 290.337'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 26990.721'MB/sec zip my value time = 1.36's, unzip length = 0.108'GB zip my value throughput = 79.444'MB/sec zip pipeline throughput = 79.444'MB/sec entries = 928986 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.48 avg-zval = 33.35 usrkeys = 928986 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.48 avg-zval = 33.35 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 928986 bytes = 3367584 } seq expand size = 6502902 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0310 GB dict = 1.08 MB all = 0.0372 GB } UnZip/Zip{ index = 10.5161 value = 3.4928 dict = 1.00 all = 3.6080 } Zip/UnZip{ index = 0.0951 value = 0.2863 dict = 1.00 all = 0.2772 } ---------------------------- total value len = 0.342874 GB avg = 0.123 KB (by entry num) total key len = 0.077998 GB avg = 0.028 KB total ukey len = 0.055713 GB avg = 0.020 KB total ukey num = 0.002785656 Billion total entry num = 0.002785656 Billion write speed all = 0.005010968 MB/sec (with seq num) write speed all = 0.004745637 MB/sec (without seq num) 2024/11/23-08:12:13.299326 140024810575424 [compaction_job.cc:1948] [default] [JOB 22483] Generated table #251886: 928986 keys, 37199634 bytes, temperature: kWarm 2024/11/23-08:12:13.299401 140024810575424 EVENT_LOG_v1 {"time_micros": 1732320733299359, "cf_name": "default", "job": 22483, "event": "table_file_creation", "file_number": 251886, "file_size": 37199634, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3512539342, "largest_seqno": 3877687008, "table_properties": {"data_size": 30980080, "index_size": 1766784, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26011608, "raw_average_key_size": 28, "raw_value_size": 108206196, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 928986, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732320729, "oldest_key_time": 0, "file_creation_time": 1732320729, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 251886, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-08:12:13.370718 140024810575424 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22483/att-00/251887.sst) /dev/shm/ToplingTemp/Topling-456915-At1IwW 2024/11/23-08:12:14.704671 140024810575424 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22483/att-00/251887.sst): first pass time = 1.33's, 100.620'MB/sec 2024/11/23-08:12:17.014757 140024810575424 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22483/att-00/251887.sst): old prealloc_size = 147639500, real_size = 32416496 2024/11/23-08:12:17.015341 140024810575424 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22483/att-00/251887.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 929127 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1082 GB zip-val = 0.0304 GB avg-val = 116.46 avg-zval = 32.72 2024/11/23-08:12:17.016136 140024810575424 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22483/att-00/251887.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-08:12:18.213491 140024810575424 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22483/att-00/251887.sst): second pass time = 2.30's, 46.945'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.20's, 30.565'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3209.733'MB/sec (index lex order gen) rebuild zvType time = 0.96's, 0.241'MB/sec write SST data time = 0.23's, 156.414'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 30771.231'MB/sec zip my value time = 2.30's, unzip length = 0.108'GB zip my value throughput = 46.945'MB/sec zip pipeline throughput = 142.159'MB/sec entries = 929127 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.46 avg-zval = 32.72 usrkeys = 929127 avg-key = 20.00 avg-zkey = 1.91 avg-val = 123.46 avg-zval = 32.72 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 929127 bytes = 3368096 } seq expand size = 6503889 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0304 GB dict = 1.08 MB all = 0.0366 GB } UnZip/Zip{ index = 10.4443 value = 3.5587 dict = 1.00 all = 3.6634 } Zip/UnZip{ index = 0.0957 value = 0.2810 dict = 1.00 all = 0.2730 } ---------------------------- total value len = 0.457580 GB avg = 0.123 KB (by entry num) total key len = 0.104014 GB avg = 0.028 KB total ukey len = 0.074296 GB avg = 0.020 KB total ukey num = 0.003714783 Billion total entry num = 0.003714783 Billion write speed all = 0.006686029 MB/sec (with seq num) write speed all = 0.006332219 MB/sec (without seq num) 2024/11/23-08:12:18.250366 140024810575424 [compaction_job.cc:1948] [default] [JOB 22483] Generated table #251887: 929127 keys, 36637584 bytes, temperature: kWarm 2024/11/23-08:12:18.250448 140024810575424 EVENT_LOG_v1 {"time_micros": 1732320738250403, "cf_name": "default", "job": 22483, "event": "table_file_creation", "file_number": 251887, "file_size": 36637584, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3604582272, "largest_seqno": 3877686201, "table_properties": {"data_size": 30404832, "index_size": 1779200, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26015556, "raw_average_key_size": 28, "raw_value_size": 108202310, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 929127, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732320733, "oldest_key_time": 0, "file_creation_time": 1732320733, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 251887, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-08:12:18.327429 140024810575424 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22483/att-00/251888.sst) /dev/shm/ToplingTemp/Topling-456915-KmVa4Y 2024/11/23-08:12:19.360240 140024810575424 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22483/att-00/251888.sst): first pass time = 1.03's, 129.960'MB/sec 2024/11/23-08:12:20.889990 140024810575424 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22483/att-00/251888.sst): old prealloc_size = 147639500, real_size = 31597120 2024/11/23-08:12:20.890532 140024810575424 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22483/att-00/251888.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 931721 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1081 GB zip-val = 0.0296 GB avg-val = 116.05 avg-zval = 31.76 2024/11/23-08:12:20.891354 140024810575424 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22483/att-00/251888.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-08:12:21.960909 140024810575424 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22483/att-00/251888.sst): second pass time = 1.53's, 70.716'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.07's, 33.454'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3404.394'MB/sec (index lex order gen) rebuild zvType time = 0.94's, 0.248'MB/sec write SST data time = 0.13's, 273.965'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 34531.544'MB/sec zip my value time = 1.53's, unzip length = 0.108'GB zip my value throughput = 70.716'MB/sec zip pipeline throughput = 70.716'MB/sec entries = 931721 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.05 avg-zval = 31.76 usrkeys = 931721 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.05 avg-zval = 31.76 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 931721 bytes = 3377504 } seq expand size = 6522047 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0296 GB dict = 1.08 MB all = 0.0358 GB } UnZip/Zip{ index = 10.5136 value = 3.6541 dict = 1.00 all = 3.7464 } Zip/UnZip{ index = 0.0951 value = 0.2737 dict = 1.00 all = 0.2669 } ---------------------------- total value len = 0.572232 GB avg = 0.123 KB (by entry num) total key len = 0.130102 GB avg = 0.028 KB total ukey len = 0.092930 GB avg = 0.020 KB total ukey num = 0.004646504 Billion total entry num = 0.004646504 Billion write speed all = 0.008361228 MB/sec (with seq num) write speed all = 0.007918698 MB/sec (without seq num) 2024/11/23-08:12:21.991810 140024810575424 [compaction_job.cc:1948] [default] [JOB 22483] Generated table #251888: 931721 keys, 35825818 bytes, temperature: kWarm 2024/11/23-08:12:21.991874 140024810575424 EVENT_LOG_v1 {"time_micros": 1732320741991842, "cf_name": "default", "job": 22483, "event": "table_file_creation", "file_number": 251888, "file_size": 35825818, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3485447251, "largest_seqno": 3877686485, "table_properties": {"data_size": 29591600, "index_size": 1772416, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26088188, "raw_average_key_size": 28, "raw_value_size": 108129658, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 931721, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732320738, "oldest_key_time": 0, "file_creation_time": 1732320738, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 251888, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-08:12:22.028130 140024810575424 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22483/att-00/251889.sst) /dev/shm/ToplingTemp/Topling-456915-JmfNWX 2024/11/23-08:12:23.280339 140024810575424 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22483/att-00/251889.sst): first pass time = 1.25's, 107.189'MB/sec 2024/11/23-08:12:24.671114 140024810575424 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22483/att-00/251889.sst): old prealloc_size = 147639500, real_size = 31696272 2024/11/23-08:12:24.671805 140024810575424 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22483/att-00/251889.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 929391 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1082 GB zip-val = 0.0297 GB avg-val = 116.41 avg-zval = 31.94 2024/11/23-08:12:24.672642 140024810575424 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22483/att-00/251889.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-08:12:25.695468 140024810575424 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22483/att-00/251889.sst): second pass time = 1.39's, 77.832'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.02's, 35.065'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2659.653'MB/sec (index lex order gen) rebuild zvType time = 0.87's, 0.267'MB/sec write SST data time = 0.15's, 232.757'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 32338.847'MB/sec zip my value time = 1.39's, unzip length = 0.108'GB zip my value throughput = 77.832'MB/sec zip pipeline throughput = 77.832'MB/sec entries = 929391 avg-key = 28.00 avg-zkey = 1.92 avg-val = 116.41 avg-zval = 31.94 usrkeys = 929391 avg-key = 20.00 avg-zkey = 1.92 avg-val = 123.41 avg-zval = 31.94 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 929391 bytes = 3369056 } seq expand size = 6505737 multi value expand size = 0 cnt WriteAppend = 15 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0297 GB dict = 1.08 MB all = 0.0359 GB } UnZip/Zip{ index = 10.4435 value = 3.6449 dict = 1.00 all = 3.7368 } Zip/UnZip{ index = 0.0958 value = 0.2744 dict = 1.00 all = 0.2676 } ---------------------------- total value len = 0.686932 GB avg = 0.123 KB (by entry num) total key len = 0.156125 GB avg = 0.028 KB total ukey len = 0.111518 GB avg = 0.020 KB total ukey num = 0.005575895 Billion total entry num = 0.005575895 Billion write speed all = 0.010036085 MB/sec (with seq num) write speed all = 0.009505064 MB/sec (without seq num) 2024/11/23-08:12:25.729713 140024810575424 [compaction_job.cc:1948] [default] [JOB 22483] Generated table #251889: 929391 keys, 35918012 bytes, temperature: kWarm 2024/11/23-08:12:25.729776 140024810575424 EVENT_LOG_v1 {"time_micros": 1732320745729745, "cf_name": "default", "job": 22483, "event": "table_file_creation", "file_number": 251889, "file_size": 35918012, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3411274482, "largest_seqno": 3877686328, "table_properties": {"data_size": 29683904, "index_size": 1779840, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26022948, "raw_average_key_size": 28, "raw_value_size": 108194866, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 929391, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732320742, "oldest_key_time": 0, "file_creation_time": 1732320742, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 251889, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-08:12:25.772748 140024810575424 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22483/att-00/251890.sst) /dev/shm/ToplingTemp/Topling-456915-PiSC8X 2024/11/23-08:12:26.938381 140024810575424 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22483/att-00/251890.sst): first pass time = 1.17's, 115.151'MB/sec 2024/11/23-08:12:28.653229 140024810575424 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22483/att-00/251890.sst): old prealloc_size = 147639500, real_size = 33214880 2024/11/23-08:12:28.653811 140024810575424 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22483/att-00/251890.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927306 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0312 GB avg-val = 116.74 avg-zval = 33.67 2024/11/23-08:12:28.654579 140024810575424 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22483/att-00/251890.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-08:12:29.609347 140024810575424 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22483/att-00/251890.sst): second pass time = 1.71's, 63.150'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.96's, 39.149'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3135.116'MB/sec (index lex order gen) rebuild zvType time = 0.83's, 0.279'MB/sec write SST data time = 0.13's, 298.343'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 32841.270'MB/sec zip my value time = 1.71's, unzip length = 0.108'GB zip my value throughput = 63.150'MB/sec zip pipeline throughput = 63.150'MB/sec entries = 927306 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.74 avg-zval = 33.67 usrkeys = 927306 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.74 avg-zval = 33.67 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 927306 bytes = 3361504 } seq expand size = 6491142 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0312 GB dict = 1.08 MB all = 0.0374 GB } UnZip/Zip{ index = 10.5123 value = 3.4676 dict = 1.00 all = 3.5858 } Zip/UnZip{ index = 0.0951 value = 0.2884 dict = 1.00 all = 0.2789 } ---------------------------- total value len = 0.801677 GB avg = 0.123 KB (by entry num) total key len = 0.182090 GB avg = 0.028 KB total ukey len = 0.130064 GB avg = 0.020 KB total ukey num = 0.006503201 Billion total entry num = 0.006503201 Billion write speed all = 0.011710594 MB/sec (with seq num) write speed all = 0.011091289 MB/sec (without seq num) 2024/11/23-08:12:29.643360 140024810575424 [compaction_job.cc:1948] [default] [JOB 22483] Generated table #251890: 927306 keys, 37430370 bytes, temperature: kWarm 2024/11/23-08:12:29.643424 140024810575424 EVENT_LOG_v1 {"time_micros": 1732320749643390, "cf_name": "default", "job": 22483, "event": "table_file_creation", "file_number": 251890, "file_size": 37430370, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3596991077, "largest_seqno": 3877687042, "table_properties": {"data_size": 31218640, "index_size": 1764224, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25964568, "raw_average_key_size": 28, "raw_value_size": 108253212, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927306, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732320745, "oldest_key_time": 0, "file_creation_time": 1732320745, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 251890, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-08:12:29.687044 140024810575424 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22483/att-00/251891.sst) /dev/shm/ToplingTemp/Topling-456915-VTiGUX 2024/11/23-08:12:30.754503 140024810575424 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22483/att-00/251891.sst): first pass time = 1.07's, 125.740'MB/sec 2024/11/23-08:12:32.093515 140024810575424 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22483/att-00/251891.sst): old prealloc_size = 147639500, real_size = 33098224 2024/11/23-08:12:32.094118 140024810575424 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22483/att-00/251891.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 929436 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0311 GB avg-val = 116.41 avg-zval = 33.46 2024/11/23-08:12:32.094920 140024810575424 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22483/att-00/251891.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-08:12:33.051016 140024810575424 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22483/att-00/251891.sst): second pass time = 1.34's, 80.871'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.96's, 38.977'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3099.584'MB/sec (index lex order gen) rebuild zvType time = 0.83's, 0.280'MB/sec write SST data time = 0.13's, 290.712'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 33199.988'MB/sec zip my value time = 1.34's, unzip length = 0.108'GB zip my value throughput = 80.871'MB/sec zip pipeline throughput = 80.871'MB/sec entries = 929436 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.41 avg-zval = 33.46 usrkeys = 929436 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.41 avg-zval = 33.46 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 929436 bytes = 3369216 } seq expand size = 6506052 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0311 GB dict = 1.08 MB all = 0.0373 GB } UnZip/Zip{ index = 10.5117 value = 3.4792 dict = 1.00 all = 3.5964 } Zip/UnZip{ index = 0.0951 value = 0.2874 dict = 1.00 all = 0.2781 } ---------------------------- total value len = 0.916376 GB avg = 0.123 KB (by entry num) total key len = 0.208114 GB avg = 0.028 KB total ukey len = 0.148653 GB avg = 0.020 KB total ukey num = 0.007432637 Billion total entry num = 0.007432637 Billion write speed all = 0.013385199 MB/sec (with seq num) write speed all = 0.012677413 MB/sec (without seq num) 2024/11/23-08:12:33.088961 140024810575424 [compaction_job.cc:1948] [default] [JOB 22483] Generated table #251891: 929436 keys, 37320374 bytes, temperature: kWarm 2024/11/23-08:12:33.089024 140024810575424 EVENT_LOG_v1 {"time_micros": 1732320753088992, "cf_name": "default", "job": 22483, "event": "table_file_creation", "file_number": 251891, "file_size": 37320374, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3405268578, "largest_seqno": 3877686646, "table_properties": {"data_size": 31097312, "index_size": 1768384, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26024208, "raw_average_key_size": 28, "raw_value_size": 108193580, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 929436, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732320749, "oldest_key_time": 0, "file_creation_time": 1732320749, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 251891, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-08:12:33.125929 140024810575424 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22483/att-00/251892.sst) /dev/shm/ToplingTemp/Topling-456915-rMbEhZ 2024/11/23-08:12:34.074106 140024810575424 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22483/att-00/251892.sst): first pass time = 0.95's, 141.560'MB/sec 2024/11/23-08:12:35.422863 140024810575424 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22483/att-00/251892.sst): old prealloc_size = 147639500, real_size = 32995328 2024/11/23-08:12:35.423427 140024810575424 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22483/att-00/251892.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 928932 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1082 GB zip-val = 0.0310 GB avg-val = 116.49 avg-zval = 33.35 2024/11/23-08:12:35.424233 140024810575424 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22483/att-00/251892.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-08:12:36.365907 140024810575424 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22483/att-00/251892.sst): second pass time = 1.35's, 80.269'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.94's, 39.464'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3259.163'MB/sec (index lex order gen) rebuild zvType time = 0.82's, 0.285'MB/sec write SST data time = 0.13's, 292.221'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 32536.753'MB/sec zip my value time = 1.35's, unzip length = 0.108'GB zip my value throughput = 80.269'MB/sec zip pipeline throughput = 80.269'MB/sec entries = 928932 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.49 avg-zval = 33.35 usrkeys = 928932 avg-key = 20.00 avg-zkey = 1.91 avg-val = 123.49 avg-zval = 33.35 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 928932 bytes = 3367392 } seq expand size = 6502524 multi value expand size = 0 cnt WriteAppend = 15 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0310 GB dict = 1.08 MB all = 0.0372 GB } UnZip/Zip{ index = 10.4451 value = 3.4923 dict = 1.00 all = 3.6065 } Zip/UnZip{ index = 0.0957 value = 0.2863 dict = 1.00 all = 0.2773 } ---------------------------- total value len = 1.031086 GB avg = 0.123 KB (by entry num) total key len = 0.234124 GB avg = 0.028 KB total ukey len = 0.167231 GB avg = 0.020 KB total ukey num = 0.008361569 Billion total entry num = 0.008361569 Billion write speed all = 0.015059649 MB/sec (with seq num) write speed all = 0.014263434 MB/sec (without seq num) 2024/11/23-08:12:36.401103 140024810575424 [compaction_job.cc:1948] [default] [JOB 22483] Generated table #251892: 928932 keys, 37215554 bytes, temperature: kWarm 2024/11/23-08:12:36.401166 140024810575424 EVENT_LOG_v1 {"time_micros": 1732320756401133, "cf_name": "default", "job": 22483, "event": "table_file_creation", "file_number": 251892, "file_size": 37215554, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3471845708, "largest_seqno": 3877687102, "table_properties": {"data_size": 30984240, "index_size": 1778688, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26010096, "raw_average_key_size": 28, "raw_value_size": 108207712, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 928932, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732320753, "oldest_key_time": 0, "file_creation_time": 1732320753, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 251892, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-08:12:36.437191 140024810575424 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22483/att-00/251893.sst) /dev/shm/ToplingTemp/Topling-456915-QxgkNX 2024/11/23-08:12:36.910632 140024810575424 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22483/att-00/251893.sst): first pass time = 0.47's, 121.087'MB/sec 2024/11/23-08:12:37.491748 140024810575424 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22483/att-00/251893.sst): old prealloc_size = 147639500, real_size = 15080928 2024/11/23-08:12:37.492030 140024810575424 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22483/att-00/251893.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 394019 prefix = 4 raw-key = 0.0063 GB zip-key = 0.0008 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.0463 GB zip-val = 0.0142 GB avg-val = 117.48 avg-zval = 36.11 2024/11/23-08:12:37.492382 140024810575424 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22483/att-00/251893.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0009 GB, waited 0.000 sec, Key+Value = 0.057 GB 2024/11/23-08:12:37.900251 140024810575424 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22483/att-00/251893.sst): second pass time = 0.58's, 79.799'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.41's, 41.214'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3060.868'MB/sec (index lex order gen) rebuild zvType time = 0.35's, 0.279'MB/sec write SST data time = 0.05's, 308.493'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.471'MB, throughput = 14368.979'MB/sec zip my value time = 0.58's, unzip length = 0.046'GB zip my value throughput = 79.799'MB/sec zip pipeline throughput = 79.799'MB/sec entries = 394019 avg-key = 28.00 avg-zkey = 1.92 avg-val = 117.48 avg-zval = 36.11 usrkeys = 394019 avg-key = 20.00 avg-zkey = 1.92 avg-val = 124.48 avg-zval = 36.11 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 394019 bytes = 1379088 } seq expand size = 2758133 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0079 GB value = 0.0463 GB dict = 0.47 MB all = 0.0573 GB } __ZipSize{ index = 0.0008 GB value = 0.0142 GB dict = 0.47 MB all = 0.0168 GB } UnZip/Zip{ index = 10.4313 value = 3.2537 dict = 1.00 all = 3.4049 } Zip/UnZip{ index = 0.0959 value = 0.3073 dict = 1.00 all = 0.2937 } ---------------------------- total value len = 1.080135 GB avg = 0.123 KB (by entry num) total key len = 0.245156 GB avg = 0.028 KB total ukey len = 0.175112 GB avg = 0.020 KB total ukey num = 0.008755588 Billion total entry num = 0.008755588 Billion write speed all = 0.015774497 MB/sec (with seq num) write speed all = 0.014940778 MB/sec (without seq num) 2024/11/23-08:12:37.919471 140024810575424 [compaction_job.cc:1948] [default] [JOB 22483] Generated table #251893: 394019 keys, 16835215 bytes, temperature: kWarm 2024/11/23-08:12:37.919533 140024810575424 EVENT_LOG_v1 {"time_micros": 1732320757919502, "cf_name": "default", "job": 22483, "event": "table_file_creation", "file_number": 251893, "file_size": 16835215, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3677667768, "largest_seqno": 3877686841, "table_properties": {"data_size": 14226768, "index_size": 755456, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 11032532, "raw_average_key_size": 28, "raw_value_size": 46290274, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 394019, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732320756, "oldest_key_time": 0, "file_creation_time": 1732320756, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 251893, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-08:12:37.934549 140024810575424 [compaction_job.cc:703] job-22483: subcompact[0], size: 0.348077 G, files: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-22483/att-00 [251884,251885,251886,251887,251888,251889,251890,251891,251892,251893] 2024/11/23-08:12:38.011716 140024810575424 (Original Log Time 2024/11/23-08:11:58.934560) EVENT_LOG_v1 {"time_micros": 1732320718934484, "job": 22483, "event": "compaction_started", "compaction_reason": "FilesMarkedForCompaction", "files_L2": [251876], "files_L3": [251812, 251813, 251814, 251815, 251816, 251817, 251818, 251819, 251820, 251821, 251747], "score": 0.987835, "input_data_size": 365066400, "oldest_snapshot_seqno": 3877726082} 2024/11/23-08:12:38.011720 140024810575424 (Original Log Time 2024/11/23-08:12:38.011110) [compaction_job.cc:2022] [default] [JOB 22483] Compacted 1@2 + 11@3 files to L3 => 348077003 bytes 2024/11/23-08:12:38.011721 140024810575424 (Original Log Time 2024/11/23-08:12:38.011651) [compaction_job.cc:1224] [default] compacted to: files[0 0 0 10 0 0 0] max score 0.01, MB/sec: 9.4 rd, 8.9 wr, level 3, files in(1, 11) out(10 +0 blob) MB in(19.5, 328.6 +0.0 blob) out(332.0 +0.0 blob), read-write-amplify(34.9) write-amplify(17.0) OK, records in: 8801428, records dropped: 45840 output_compression: Snappy 2024/11/23-08:12:38.011729 140024810575424 (Original Log Time 2024/11/23-08:12:38.011695) EVENT_LOG_v1 {"time_micros": 1732320758011674, "cf": "default", "job": 22483, "event": "compaction_finished", "compaction_time_micros": 38999997, "compaction_time_cpu_micros": 17126547, "output_level": 3, "num_output_files": 10, "total_output_size": 348077003, "num_input_records": 8801428, "num_output_records": 8755588, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "file_write_nanos": 257911308, "file_range_sync_nanos": 0, "file_fsync_nanos": 9445, "file_prepare_write_nanos": 24478, "lsm_state": [0, 0, 0, 10, 0, 0, 0]} 2024/11/23-08:12:38.136170 140024810575424 DEBG dcompact_worker.cpp:240: HttpPost: 200 OK: url = http://nlb-7zny4kaa1poal01o64.cn-shenzhen.nlb.aliyuncs.com:8443, body = {"instanceId":"nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137","labourId":"","dbId":"d89b4006-2803-486e-b7a2-759bcf348921","dbStarts":1732256054,"starts":1732320718,"executesMs":39217,"compactionJobId":22483,"attempt":0,"compactionInputRawBytes":1271792404,"compactionInputZipBytes":365066400,"compactionOutputRawBytes":0,"compactionOutputZipBytes":348077003,"headers":{"Accept":"*/*","Connection":"close","Host":"aliyun-topling-saas.topling.cn:18443","RemoteIp":"120.24.192.169","X-Forwarded-For":"120.24.192.169","region":"cn-shenzhen","token":"e6474c481bd4415abc537135cc03626b","instance-token":"e6474c481bd4415abc537135cc03626b","provider":"aliyun","CloudMarketInstanceId":"si-59c0ae5c955845588903","MeteringAssit":"","Transfer-Encoding":"chunked","traceparent":"00-c9e283f94cc091fc07f7de414790fbb3-4bf1442e427f0cbe-00"}}, response = 2024/11/23-08:12:38.136243 140024810575424 INFO dcompact_worker.cpp:1459: finish /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-22483/att-00: olev 3, work 39.218 s, result 4.933 ms, install 0.639 ms, input{raw 1.184 GiB zip 348.154 MiB}