2024/11/24-08:38:47.086825 139957542479424 DEBG dcompact_worker.cpp:2214: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-44066/att-00: fork to child time = 0.008968 sec 2024/11/24-08:38:47.087638 139957542479424 DEBG dcompact_worker.cpp:1013: Beg SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-44066/att-00 2024/11/24-08:38:47.094444 139957542479424 DEBG dcompact_worker.cpp:1033: End SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-44066/att-00 2024/11/24-08:38:47.095440 139957542479424 TRAC dcompact_worker.cpp:1083: INFO_LOG_LEVEL: rpc = INFO_LEVEL, env_var = undefined 2024/11/24-08:38:47.095746 139957542479424 [WARN] [column_family.cc:386] multiple cf_paths/db_paths and level_compaction_dynamic_level_bytes can't be used together 2024/11/24-08:38:47.146531 139957542479424 [version_set.cc:6208] Recovering from manifest file: /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-44066/att-00/MANIFEST-206347 2024/11/24-08:38:47.162594 139957542479424 [version_set.cc:6251] Recovered from manifest file:/worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-44066/att-00/MANIFEST-206347 succeeded,manifest_file_number is 206347, next_file_number is 297814, last_sequence is 4517418827, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 297672 2024/11/24-08:38:47.162603 139957542479424 [version_set.cc:6266] Column family [default] (ID 0), log number is 0 2024/11/24-08:38:47.162737 139957542479424 [version_set.cc:5721] Creating manifest 297814 2024/11/24-08:38:47.197355 139957542479424 DEBG dcompact_worker.cpp:1218: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-44066/att-00: bottommost_level: fake = 1, rpc = 0 2024/11/24-08:38:47.218785 139957542479424 [compaction_job.cc:2437] [default] [JOB 44066] Compacting 1@2 + 10@3 files to L3, score 0.97, subcompactions 1 : 1 2024/11/24-08:38:47.218801 139957542479424 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 33032 Base level 2, inputs: [297809(27MB)], [297742(34MB) 297743(35MB) 297744(34MB) 297745(35MB) 297746(35MB) 297747(34MB) 297748(35MB) 297749(34MB) 297750(36MB) 297751(7576KB)] 2024/11/24-08:38:47.226374 139957542479424 [top_zip_table.cc:59] core git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/24-08:38:47.226412 139957542479424 [top_zip_table.cc:60] fsa git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/24-08:38:47.226431 139957542479424 [top_zip_table.cc:61] zbs git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/24-08:38:47.226437 139957542479424 [top_zip_table.cc:62] topling-zip_table_reader: git_version_hash_info_is: commit a4a382006cb82713acf5b3425835f22711877681 Author: leipeng Date: 2024-04-11 19:44:14 +0800 fixed_len_hole_index.cc: Add env bool FixedLenHoleIndexUseAVX512 for ut & debug 1. FixedLenHoleIndexUseAVX512 is only in unit tests or debug 2. In release mode, use avx512 by compile options(-march=) g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/24-08:38:47.226448 139957542479424 [top_zip_table.cc:64] topling-rocks git_version_hash_info_is: commit feab587e468621ba0204d47b4ffacc52e7c4290d Author: leipeng Date: 2024-03-22 13:35:06 +0800 ToplingZipTableBuilder::Add: immediately return after error This function returns void, and caller does not check builder->status() after calling this function and graceful abandon. So immediately return after error, and return error status in Finish(). g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/24-08:38:47.827441 139957542479424 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-44066/att-00/297815.sst) /dev/shm/ToplingTemp/Topling-307162-PckxYm 2024/11/24-08:38:48.425389 139957542479424 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-44066/att-00/297815.sst): first pass time = 0.60's, 224.479'MB/sec 2024/11/24-08:38:49.878389 139957542479424 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-44066/att-00/297815.sst): old prealloc_size = 147639500, real_size = 31971152 2024/11/24-08:38:49.878993 139957542479424 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-44066/att-00/297815.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 928668 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0300 GB avg-val = 116.53 avg-zval = 32.27 2024/11/24-08:38:49.879862 139957542479424 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-44066/att-00/297815.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-08:38:51.316403 139957542479424 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-44066/att-00/297815.sst): second pass time = 1.45's, 74.566'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.44's, 25.007'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3037.635'MB/sec (index lex order gen) rebuild zvType time = 1.12's, 0.207'MB/sec write SST data time = 0.32's, 113.811'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 37232.382'MB/sec zip my value time = 1.45's, unzip length = 0.108'GB zip my value throughput = 74.566'MB/sec zip pipeline throughput = 74.568'MB/sec entries = 928668 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.53 avg-zval = 32.27 usrkeys = 928668 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.53 avg-zval = 32.27 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 928668 bytes = 3134272 } seq expand size = 6500676 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0300 GB dict = 1.08 MB all = 0.0360 GB } UnZip/Zip{ index = 10.5148 value = 3.6105 dict = 1.00 all = 3.7325 } Zip/UnZip{ index = 0.0951 value = 0.2770 dict = 1.00 all = 0.2679 } ---------------------------- total value len = 2251.440289 GB avg = 0.200 KB (by entry num) total key len = 306.908965 GB avg = 0.027 KB total ukey len = 237.373301 GB avg = 0.015 KB total ukey num = 15.739589831 Billion total entry num = 11.280903779 Billion write speed all = 29.950552071 MB/sec (with seq num) write speed all = 28.894029251 MB/sec (without seq num) 2024/11/24-08:38:51.381748 139957542479424 [compaction_job.cc:1948] [default] [JOB 44066] Generated table #297815: 928668 keys, 35959008 bytes, temperature: kWarm 2024/11/24-08:38:51.382011 139957542479424 EVENT_LOG_v1 {"time_micros": 1732408731381824, "cf_name": "default", "job": 44066, "event": "table_file_creation", "file_number": 297815, "file_size": 35959008, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4444083347, "largest_seqno": 4517407249, "table_properties": {"data_size": 29972416, "index_size": 1766400, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26002704, "raw_average_key_size": 28, "raw_value_size": 108215088, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 928668, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732408727, "oldest_key_time": 0, "file_creation_time": 1732408727, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 297815, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-08:38:51.435369 139957542479424 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-44066/att-00/297816.sst) /dev/shm/ToplingTemp/Topling-307162-IZmSQn 2024/11/24-08:38:53.018282 139957542479424 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-44066/att-00/297816.sst): first pass time = 1.58's, 84.795'MB/sec 2024/11/24-08:38:54.536268 139957542479424 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-44066/att-00/297816.sst): old prealloc_size = 147639500, real_size = 32780560 2024/11/24-08:38:54.537063 139957542479424 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-44066/att-00/297816.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 928731 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0308 GB avg-val = 116.52 avg-zval = 33.14 2024/11/24-08:38:54.537938 139957542479424 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-44066/att-00/297816.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-08:38:55.956392 139957542479424 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-44066/att-00/297816.sst): second pass time = 1.52's, 71.400'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.42's, 25.892'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2285.561'MB/sec (index lex order gen) rebuild zvType time = 1.10's, 0.210'MB/sec write SST data time = 0.31's, 116.822'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 32661.827'MB/sec zip my value time = 1.52's, unzip length = 0.108'GB zip my value throughput = 71.400'MB/sec zip pipeline throughput = 71.400'MB/sec entries = 928731 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.52 avg-zval = 33.14 usrkeys = 928731 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.52 avg-zval = 33.14 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 928731 bytes = 3134480 } seq expand size = 6501117 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0308 GB dict = 1.08 MB all = 0.0368 GB } UnZip/Zip{ index = 10.5140 value = 3.5155 dict = 1.00 all = 3.6503 } Zip/UnZip{ index = 0.0951 value = 0.2845 dict = 1.00 all = 0.2739 } ---------------------------- total value len = 2251.555003 GB avg = 0.200 KB (by entry num) total key len = 306.934970 GB avg = 0.027 KB total ukey len = 237.391875 GB avg = 0.015 KB total ukey num = 15.740518562 Billion total entry num = 11.281832510 Billion write speed all = 29.950572546 MB/sec (with seq num) write speed all = 28.894020137 MB/sec (without seq num) 2024/11/24-08:38:56.006006 139957542479424 [compaction_job.cc:1948] [default] [JOB 44066] Generated table #297816: 928731 keys, 36768520 bytes, temperature: kWarm 2024/11/24-08:38:56.006096 139957542479424 EVENT_LOG_v1 {"time_micros": 1732408736006048, "cf_name": "default", "job": 44066, "event": "table_file_creation", "file_number": 297816, "file_size": 36768520, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4409092075, "largest_seqno": 4517407268, "table_properties": {"data_size": 30781568, "index_size": 1766656, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26004468, "raw_average_key_size": 28, "raw_value_size": 108213366, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 928731, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732408731, "oldest_key_time": 0, "file_creation_time": 1732408731, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 297816, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-08:38:56.079435 139957542479424 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-44066/att-00/297817.sst) /dev/shm/ToplingTemp/Topling-307162-FV2r2k 2024/11/24-08:38:57.695939 139957542479424 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-44066/att-00/297817.sst): first pass time = 1.62's, 83.033'MB/sec 2024/11/24-08:38:59.260784 139957542479424 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-44066/att-00/297817.sst): old prealloc_size = 147639500, real_size = 32242432 2024/11/24-08:38:59.261351 139957542479424 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-44066/att-00/297817.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 928504 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0302 GB avg-val = 116.55 avg-zval = 32.57 2024/11/24-08:38:59.262130 139957542479424 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-44066/att-00/297817.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-08:39:00.211361 139957542479424 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-44066/att-00/297817.sst): second pass time = 1.56's, 69.185'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.95's, 38.237'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3244.487'MB/sec (index lex order gen) rebuild zvType time = 0.82's, 0.282'MB/sec write SST data time = 0.13's, 287.725'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 41572.974'MB/sec zip my value time = 1.56's, unzip length = 0.108'GB zip my value throughput = 69.185'MB/sec zip pipeline throughput = 69.185'MB/sec entries = 928504 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.55 avg-zval = 32.57 usrkeys = 928504 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.55 avg-zval = 32.57 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 928504 bytes = 3249776 } seq expand size = 6499528 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0302 GB dict = 1.08 MB all = 0.0363 GB } UnZip/Zip{ index = 10.5126 value = 3.5783 dict = 1.00 all = 3.6928 } Zip/UnZip{ index = 0.0951 value = 0.2795 dict = 1.00 all = 0.2708 } ---------------------------- total value len = 2251.669723 GB avg = 0.200 KB (by entry num) total key len = 306.960968 GB avg = 0.027 KB total ukey len = 237.410445 GB avg = 0.015 KB total ukey num = 15.741447066 Billion total entry num = 11.282761014 Billion write speed all = 29.950727972 MB/sec (with seq num) write speed all = 28.894141237 MB/sec (without seq num) 2024/11/24-08:39:00.256744 139957542479424 [compaction_job.cc:1948] [default] [JOB 44066] Generated table #297817: 928504 keys, 36345730 bytes, temperature: kWarm 2024/11/24-08:39:00.256838 139957542479424 EVENT_LOG_v1 {"time_micros": 1732408740256786, "cf_name": "default", "job": 44066, "event": "table_file_creation", "file_number": 297817, "file_size": 36345730, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4261178518, "largest_seqno": 4517407279, "table_properties": {"data_size": 30243632, "index_size": 1766464, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25998112, "raw_average_key_size": 28, "raw_value_size": 108219712, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 928504, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732408736, "oldest_key_time": 0, "file_creation_time": 1732408736, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 297817, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-08:39:00.296037 139957542479424 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-44066/att-00/297818.sst) /dev/shm/ToplingTemp/Topling-307162-161eZk 2024/11/24-08:39:01.230546 139957542479424 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-44066/att-00/297818.sst): first pass time = 0.93's, 143.630'MB/sec 2024/11/24-08:39:02.602585 139957542479424 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-44066/att-00/297818.sst): old prealloc_size = 147639500, real_size = 33035280 2024/11/24-08:39:02.603275 139957542479424 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-44066/att-00/297818.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 928655 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0310 GB avg-val = 116.53 avg-zval = 33.42 2024/11/24-08:39:02.604132 139957542479424 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-44066/att-00/297818.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-08:39:03.782757 139957542479424 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-44066/att-00/297818.sst): second pass time = 1.37's, 78.923'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.18's, 31.273'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2638.270'MB/sec (index lex order gen) rebuild zvType time = 1.02's, 0.227'MB/sec write SST data time = 0.16's, 235.782'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 37592.230'MB/sec zip my value time = 1.37's, unzip length = 0.108'GB zip my value throughput = 78.923'MB/sec zip pipeline throughput = 78.923'MB/sec entries = 928655 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.53 avg-zval = 33.42 usrkeys = 928655 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.53 avg-zval = 33.42 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 928655 bytes = 3018144 } seq expand size = 6500585 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0310 GB dict = 1.08 MB all = 0.0369 GB } UnZip/Zip{ index = 10.5143 value = 3.4867 dict = 1.00 all = 3.6366 } Zip/UnZip{ index = 0.0951 value = 0.2868 dict = 1.00 all = 0.2750 } ---------------------------- total value len = 2251.784439 GB avg = 0.200 KB (by entry num) total key len = 306.986970 GB avg = 0.027 KB total ukey len = 237.429018 GB avg = 0.015 KB total ukey num = 15.742375721 Billion total entry num = 11.283689669 Billion write speed all = 29.951123052 MB/sec (with seq num) write speed all = 28.894493525 MB/sec (without seq num) 2024/11/24-08:39:03.832321 139957542479424 [compaction_job.cc:1948] [default] [JOB 44066] Generated table #297818: 928655 keys, 36907000 bytes, temperature: kWarm 2024/11/24-08:39:03.832386 139957542479424 EVENT_LOG_v1 {"time_micros": 1732408743832353, "cf_name": "default", "job": 44066, "event": "table_file_creation", "file_number": 297818, "file_size": 36907000, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4455995940, "largest_seqno": 4517407299, "table_properties": {"data_size": 31036480, "index_size": 1766464, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26002340, "raw_average_key_size": 28, "raw_value_size": 108215398, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 928655, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732408740, "oldest_key_time": 0, "file_creation_time": 1732408740, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 297818, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-08:39:03.871424 139957542479424 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-44066/att-00/297819.sst) /dev/shm/ToplingTemp/Topling-307162-YiQf4n 2024/11/24-08:39:04.760670 139957542479424 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-44066/att-00/297819.sst): first pass time = 0.89's, 150.942'MB/sec 2024/11/24-08:39:06.335930 139957542479424 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-44066/att-00/297819.sst): old prealloc_size = 147639500, real_size = 33102240 2024/11/24-08:39:06.336523 139957542479424 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-44066/att-00/297819.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 929134 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0311 GB avg-val = 116.45 avg-zval = 33.47 2024/11/24-08:39:06.337295 139957542479424 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-44066/att-00/297819.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-08:39:07.518755 139957542479424 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-44066/att-00/297819.sst): second pass time = 1.57's, 68.736'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.18's, 31.358'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3096.707'MB/sec (index lex order gen) rebuild zvType time = 1.04's, 0.222'MB/sec write SST data time = 0.14's, 270.219'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 33437.521'MB/sec zip my value time = 1.57's, unzip length = 0.108'GB zip my value throughput = 68.736'MB/sec zip pipeline throughput = 68.736'MB/sec entries = 929134 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.45 avg-zval = 33.47 usrkeys = 929134 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.45 avg-zval = 33.47 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 929134 bytes = 3135840 } seq expand size = 6503938 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0311 GB dict = 1.08 MB all = 0.0371 GB } UnZip/Zip{ index = 10.5117 value = 3.4789 dict = 1.00 all = 3.6186 } Zip/UnZip{ index = 0.0951 value = 0.2874 dict = 1.00 all = 0.2763 } ---------------------------- total value len = 2251.899145 GB avg = 0.200 KB (by entry num) total key len = 307.012986 GB avg = 0.027 KB total ukey len = 237.447601 GB avg = 0.015 KB total ukey num = 15.743304855 Billion total entry num = 11.284618803 Billion write speed all = 29.951460432 MB/sec (with seq num) write speed all = 28.894790109 MB/sec (without seq num) 2024/11/24-08:39:07.568499 139957542479424 [compaction_job.cc:1948] [default] [JOB 44066] Generated table #297819: 929134 keys, 37090796 bytes, temperature: kWarm 2024/11/24-08:39:07.568559 139957542479424 EVENT_LOG_v1 {"time_micros": 1732408747568527, "cf_name": "default", "job": 44066, "event": "table_file_creation", "file_number": 297819, "file_size": 37090796, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4390257898, "largest_seqno": 4517407334, "table_properties": {"data_size": 31101968, "index_size": 1767808, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26015752, "raw_average_key_size": 28, "raw_value_size": 108202072, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 929134, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732408743, "oldest_key_time": 0, "file_creation_time": 1732408743, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 297819, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-08:39:07.607672 139957542479424 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-44066/att-00/297820.sst) /dev/shm/ToplingTemp/Topling-307162-0r6pYj 2024/11/24-08:39:08.596017 139957542479424 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-44066/att-00/297820.sst): first pass time = 0.99's, 135.806'MB/sec 2024/11/24-08:39:10.098094 139957542479424 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-44066/att-00/297820.sst): old prealloc_size = 147639500, real_size = 32030304 2024/11/24-08:39:10.098649 139957542479424 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-44066/att-00/297820.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 936435 prefix = 4 raw-key = 0.0150 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1080 GB zip-val = 0.0300 GB avg-val = 115.33 avg-zval = 32.05 2024/11/24-08:39:10.099388 139957542479424 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-44066/att-00/297820.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-08:39:11.071382 139957542479424 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-44066/att-00/297820.sst): second pass time = 1.50's, 71.940'MB/sec, value only(80.5% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.97's, 36.909'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3332.425'MB/sec (index lex order gen) rebuild zvType time = 0.85's, 0.276'MB/sec write SST data time = 0.13's, 286.134'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.077'MB, throughput = 38189.828'MB/sec zip my value time = 1.50's, unzip length = 0.108'GB zip my value throughput = 71.940'MB/sec zip pipeline throughput = 71.940'MB/sec entries = 936435 avg-key = 28.00 avg-zkey = 1.90 avg-val = 115.33 avg-zval = 32.05 usrkeys = 936435 avg-key = 20.00 avg-zkey = 1.90 avg-val = 122.33 avg-zval = 32.05 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 936435 bytes = 3043424 } seq expand size = 6555045 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0187 GB value = 0.1080 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0300 GB dict = 1.08 MB all = 0.0359 GB } UnZip/Zip{ index = 10.5144 value = 3.5982 dict = 1.00 all = 3.7364 } Zip/UnZip{ index = 0.0951 value = 0.2779 dict = 1.00 all = 0.2676 } ---------------------------- total value len = 2252.013697 GB avg = 0.200 KB (by entry num) total key len = 307.039206 GB avg = 0.027 KB total ukey len = 237.466330 GB avg = 0.015 KB total ukey num = 15.744241290 Billion total entry num = 11.285555238 Billion write speed all = 29.951862670 MB/sec (with seq num) write speed all = 28.895148602 MB/sec (without seq num) 2024/11/24-08:39:11.116578 139957542479424 [compaction_job.cc:1948] [default] [JOB 44066] Generated table #297820: 936435 keys, 35922180 bytes, temperature: kWarm 2024/11/24-08:39:11.116649 139957542479424 EVENT_LOG_v1 {"time_micros": 1732408751116615, "cf_name": "default", "job": 44066, "event": "table_file_creation", "file_number": 297820, "file_size": 35922180, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4467943581, "largest_seqno": 4517407350, "table_properties": {"data_size": 30014736, "index_size": 1781248, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26220180, "raw_average_key_size": 28, "raw_value_size": 107997682, "raw_average_value_size": 115, "num_data_blocks": 1, "num_entries": 936435, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732408747, "oldest_key_time": 0, "file_creation_time": 1732408747, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 297820, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-08:39:11.154289 139957542479424 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-44066/att-00/297821.sst) /dev/shm/ToplingTemp/Topling-307162-g4iBHm 2024/11/24-08:39:12.028931 139957542479424 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-44066/att-00/297821.sst): first pass time = 0.87's, 153.460'MB/sec 2024/11/24-08:39:13.390259 139957542479424 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-44066/att-00/297821.sst): old prealloc_size = 147639500, real_size = 33085936 2024/11/24-08:39:13.390819 139957542479424 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-44066/att-00/297821.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 929404 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0311 GB avg-val = 116.41 avg-zval = 33.45 2024/11/24-08:39:13.391619 139957542479424 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-44066/att-00/297821.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-08:39:14.235717 139957542479424 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-44066/att-00/297821.sst): second pass time = 1.36's, 79.522'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.85's, 43.991'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3292.482'MB/sec (index lex order gen) rebuild zvType time = 0.72's, 0.323'MB/sec write SST data time = 0.13's, 296.851'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 36463.919'MB/sec zip my value time = 1.36's, unzip length = 0.108'GB zip my value throughput = 79.522'MB/sec zip pipeline throughput = 79.522'MB/sec entries = 929404 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.41 avg-zval = 33.45 usrkeys = 929404 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.41 avg-zval = 33.45 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 929404 bytes = 3252928 } seq expand size = 6505828 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0311 GB dict = 1.08 MB all = 0.0372 GB } UnZip/Zip{ index = 10.5144 value = 3.4805 dict = 1.00 all = 3.6088 } Zip/UnZip{ index = 0.0951 value = 0.2873 dict = 1.00 all = 0.2771 } ---------------------------- total value len = 2252.128398 GB avg = 0.200 KB (by entry num) total key len = 307.065229 GB avg = 0.027 KB total ukey len = 237.484918 GB avg = 0.015 KB total ukey num = 15.745170694 Billion total entry num = 11.286484642 Billion write speed all = 29.952400414 MB/sec (with seq num) write speed all = 28.895638460 MB/sec (without seq num) 2024/11/24-08:39:14.285029 139957542479424 [compaction_job.cc:1948] [default] [JOB 44066] Generated table #297821: 929404 keys, 37191732 bytes, temperature: kWarm 2024/11/24-08:39:14.285100 139957542479424 EVENT_LOG_v1 {"time_micros": 1732408754285064, "cf_name": "default", "job": 44066, "event": "table_file_creation", "file_number": 297821, "file_size": 37191732, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4268980586, "largest_seqno": 4517407370, "table_properties": {"data_size": 31085536, "index_size": 1767872, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26023312, "raw_average_key_size": 28, "raw_value_size": 108194532, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 929404, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732408751, "oldest_key_time": 0, "file_creation_time": 1732408751, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 297821, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-08:39:14.322454 139957542479424 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-44066/att-00/297822.sst) /dev/shm/ToplingTemp/Topling-307162-B0yFsj 2024/11/24-08:39:15.335007 139957542479424 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-44066/att-00/297822.sst): first pass time = 1.01's, 132.558'MB/sec 2024/11/24-08:39:16.813676 139957542479424 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-44066/att-00/297822.sst): old prealloc_size = 147639500, real_size = 30887568 2024/11/24-08:39:16.814321 139957542479424 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-44066/att-00/297822.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 926677 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1083 GB zip-val = 0.0289 GB avg-val = 116.84 avg-zval = 31.17 2024/11/24-08:39:16.815118 139957542479424 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-44066/att-00/297822.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-08:39:17.645127 139957542479424 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-44066/att-00/297822.sst): second pass time = 1.48's, 73.262'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.83's, 42.079'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2847.601'MB/sec (index lex order gen) rebuild zvType time = 0.70's, 0.333'MB/sec write SST data time = 0.13's, 259.183'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 37348.611'MB/sec zip my value time = 1.48's, unzip length = 0.108'GB zip my value throughput = 73.262'MB/sec zip pipeline throughput = 73.262'MB/sec entries = 926677 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.84 avg-zval = 31.17 usrkeys = 926677 avg-key = 20.00 avg-zkey = 1.91 avg-val = 123.84 avg-zval = 31.17 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 926677 bytes = 3243392 } seq expand size = 6486739 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0289 GB dict = 1.08 MB all = 0.0350 GB } UnZip/Zip{ index = 10.4450 value = 3.7488 dict = 1.00 all = 3.8364 } Zip/UnZip{ index = 0.0957 value = 0.2668 dict = 1.00 all = 0.2607 } ---------------------------- total value len = 2252.243155 GB avg = 0.200 KB (by entry num) total key len = 307.091176 GB avg = 0.027 KB total ukey len = 237.503451 GB avg = 0.015 KB total ukey num = 15.746097371 Billion total entry num = 11.287411319 Billion write speed all = 29.952851983 MB/sec (with seq num) write speed all = 28.896045434 MB/sec (without seq num) 2024/11/24-08:39:17.691615 139957542479424 [compaction_job.cc:1948] [default] [JOB 44066] Generated table #297822: 926677 keys, 34985738 bytes, temperature: kWarm 2024/11/24-08:39:17.691683 139957542479424 EVENT_LOG_v1 {"time_micros": 1732408757691648, "cf_name": "default", "job": 44066, "event": "table_file_creation", "file_number": 297822, "file_size": 34985738, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4311020188, "largest_seqno": 4517407382, "table_properties": {"data_size": 28881344, "index_size": 1774400, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25946956, "raw_average_key_size": 28, "raw_value_size": 108270790, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 926677, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732408754, "oldest_key_time": 0, "file_creation_time": 1732408754, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 297822, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-08:39:17.726566 139957542479424 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-44066/att-00/297823.sst) /dev/shm/ToplingTemp/Topling-307162-UCH2rk 2024/11/24-08:39:18.704804 139957542479424 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-44066/att-00/297823.sst): first pass time = 0.98's, 137.211'MB/sec 2024/11/24-08:39:20.213790 139957542479424 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-44066/att-00/297823.sst): old prealloc_size = 147639500, real_size = 33606080 2024/11/24-08:39:20.214457 139957542479424 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-44066/att-00/297823.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 931356 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1081 GB zip-val = 0.0316 GB avg-val = 116.11 avg-zval = 33.92 2024/11/24-08:39:20.215269 139957542479424 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-44066/att-00/297823.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-08:39:21.127730 139957542479424 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-44066/att-00/297823.sst): second pass time = 1.51's, 71.708'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.91's, 41.020'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2777.945'MB/sec (index lex order gen) rebuild zvType time = 0.76's, 0.308'MB/sec write SST data time = 0.16's, 238.280'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 37412.793'MB/sec zip my value time = 1.51's, unzip length = 0.108'GB zip my value throughput = 71.708'MB/sec zip pipeline throughput = 71.708'MB/sec entries = 931356 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.11 avg-zval = 33.92 usrkeys = 931356 avg-key = 20.00 avg-zkey = 1.91 avg-val = 123.11 avg-zval = 33.92 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 931356 bytes = 3026928 } seq expand size = 6519492 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0316 GB dict = 1.08 MB all = 0.0375 GB } UnZip/Zip{ index = 10.4453 value = 3.4233 dict = 1.00 all = 3.5802 } Zip/UnZip{ index = 0.0957 value = 0.2921 dict = 1.00 all = 0.2793 } ---------------------------- total value len = 2252.357815 GB avg = 0.200 KB (by entry num) total key len = 307.117254 GB avg = 0.027 KB total ukey len = 237.522079 GB avg = 0.015 KB total ukey num = 15.747028727 Billion total entry num = 11.288342675 Billion write speed all = 29.953278243 MB/sec (with seq num) write speed all = 28.896427568 MB/sec (without seq num) 2024/11/24-08:39:21.176002 139957542479424 [compaction_job.cc:1948] [default] [JOB 44066] Generated table #297823: 931356 keys, 37489176 bytes, temperature: kWarm 2024/11/24-08:39:21.176072 139957542479424 EVENT_LOG_v1 {"time_micros": 1732408761176037, "cf_name": "default", "job": 44066, "event": "table_file_creation", "file_number": 297823, "file_size": 37489176, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4478441310, "largest_seqno": 4517407573, "table_properties": {"data_size": 31589744, "index_size": 1783296, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26077968, "raw_average_key_size": 28, "raw_value_size": 108139804, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 931356, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732408757, "oldest_key_time": 0, "file_creation_time": 1732408757, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 297823, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-08:39:21.224435 139957542479424 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-44066/att-00/297824.sst) /dev/shm/ToplingTemp/Topling-307162-zVnijn 2024/11/24-08:39:21.554830 139957542479424 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-44066/att-00/297824.sst): first pass time = 0.33's, 150.480'MB/sec 2024/11/24-08:39:22.042016 139957542479424 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-44066/att-00/297824.sst): old prealloc_size = 147639500, real_size = 12909552 2024/11/24-08:39:22.042271 139957542479424 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-44066/att-00/297824.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 346003 prefix = 4 raw-key = 0.0055 GB zip-key = 0.0007 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.0400 GB zip-val = 0.0122 GB avg-val = 115.67 avg-zval = 35.15 2024/11/24-08:39:22.042655 139957542479424 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-44066/att-00/297824.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0008 GB, waited 0.000 sec, Key+Value = 0.050 GB 2024/11/24-08:39:22.355865 139957542479424 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-44066/att-00/297824.sst): second pass time = 0.49's, 82.290'MB/sec, value only(80.5% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.31's, 46.025'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2728.516'MB/sec (index lex order gen) rebuild zvType time = 0.27's, 0.325'MB/sec write SST data time = 0.05's, 303.485'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.407'MB, throughput = 13684.518'MB/sec zip my value time = 0.49's, unzip length = 0.040'GB zip my value throughput = 82.290'MB/sec zip pipeline throughput = 82.290'MB/sec entries = 346003 avg-key = 28.00 avg-zkey = 1.91 avg-val = 115.67 avg-zval = 35.15 usrkeys = 346003 avg-key = 20.00 avg-zkey = 1.91 avg-val = 122.67 avg-zval = 35.15 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 346003 bytes = 1211024 } seq expand size = 2422021 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0069 GB value = 0.0400 GB dict = 0.41 MB all = 0.0497 GB } __ZipSize{ index = 0.0007 GB value = 0.0122 GB dict = 0.41 MB all = 0.0144 GB } UnZip/Zip{ index = 10.4966 value = 3.2904 dict = 1.00 all = 3.4415 } Zip/UnZip{ index = 0.0953 value = 0.3039 dict = 1.00 all = 0.2906 } ---------------------------- total value len = 2252.400260 GB avg = 0.200 KB (by entry num) total key len = 307.126942 GB avg = 0.027 KB total ukey len = 237.528999 GB avg = 0.015 KB total ukey num = 15.747374730 Billion total entry num = 11.288688678 Billion write speed all = 29.953457839 MB/sec (with seq num) write speed all = 28.896589961 MB/sec (without seq num) 2024/11/24-08:39:22.378715 139957542479424 [compaction_job.cc:1948] [default] [JOB 44066] Generated table #297824: 346003 keys, 14444377 bytes, temperature: kWarm 2024/11/24-08:39:22.378783 139957542479424 EVENT_LOG_v1 {"time_micros": 1732408762378749, "cf_name": "default", "job": 44066, "event": "table_file_creation", "file_number": 297824, "file_size": 14444377, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4310565389, "largest_seqno": 4517406947, "table_properties": {"data_size": 12163616, "index_size": 659264, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 9688084, "raw_average_key_size": 28, "raw_value_size": 40022922, "raw_average_value_size": 115, "num_data_blocks": 1, "num_entries": 346003, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732408761, "oldest_key_time": 0, "file_creation_time": 1732408761, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 297824, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-08:39:22.394684 139957542479424 [compaction_job.cc:703] job-44066: subcompact[0], size: 0.343104 G, files: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-44066/att-00 [297815,297816,297817,297818,297819,297820,297821,297822,297823,297824] 2024/11/24-08:39:22.500753 139957542479424 (Original Log Time 2024/11/24-08:38:47.218874) EVENT_LOG_v1 {"time_micros": 1732408727218818, "job": 44066, "event": "compaction_started", "compaction_reason": "FilesMarkedForCompaction", "files_L2": [297809], "files_L3": [297742, 297743, 297744, 297745, 297746, 297747, 297748, 297749, 297750, 297751], "score": 0.974258, "input_data_size": 367383569, "oldest_snapshot_seqno": 4517418753} 2024/11/24-08:39:22.500759 139957542479424 (Original Log Time 2024/11/24-08:39:22.499545) [compaction_job.cc:2022] [default] [JOB 44066] Compacted 1@2 + 10@3 files to L3 => 343104257 bytes 2024/11/24-08:39:22.500762 139957542479424 (Original Log Time 2024/11/24-08:39:22.500662) [compaction_job.cc:1224] [default] compacted to: files[0 0 0 10 0 0 0] max score 0.01, MB/sec: 10.4 rd, 9.8 wr, level 3, files in(1, 10) out(10 +0 blob) MB in(27.1, 323.3 +0.0 blob) out(327.2 +0.0 blob), read-write-amplify(25.0) write-amplify(12.1) OK, records in: 8779015, records dropped: 65448 output_compression: Snappy 2024/11/24-08:39:22.500772 139957542479424 (Original Log Time 2024/11/24-08:39:22.500725) EVENT_LOG_v1 {"time_micros": 1732408762500696, "cf": "default", "job": 44066, "event": "compaction_finished", "compaction_time_micros": 35175822, "compaction_time_cpu_micros": 15826034, "output_level": 3, "num_output_files": 10, "total_output_size": 343104257, "num_input_records": 8779015, "num_output_records": 8713567, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "file_write_nanos": 267042425, "file_range_sync_nanos": 0, "file_fsync_nanos": 7942, "file_prepare_write_nanos": 27624, "lsm_state": [0, 0, 0, 10, 0, 0, 0]} 2024/11/24-08:39:22.638853 139957542479424 DEBG dcompact_worker.cpp:240: HttpPost: 200 OK: url = http://nlb-7zny4kaa1poal01o64.cn-shenzhen.nlb.aliyuncs.com:8443, body = {"instanceId":"nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137","labourId":"","dbId":"d89b4006-2803-486e-b7a2-759bcf348921","dbStarts":1732256054,"starts":1732408727,"executesMs":35404,"compactionJobId":44066,"attempt":0,"compactionInputRawBytes":1266964858,"compactionInputZipBytes":367383569,"compactionOutputRawBytes":0,"compactionOutputZipBytes":343104257,"headers":{"Accept":"*/*","Connection":"close","Host":"aliyun-topling-saas.topling.cn:18443","RemoteIp":"120.24.192.169","X-Forwarded-For":"120.24.192.169","region":"cn-shenzhen","token":"e6474c481bd4415abc537135cc03626b","instance-token":"e6474c481bd4415abc537135cc03626b","provider":"aliyun","CloudMarketInstanceId":"si-59c0ae5c955845588903","MeteringAssit":"","Transfer-Encoding":"chunked","traceparent":"00-95a661bd304523ebed25c44a1138aae9-6a6ea5fd6fd23fea-00"}}, response = 2024/11/24-08:39:22.639012 139957542479424 INFO dcompact_worker.cpp:1459: finish /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-44066/att-00: olev 3, work 35.405 s, result 7.887 ms, install 1.256 ms, input{raw 1.180 GiB zip 350.364 MiB}