2024/11/24-05:40:52.071106 139957383018048 DEBG dcompact_worker.cpp:2214: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42329/att-00: fork to child time = 0.009078 sec 2024/11/24-05:40:52.071859 139957383018048 DEBG dcompact_worker.cpp:1013: Beg SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42329/att-00 2024/11/24-05:40:52.077200 139957383018048 DEBG dcompact_worker.cpp:1033: End SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42329/att-00 2024/11/24-05:40:52.078115 139957383018048 TRAC dcompact_worker.cpp:1083: INFO_LOG_LEVEL: rpc = INFO_LEVEL, env_var = undefined 2024/11/24-05:40:52.078349 139957383018048 [WARN] [column_family.cc:386] multiple cf_paths/db_paths and level_compaction_dynamic_level_bytes can't be used together 2024/11/24-05:40:52.133051 139957383018048 [version_set.cc:6208] Recovering from manifest file: /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-42329/att-00/MANIFEST-206347 2024/11/24-05:40:52.149015 139957383018048 [version_set.cc:6251] Recovered from manifest file:/worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-42329/att-00/MANIFEST-206347 succeeded,manifest_file_number is 206347, next_file_number is 293847, last_sequence is 4463939223, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 293700 2024/11/24-05:40:52.149021 139957383018048 [version_set.cc:6266] Column family [default] (ID 0), log number is 0 2024/11/24-05:40:52.149093 139957383018048 [version_set.cc:5721] Creating manifest 293847 2024/11/24-05:40:52.183058 139957383018048 DEBG dcompact_worker.cpp:1218: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42329/att-00: bottommost_level: fake = 1, rpc = 0 2024/11/24-05:40:52.203923 139957383018048 [compaction_job.cc:2437] [default] [JOB 42329] Compacting 1@2 + 10@3 files to L3, score 0.84, subcompactions 1 : 1 2024/11/24-05:40:52.203934 139957383018048 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 31739 Base level 2, inputs: [293781(12MB)], [293821(32MB) 293714(34MB) 293715(33MB) 293716(35MB) 293717(33MB) 293718(35MB) 293719(34MB) 293720(33MB) 293721(35MB) 293822(33MB)] 2024/11/24-05:40:52.209376 139957383018048 [top_zip_table.cc:59] core git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/24-05:40:52.209402 139957383018048 [top_zip_table.cc:60] fsa git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/24-05:40:52.209417 139957383018048 [top_zip_table.cc:61] zbs git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/24-05:40:52.209421 139957383018048 [top_zip_table.cc:62] topling-zip_table_reader: git_version_hash_info_is: commit a4a382006cb82713acf5b3425835f22711877681 Author: leipeng Date: 2024-04-11 19:44:14 +0800 fixed_len_hole_index.cc: Add env bool FixedLenHoleIndexUseAVX512 for ut & debug 1. FixedLenHoleIndexUseAVX512 is only in unit tests or debug 2. In release mode, use avx512 by compile options(-march=) g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/24-05:40:52.209430 139957383018048 [top_zip_table.cc:64] topling-rocks git_version_hash_info_is: commit feab587e468621ba0204d47b4ffacc52e7c4290d Author: leipeng Date: 2024-03-22 13:35:06 +0800 ToplingZipTableBuilder::Add: immediately return after error This function returns void, and caller does not check builder->status() after calling this function and graceful abandon. So immediately return after error, and return error status in Finish(). g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/24-05:40:52.588043 139957383018048 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42329/att-00/293848.sst) /dev/shm/ToplingTemp/Topling-281911-YpkJg0 2024/11/24-05:40:53.669965 139957383018048 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42329/att-00/293848.sst): first pass time = 1.08's, 124.059'MB/sec 2024/11/24-05:40:55.266637 139957383018048 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42329/att-00/293848.sst): old prealloc_size = 147639500, real_size = 32752800 2024/11/24-05:40:55.267182 139957383018048 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42329/att-00/293848.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 923703 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1084 GB zip-val = 0.0308 GB avg-val = 117.30 avg-zval = 33.31 2024/11/24-05:40:55.267985 139957383018048 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42329/att-00/293848.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-05:40:56.349824 139957383018048 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42329/att-00/293848.sst): second pass time = 1.60's, 67.902'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.08's, 34.014'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3372.771'MB/sec (index lex order gen) rebuild zvType time = 0.95's, 0.242'MB/sec write SST data time = 0.13's, 288.508'MB/sec dict compress time = 0.00's, 1071445.545'MB/sec z-dict build time = 0.00's, sample length = 1.082'MB, throughput = 35846.169'MB/sec zip my value time = 1.60's, unzip length = 0.108'GB zip my value throughput = 67.902'MB/sec zip pipeline throughput = 67.902'MB/sec entries = 923703 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.30 avg-zval = 33.31 usrkeys = 923703 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.30 avg-zval = 33.31 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 923703 bytes = 3232976 } seq expand size = 6465921 multi value expand size = 0 cnt WriteAppend = 11 UnZipSize{ index = 0.0185 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0308 GB dict = 1.08 MB all = 0.0368 GB } UnZip/Zip{ index = 10.5108 value = 3.5221 dict = 1.00 all = 3.6430 } Zip/UnZip{ index = 0.0951 value = 0.2839 dict = 1.00 all = 0.2745 } ---------------------------- total value len = 2251.440393 GB avg = 0.200 KB (by entry num) total key len = 306.908826 GB avg = 0.027 KB total ukey len = 237.373201 GB avg = 0.015 KB total ukey num = 15.739584866 Billion total entry num = 11.280898814 Billion write speed all = 34.228093129 MB/sec (with seq num) write speed all = 33.020678122 MB/sec (without seq num) 2024/11/24-05:40:56.396273 139957383018048 [compaction_job.cc:1948] [default] [JOB 42329] Generated table #293848: 923703 keys, 36842816 bytes, temperature: kWarm 2024/11/24-05:40:56.396374 139957383018048 EVENT_LOG_v1 {"time_micros": 1732398056396317, "cf_name": "default", "job": 42329, "event": "table_file_creation", "file_number": 293848, "file_size": 36842816, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4261178675, "largest_seqno": 4463477562, "table_properties": {"data_size": 30764048, "index_size": 1757632, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25863684, "raw_average_key_size": 28, "raw_value_size": 108354186, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 923703, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732398052, "oldest_key_time": 0, "file_creation_time": 1732398052, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 293848, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-05:40:56.433107 139957383018048 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42329/att-00/293849.sst) /dev/shm/ToplingTemp/Topling-281911-LwImt1 2024/11/24-05:40:57.342204 139957383018048 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42329/att-00/293849.sst): first pass time = 0.91's, 147.643'MB/sec 2024/11/24-05:40:58.828190 139957383018048 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42329/att-00/293849.sst): old prealloc_size = 147639500, real_size = 32497232 2024/11/24-05:40:58.828744 139957383018048 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42329/att-00/293849.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927475 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1082 GB zip-val = 0.0305 GB avg-val = 116.71 avg-zval = 32.87 2024/11/24-05:40:58.829511 139957383018048 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42329/att-00/293849.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-05:40:59.672330 139957383018048 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42329/att-00/293849.sst): second pass time = 1.49's, 72.890'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.84's, 43.357'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3407.501'MB/sec (index lex order gen) rebuild zvType time = 0.72's, 0.323'MB/sec write SST data time = 0.13's, 288.790'MB/sec dict compress time = 0.00's, 1069843.564'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 37172.905'MB/sec zip my value time = 1.49's, unzip length = 0.108'GB zip my value throughput = 72.890'MB/sec zip pipeline throughput = 72.890'MB/sec entries = 927475 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.71 avg-zval = 32.87 usrkeys = 927475 avg-key = 20.00 avg-zkey = 1.91 avg-val = 123.71 avg-zval = 32.87 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 927475 bytes = 3246176 } seq expand size = 6492325 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0305 GB dict = 1.08 MB all = 0.0366 GB } UnZip/Zip{ index = 10.4445 value = 3.5504 dict = 1.00 all = 3.6674 } Zip/UnZip{ index = 0.0957 value = 0.2817 dict = 1.00 all = 0.2727 } ---------------------------- total value len = 2251.555134 GB avg = 0.200 KB (by entry num) total key len = 306.934795 GB avg = 0.027 KB total ukey len = 237.391751 GB avg = 0.015 KB total ukey num = 15.740512341 Billion total entry num = 11.281826289 Billion write speed all = 34.228454178 MB/sec (with seq num) write speed all = 33.020993575 MB/sec (without seq num) 2024/11/24-05:40:59.724308 139957383018048 [compaction_job.cc:1948] [default] [JOB 42329] Generated table #293849: 927475 keys, 36597870 bytes, temperature: kWarm 2024/11/24-05:40:59.724377 139957383018048 EVENT_LOG_v1 {"time_micros": 1732398059724342, "cf_name": "default", "job": 42329, "event": "table_file_creation", "file_number": 293849, "file_size": 36597870, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4261178686, "largest_seqno": 4463478493, "table_properties": {"data_size": 30489152, "index_size": 1776000, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25969300, "raw_average_key_size": 28, "raw_value_size": 108248534, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927475, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732398056, "oldest_key_time": 0, "file_creation_time": 1732398056, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 293849, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-05:40:59.762892 139957383018048 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42329/att-00/293850.sst) /dev/shm/ToplingTemp/Topling-281911-RsLDaY 2024/11/24-05:41:00.697358 139957383018048 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42329/att-00/293850.sst): first pass time = 0.93's, 143.636'MB/sec 2024/11/24-05:41:02.131214 139957383018048 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42329/att-00/293850.sst): old prealloc_size = 147639500, real_size = 31491712 2024/11/24-05:41:02.131806 139957383018048 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42329/att-00/293850.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 919300 prefix = 4 raw-key = 0.0147 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.93 raw-val = 0.1085 GB zip-val = 0.0295 GB avg-val = 118.00 avg-zval = 32.08 2024/11/24-05:41:02.132615 139957383018048 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42329/att-00/293850.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-05:41:02.964023 139957383018048 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42329/att-00/293850.sst): second pass time = 1.43's, 75.699'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.83's, 42.711'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3088.343'MB/sec (index lex order gen) rebuild zvType time = 0.70's, 0.328'MB/sec write SST data time = 0.13's, 270.614'MB/sec dict compress time = 0.00's, 1074267.327'MB/sec z-dict build time = 0.00's, sample length = 1.085'MB, throughput = 34950.715'MB/sec zip my value time = 1.43's, unzip length = 0.108'GB zip my value throughput = 75.699'MB/sec zip pipeline throughput = 75.699'MB/sec entries = 919300 avg-key = 28.00 avg-zkey = 1.93 avg-val = 118.00 avg-zval = 32.08 usrkeys = 919300 avg-key = 20.00 avg-zkey = 1.93 avg-val = 125.00 avg-zval = 32.08 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 919300 bytes = 3217568 } seq expand size = 6435100 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0184 GB value = 0.1085 GB dict = 1.09 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0295 GB dict = 1.09 MB all = 0.0356 GB } UnZip/Zip{ index = 10.3745 value = 3.6785 dict = 1.00 all = 3.7735 } Zip/UnZip{ index = 0.0964 value = 0.2718 dict = 1.00 all = 0.2650 } ---------------------------- total value len = 2251.670047 GB avg = 0.200 KB (by entry num) total key len = 306.960536 GB avg = 0.027 KB total ukey len = 237.410137 GB avg = 0.015 KB total ukey num = 15.741431641 Billion total entry num = 11.282745589 Billion write speed all = 34.228828536 MB/sec (with seq num) write speed all = 33.021322718 MB/sec (without seq num) 2024/11/24-05:41:03.012091 139957383018048 [compaction_job.cc:1948] [default] [JOB 42329] Generated table #293850: 919300 keys, 35568434 bytes, temperature: kWarm 2024/11/24-05:41:03.012161 139957383018048 EVENT_LOG_v1 {"time_micros": 1732398063012127, "cf_name": "default", "job": 42329, "event": "table_file_creation", "file_number": 293850, "file_size": 35568434, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4290610056, "largest_seqno": 4442784063, "table_properties": {"data_size": 29489456, "index_size": 1772224, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25740400, "raw_average_key_size": 28, "raw_value_size": 108477400, "raw_average_value_size": 118, "num_data_blocks": 1, "num_entries": 919300, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 118, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732398059, "oldest_key_time": 0, "file_creation_time": 1732398059, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 293850, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-05:41:03.049755 139957383018048 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42329/att-00/293851.sst) /dev/shm/ToplingTemp/Topling-281911-tTU8F0 2024/11/24-05:41:04.055747 139957383018048 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42329/att-00/293851.sst): first pass time = 1.01's, 133.423'MB/sec 2024/11/24-05:41:05.554593 139957383018048 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42329/att-00/293851.sst): old prealloc_size = 147639500, real_size = 33434560 2024/11/24-05:41:05.555161 139957383018048 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42329/att-00/293851.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927502 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0314 GB avg-val = 116.71 avg-zval = 33.90 2024/11/24-05:41:05.555925 139957383018048 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42329/att-00/293851.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-05:41:06.419471 139957383018048 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42329/att-00/293851.sst): second pass time = 1.50's, 72.280'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.86's, 43.400'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3226.817'MB/sec (index lex order gen) rebuild zvType time = 0.74's, 0.315'MB/sec write SST data time = 0.13's, 295.092'MB/sec dict compress time = 0.00's, 1069637.624'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 36436.223'MB/sec zip my value time = 1.50's, unzip length = 0.108'GB zip my value throughput = 72.280'MB/sec zip pipeline throughput = 72.280'MB/sec entries = 927502 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.71 avg-zval = 33.90 usrkeys = 927502 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.71 avg-zval = 33.90 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 927502 bytes = 3246272 } seq expand size = 6492514 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0314 GB dict = 1.08 MB all = 0.0375 GB } UnZip/Zip{ index = 10.5142 value = 3.4432 dict = 1.00 all = 3.5758 } Zip/UnZip{ index = 0.0951 value = 0.2904 dict = 1.00 all = 0.2797 } ---------------------------- total value len = 2251.784787 GB avg = 0.200 KB (by entry num) total key len = 306.986506 GB avg = 0.027 KB total ukey len = 237.428687 GB avg = 0.015 KB total ukey num = 15.742359143 Billion total entry num = 11.283673091 Billion write speed all = 34.229128637 MB/sec (with seq num) write speed all = 33.021579376 MB/sec (without seq num) 2024/11/24-05:41:06.470359 139957383018048 [compaction_job.cc:1948] [default] [JOB 42329] Generated table #293851: 927502 keys, 37535134 bytes, temperature: kWarm 2024/11/24-05:41:06.470428 139957383018048 EVENT_LOG_v1 {"time_micros": 1732398066470394, "cf_name": "default", "job": 42329, "event": "table_file_creation", "file_number": 293851, "file_size": 37535134, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4261178700, "largest_seqno": 4463478509, "table_properties": {"data_size": 31438192, "index_size": 1764288, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25970056, "raw_average_key_size": 28, "raw_value_size": 108247780, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927502, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732398063, "oldest_key_time": 0, "file_creation_time": 1732398063, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 293851, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-05:41:06.507360 139957383018048 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42329/att-00/293852.sst) /dev/shm/ToplingTemp/Topling-281911-OFaqd0 2024/11/24-05:41:07.509869 139957383018048 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42329/att-00/293852.sst): first pass time = 1.00's, 133.886'MB/sec 2024/11/24-05:41:08.941392 139957383018048 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42329/att-00/293852.sst): old prealloc_size = 147639500, real_size = 30967648 2024/11/24-05:41:08.941941 139957383018048 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42329/att-00/293852.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 924889 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1083 GB zip-val = 0.0290 GB avg-val = 117.12 avg-zval = 31.32 2024/11/24-05:41:08.942717 139957383018048 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42329/att-00/293852.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-05:41:09.754943 139957383018048 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42329/att-00/293852.sst): second pass time = 1.43's, 75.715'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.81's, 42.953'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3368.793'MB/sec (index lex order gen) rebuild zvType time = 0.69's, 0.336'MB/sec write SST data time = 0.13's, 278.036'MB/sec dict compress time = 0.00's, 1070524.752'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 33227.720'MB/sec zip my value time = 1.43's, unzip length = 0.108'GB zip my value throughput = 75.715'MB/sec zip pipeline throughput = 75.715'MB/sec entries = 924889 avg-key = 28.00 avg-zkey = 1.91 avg-val = 117.12 avg-zval = 31.32 usrkeys = 924889 avg-key = 20.00 avg-zkey = 1.91 avg-val = 124.12 avg-zval = 31.32 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 924889 bytes = 3121520 } seq expand size = 6474223 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0290 GB dict = 1.08 MB all = 0.0349 GB } UnZip/Zip{ index = 10.4455 value = 3.7397 dict = 1.00 all = 3.8410 } Zip/UnZip{ index = 0.0957 value = 0.2674 dict = 1.00 all = 0.2603 } ---------------------------- total value len = 2251.899582 GB avg = 0.200 KB (by entry num) total key len = 307.012403 GB avg = 0.027 KB total ukey len = 237.447185 GB avg = 0.015 KB total ukey num = 15.743284032 Billion total entry num = 11.284597980 Billion write speed all = 34.229483405 MB/sec (with seq num) write speed all = 33.021889048 MB/sec (without seq num) 2024/11/24-05:41:09.801327 139957383018048 [compaction_job.cc:1948] [default] [JOB 42329] Generated table #293852: 924889 keys, 34943134 bytes, temperature: kWarm 2024/11/24-05:41:09.801395 139957383018048 EVENT_LOG_v1 {"time_micros": 1732398069801361, "cf_name": "default", "job": 42329, "event": "table_file_creation", "file_number": 293852, "file_size": 34943134, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4345267842, "largest_seqno": 4463478528, "table_properties": {"data_size": 28965392, "index_size": 1770880, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25896892, "raw_average_key_size": 28, "raw_value_size": 108320878, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 924889, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732398066, "oldest_key_time": 0, "file_creation_time": 1732398066, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 293852, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-05:41:09.839482 139957383018048 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42329/att-00/293853.sst) /dev/shm/ToplingTemp/Topling-281911-tx0lE0 2024/11/24-05:41:10.847362 139957383018048 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42329/att-00/293853.sst): first pass time = 1.01's, 133.173'MB/sec 2024/11/24-05:41:12.314815 139957383018048 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42329/att-00/293853.sst): old prealloc_size = 147639500, real_size = 32450384 2024/11/24-05:41:12.315396 139957383018048 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42329/att-00/293853.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 921997 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1084 GB zip-val = 0.0305 GB avg-val = 117.57 avg-zval = 33.04 2024/11/24-05:41:12.316164 139957383018048 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42329/att-00/293853.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-05:41:13.144604 139957383018048 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42329/att-00/293853.sst): second pass time = 1.47's, 73.911'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.83's, 44.032'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3143.199'MB/sec (index lex order gen) rebuild zvType time = 0.70's, 0.328'MB/sec write SST data time = 0.13's, 289.785'MB/sec dict compress time = 0.00's, 1072463.366'MB/sec z-dict build time = 0.00's, sample length = 1.083'MB, throughput = 37993.266'MB/sec zip my value time = 1.47's, unzip length = 0.108'GB zip my value throughput = 73.911'MB/sec zip pipeline throughput = 73.911'MB/sec entries = 921997 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.57 avg-zval = 33.04 usrkeys = 921997 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.57 avg-zval = 33.04 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 921997 bytes = 3227008 } seq expand size = 6453979 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0184 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0305 GB dict = 1.08 MB all = 0.0365 GB } UnZip/Zip{ index = 10.5113 value = 3.5582 dict = 1.00 all = 3.6736 } Zip/UnZip{ index = 0.0951 value = 0.2810 dict = 1.00 all = 0.2722 } ---------------------------- total value len = 2252.014438 GB avg = 0.200 KB (by entry num) total key len = 307.038219 GB avg = 0.027 KB total ukey len = 237.465625 GB avg = 0.015 KB total ukey num = 15.744206029 Billion total entry num = 11.285519977 Billion write speed all = 34.229813067 MB/sec (with seq num) write speed all = 33.022174801 MB/sec (without seq num) 2024/11/24-05:41:13.195363 139957383018048 [compaction_job.cc:1948] [default] [JOB 42329] Generated table #293853: 921997 keys, 36535940 bytes, temperature: kWarm 2024/11/24-05:41:13.195454 139957383018048 EVENT_LOG_v1 {"time_micros": 1732398073195406, "cf_name": "default", "job": 42329, "event": "table_file_creation", "file_number": 293853, "file_size": 36535940, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4261178719, "largest_seqno": 4463476984, "table_properties": {"data_size": 30465408, "index_size": 1754304, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25815916, "raw_average_key_size": 28, "raw_value_size": 108401822, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 921997, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732398069, "oldest_key_time": 0, "file_creation_time": 1732398069, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 293853, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-05:41:13.238607 139957383018048 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42329/att-00/293854.sst) /dev/shm/ToplingTemp/Topling-281911-WCBYNY 2024/11/24-05:41:14.237245 139957383018048 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42329/att-00/293854.sst): first pass time = 1.00's, 134.406'MB/sec 2024/11/24-05:41:15.575275 139957383018048 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42329/att-00/293854.sst): old prealloc_size = 147639500, real_size = 32780320 2024/11/24-05:41:15.575841 139957383018048 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42329/att-00/293854.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927837 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0308 GB avg-val = 116.66 avg-zval = 33.18 2024/11/24-05:41:15.576637 139957383018048 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42329/att-00/293854.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-05:41:16.419658 139957383018048 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42329/att-00/293854.sst): second pass time = 1.34's, 80.943'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.84's, 43.680'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3320.210'MB/sec (index lex order gen) rebuild zvType time = 0.72's, 0.323'MB/sec write SST data time = 0.13's, 291.043'MB/sec dict compress time = 0.00's, 1069437.624'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 35818.146'MB/sec zip my value time = 1.34's, unzip length = 0.108'GB zip my value throughput = 80.943'MB/sec zip pipeline throughput = 80.943'MB/sec entries = 927837 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.66 avg-zval = 33.18 usrkeys = 927837 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.66 avg-zval = 33.18 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 927837 bytes = 3247440 } seq expand size = 6494859 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0308 GB dict = 1.08 MB all = 0.0369 GB } UnZip/Zip{ index = 10.5130 value = 3.5162 dict = 1.00 all = 3.6391 } Zip/UnZip{ index = 0.0951 value = 0.2844 dict = 1.00 all = 0.2748 } ---------------------------- total value len = 2252.129171 GB avg = 0.200 KB (by entry num) total key len = 307.064198 GB avg = 0.027 KB total ukey len = 237.484181 GB avg = 0.015 KB total ukey num = 15.745133866 Billion total entry num = 11.286447814 Billion write speed all = 34.230195709 MB/sec (with seq num) write speed all = 33.022511062 MB/sec (without seq num) 2024/11/24-05:41:16.464667 139957383018048 [compaction_job.cc:1948] [default] [JOB 42329] Generated table #293854: 927837 keys, 36881748 bytes, temperature: kWarm 2024/11/24-05:41:16.464738 139957383018048 EVENT_LOG_v1 {"time_micros": 1732398076464701, "cf_name": "default", "job": 42329, "event": "table_file_creation", "file_number": 293854, "file_size": 36881748, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4261178730, "largest_seqno": 4463478538, "table_properties": {"data_size": 30783056, "index_size": 1765120, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25979436, "raw_average_key_size": 28, "raw_value_size": 108238382, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927837, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732398073, "oldest_key_time": 0, "file_creation_time": 1732398073, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 293854, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-05:41:16.500093 139957383018048 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42329/att-00/293855.sst) /dev/shm/ToplingTemp/Topling-281911-ISAEP0 2024/11/24-05:41:17.515386 139957383018048 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42329/att-00/293855.sst): first pass time = 1.02's, 132.200'MB/sec 2024/11/24-05:41:18.825177 139957383018048 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42329/att-00/293855.sst): old prealloc_size = 147639500, real_size = 31428544 2024/11/24-05:41:18.825747 139957383018048 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42329/att-00/293855.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 919300 prefix = 4 raw-key = 0.0147 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1085 GB zip-val = 0.0294 GB avg-val = 118.00 avg-zval = 32.02 2024/11/24-05:41:18.826512 139957383018048 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42329/att-00/293855.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-05:41:19.639144 139957383018048 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42329/att-00/293855.sst): second pass time = 1.31's, 82.901'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.81's, 43.621'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3204.451'MB/sec (index lex order gen) rebuild zvType time = 0.69's, 0.335'MB/sec write SST data time = 0.13's, 279.784'MB/sec dict compress time = 0.00's, 1074267.327'MB/sec z-dict build time = 0.00's, sample length = 1.085'MB, throughput = 33247.840'MB/sec zip my value time = 1.31's, unzip length = 0.108'GB zip my value throughput = 82.901'MB/sec zip pipeline throughput = 82.901'MB/sec entries = 919300 avg-key = 28.00 avg-zkey = 1.91 avg-val = 118.00 avg-zval = 32.02 usrkeys = 919300 avg-key = 20.00 avg-zkey = 1.91 avg-val = 125.00 avg-zval = 32.02 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 919300 bytes = 3217568 } seq expand size = 6435100 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0184 GB value = 0.1085 GB dict = 1.09 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0294 GB dict = 1.09 MB all = 0.0355 GB } UnZip/Zip{ index = 10.4458 value = 3.6849 dict = 1.00 all = 3.7802 } Zip/UnZip{ index = 0.0957 value = 0.2714 dict = 1.00 all = 0.2645 } ---------------------------- total value len = 2252.244084 GB avg = 0.200 KB (by entry num) total key len = 307.089939 GB avg = 0.027 KB total ukey len = 237.502567 GB avg = 0.015 KB total ukey num = 15.746053166 Billion total entry num = 11.287367114 Billion write speed all = 34.230602960 MB/sec (with seq num) write speed all = 33.022871953 MB/sec (without seq num) 2024/11/24-05:41:19.682680 139957383018048 [compaction_job.cc:1948] [default] [JOB 42329] Generated table #293855: 919300 keys, 35505266 bytes, temperature: kWarm 2024/11/24-05:41:19.682750 139957383018048 EVENT_LOG_v1 {"time_micros": 1732398079682714, "cf_name": "default", "job": 42329, "event": "table_file_creation", "file_number": 293855, "file_size": 35505266, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4298517318, "largest_seqno": 4450080680, "table_properties": {"data_size": 29438384, "index_size": 1760128, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25740400, "raw_average_key_size": 28, "raw_value_size": 108477400, "raw_average_value_size": 118, "num_data_blocks": 1, "num_entries": 919300, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 118, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732398076, "oldest_key_time": 0, "file_creation_time": 1732398076, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 293855, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-05:41:19.722314 139957383018048 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42329/att-00/293856.sst) /dev/shm/ToplingTemp/Topling-281911-r7SGg0 2024/11/24-05:41:20.687739 139957383018048 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42329/att-00/293856.sst): first pass time = 0.97's, 139.031'MB/sec 2024/11/24-05:41:22.018311 139957383018048 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42329/att-00/293856.sst): old prealloc_size = 147639500, real_size = 33380608 2024/11/24-05:41:22.018907 139957383018048 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42329/att-00/293856.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927446 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0314 GB avg-val = 116.72 avg-zval = 33.84 2024/11/24-05:41:22.019704 139957383018048 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42329/att-00/293856.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-05:41:22.874707 139957383018048 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42329/att-00/293856.sst): second pass time = 1.33's, 81.402'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.86's, 43.767'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3094.120'MB/sec (index lex order gen) rebuild zvType time = 0.73's, 0.318'MB/sec write SST data time = 0.13's, 296.977'MB/sec dict compress time = 0.00's, 1069560.396'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 29350.795'MB/sec zip my value time = 1.33's, unzip length = 0.108'GB zip my value throughput = 81.402'MB/sec zip pipeline throughput = 81.402'MB/sec entries = 927446 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.72 avg-zval = 33.84 usrkeys = 927446 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.72 avg-zval = 33.84 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 927446 bytes = 3246080 } seq expand size = 6492122 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0314 GB dict = 1.08 MB all = 0.0375 GB } UnZip/Zip{ index = 10.5128 value = 3.4492 dict = 1.00 all = 3.5810 } Zip/UnZip{ index = 0.0951 value = 0.2899 dict = 1.00 all = 0.2793 } ---------------------------- total value len = 2252.358825 GB avg = 0.200 KB (by entry num) total key len = 307.115907 GB avg = 0.027 KB total ukey len = 237.521116 GB avg = 0.015 KB total ukey num = 15.746980612 Billion total entry num = 11.288294560 Billion write speed all = 34.231003583 MB/sec (with seq num) write speed all = 33.023225607 MB/sec (without seq num) 2024/11/24-05:41:22.920349 139957383018048 [compaction_job.cc:1948] [default] [JOB 42329] Generated table #293856: 927446 keys, 37480976 bytes, temperature: kWarm 2024/11/24-05:41:22.920418 139957383018048 EVENT_LOG_v1 {"time_micros": 1732398082920383, "cf_name": "default", "job": 42329, "event": "table_file_creation", "file_number": 293856, "file_size": 37480976, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4265680186, "largest_seqno": 4463478557, "table_properties": {"data_size": 31384176, "index_size": 1764416, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25968488, "raw_average_key_size": 28, "raw_value_size": 108249324, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927446, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732398079, "oldest_key_time": 0, "file_creation_time": 1732398079, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 293856, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-05:41:22.959536 139957383018048 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42329/att-00/293857.sst) /dev/shm/ToplingTemp/Topling-281911-6QtOP0 2024/11/24-05:41:23.472264 139957383018048 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42329/att-00/293857.sst): first pass time = 0.51's, 252.036'MB/sec 2024/11/24-05:41:24.749467 139957383018048 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42329/att-00/293857.sst): old prealloc_size = 147639500, real_size = 29812688 2024/11/24-05:41:24.750040 139957383018048 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42329/att-00/293857.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 891736 prefix = 4 raw-key = 0.0143 GB zip-key = 0.0017 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1042 GB zip-val = 0.0279 GB avg-val = 116.90 avg-zval = 31.27 2024/11/24-05:41:24.750756 139957383018048 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42329/att-00/293857.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0022 GB, waited 0.000 sec, Key+Value = 0.129 GB 2024/11/24-05:41:25.543116 139957383018048 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42329/att-00/293857.sst): second pass time = 1.28's, 81.700'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.79's, 42.395'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3106.677'MB/sec (index lex order gen) rebuild zvType time = 0.67's, 0.332'MB/sec write SST data time = 0.12's, 274.760'MB/sec dict compress time = 0.00's, 1032380.198'MB/sec z-dict build time = 0.00's, sample length = 1.043'MB, throughput = 32552.964'MB/sec zip my value time = 1.28's, unzip length = 0.104'GB zip my value throughput = 81.700'MB/sec zip pipeline throughput = 81.700'MB/sec entries = 891736 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.90 avg-zval = 31.27 usrkeys = 891736 avg-key = 20.00 avg-zkey = 1.91 avg-val = 123.90 avg-zval = 31.27 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 891736 bytes = 3009616 } seq expand size = 6242152 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0178 GB value = 0.1042 GB dict = 1.04 MB all = 0.1292 GB } __ZipSize{ index = 0.0017 GB value = 0.0279 GB dict = 1.04 MB all = 0.0336 GB } UnZip/Zip{ index = 10.4468 value = 3.7389 dict = 1.00 all = 3.8405 } Zip/UnZip{ index = 0.0957 value = 0.2675 dict = 1.00 all = 0.2604 } ---------------------------- total value len = 2252.469315 GB avg = 0.200 KB (by entry num) total key len = 307.140876 GB avg = 0.027 KB total ukey len = 237.538951 GB avg = 0.015 KB total ukey num = 15.747872348 Billion total entry num = 11.289186296 Billion write speed all = 34.231593588 MB/sec (with seq num) write speed all = 33.023763306 MB/sec (without seq num) 2024/11/24-05:41:25.585324 139957383018048 [compaction_job.cc:1948] [default] [JOB 42329] Generated table #293857: 891736 keys, 33645920 bytes, temperature: kWarm 2024/11/24-05:41:25.585393 139957383018048 EVENT_LOG_v1 {"time_micros": 1732398085585359, "cf_name": "default", "job": 42329, "event": "table_file_creation", "file_number": 293857, "file_size": 33645920, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4357634835, "largest_seqno": 4463478571, "table_properties": {"data_size": 27882368, "index_size": 1707200, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 24968608, "raw_average_key_size": 28, "raw_value_size": 104248200, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 891736, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732398082, "oldest_key_time": 0, "file_creation_time": 1732398082, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 293857, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-05:41:25.609743 139957383018048 [compaction_job.cc:703] job-42329: subcompact[0], size: 0.361537 G, files: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-42329/att-00 [293848,293849,293850,293851,293852,293853,293854,293855,293856,293857] 2024/11/24-05:41:25.674848 139957383018048 (Original Log Time 2024/11/24-05:40:52.203967) EVENT_LOG_v1 {"time_micros": 1732398052203942, "job": 42329, "event": "compaction_started", "compaction_reason": "FilesMarkedForCompaction", "files_L2": [293781], "files_L3": [293821, 293714, 293715, 293716, 293717, 293718, 293719, 293720, 293721, 293822], "score": 0.844834, "input_data_size": 371897534, "oldest_snapshot_seqno": 4463939197} 2024/11/24-05:41:25.674852 139957383018048 (Original Log Time 2024/11/24-05:41:25.673955) [compaction_job.cc:2022] [default] [JOB 42329] Compacted 1@2 + 10@3 files to L3 => 361537238 bytes 2024/11/24-05:41:25.674853 139957383018048 (Original Log Time 2024/11/24-05:41:25.674783) [compaction_job.cc:1224] [default] compacted to: files[0 0 0 10 0 0 0] max score 0.01, MB/sec: 11.1 rd, 10.8 wr, level 3, files in(1, 10) out(10 +0 blob) MB in(12.4, 342.2 +0.0 blob) out(344.8 +0.0 blob), read-write-amplify(56.3) write-amplify(27.7) OK, records in: 9260824, records dropped: 49639 output_compression: Snappy 2024/11/24-05:41:25.674860 139957383018048 (Original Log Time 2024/11/24-05:41:25.674826) EVENT_LOG_v1 {"time_micros": 1732398085674807, "cf": "default", "job": 42329, "event": "compaction_finished", "compaction_time_micros": 33405787, "compaction_time_cpu_micros": 13980557, "output_level": 3, "num_output_files": 10, "total_output_size": 361537238, "num_input_records": 9260824, "num_output_records": 9211185, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "file_write_nanos": 254998502, "file_range_sync_nanos": 0, "file_fsync_nanos": 7148, "file_prepare_write_nanos": 23313, "lsm_state": [0, 0, 0, 10, 0, 0, 0]} 2024/11/24-05:41:25.807071 139957383018048 DEBG dcompact_worker.cpp:240: HttpPost: 200 OK: url = http://nlb-7zny4kaa1poal01o64.cn-shenzhen.nlb.aliyuncs.com:8443, body = {"instanceId":"nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137","labourId":"","dbId":"d89b4006-2803-486e-b7a2-759bcf348921","dbStarts":1732256054,"starts":1732398052,"executesMs":33594,"compactionJobId":42329,"attempt":0,"compactionInputRawBytes":1344225824,"compactionInputZipBytes":371897534,"compactionOutputRawBytes":0,"compactionOutputZipBytes":361537238,"headers":{"Accept":"*/*","Connection":"close","Host":"aliyun-topling-saas.topling.cn:18443","RemoteIp":"120.24.192.169","X-Forwarded-For":"120.24.192.169","region":"cn-shenzhen","token":"e6474c481bd4415abc537135cc03626b","instance-token":"e6474c481bd4415abc537135cc03626b","provider":"aliyun","CloudMarketInstanceId":"si-59c0ae5c955845588903","MeteringAssit":"","Transfer-Encoding":"chunked","traceparent":"00-ed7701822719c57e8e4060c5ca65f854-de0c790cf664f99b-00"}}, response = 2024/11/24-05:41:25.807164 139957383018048 INFO dcompact_worker.cpp:1459: finish /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-42329/att-00: olev 3, work 33.595 s, result 7.690 ms, install 0.921 ms, input{raw 1.252 GiB zip 354.669 MiB}