2024/11/22-17:55:30.006711 140024919680576 DEBG dcompact_worker.cpp:2214: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06717/att-00: fork to child time = 0.009244 sec 2024/11/22-17:55:30.007565 140024919680576 DEBG dcompact_worker.cpp:1013: Beg SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06717/att-00 2024/11/22-17:55:30.014665 140024919680576 DEBG dcompact_worker.cpp:1033: End SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06717/att-00 2024/11/22-17:55:30.015826 140024919680576 TRAC dcompact_worker.cpp:1083: INFO_LOG_LEVEL: rpc = INFO_LEVEL, env_var = undefined 2024/11/22-17:55:30.016261 140024919680576 [WARN] [column_family.cc:386] multiple cf_paths/db_paths and level_compaction_dynamic_level_bytes can't be used together 2024/11/22-17:55:30.068978 140024919680576 [version_set.cc:6208] Recovering from manifest file: /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-06717/att-00/MANIFEST-206347 2024/11/22-17:55:30.111061 140024919680576 [version_set.cc:6251] Recovered from manifest file:/worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-06717/att-00/MANIFEST-206347 succeeded,manifest_file_number is 206347, next_file_number is 218918, last_sequence is 3442097365, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 218731 2024/11/22-17:55:30.111069 140024919680576 [version_set.cc:6266] Column family [default] (ID 0), log number is 0 2024/11/22-17:55:30.111168 140024919680576 [version_set.cc:5721] Creating manifest 218918 2024/11/22-17:55:30.145737 140024919680576 DEBG dcompact_worker.cpp:1218: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06717/att-00: bottommost_level: fake = 1, rpc = 0 2024/11/22-17:55:30.166790 140024919680576 [compaction_job.cc:2437] [default] [JOB 6717] Compacting 1@2 + 11@3 files to L3, score 0.95, subcompactions 1 : 1 2024/11/22-17:55:30.166809 140024919680576 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 5143 Base level 2, inputs: [218857(27MB)], [218907(7604KB) 218829(36MB) 218830(36MB) 218831(36MB) 218832(9670KB) 218813(34MB) 218814(37MB) 218815(36MB) 218816(35MB) 218817(36MB) 218908(35MB)] 2024/11/22-17:55:30.175600 140024919680576 [top_zip_table.cc:59] core git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/22-17:55:30.175640 140024919680576 [top_zip_table.cc:60] fsa git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/22-17:55:30.175660 140024919680576 [top_zip_table.cc:61] zbs git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/22-17:55:30.175666 140024919680576 [top_zip_table.cc:62] topling-zip_table_reader: git_version_hash_info_is: commit a4a382006cb82713acf5b3425835f22711877681 Author: leipeng Date: 2024-04-11 19:44:14 +0800 fixed_len_hole_index.cc: Add env bool FixedLenHoleIndexUseAVX512 for ut & debug 1. FixedLenHoleIndexUseAVX512 is only in unit tests or debug 2. In release mode, use avx512 by compile options(-march=) g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/22-17:55:30.175677 140024919680576 [top_zip_table.cc:64] topling-rocks git_version_hash_info_is: commit feab587e468621ba0204d47b4ffacc52e7c4290d Author: leipeng Date: 2024-03-22 13:35:06 +0800 ToplingZipTableBuilder::Add: immediately return after error This function returns void, and caller does not check builder->status() after calling this function and graceful abandon. So immediately return after error, and return error status in Finish(). g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/22-17:55:30.483657 140024919680576 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06717/att-00/218919.sst) /dev/shm/ToplingTemp/Topling-229175-YP7nOi 2024/11/22-17:55:31.432038 140024919680576 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06717/att-00/218919.sst): first pass time = 0.95's, 141.530'MB/sec 2024/11/22-17:55:32.784007 140024919680576 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06717/att-00/218919.sst): old prealloc_size = 147639500, real_size = 34375904 2024/11/22-17:55:32.784540 140024919680576 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06717/att-00/218919.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 924984 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.93 raw-val = 0.1083 GB zip-val = 0.0324 GB avg-val = 117.10 avg-zval = 34.99 2024/11/22-17:55:32.785359 140024919680576 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06717/att-00/218919.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-17:55:33.695387 140024919680576 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06717/att-00/218919.sst): second pass time = 1.35's, 80.199'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.91's, 42.209'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3468.817'MB/sec (index lex order gen) rebuild zvType time = 0.78's, 0.296'MB/sec write SST data time = 0.13's, 294.497'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 32723.326'MB/sec zip my value time = 1.35's, unzip length = 0.108'GB zip my value throughput = 80.199'MB/sec zip pipeline throughput = 80.199'MB/sec entries = 924984 avg-key = 28.00 avg-zkey = 1.93 avg-val = 117.10 avg-zval = 34.99 usrkeys = 924984 avg-key = 20.00 avg-zkey = 1.93 avg-val = 124.10 avg-zval = 34.99 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 924984 bytes = 3237456 } seq expand size = 6474888 multi value expand size = 0 cnt WriteAppend = 16 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0324 GB dict = 1.08 MB all = 0.0385 GB } UnZip/Zip{ index = 10.3750 value = 3.3471 dict = 1.00 all = 3.4890 } Zip/UnZip{ index = 0.0964 value = 0.2988 dict = 1.00 all = 0.2866 } ---------------------------- total value len = 0.114793 GB avg = 0.124 KB (by entry num) total key len = 0.025900 GB avg = 0.028 KB total ukey len = 0.018500 GB avg = 0.020 KB total ukey num = 0.000924984 Billion total entry num = 0.000924984 Billion write speed all = 0.004316972 MB/sec (with seq num) write speed all = 0.004089917 MB/sec (without seq num) 2024/11/22-17:55:33.730679 140024919680576 [compaction_job.cc:1948] [default] [JOB 6717] Generated table #218919: 924984 keys, 38468770 bytes, temperature: kWarm 2024/11/22-17:55:33.730767 140024919680576 EVENT_LOG_v1 {"time_micros": 1732269333730714, "cf_name": "default", "job": 6717, "event": "table_file_creation", "file_number": 218919, "file_size": 38468770, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3273701386, "largest_seqno": 3441621892, "table_properties": {"data_size": 32361360, "index_size": 1783104, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25899552, "raw_average_key_size": 28, "raw_value_size": 108318276, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 924984, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732269330, "oldest_key_time": 0, "file_creation_time": 1732269330, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 218919, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-17:55:33.765404 140024919680576 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06717/att-00/218920.sst) /dev/shm/ToplingTemp/Topling-229175-0dlpXi 2024/11/22-17:55:34.710356 140024919680576 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06717/att-00/218920.sst): first pass time = 0.94's, 142.043'MB/sec 2024/11/22-17:55:36.062894 140024919680576 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06717/att-00/218920.sst): old prealloc_size = 147639500, real_size = 34545280 2024/11/22-17:55:36.063445 140024919680576 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06717/att-00/218920.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 925567 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0326 GB avg-val = 117.01 avg-zval = 35.17 2024/11/22-17:55:36.064196 140024919680576 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06717/att-00/218920.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-17:55:36.974758 140024919680576 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06717/att-00/218920.sst): second pass time = 1.35's, 80.111'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.91's, 42.121'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3399.923'MB/sec (index lex order gen) rebuild zvType time = 0.78's, 0.296'MB/sec write SST data time = 0.13's, 293.391'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 34112.465'MB/sec zip my value time = 1.35's, unzip length = 0.108'GB zip my value throughput = 80.111'MB/sec zip pipeline throughput = 80.111'MB/sec entries = 925567 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.01 avg-zval = 35.17 usrkeys = 925567 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.01 avg-zval = 35.17 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 925567 bytes = 3008112 } seq expand size = 6478969 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0326 GB dict = 1.08 MB all = 0.0384 GB } UnZip/Zip{ index = 10.5140 value = 3.3269 dict = 1.00 all = 3.4945 } Zip/UnZip{ index = 0.0951 value = 0.3006 dict = 1.00 all = 0.2862 } ---------------------------- total value len = 0.229574 GB avg = 0.124 KB (by entry num) total key len = 0.051815 GB avg = 0.028 KB total ukey len = 0.037011 GB avg = 0.020 KB total ukey num = 0.001850551 Billion total entry num = 0.001850551 Billion write speed all = 0.008633202 MB/sec (with seq num) write speed all = 0.008178993 MB/sec (without seq num) 2024/11/22-17:55:37.007156 140024919680576 [compaction_job.cc:1948] [default] [JOB 6717] Generated table #218920: 925567 keys, 38408234 bytes, temperature: kWarm 2024/11/22-17:55:37.007217 140024919680576 EVENT_LOG_v1 {"time_micros": 1732269337007185, "cf_name": "default", "job": 6717, "event": "table_file_creation", "file_number": 218920, "file_size": 38408234, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3376774735, "largest_seqno": 3441621932, "table_properties": {"data_size": 32553072, "index_size": 1760640, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25915876, "raw_average_key_size": 28, "raw_value_size": 108301966, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 925567, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732269333, "oldest_key_time": 0, "file_creation_time": 1732269333, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 218920, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-17:55:37.046336 140024919680576 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06717/att-00/218921.sst) /dev/shm/ToplingTemp/Topling-229175-sCjBXj 2024/11/22-17:55:37.982849 140024919680576 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06717/att-00/218921.sst): first pass time = 0.94's, 143.323'MB/sec 2024/11/22-17:55:39.318671 140024919680576 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06717/att-00/218921.sst): old prealloc_size = 147639500, real_size = 34053168 2024/11/22-17:55:39.319264 140024919680576 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06717/att-00/218921.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927315 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0321 GB avg-val = 116.74 avg-zval = 34.57 2024/11/22-17:55:39.320004 140024919680576 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06717/att-00/218921.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-17:55:40.242414 140024919680576 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06717/att-00/218921.sst): second pass time = 1.34's, 81.085'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.92's, 41.053'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3083.052'MB/sec (index lex order gen) rebuild zvType time = 0.79's, 0.293'MB/sec write SST data time = 0.13's, 289.933'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 34131.897'MB/sec zip my value time = 1.34's, unzip length = 0.108'GB zip my value throughput = 81.085'MB/sec zip pipeline throughput = 81.085'MB/sec entries = 927315 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.74 avg-zval = 34.57 usrkeys = 927315 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.74 avg-zval = 34.57 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 927315 bytes = 3013792 } seq expand size = 6491205 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0321 GB dict = 1.08 MB all = 0.0379 GB } UnZip/Zip{ index = 10.5140 value = 3.3769 dict = 1.00 all = 3.5393 } Zip/UnZip{ index = 0.0951 value = 0.2961 dict = 1.00 all = 0.2825 } ---------------------------- total value len = 0.344318 GB avg = 0.124 KB (by entry num) total key len = 0.077780 GB avg = 0.028 KB total ukey len = 0.055557 GB avg = 0.020 KB total ukey num = 0.002777866 Billion total entry num = 0.002777866 Billion write speed all = 0.012948943 MB/sec (with seq num) write speed all = 0.012267198 MB/sec (without seq num) 2024/11/22-17:55:40.275377 140024919680576 [compaction_job.cc:1948] [default] [JOB 6717] Generated table #218921: 927315 keys, 37921626 bytes, temperature: kWarm 2024/11/22-17:55:40.275438 140024919680576 EVENT_LOG_v1 {"time_micros": 1732269340275407, "cf_name": "default", "job": 6717, "event": "table_file_creation", "file_number": 218921, "file_size": 37921626, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3376774766, "largest_seqno": 3441621959, "table_properties": {"data_size": 32057184, "index_size": 1763968, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25964820, "raw_average_key_size": 28, "raw_value_size": 108253026, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927315, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732269337, "oldest_key_time": 0, "file_creation_time": 1732269337, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 218921, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-17:55:40.310253 140024919680576 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06717/att-00/218922.sst) /dev/shm/ToplingTemp/Topling-229175-pHDTMi 2024/11/22-17:55:41.279585 140024919680576 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06717/att-00/218922.sst): first pass time = 0.97's, 138.470'MB/sec 2024/11/22-17:55:42.708561 140024919680576 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06717/att-00/218922.sst): old prealloc_size = 147639500, real_size = 35503536 2024/11/22-17:55:42.709144 140024919680576 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06717/att-00/218922.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 926892 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.93 raw-val = 0.1083 GB zip-val = 0.0335 GB avg-val = 116.80 avg-zval = 36.13 2024/11/22-17:55:42.709588 140024919680576 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06717/att-00/218922.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-17:55:43.505863 140024919680576 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06717/att-00/218922.sst): second pass time = 1.43's, 75.799'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.80's, 47.631'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3180.543'MB/sec (index lex order gen) rebuild zvType time = 0.67's, 0.348'MB/sec write SST data time = 0.13's, 288.408'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 34851.595'MB/sec zip my value time = 1.43's, unzip length = 0.108'GB zip my value throughput = 75.799'MB/sec zip pipeline throughput = 75.799'MB/sec entries = 926892 avg-key = 28.00 avg-zkey = 1.93 avg-val = 116.80 avg-zval = 36.13 usrkeys = 926892 avg-key = 20.00 avg-zkey = 1.93 avg-val = 120.22 avg-zval = 36.13 TagRS{ kinds = RS_Key0_TagN bytes = 144920 } TagArray{ size = 451972 bytes = 1468928 } seq expand size = 3163804 multi value expand size = 0 cnt WriteAppend = 18 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0335 GB dict = 1.08 MB all = 0.0380 GB } UnZip/Zip{ index = 10.3778 value = 3.2332 dict = 1.00 all = 3.5343 } Zip/UnZip{ index = 0.0964 value = 0.3093 dict = 1.00 all = 0.2829 } ---------------------------- total value len = 0.455747 GB avg = 0.123 KB (by entry num) total key len = 0.103733 GB avg = 0.028 KB total ukey len = 0.074095 GB avg = 0.020 KB total ukey num = 0.003704758 Billion total entry num = 0.003704758 Billion write speed all = 0.017161753 MB/sec (with seq num) write speed all = 0.016252621 MB/sec (without seq num) 2024/11/22-17:55:43.540915 140024919680576 [compaction_job.cc:1948] [default] [JOB 6717] Generated table #218922: 926892 keys, 37975623 bytes, temperature: kWarm 2024/11/22-17:55:43.540975 140024919680576 EVENT_LOG_v1 {"time_micros": 1732269343540945, "cf_name": "default", "job": 6717, "event": "table_file_creation", "file_number": 218922, "file_size": 37975623, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3441621973, "table_properties": {"data_size": 33485344, "index_size": 1786304, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25952976, "raw_average_key_size": 28, "raw_value_size": 108264816, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 926892, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732269340, "oldest_key_time": 0, "file_creation_time": 1732269340, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 218922, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-17:55:43.577932 140024919680576 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06717/att-00/218923.sst) /dev/shm/ToplingTemp/Topling-229175-sYEEUi 2024/11/22-17:55:44.418960 140024919680576 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06717/att-00/218923.sst): first pass time = 0.84's, 159.596'MB/sec 2024/11/22-17:55:45.776074 140024919680576 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06717/att-00/218923.sst): old prealloc_size = 147639500, real_size = 35450320 2024/11/22-17:55:45.776710 140024919680576 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06717/att-00/218923.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 1080192 prefix = 4 raw-key = 0.0173 GB zip-key = 0.0021 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1040 GB zip-val = 0.0331 GB avg-val = 96.25 avg-zval = 30.67 2024/11/22-17:55:45.776993 140024919680576 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06717/att-00/218923.sst: sumWaitingMem = 0.003 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0028 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-17:55:46.439228 140024919680576 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06717/att-00/218923.sst): second pass time = 1.36's, 76.670'MB/sec, value only(77.5% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.66's, 55.749'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3346.048'MB/sec (index lex order gen) rebuild zvType time = 0.52's, 0.520'MB/sec write SST data time = 0.14's, 258.515'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.026'MB, throughput = 33829.563'MB/sec zip my value time = 1.36's, unzip length = 0.104'GB zip my value throughput = 76.670'MB/sec zip pipeline throughput = 76.670'MB/sec entries = 1080192 avg-key = 28.00 avg-zkey = 1.90 avg-val = 96.25 avg-zval = 30.67 usrkeys = 1080192 avg-key = 20.00 avg-zkey = 1.90 avg-val = 97.33 avg-zval = 30.67 TagRS{ kinds = RS_Key0_TagN bytes = 168880 } TagArray{ size = 166709 bytes = 583504 } seq expand size = 1166963 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0216 GB value = 0.1040 GB dict = 1.03 MB all = 0.1342 GB } __ZipSize{ index = 0.0021 GB value = 0.0331 GB dict = 1.03 MB all = 0.0370 GB } UnZip/Zip{ index = 10.5162 value = 3.1387 dict = 1.00 all = 3.6305 } Zip/UnZip{ index = 0.0951 value = 0.3186 dict = 1.00 all = 0.2754 } ---------------------------- total value len = 0.560886 GB avg = 0.117 KB (by entry num) total key len = 0.133979 GB avg = 0.028 KB total ukey len = 0.095699 GB avg = 0.020 KB total ukey num = 0.004784950 Billion total entry num = 0.004784950 Billion write speed all = 0.021312689 MB/sec (with seq num) write speed all = 0.020138589 MB/sec (without seq num) 2024/11/22-17:55:46.477437 140024919680576 [compaction_job.cc:1948] [default] [JOB 6717] Generated table #218923: 1080192 keys, 36969614 bytes, temperature: kWarm 2024/11/22-17:55:46.477497 140024919680576 EVENT_LOG_v1 {"time_micros": 1732269346477466, "cf_name": "default", "job": 6717, "event": "table_file_creation", "file_number": 218923, "file_size": 36969614, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3413508112, "table_properties": {"data_size": 33125760, "index_size": 2054336, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 30245376, "raw_average_key_size": 28, "raw_value_size": 103972401, "raw_average_value_size": 96, "num_data_blocks": 1, "num_entries": 1080192, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732269343, "oldest_key_time": 0, "file_creation_time": 1732269343, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 218923, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-17:55:46.512758 140024919680576 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06717/att-00/218924.sst) /dev/shm/ToplingTemp/Topling-229175-lSyLbl 2024/11/22-17:55:47.335225 140024919680576 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06717/att-00/218924.sst): first pass time = 0.82's, 163.199'MB/sec 2024/11/22-17:55:48.684395 140024919680576 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06717/att-00/218924.sst): old prealloc_size = 147639500, real_size = 34890240 2024/11/22-17:55:48.684966 140024919680576 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06717/att-00/218924.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 925255 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0329 GB avg-val = 117.06 avg-zval = 35.56 2024/11/22-17:55:48.685714 140024919680576 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06717/att-00/218924.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-17:55:49.586099 140024919680576 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06717/att-00/218924.sst): second pass time = 1.35's, 80.318'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.90's, 43.106'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3204.829'MB/sec (index lex order gen) rebuild zvType time = 0.77's, 0.300'MB/sec write SST data time = 0.13's, 297.362'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 34796.870'MB/sec zip my value time = 1.35's, unzip length = 0.108'GB zip my value throughput = 80.318'MB/sec zip pipeline throughput = 80.318'MB/sec entries = 925255 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.06 avg-zval = 35.56 usrkeys = 925255 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.06 avg-zval = 35.56 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 925255 bytes = 3122752 } seq expand size = 6476785 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0329 GB dict = 1.08 MB all = 0.0389 GB } UnZip/Zip{ index = 10.5116 value = 3.2923 dict = 1.00 all = 3.4531 } Zip/UnZip{ index = 0.0951 value = 0.3037 dict = 1.00 all = 0.2896 } ---------------------------- total value len = 0.675674 GB avg = 0.118 KB (by entry num) total key len = 0.159886 GB avg = 0.028 KB total ukey len = 0.114204 GB avg = 0.020 KB total ukey num = 0.005710205 Billion total entry num = 0.005710205 Billion write speed all = 0.025625560 MB/sec (with seq num) write speed all = 0.024224561 MB/sec (without seq num) 2024/11/22-17:55:49.620365 140024919680576 [compaction_job.cc:1948] [default] [JOB 6717] Generated table #218924: 925255 keys, 38868292 bytes, temperature: kWarm 2024/11/22-17:55:49.620432 140024919680576 EVENT_LOG_v1 {"time_micros": 1732269349620397, "cf_name": "default", "job": 6717, "event": "table_file_creation", "file_number": 218924, "file_size": 38868292, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3365258144, "largest_seqno": 3441621697, "table_properties": {"data_size": 32898288, "index_size": 1760448, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25907140, "raw_average_key_size": 28, "raw_value_size": 108310718, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 925255, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732269346, "oldest_key_time": 0, "file_creation_time": 1732269346, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 218924, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-17:55:49.657863 140024919680576 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06717/att-00/218925.sst) /dev/shm/ToplingTemp/Topling-229175-3sZPvj 2024/11/22-17:55:50.602944 140024919680576 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06717/att-00/218925.sst): first pass time = 0.95's, 142.023'MB/sec 2024/11/22-17:55:51.937618 140024919680576 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06717/att-00/218925.sst): old prealloc_size = 147639500, real_size = 33143216 2024/11/22-17:55:51.938142 140024919680576 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06717/att-00/218925.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 922190 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1084 GB zip-val = 0.0312 GB avg-val = 117.54 avg-zval = 33.79 2024/11/22-17:55:51.938924 140024919680576 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06717/att-00/218925.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-17:55:52.850598 140024919680576 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06717/att-00/218925.sst): second pass time = 1.33's, 81.290'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.91's, 40.779'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3485.590'MB/sec (index lex order gen) rebuild zvType time = 0.78's, 0.294'MB/sec write SST data time = 0.13's, 287.630'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.083'MB, throughput = 27514.262'MB/sec zip my value time = 1.33's, unzip length = 0.108'GB zip my value throughput = 81.290'MB/sec zip pipeline throughput = 81.290'MB/sec entries = 922190 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.54 avg-zval = 33.79 usrkeys = 922190 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.54 avg-zval = 33.79 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 922190 bytes = 3227680 } seq expand size = 6455330 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0184 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0312 GB dict = 1.08 MB all = 0.0372 GB } UnZip/Zip{ index = 10.5112 value = 3.4790 dict = 1.00 all = 3.6052 } Zip/UnZip{ index = 0.0951 value = 0.2874 dict = 1.00 all = 0.2774 } ---------------------------- total value len = 0.790526 GB avg = 0.119 KB (by entry num) total key len = 0.185707 GB avg = 0.028 KB total ukey len = 0.132648 GB avg = 0.020 KB total ukey num = 0.006632395 Billion total entry num = 0.006632395 Billion write speed all = 0.029936832 MB/sec (with seq num) write speed all = 0.028309737 MB/sec (without seq num) 2024/11/22-17:55:52.885916 140024919680576 [compaction_job.cc:1948] [default] [JOB 6717] Generated table #218925: 922190 keys, 37229456 bytes, temperature: kWarm 2024/11/22-17:55:52.885975 140024919680576 EVENT_LOG_v1 {"time_micros": 1732269352885944, "cf_name": "default", "job": 6717, "event": "table_file_creation", "file_number": 218925, "file_size": 37229456, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3273701103, "largest_seqno": 3441621716, "table_properties": {"data_size": 31157792, "index_size": 1754688, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25821320, "raw_average_key_size": 28, "raw_value_size": 108396540, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 922190, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732269349, "oldest_key_time": 0, "file_creation_time": 1732269349, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 218925, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-17:55:52.921123 140024919680576 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06717/att-00/218926.sst) /dev/shm/ToplingTemp/Topling-229175-sV5I6i 2024/11/22-17:55:53.771690 140024919680576 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06717/att-00/218926.sst): first pass time = 0.85's, 157.805'MB/sec 2024/11/22-17:55:55.131447 140024919680576 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06717/att-00/218926.sst): old prealloc_size = 147639500, real_size = 34375824 2024/11/22-17:55:55.132017 140024919680576 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06717/att-00/218926.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 925379 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1083 GB zip-val = 0.0324 GB avg-val = 117.04 avg-zval = 34.98 2024/11/22-17:55:55.132801 140024919680576 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06717/att-00/218926.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-17:55:56.046243 140024919680576 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06717/att-00/218926.sst): second pass time = 1.36's, 79.690'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.91's, 42.054'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3216.719'MB/sec (index lex order gen) rebuild zvType time = 0.78's, 0.295'MB/sec write SST data time = 0.13's, 297.271'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 33089.824'MB/sec zip my value time = 1.36's, unzip length = 0.108'GB zip my value throughput = 79.690'MB/sec zip pipeline throughput = 79.690'MB/sec entries = 925379 avg-key = 28.00 avg-zkey = 1.92 avg-val = 117.04 avg-zval = 34.98 usrkeys = 925379 avg-key = 20.00 avg-zkey = 1.92 avg-val = 124.04 avg-zval = 34.98 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 925379 bytes = 3238848 } seq expand size = 6477653 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0324 GB dict = 1.08 MB all = 0.0385 GB } UnZip/Zip{ index = 10.4413 value = 3.3457 dict = 1.00 all = 3.4889 } Zip/UnZip{ index = 0.0958 value = 0.2989 dict = 1.00 all = 0.2866 } ---------------------------- total value len = 0.905310 GB avg = 0.120 KB (by entry num) total key len = 0.211618 GB avg = 0.028 KB total ukey len = 0.151155 GB avg = 0.020 KB total ukey num = 0.007557774 Billion total entry num = 0.007557774 Billion write speed all = 0.034247995 MB/sec (with seq num) write speed all = 0.032394063 MB/sec (without seq num) 2024/11/22-17:55:56.083722 140024919680576 [compaction_job.cc:1948] [default] [JOB 6717] Generated table #218926: 925379 keys, 38470046 bytes, temperature: kWarm 2024/11/22-17:55:56.083791 140024919680576 EVENT_LOG_v1 {"time_micros": 1732269356083752, "cf_name": "default", "job": 6717, "event": "table_file_creation", "file_number": 218926, "file_size": 38470046, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3273701122, "largest_seqno": 3441621748, "table_properties": {"data_size": 32371776, "index_size": 1772544, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25910612, "raw_average_key_size": 28, "raw_value_size": 108307154, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 925379, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732269352, "oldest_key_time": 0, "file_creation_time": 1732269352, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 218926, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-17:55:56.118498 140024919680576 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06717/att-00/218927.sst) /dev/shm/ToplingTemp/Topling-229175-309sul 2024/11/22-17:55:56.951060 140024919680576 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06717/att-00/218927.sst): first pass time = 0.83's, 161.221'MB/sec 2024/11/22-17:55:58.288646 140024919680576 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06717/att-00/218927.sst): old prealloc_size = 147639500, real_size = 33659408 2024/11/22-17:55:58.289229 140024919680576 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06717/att-00/218927.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 922216 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1084 GB zip-val = 0.0317 GB avg-val = 117.54 avg-zval = 34.35 2024/11/22-17:55:58.289996 140024919680576 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06717/att-00/218927.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-17:55:59.219399 140024919680576 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06717/att-00/218927.sst): second pass time = 1.34's, 81.076'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.93's, 40.431'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3130.723'MB/sec (index lex order gen) rebuild zvType time = 0.80's, 0.288'MB/sec write SST data time = 0.13's, 291.813'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.084'MB, throughput = 33085.435'MB/sec zip my value time = 1.34's, unzip length = 0.108'GB zip my value throughput = 81.076'MB/sec zip pipeline throughput = 81.076'MB/sec entries = 922216 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.54 avg-zval = 34.35 usrkeys = 922216 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.54 avg-zval = 34.35 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 922216 bytes = 3112496 } seq expand size = 6455512 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0184 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0317 GB dict = 1.08 MB all = 0.0376 GB } UnZip/Zip{ index = 10.5130 value = 3.4222 dict = 1.00 all = 3.5667 } Zip/UnZip{ index = 0.0951 value = 0.2922 dict = 1.00 all = 0.2804 } ---------------------------- total value len = 1.020162 GB avg = 0.120 KB (by entry num) total key len = 0.237440 GB avg = 0.028 KB total ukey len = 0.169600 GB avg = 0.020 KB total ukey num = 0.008479990 Billion total entry num = 0.008479990 Billion write speed all = 0.038557660 MB/sec (with seq num) write speed all = 0.036477710 MB/sec (without seq num) 2024/11/22-17:55:59.255771 140024919680576 [compaction_job.cc:1948] [default] [JOB 6717] Generated table #218927: 922216 keys, 37630700 bytes, temperature: kWarm 2024/11/22-17:55:59.255841 140024919680576 EVENT_LOG_v1 {"time_micros": 1732269359255808, "cf_name": "default", "job": 6717, "event": "table_file_creation", "file_number": 218927, "file_size": 37630700, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3326330223, "largest_seqno": 3441621765, "table_properties": {"data_size": 31674240, "index_size": 1754432, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25822048, "raw_average_key_size": 28, "raw_value_size": 108395684, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 922216, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732269356, "oldest_key_time": 0, "file_creation_time": 1732269356, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 218927, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-17:55:59.293249 140024919680576 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06717/att-00/218928.sst) /dev/shm/ToplingTemp/Topling-229175-JCS5Qk 2024/11/22-17:55:59.612204 140024919680576 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06717/att-00/218928.sst): first pass time = 0.32's, 236.818'MB/sec 2024/11/22-17:56:00.360017 140024919680576 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06717/att-00/218928.sst): old prealloc_size = 147639500, real_size = 20049696 2024/11/22-17:56:00.360365 140024919680576 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06717/att-00/218928.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 522529 prefix = 4 raw-key = 0.0084 GB zip-key = 0.0010 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.0609 GB zip-val = 0.0189 GB avg-val = 116.54 avg-zval = 36.22 2024/11/22-17:56:00.360863 140024919680576 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06717/att-00/218928.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0012 GB, waited 0.000 sec, Key+Value = 0.076 GB 2024/11/22-17:56:00.882069 140024919680576 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06717/att-00/218928.sst): second pass time = 0.75's, 81.499'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.52's, 42.835'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3058.769'MB/sec (index lex order gen) rebuild zvType time = 0.45's, 0.291'MB/sec write SST data time = 0.07's, 304.356'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.610'MB, throughput = 20667.299'MB/sec zip my value time = 0.75's, unzip length = 0.061'GB zip my value throughput = 81.499'MB/sec zip pipeline throughput = 81.499'MB/sec entries = 522529 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.54 avg-zval = 36.22 usrkeys = 522529 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.54 avg-zval = 36.22 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 522529 bytes = 1828864 } seq expand size = 3657703 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0105 GB value = 0.0609 GB dict = 0.61 MB all = 0.0755 GB } __ZipSize{ index = 0.0010 GB value = 0.0189 GB dict = 0.61 MB all = 0.0224 GB } UnZip/Zip{ index = 10.5044 value = 3.2178 dict = 1.00 all = 3.3775 } Zip/UnZip{ index = 0.0952 value = 0.3108 dict = 1.00 all = 0.2961 } ---------------------------- total value len = 1.084713 GB avg = 0.120 KB (by entry num) total key len = 0.252071 GB avg = 0.028 KB total ukey len = 0.180050 GB avg = 0.020 KB total ukey num = 0.009002519 Billion total entry num = 0.009002519 Billion write speed all = 0.040983284 MB/sec (with seq num) write speed all = 0.038775282 MB/sec (without seq num) 2024/11/22-17:56:00.903882 140024919680576 [compaction_job.cc:1948] [default] [JOB 6717] Generated table #218928: 522529 keys, 22361401 bytes, temperature: kWarm 2024/11/22-17:56:00.903945 140024919680576 EVENT_LOG_v1 {"time_micros": 1732269360903913, "cf_name": "default", "job": 6717, "event": "table_file_creation", "file_number": 218928, "file_size": 22361401, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3273701165, "largest_seqno": 3441621796, "table_properties": {"data_size": 18923984, "index_size": 994880, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 14630812, "raw_average_key_size": 28, "raw_value_size": 60894074, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 522529, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732269359, "oldest_key_time": 0, "file_creation_time": 1732269359, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 218928, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-17:56:00.923163 140024919680576 [compaction_job.cc:703] job-06717: subcompact[0], size: 0.364304 G, files: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06717/att-00 [218919,218920,218921,218922,218923,218924,218925,218926,218927,218928] 2024/11/22-17:56:00.990536 140024919680576 (Original Log Time 2024/11/22-17:55:30.166874) EVENT_LOG_v1 {"time_micros": 1732269330166826, "job": 6717, "event": "compaction_started", "compaction_reason": "FilesMarkedForCompaction", "files_L2": [218857], "files_L3": [218907, 218829, 218830, 218831, 218832, 218813, 218814, 218815, 218816, 218817, 218908], "score": 0.946653, "input_data_size": 387594984, "oldest_snapshot_seqno": 3442097365} 2024/11/22-17:56:00.990540 140024919680576 (Original Log Time 2024/11/22-17:56:00.989936) [compaction_job.cc:2022] [default] [JOB 6717] Compacted 1@2 + 11@3 files to L3 => 364303762 bytes 2024/11/22-17:56:00.990542 140024919680576 (Original Log Time 2024/11/22-17:56:00.990472) [compaction_job.cc:1224] [default] compacted to: files[0 0 0 10 0 0 0] max score 0.01, MB/sec: 12.6 rd, 11.8 wr, level 3, files in(1, 11) out(10 +0 blob) MB in(27.2, 342.5 +0.0 blob) out(347.4 +0.0 blob), read-write-amplify(26.4) write-amplify(12.8) OK, records in: 9108482, records dropped: 105963 output_compression: Snappy 2024/11/22-17:56:00.990549 140024919680576 (Original Log Time 2024/11/22-17:56:00.990516) EVENT_LOG_v1 {"time_micros": 1732269360990496, "cf": "default", "job": 6717, "event": "compaction_finished", "compaction_time_micros": 30756300, "compaction_time_cpu_micros": 13800190, "output_level": 3, "num_output_files": 10, "total_output_size": 364303762, "num_input_records": 9108482, "num_output_records": 9002519, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "file_write_nanos": 229800470, "file_range_sync_nanos": 0, "file_fsync_nanos": 9320, "file_prepare_write_nanos": 22300, "lsm_state": [0, 0, 0, 10, 0, 0, 0]} 2024/11/22-17:56:01.123864 140024919680576 DEBG dcompact_worker.cpp:240: HttpPost: 200 OK: url = http://nlb-7zny4kaa1poal01o64.cn-shenzhen.nlb.aliyuncs.com:8443, body = {"instanceId":"nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137","labourId":"","dbId":"d89b4006-2803-486e-b7a2-759bcf348921","dbStarts":1732256054,"starts":1732269329,"executesMs":30976,"compactionJobId":6717,"attempt":0,"compactionInputRawBytes":1298531933,"compactionInputZipBytes":387594984,"compactionOutputRawBytes":0,"compactionOutputZipBytes":364303762,"headers":{"Accept":"*/*","Connection":"close","Host":"aliyun-topling-saas.topling.cn:18443","RemoteIp":"120.24.192.169","X-Forwarded-For":"120.24.192.169","region":"cn-shenzhen","token":"e6474c481bd4415abc537135cc03626b","instance-token":"e6474c481bd4415abc537135cc03626b","provider":"aliyun","CloudMarketInstanceId":"si-59c0ae5c955845588903","MeteringAssit":"","Transfer-Encoding":"chunked","traceparent":"00-20bf6369ffeb8a8dd2ae0a118612c97c-fa2dbe0ae14d6846-00"}}, response = 2024/11/22-17:56:01.123937 140024919680576 INFO dcompact_worker.cpp:1459: finish /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-06717/att-00: olev 3, work 30.977 s, result 6.286 ms, install 0.633 ms, input{raw 1.209 GiB zip 369.639 MiB}