2024/11/22-19:19:20.162724 140025062356544 DEBG dcompact_worker.cpp:2214: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08647/att-00: fork to child time = 0.009951 sec 2024/11/22-19:19:20.163560 140025062356544 DEBG dcompact_worker.cpp:1013: Beg SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08647/att-00 2024/11/22-19:19:20.170412 140025062356544 DEBG dcompact_worker.cpp:1033: End SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08647/att-00 2024/11/22-19:19:20.171545 140025062356544 TRAC dcompact_worker.cpp:1083: INFO_LOG_LEVEL: rpc = INFO_LEVEL, env_var = undefined 2024/11/22-19:19:20.171801 140025062356544 [WARN] [column_family.cc:386] multiple cf_paths/db_paths and level_compaction_dynamic_level_bytes can't be used together 2024/11/22-19:19:20.221440 140025062356544 [version_set.cc:6208] Recovering from manifest file: /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-08647/att-00/MANIFEST-206347 2024/11/22-19:19:20.251646 140025062356544 [version_set.cc:6251] Recovered from manifest file:/worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-08647/att-00/MANIFEST-206347 succeeded,manifest_file_number is 206347, next_file_number is 222852, last_sequence is 3497615763, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 222714 2024/11/22-19:19:20.251654 140025062356544 [version_set.cc:6266] Column family [default] (ID 0), log number is 0 2024/11/22-19:19:20.251790 140025062356544 [version_set.cc:5721] Creating manifest 222852 2024/11/22-19:19:20.289265 140025062356544 DEBG dcompact_worker.cpp:1218: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08647/att-00: bottommost_level: fake = 1, rpc = 0 2024/11/22-19:19:20.309835 140025062356544 [compaction_job.cc:2437] [default] [JOB 8647] Compacting 1@2 + 11@3 files to L3, score 0.97, subcompactions 1 : 1 2024/11/22-19:19:20.309859 140025062356544 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 6555 Base level 2, inputs: [222848(26MB)], [222823(36MB) 222824(11MB) 222798(35MB) 222799(35MB) 222800(36MB) 222801(36MB) 222802(34MB) 222803(35MB) 222804(35MB) 222805(35MB) 222806(10MB)] 2024/11/22-19:19:20.317693 140025062356544 [top_zip_table.cc:59] core git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/22-19:19:20.317732 140025062356544 [top_zip_table.cc:60] fsa git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/22-19:19:20.317752 140025062356544 [top_zip_table.cc:61] zbs git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/22-19:19:20.317757 140025062356544 [top_zip_table.cc:62] topling-zip_table_reader: git_version_hash_info_is: commit a4a382006cb82713acf5b3425835f22711877681 Author: leipeng Date: 2024-04-11 19:44:14 +0800 fixed_len_hole_index.cc: Add env bool FixedLenHoleIndexUseAVX512 for ut & debug 1. FixedLenHoleIndexUseAVX512 is only in unit tests or debug 2. In release mode, use avx512 by compile options(-march=) g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/22-19:19:20.317768 140025062356544 [top_zip_table.cc:64] topling-rocks git_version_hash_info_is: commit feab587e468621ba0204d47b4ffacc52e7c4290d Author: leipeng Date: 2024-03-22 13:35:06 +0800 ToplingZipTableBuilder::Add: immediately return after error This function returns void, and caller does not check builder->status() after calling this function and graceful abandon. So immediately return after error, and return error status in Finish(). g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/22-19:19:20.800274 140025062356544 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08647/att-00/222853.sst) /dev/shm/ToplingTemp/Topling-256312-dsIBBh 2024/11/22-19:19:21.546332 140025062356544 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08647/att-00/222853.sst): first pass time = 0.75's, 179.911'MB/sec 2024/11/22-19:19:24.357660 140025062356544 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08647/att-00/222853.sst): old prealloc_size = 147639500, real_size = 34286800 2024/11/22-19:19:24.358392 140025062356544 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08647/att-00/222853.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 924434 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1083 GB zip-val = 0.0323 GB avg-val = 117.19 avg-zval = 34.92 2024/11/22-19:19:24.359319 140025062356544 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08647/att-00/222853.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-19:19:25.703065 140025062356544 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08647/att-00/222853.sst): second pass time = 2.81's, 38.554'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.35's, 28.525'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2457.441'MB/sec (index lex order gen) rebuild zvType time = 1.21's, 0.191'MB/sec write SST data time = 0.13's, 286.637'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 31088.760'MB/sec zip my value time = 2.81's, unzip length = 0.108'GB zip my value throughput = 38.554'MB/sec zip pipeline throughput = 113.331'MB/sec entries = 924434 avg-key = 28.00 avg-zkey = 1.91 avg-val = 117.19 avg-zval = 34.92 usrkeys = 924434 avg-key = 20.00 avg-zkey = 1.91 avg-val = 124.19 avg-zval = 34.92 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 924434 bytes = 3235536 } seq expand size = 6471038 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0323 GB dict = 1.08 MB all = 0.0384 GB } UnZip/Zip{ index = 10.4457 value = 3.3555 dict = 1.00 all = 3.4972 } Zip/UnZip{ index = 0.0957 value = 0.2980 dict = 1.00 all = 0.2859 } ---------------------------- total value len = 0.114805 GB avg = 0.124 KB (by entry num) total key len = 0.025884 GB avg = 0.028 KB total ukey len = 0.018489 GB avg = 0.020 KB total ukey num = 0.000924434 Billion total entry num = 0.000924434 Billion write speed all = 0.003739475 MB/sec (with seq num) write speed all = 0.003542905 MB/sec (without seq num) 2024/11/22-19:19:25.737040 140025062356544 [compaction_job.cc:1948] [default] [JOB 8647] Generated table #222853: 924434 keys, 38378276 bytes, temperature: kWarm 2024/11/22-19:19:25.737150 140025062356544 EVENT_LOG_v1 {"time_micros": 1732274365737081, "cf_name": "default", "job": 8647, "event": "table_file_creation", "file_number": 222853, "file_size": 38378276, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3273701165, "largest_seqno": 3497594020, "table_properties": {"data_size": 32285504, "index_size": 1769984, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25884152, "raw_average_key_size": 28, "raw_value_size": 108333600, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 924434, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732274360, "oldest_key_time": 0, "file_creation_time": 1732274360, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 222853, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-19:19:25.791712 140025062356544 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08647/att-00/222854.sst) /dev/shm/ToplingTemp/Topling-256312-XmE4Hl 2024/11/22-19:19:27.241590 140025062356544 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08647/att-00/222854.sst): first pass time = 1.45's, 92.575'MB/sec 2024/11/22-19:19:28.793171 140025062356544 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08647/att-00/222854.sst): old prealloc_size = 147639500, real_size = 33226128 2024/11/22-19:19:28.793867 140025062356544 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08647/att-00/222854.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 926697 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1083 GB zip-val = 0.0312 GB avg-val = 116.83 avg-zval = 33.69 2024/11/22-19:19:28.794730 140025062356544 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08647/att-00/222854.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-19:19:30.026672 140025062356544 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08647/att-00/222854.sst): second pass time = 1.55's, 69.817'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.23's, 30.165'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2583.515'MB/sec (index lex order gen) rebuild zvType time = 1.01's, 0.229'MB/sec write SST data time = 0.22's, 167.064'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 36756.593'MB/sec zip my value time = 1.55's, unzip length = 0.108'GB zip my value throughput = 69.817'MB/sec zip pipeline throughput = 69.817'MB/sec entries = 926697 avg-key = 28.00 avg-zkey = 1.92 avg-val = 116.83 avg-zval = 33.69 usrkeys = 926697 avg-key = 20.00 avg-zkey = 1.92 avg-val = 123.83 avg-zval = 33.69 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 926697 bytes = 3127616 } seq expand size = 6486879 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0312 GB dict = 1.08 MB all = 0.0372 GB } UnZip/Zip{ index = 10.4433 value = 3.4680 dict = 1.00 all = 3.6072 } Zip/UnZip{ index = 0.0958 value = 0.2883 dict = 1.00 all = 0.2772 } ---------------------------- total value len = 0.229562 GB avg = 0.124 KB (by entry num) total key len = 0.051832 GB avg = 0.028 KB total ukey len = 0.037023 GB avg = 0.020 KB total ukey num = 0.001851131 Billion total entry num = 0.001851131 Billion write speed all = 0.007478514 MB/sec (with seq num) write speed all = 0.007084938 MB/sec (without seq num) 2024/11/22-19:19:30.059881 140025062356544 [compaction_job.cc:1948] [default] [JOB 8647] Generated table #222854: 926697 keys, 37207990 bytes, temperature: kWarm 2024/11/22-19:19:30.059949 140025062356544 EVENT_LOG_v1 {"time_micros": 1732274370059911, "cf_name": "default", "job": 8647, "event": "table_file_creation", "file_number": 222854, "file_size": 37207990, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3369353416, "largest_seqno": 3497594259, "table_properties": {"data_size": 31219520, "index_size": 1774720, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25947516, "raw_average_key_size": 28, "raw_value_size": 108270342, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 926697, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732274365, "oldest_key_time": 0, "file_creation_time": 1732274365, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 222854, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-19:19:30.098302 140025062356544 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08647/att-00/222855.sst) /dev/shm/ToplingTemp/Topling-256312-Bt33cl 2024/11/22-19:19:31.108697 140025062356544 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08647/att-00/222855.sst): first pass time = 1.01's, 132.842'MB/sec 2024/11/22-19:19:32.454951 140025062356544 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08647/att-00/222855.sst): old prealloc_size = 147639500, real_size = 33095280 2024/11/22-19:19:32.455511 140025062356544 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08647/att-00/222855.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 925145 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0311 GB avg-val = 117.08 avg-zval = 33.62 2024/11/22-19:19:32.456190 140025062356544 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08647/att-00/222855.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-19:19:33.436157 140025062356544 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08647/att-00/222855.sst): second pass time = 1.35's, 80.495'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.98's, 37.250'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3252.672'MB/sec (index lex order gen) rebuild zvType time = 0.85's, 0.273'MB/sec write SST data time = 0.13's, 276.535'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 36155.050'MB/sec zip my value time = 1.35's, unzip length = 0.108'GB zip my value throughput = 80.495'MB/sec zip pipeline throughput = 80.495'MB/sec entries = 925145 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.08 avg-zval = 33.62 usrkeys = 925145 avg-key = 20.00 avg-zkey = 1.90 avg-val = 122.57 avg-zval = 33.62 TagRS{ kinds = RS_Key0_TagN bytes = 144640 } TagArray{ size = 725903 bytes = 2449936 } seq expand size = 5081321 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0311 GB dict = 1.08 MB all = 0.0365 GB } UnZip/Zip{ index = 10.5100 value = 3.4824 dict = 1.00 all = 3.6722 } Zip/UnZip{ index = 0.0951 value = 0.2872 dict = 1.00 all = 0.2723 } ---------------------------- total value len = 0.342957 GB avg = 0.124 KB (by entry num) total key len = 0.077736 GB avg = 0.028 KB total ukey len = 0.055526 GB avg = 0.020 KB total ukey num = 0.002776276 Billion total entry num = 0.002776276 Billion write speed all = 0.011179614 MB/sec (with seq num) write speed all = 0.010589393 MB/sec (without seq num) 2024/11/22-19:19:33.469805 140025062356544 [compaction_job.cc:1948] [default] [JOB 8647] Generated table #222855: 925145 keys, 36549212 bytes, temperature: kWarm 2024/11/22-19:19:33.469880 140025062356544 EVENT_LOG_v1 {"time_micros": 1732274373469846, "cf_name": "default", "job": 8647, "event": "table_file_creation", "file_number": 222855, "file_size": 36549212, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3497594045, "table_properties": {"data_size": 31103328, "index_size": 1760512, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25904060, "raw_average_key_size": 28, "raw_value_size": 108313758, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 925145, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732274370, "oldest_key_time": 0, "file_creation_time": 1732274370, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 222855, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-19:19:33.506745 140025062356544 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08647/att-00/222856.sst) /dev/shm/ToplingTemp/Topling-256312-PJZuTi 2024/11/22-19:19:34.410115 140025062356544 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08647/att-00/222856.sst): first pass time = 0.90's, 148.583'MB/sec 2024/11/22-19:19:35.858639 140025062356544 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08647/att-00/222856.sst): old prealloc_size = 147639500, real_size = 35831664 2024/11/22-19:19:35.859230 140025062356544 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08647/att-00/222856.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 923388 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1084 GB zip-val = 0.0338 GB avg-val = 117.35 avg-zval = 36.65 2024/11/22-19:19:35.859656 140025062356544 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08647/att-00/222856.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-19:19:36.746216 140025062356544 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08647/att-00/222856.sst): second pass time = 1.45's, 74.890'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.89's, 43.133'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3100.530'MB/sec (index lex order gen) rebuild zvType time = 0.76's, 0.304'MB/sec write SST data time = 0.13's, 298.564'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.083'MB, throughput = 34948.133'MB/sec zip my value time = 1.45's, unzip length = 0.108'GB zip my value throughput = 74.890'MB/sec zip pipeline throughput = 74.890'MB/sec entries = 923388 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.35 avg-zval = 36.65 usrkeys = 923388 avg-key = 20.00 avg-zkey = 1.90 avg-val = 120.60 avg-zval = 36.65 TagRS{ kinds = RS_Key0_TagN bytes = 144360 } TagArray{ size = 428331 bytes = 1445632 } seq expand size = 2998317 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0185 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0338 GB dict = 1.08 MB all = 0.0383 GB } UnZip/Zip{ index = 10.5145 value = 3.2018 dict = 1.00 all = 3.5059 } Zip/UnZip{ index = 0.0951 value = 0.3123 dict = 1.00 all = 0.2852 } ---------------------------- total value len = 0.454318 GB avg = 0.123 KB (by entry num) total key len = 0.103591 GB avg = 0.028 KB total ukey len = 0.073993 GB avg = 0.020 KB total ukey num = 0.003699664 Billion total entry num = 0.003699664 Billion write speed all = 0.014824734 MB/sec (with seq num) write speed all = 0.014038275 MB/sec (without seq num) 2024/11/22-19:19:36.781726 140025062356544 [compaction_job.cc:1948] [default] [JOB 8647] Generated table #222856: 923388 keys, 38283069 bytes, temperature: kWarm 2024/11/22-19:19:36.781820 140025062356544 EVENT_LOG_v1 {"time_micros": 1732274376781757, "cf_name": "default", "job": 8647, "event": "table_file_creation", "file_number": 222856, "file_size": 38283069, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3355237353, "table_properties": {"data_size": 33844192, "index_size": 1756416, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25854864, "raw_average_key_size": 28, "raw_value_size": 108362988, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 923388, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732274373, "oldest_key_time": 0, "file_creation_time": 1732274373, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 222856, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-19:19:36.833085 140025062356544 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08647/att-00/222857.sst) /dev/shm/ToplingTemp/Topling-256312-Kitatl 2024/11/22-19:19:37.701368 140025062356544 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08647/att-00/222857.sst): first pass time = 0.87's, 154.586'MB/sec 2024/11/22-19:19:39.104476 140025062356544 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08647/att-00/222857.sst): old prealloc_size = 147639500, real_size = 34363648 2024/11/22-19:19:39.105049 140025062356544 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08647/att-00/222857.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 926198 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0324 GB avg-val = 116.91 avg-zval = 34.95 2024/11/22-19:19:39.106894 140025062356544 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08647/att-00/222857.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-19:19:40.107938 140025062356544 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08647/att-00/222857.sst): second pass time = 1.40's, 77.215'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.00's, 38.328'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3200.099'MB/sec (index lex order gen) rebuild zvType time = 0.87's, 0.265'MB/sec write SST data time = 0.13's, 297.142'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 31990.819'MB/sec zip my value time = 1.40's, unzip length = 0.108'GB zip my value throughput = 77.215'MB/sec zip pipeline throughput = 77.215'MB/sec entries = 926198 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.91 avg-zval = 34.95 usrkeys = 926198 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.91 avg-zval = 34.95 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 926198 bytes = 3241712 } seq expand size = 6483386 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0324 GB dict = 1.08 MB all = 0.0385 GB } UnZip/Zip{ index = 10.5131 value = 3.3452 dict = 1.00 all = 3.4898 } Zip/UnZip{ index = 0.0951 value = 0.2989 dict = 1.00 all = 0.2865 } ---------------------------- total value len = 0.569086 GB avg = 0.123 KB (by entry num) total key len = 0.129524 GB avg = 0.028 KB total ukey len = 0.092517 GB avg = 0.020 KB total ukey num = 0.004625862 Billion total entry num = 0.004625862 Billion write speed all = 0.018561783 MB/sec (with seq num) write speed all = 0.017578525 MB/sec (without seq num) 2024/11/22-19:19:40.140280 140025062356544 [compaction_job.cc:1948] [default] [JOB 8647] Generated table #222857: 926198 keys, 38459834 bytes, temperature: kWarm 2024/11/22-19:19:40.140347 140025062356544 EVENT_LOG_v1 {"time_micros": 1732274380140315, "cf_name": "default", "job": 8647, "event": "table_file_creation", "file_number": 222857, "file_size": 38459834, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3355237354, "largest_seqno": 3497594238, "table_properties": {"data_size": 32369904, "index_size": 1761984, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25933544, "raw_average_key_size": 28, "raw_value_size": 108284272, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 926198, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732274376, "oldest_key_time": 0, "file_creation_time": 1732274376, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 222857, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-19:19:40.203219 140025062356544 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08647/att-00/222858.sst) /dev/shm/ToplingTemp/Topling-256312-4zJ3Vk 2024/11/22-19:19:41.046270 140025062356544 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08647/att-00/222858.sst): first pass time = 0.84's, 159.213'MB/sec 2024/11/22-19:19:42.400175 140025062356544 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08647/att-00/222858.sst): old prealloc_size = 147639500, real_size = 32381280 2024/11/22-19:19:42.400713 140025062356544 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08647/att-00/222858.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 921658 prefix = 4 raw-key = 0.0147 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1084 GB zip-val = 0.0304 GB avg-val = 117.63 avg-zval = 32.98 2024/11/22-19:19:42.401498 140025062356544 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08647/att-00/222858.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-19:19:43.395502 140025062356544 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08647/att-00/222858.sst): second pass time = 1.35's, 80.109'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.00's, 36.638'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3409.609'MB/sec (index lex order gen) rebuild zvType time = 0.87's, 0.266'MB/sec write SST data time = 0.13's, 281.154'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.084'MB, throughput = 34141.345'MB/sec zip my value time = 1.35's, unzip length = 0.108'GB zip my value throughput = 80.109'MB/sec zip pipeline throughput = 80.109'MB/sec entries = 921658 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.63 avg-zval = 32.98 usrkeys = 921658 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.63 avg-zval = 32.98 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 921658 bytes = 3225824 } seq expand size = 6451606 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0184 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0304 GB dict = 1.08 MB all = 0.0365 GB } UnZip/Zip{ index = 10.5162 value = 3.5664 dict = 1.00 all = 3.6806 } Zip/UnZip{ index = 0.0951 value = 0.2804 dict = 1.00 all = 0.2717 } ---------------------------- total value len = 0.683949 GB avg = 0.123 KB (by entry num) total key len = 0.155331 GB avg = 0.028 KB total ukey len = 0.110950 GB avg = 0.020 KB total ukey num = 0.005547520 Billion total entry num = 0.005547520 Billion write speed all = 0.022297363 MB/sec (with seq num) write speed all = 0.021118303 MB/sec (without seq num) 2024/11/22-19:19:43.427664 140025062356544 [compaction_job.cc:1948] [default] [JOB 8647] Generated table #222858: 921658 keys, 36466058 bytes, temperature: kWarm 2024/11/22-19:19:43.427737 140025062356544 EVENT_LOG_v1 {"time_micros": 1732274383427705, "cf_name": "default", "job": 8647, "event": "table_file_creation", "file_number": 222858, "file_size": 36466058, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3273701550, "largest_seqno": 3497592628, "table_properties": {"data_size": 30397840, "index_size": 1752832, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25806424, "raw_average_key_size": 28, "raw_value_size": 108411360, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 921658, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732274380, "oldest_key_time": 0, "file_creation_time": 1732274380, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 222858, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-19:19:43.465175 140025062356544 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08647/att-00/222859.sst) /dev/shm/ToplingTemp/Topling-256312-RR7vyk 2024/11/22-19:19:44.387678 140025062356544 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08647/att-00/222859.sst): first pass time = 0.92's, 145.500'MB/sec 2024/11/22-19:19:45.779048 140025062356544 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08647/att-00/222859.sst): old prealloc_size = 147639500, real_size = 33260448 2024/11/22-19:19:45.779676 140025062356544 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08647/att-00/222859.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927016 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0313 GB avg-val = 116.78 avg-zval = 33.73 2024/11/22-19:19:45.780465 140025062356544 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08647/att-00/222859.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-19:19:46.857347 140025062356544 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08647/att-00/222859.sst): second pass time = 1.39's, 77.850'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.08's, 34.539'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2914.191'MB/sec (index lex order gen) rebuild zvType time = 0.92's, 0.251'MB/sec write SST data time = 0.15's, 243.379'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 35327.687'MB/sec zip my value time = 1.39's, unzip length = 0.108'GB zip my value throughput = 77.850'MB/sec zip pipeline throughput = 77.850'MB/sec entries = 927016 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.78 avg-zval = 33.73 usrkeys = 927016 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.78 avg-zval = 33.73 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 927016 bytes = 3128688 } seq expand size = 6489112 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0313 GB dict = 1.08 MB all = 0.0372 GB } UnZip/Zip{ index = 10.5117 value = 3.4627 dict = 1.00 all = 3.6038 } Zip/UnZip{ index = 0.0951 value = 0.2888 dict = 1.00 all = 0.2775 } ---------------------------- total value len = 0.798699 GB avg = 0.123 KB (by entry num) total key len = 0.181287 GB avg = 0.028 KB total ukey len = 0.129491 GB avg = 0.020 KB total ukey num = 0.006474536 Billion total entry num = 0.006474536 Billion write speed all = 0.026033168 MB/sec (with seq num) write speed all = 0.024657208 MB/sec (without seq num) 2024/11/22-19:19:46.889145 140025062356544 [compaction_job.cc:1948] [default] [JOB 8647] Generated table #222859: 927016 keys, 37243508 bytes, temperature: kWarm 2024/11/22-19:19:46.889206 140025062356544 EVENT_LOG_v1 {"time_micros": 1732274386889175, "cf_name": "default", "job": 8647, "event": "table_file_creation", "file_number": 222859, "file_size": 37243508, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3405268519, "largest_seqno": 3497593806, "table_properties": {"data_size": 31264720, "index_size": 1763776, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25956448, "raw_average_key_size": 28, "raw_value_size": 108261364, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927016, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732274383, "oldest_key_time": 0, "file_creation_time": 1732274383, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 222859, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-19:19:46.927311 140025062356544 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08647/att-00/222860.sst) /dev/shm/ToplingTemp/Topling-256312-wGdXKj 2024/11/22-19:19:47.816929 140025062356544 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08647/att-00/222860.sst): first pass time = 0.89's, 150.877'MB/sec 2024/11/22-19:19:49.198210 140025062356544 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08647/att-00/222860.sst): old prealloc_size = 147639500, real_size = 33424048 2024/11/22-19:19:49.198756 140025062356544 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08647/att-00/222860.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 923147 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1084 GB zip-val = 0.0314 GB avg-val = 117.39 avg-zval = 34.05 2024/11/22-19:19:49.199510 140025062356544 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08647/att-00/222860.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-19:19:50.233561 140025062356544 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08647/att-00/222860.sst): second pass time = 1.38's, 78.495'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.04's, 36.121'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3353.608'MB/sec (index lex order gen) rebuild zvType time = 0.90's, 0.255'MB/sec write SST data time = 0.13's, 287.946'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.083'MB, throughput = 32471.618'MB/sec zip my value time = 1.38's, unzip length = 0.108'GB zip my value throughput = 78.495'MB/sec zip pipeline throughput = 78.495'MB/sec entries = 923147 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.39 avg-zval = 34.05 usrkeys = 923147 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.39 avg-zval = 34.05 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 923147 bytes = 3115632 } seq expand size = 6462029 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0185 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0314 GB dict = 1.08 MB all = 0.0374 GB } UnZip/Zip{ index = 10.5129 value = 3.4472 dict = 1.00 all = 3.5889 } Zip/UnZip{ index = 0.0951 value = 0.2901 dict = 1.00 all = 0.2786 } ---------------------------- total value len = 0.913531 GB avg = 0.123 KB (by entry num) total key len = 0.207135 GB avg = 0.028 KB total ukey len = 0.147954 GB avg = 0.020 KB total ukey num = 0.007397683 Billion total entry num = 0.007397683 Billion write speed all = 0.029767633 MB/sec (with seq num) write speed all = 0.028195628 MB/sec (without seq num) 2024/11/22-19:19:50.269144 140025062356544 [compaction_job.cc:1948] [default] [JOB 8647] Generated table #222860: 923147 keys, 37397600 bytes, temperature: kWarm 2024/11/22-19:19:50.269208 140025062356544 EVENT_LOG_v1 {"time_micros": 1732274390269177, "cf_name": "default", "job": 8647, "event": "table_file_creation", "file_number": 222860, "file_size": 37397600, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3405268543, "largest_seqno": 3497593646, "table_properties": {"data_size": 31436832, "index_size": 1756224, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25848116, "raw_average_key_size": 28, "raw_value_size": 108369662, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 923147, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732274386, "oldest_key_time": 0, "file_creation_time": 1732274386, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 222860, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-19:19:50.309738 140025062356544 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08647/att-00/222861.sst) /dev/shm/ToplingTemp/Topling-256312-rVql6g 2024/11/22-19:19:51.224009 140025062356544 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08647/att-00/222861.sst): first pass time = 0.91's, 146.809'MB/sec 2024/11/22-19:19:52.606878 140025062356544 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08647/att-00/222861.sst): old prealloc_size = 147639500, real_size = 33082272 2024/11/22-19:19:52.607489 140025062356544 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08647/att-00/222861.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927002 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0311 GB avg-val = 116.79 avg-zval = 33.53 2024/11/22-19:19:52.608308 140025062356544 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08647/att-00/222861.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-19:19:53.617458 140025062356544 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08647/att-00/222861.sst): second pass time = 1.38's, 78.376'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.01's, 36.677'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2995.652'MB/sec (index lex order gen) rebuild zvType time = 0.85's, 0.272'MB/sec write SST data time = 0.16's, 233.072'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 34488.635'MB/sec zip my value time = 1.38's, unzip length = 0.108'GB zip my value throughput = 78.376'MB/sec zip pipeline throughput = 78.376'MB/sec entries = 927002 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.79 avg-zval = 33.53 usrkeys = 927002 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.79 avg-zval = 33.53 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 927002 bytes = 3128640 } seq expand size = 6489014 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0311 GB dict = 1.08 MB all = 0.0371 GB } UnZip/Zip{ index = 10.5123 value = 3.4826 dict = 1.00 all = 3.6211 } Zip/UnZip{ index = 0.0951 value = 0.2871 dict = 1.00 all = 0.2762 } ---------------------------- total value len = 1.028282 GB avg = 0.124 KB (by entry num) total key len = 0.233091 GB avg = 0.028 KB total ukey len = 0.166494 GB avg = 0.020 KB total ukey num = 0.008324685 Billion total entry num = 0.008324685 Billion write speed all = 0.033502137 MB/sec (with seq num) write speed all = 0.031733304 MB/sec (without seq num) 2024/11/22-19:19:53.650343 140025062356544 [compaction_job.cc:1948] [default] [JOB 8647] Generated table #222861: 927002 keys, 37065298 bytes, temperature: kWarm 2024/11/22-19:19:53.650403 140025062356544 EVENT_LOG_v1 {"time_micros": 1732274393650372, "cf_name": "default", "job": 8647, "event": "table_file_creation", "file_number": 222861, "file_size": 37065298, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3405268562, "largest_seqno": 3497593670, "table_properties": {"data_size": 31086672, "index_size": 1763648, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25956056, "raw_average_key_size": 28, "raw_value_size": 108261680, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927002, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732274390, "oldest_key_time": 0, "file_creation_time": 1732274390, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 222861, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-19:19:53.688271 140025062356544 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08647/att-00/222862.sst) /dev/shm/ToplingTemp/Topling-256312-kcvKEl 2024/11/22-19:19:54.204201 140025062356544 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08647/att-00/222862.sst): first pass time = 0.52's, 190.174'MB/sec 2024/11/22-19:19:55.217294 140025062356544 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08647/att-00/222862.sst): old prealloc_size = 147639500, real_size = 25211328 2024/11/22-19:19:55.217743 140025062356544 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08647/att-00/222862.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 679241 prefix = 4 raw-key = 0.0109 GB zip-key = 0.0013 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.0791 GB zip-val = 0.0237 GB avg-val = 116.44 avg-zval = 34.96 2024/11/22-19:19:55.218349 140025062356544 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08647/att-00/222862.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0017 GB, waited 0.000 sec, Key+Value = 0.098 GB 2024/11/22-19:19:55.995109 140025062356544 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08647/att-00/222862.sst): second pass time = 1.01's, 78.110'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.78's, 36.276'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3037.610'MB/sec (index lex order gen) rebuild zvType time = 0.60's, 0.285'MB/sec write SST data time = 0.18's, 154.913'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.793'MB, throughput = 25707.760'MB/sec zip my value time = 1.01's, unzip length = 0.079'GB zip my value throughput = 78.110'MB/sec zip pipeline throughput = 78.110'MB/sec entries = 679241 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.44 avg-zval = 34.96 usrkeys = 679241 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.36 avg-zval = 34.96 TagRS{ kinds = RS_Key0_TagN bytes = 106240 } TagArray{ size = 671432 bytes = 2266096 } seq expand size = 4700024 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0136 GB value = 0.0791 GB dict = 0.79 MB all = 0.0981 GB } __ZipSize{ index = 0.0013 GB value = 0.0237 GB dict = 0.79 MB all = 0.0282 GB } UnZip/Zip{ index = 10.5065 value = 3.3304 dict = 1.00 all = 3.4772 } Zip/UnZip{ index = 0.0952 value = 0.3003 dict = 1.00 all = 0.2876 } ---------------------------- total value len = 1.112072 GB avg = 0.124 KB (by entry num) total key len = 0.252110 GB avg = 0.028 KB total ukey len = 0.180079 GB avg = 0.020 KB total ukey num = 0.009003926 Billion total entry num = 0.009003926 Billion write speed all = 0.036230467 MB/sec (with seq num) write speed all = 0.034317429 MB/sec (without seq num) 2024/11/22-19:19:56.025032 140025062356544 [compaction_job.cc:1948] [default] [JOB 8647] Generated table #222862: 679241 keys, 28214670 bytes, temperature: kWarm 2024/11/22-19:19:56.025109 140025062356544 EVENT_LOG_v1 {"time_micros": 1732274396025067, "cf_name": "default", "job": 8647, "event": "table_file_creation", "file_number": 222862, "file_size": 28214670, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3497594313, "table_properties": {"data_size": 23748336, "index_size": 1292992, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 19018748, "raw_average_key_size": 28, "raw_value_size": 79090426, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 679241, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732274393, "oldest_key_time": 0, "file_creation_time": 1732274393, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 222862, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-19:19:56.062229 140025062356544 [compaction_job.cc:703] job-08647: subcompact[0], size: 0.365266 G, files: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-08647/att-00 [222853,222854,222855,222856,222857,222858,222859,222860,222861,222862] 2024/11/22-19:19:56.149973 140025062356544 (Original Log Time 2024/11/22-19:19:20.309920) EVENT_LOG_v1 {"time_micros": 1732274360309875, "job": 8647, "event": "compaction_started", "compaction_reason": "FilesMarkedForCompaction", "files_L2": [222848], "files_L3": [222823, 222824, 222798, 222799, 222800, 222801, 222802, 222803, 222804, 222805, 222806], "score": 0.974691, "input_data_size": 388743521, "oldest_snapshot_seqno": 3497615741} 2024/11/22-19:19:56.149976 140025062356544 (Original Log Time 2024/11/22-19:19:56.149368) [compaction_job.cc:2022] [default] [JOB 8647] Compacted 1@2 + 11@3 files to L3 => 365265515 bytes 2024/11/22-19:19:56.149978 140025062356544 (Original Log Time 2024/11/22-19:19:56.149906) [compaction_job.cc:1224] [default] compacted to: files[0 0 0 10 0 0 0] max score 0.01, MB/sec: 10.9 rd, 10.2 wr, level 3, files in(1, 11) out(10 +0 blob) MB in(26.2, 344.5 +0.0 blob) out(348.3 +0.0 blob), read-write-amplify(27.4) write-amplify(13.3) OK, records in: 9083014, records dropped: 79088 output_compression: Snappy 2024/11/22-19:19:56.149984 140025062356544 (Original Log Time 2024/11/22-19:19:56.149952) EVENT_LOG_v1 {"time_micros": 1732274396149930, "cf": "default", "job": 8647, "event": "compaction_finished", "compaction_time_micros": 35752324, "compaction_time_cpu_micros": 15930694, "output_level": 3, "num_output_files": 10, "total_output_size": 365265515, "num_input_records": 9083014, "num_output_records": 9003926, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "file_write_nanos": 238312846, "file_range_sync_nanos": 0, "file_fsync_nanos": 10135, "file_prepare_write_nanos": 22026, "lsm_state": [0, 0, 0, 10, 0, 0, 0]} 2024/11/22-19:19:56.282756 140025062356544 DEBG dcompact_worker.cpp:240: HttpPost: 200 OK: url = http://nlb-7zny4kaa1poal01o64.cn-shenzhen.nlb.aliyuncs.com:8443, body = {"instanceId":"nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137","labourId":"","dbId":"d89b4006-2803-486e-b7a2-759bcf348921","dbStarts":1732256054,"starts":1732274360,"executesMs":35980,"compactionJobId":8647,"attempt":0,"compactionInputRawBytes":1317299876,"compactionInputZipBytes":388743521,"compactionOutputRawBytes":0,"compactionOutputZipBytes":365265515,"headers":{"Accept":"*/*","Connection":"close","Host":"aliyun-topling-saas.topling.cn:18443","RemoteIp":"120.24.192.169","X-Forwarded-For":"120.24.192.169","region":"cn-shenzhen","token":"e6474c481bd4415abc537135cc03626b","instance-token":"e6474c481bd4415abc537135cc03626b","provider":"aliyun","CloudMarketInstanceId":"si-59c0ae5c955845588903","MeteringAssit":"","Transfer-Encoding":"chunked","traceparent":"00-a399c4a389ffee08535e28d0648ff4f4-0407e5134c538947-00"}}, response = 2024/11/22-19:19:56.282827 140025062356544 INFO dcompact_worker.cpp:1459: finish /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-08647/att-00: olev 3, work 35.980 s, result 6.264 ms, install 0.635 ms, input{raw 1.227 GiB zip 370.735 MiB}