2024/11/22-22:24:20.227364 140025154676288 DEBG dcompact_worker.cpp:2214: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12684/att-00: fork to child time = 0.009195 sec 2024/11/22-22:24:20.228353 140025154676288 DEBG dcompact_worker.cpp:1013: Beg SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12684/att-00 2024/11/22-22:24:20.235416 140025154676288 DEBG dcompact_worker.cpp:1033: End SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12684/att-00 2024/11/22-22:24:20.236598 140025154676288 TRAC dcompact_worker.cpp:1083: INFO_LOG_LEVEL: rpc = INFO_LEVEL, env_var = undefined 2024/11/22-22:24:20.236872 140025154676288 [WARN] [column_family.cc:386] multiple cf_paths/db_paths and level_compaction_dynamic_level_bytes can't be used together 2024/11/22-22:24:20.284824 140025154676288 [version_set.cc:6208] Recovering from manifest file: /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-12684/att-00/MANIFEST-206347 2024/11/22-22:24:20.298622 140025154676288 [version_set.cc:6251] Recovered from manifest file:/worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-12684/att-00/MANIFEST-206347 succeeded,manifest_file_number is 206347, next_file_number is 231150, last_sequence is 3607604909, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 230999 2024/11/22-22:24:20.298629 140025154676288 [version_set.cc:6266] Column family [default] (ID 0), log number is 0 2024/11/22-22:24:20.298710 140025154676288 [version_set.cc:5721] Creating manifest 231150 2024/11/22-22:24:20.336164 140025154676288 DEBG dcompact_worker.cpp:1218: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12684/att-00: bottommost_level: fake = 1, rpc = 0 2024/11/22-22:24:20.355664 140025154676288 [compaction_job.cc:2437] [default] [JOB 12684] Compacting 1@2 + 9@3 files to L3, score 1.00, subcompactions 1 : 1 2024/11/22-22:24:20.355680 140025154676288 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 9544 Base level 2, inputs: [231139(20MB)], [231077(35MB) 231078(36MB) 231079(34MB) 231080(35MB) 231081(35MB) 231082(35MB) 231102(35MB) 231103(35MB) 231104(35MB)] 2024/11/22-22:24:20.361401 140025154676288 [top_zip_table.cc:59] core git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/22-22:24:20.361433 140025154676288 [top_zip_table.cc:60] fsa git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/22-22:24:20.361455 140025154676288 [top_zip_table.cc:61] zbs git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/22-22:24:20.361460 140025154676288 [top_zip_table.cc:62] topling-zip_table_reader: git_version_hash_info_is: commit a4a382006cb82713acf5b3425835f22711877681 Author: leipeng Date: 2024-04-11 19:44:14 +0800 fixed_len_hole_index.cc: Add env bool FixedLenHoleIndexUseAVX512 for ut & debug 1. FixedLenHoleIndexUseAVX512 is only in unit tests or debug 2. In release mode, use avx512 by compile options(-march=) g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/22-22:24:20.361471 140025154676288 [top_zip_table.cc:64] topling-rocks git_version_hash_info_is: commit feab587e468621ba0204d47b4ffacc52e7c4290d Author: leipeng Date: 2024-03-22 13:35:06 +0800 ToplingZipTableBuilder::Add: immediately return after error This function returns void, and caller does not check builder->status() after calling this function and graceful abandon. So immediately return after error, and return error status in Finish(). g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/22-22:24:20.780149 140025154676288 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12684/att-00/231151.sst) /dev/shm/ToplingTemp/Topling-314164-zIH8rO 2024/11/22-22:24:21.686156 140025154676288 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12684/att-00/231151.sst): first pass time = 0.91's, 148.148'MB/sec 2024/11/22-22:24:23.246952 140025154676288 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12684/att-00/231151.sst): old prealloc_size = 147639500, real_size = 33340480 2024/11/22-22:24:23.247651 140025154676288 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12684/att-00/231151.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 930558 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0313 GB avg-val = 116.23 avg-zval = 33.68 2024/11/22-22:24:23.248512 140025154676288 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12684/att-00/231151.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-22:24:24.870182 140025154676288 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12684/att-00/231151.sst): second pass time = 1.56's, 69.355'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.62's, 23.071'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2621.795'MB/sec (index lex order gen) rebuild zvType time = 1.31's, 0.178'MB/sec write SST data time = 0.31's, 119.094'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 31993.413'MB/sec zip my value time = 1.56's, unzip length = 0.108'GB zip my value throughput = 69.355'MB/sec zip pipeline throughput = 69.355'MB/sec entries = 930558 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.23 avg-zval = 33.68 usrkeys = 930558 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.23 avg-zval = 33.68 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 930558 bytes = 3256960 } seq expand size = 6513906 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0313 GB dict = 1.08 MB all = 0.0374 GB } UnZip/Zip{ index = 10.5149 value = 3.4515 dict = 1.00 all = 3.5840 } Zip/UnZip{ index = 0.0951 value = 0.2897 dict = 1.00 all = 0.2790 } ---------------------------- total value len = 0.114676 GB avg = 0.123 KB (by entry num) total key len = 0.026056 GB avg = 0.028 KB total ukey len = 0.018611 GB avg = 0.020 KB total ukey num = 0.000930558 Billion total entry num = 0.000930558 Billion write speed all = 0.002888476 MB/sec (with seq num) write speed all = 0.002735680 MB/sec (without seq num) 2024/11/22-22:24:24.906466 140025154676288 [compaction_job.cc:1948] [default] [JOB 12684] Generated table #231151: 930558 keys, 37448978 bytes, temperature: kWarm 2024/11/22-22:24:24.906583 140025154676288 EVENT_LOG_v1 {"time_micros": 1732285464906513, "cf_name": "default", "job": 12684, "event": "table_file_creation", "file_number": 231151, "file_size": 37448978, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3376774746, "largest_seqno": 3607579201, "table_properties": {"data_size": 31337648, "index_size": 1769984, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26055624, "raw_average_key_size": 28, "raw_value_size": 108162136, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 930558, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732285460, "oldest_key_time": 0, "file_creation_time": 1732285460, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 231151, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-22:24:24.959625 140025154676288 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12684/att-00/231152.sst) /dev/shm/ToplingTemp/Topling-314164-9ZwqHO 2024/11/22-22:24:26.160491 140025154676288 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12684/att-00/231152.sst): first pass time = 1.20's, 111.772'MB/sec 2024/11/22-22:24:28.055735 140025154676288 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12684/att-00/231152.sst): old prealloc_size = 147639500, real_size = 34664032 2024/11/22-22:24:28.056446 140025154676288 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12684/att-00/231152.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 931892 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1081 GB zip-val = 0.0327 GB avg-val = 116.03 avg-zval = 35.04 2024/11/22-22:24:28.057217 140025154676288 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12684/att-00/231152.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-22:24:29.710872 140025154676288 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12684/att-00/231152.sst): second pass time = 1.89's, 57.111'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.66's, 23.243'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2626.423'MB/sec (index lex order gen) rebuild zvType time = 1.34's, 0.174'MB/sec write SST data time = 0.31's, 122.273'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 33332.632'MB/sec zip my value time = 1.89's, unzip length = 0.108'GB zip my value throughput = 57.111'MB/sec zip pipeline throughput = 77.212'MB/sec entries = 931892 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.03 avg-zval = 35.04 usrkeys = 931892 avg-key = 20.00 avg-zkey = 1.90 avg-val = 122.27 avg-zval = 35.04 TagRS{ kinds = RS_Key0_TagN bytes = 145720 } TagArray{ size = 831395 bytes = 2805968 } seq expand size = 5819765 multi value expand size = 0 cnt WriteAppend = 16 UnZipSize{ index = 0.0186 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0327 GB dict = 1.08 MB all = 0.0385 GB } UnZip/Zip{ index = 10.5136 value = 3.3108 dict = 1.00 all = 3.4889 } Zip/UnZip{ index = 0.0951 value = 0.3020 dict = 1.00 all = 0.2866 } ---------------------------- total value len = 0.228621 GB avg = 0.123 KB (by entry num) total key len = 0.052149 GB avg = 0.028 KB total ukey len = 0.037249 GB avg = 0.020 KB total ukey num = 0.001862450 Billion total entry num = 0.001862450 Billion write speed all = 0.005762132 MB/sec (with seq num) write speed all = 0.005456353 MB/sec (without seq num) 2024/11/22-22:24:29.748110 140025154676288 [compaction_job.cc:1948] [default] [JOB 12684] Generated table #231152: 931892 keys, 38470444 bytes, temperature: kWarm 2024/11/22-22:24:29.748191 140025154676288 EVENT_LOG_v1 {"time_micros": 1732285469748148, "cf_name": "default", "job": 12684, "event": "table_file_creation", "file_number": 231152, "file_size": 38470444, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3607579773, "table_properties": {"data_size": 32658128, "index_size": 1772736, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26092976, "raw_average_key_size": 28, "raw_value_size": 108124784, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 931892, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732285464, "oldest_key_time": 0, "file_creation_time": 1732285464, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 231152, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-22:24:29.798717 140025154676288 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12684/att-00/231153.sst) /dev/shm/ToplingTemp/Topling-314164-I91QqO 2024/11/22-22:24:30.838222 140025154676288 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12684/att-00/231153.sst): first pass time = 1.04's, 129.124'MB/sec 2024/11/22-22:24:32.841640 140025154676288 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12684/att-00/231153.sst): old prealloc_size = 147639500, real_size = 34977456 2024/11/22-22:24:32.842442 140025154676288 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12684/att-00/231153.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 1081622 prefix = 4 raw-key = 0.0173 GB zip-key = 0.0021 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1039 GB zip-val = 0.0326 GB avg-val = 96.09 avg-zval = 30.17 2024/11/22-22:24:32.842506 140025154676288 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12684/att-00/231153.sst: sumWaitingMem = 0.003 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0028 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-22:24:34.069752 140025154676288 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12684/att-00/231153.sst): second pass time = 2.00's, 51.901'MB/sec, value only(77.4% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.23's, 29.115'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2656.134'MB/sec (index lex order gen) rebuild zvType time = 0.92's, 0.293'MB/sec write SST data time = 0.31's, 116.868'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.036'MB, throughput = 17889.177'MB/sec zip my value time = 2.00's, unzip length = 0.104'GB zip my value throughput = 51.901'MB/sec zip pipeline throughput = 63.727'MB/sec entries = 1081622 avg-key = 28.00 avg-zkey = 1.91 avg-val = 96.09 avg-zval = 30.17 usrkeys = 1081622 avg-key = 20.00 avg-zkey = 1.91 avg-val = 96.09 avg-zval = 30.17 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0216 GB value = 0.1039 GB dict = 1.04 MB all = 0.1342 GB } __ZipSize{ index = 0.0021 GB value = 0.0326 GB dict = 1.04 MB all = 0.0358 GB } UnZip/Zip{ index = 10.4471 value = 3.1846 dict = 1.00 all = 3.7540 } Zip/UnZip{ index = 0.0957 value = 0.3140 dict = 1.00 all = 0.2664 } ---------------------------- total value len = 0.332553 GB avg = 0.113 KB (by entry num) total key len = 0.082434 GB avg = 0.028 KB total ukey len = 0.058881 GB avg = 0.020 KB total ukey num = 0.002944072 Billion total entry num = 0.002944072 Billion write speed all = 0.008515878 MB/sec (with seq num) write speed all = 0.008032559 MB/sec (without seq num) 2024/11/22-22:24:34.107044 140025154676288 [compaction_job.cc:1948] [default] [JOB 12684] Generated table #231153: 1081622 keys, 35753405 bytes, temperature: kWarm 2024/11/22-22:24:34.107127 140025154676288 EVENT_LOG_v1 {"time_micros": 1732285474107083, "cf_name": "default", "job": 12684, "event": "table_file_creation", "file_number": 231153, "file_size": 35753405, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 32636192, "index_size": 2070656, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 30285416, "raw_average_key_size": 28, "raw_value_size": 103932401, "raw_average_value_size": 96, "num_data_blocks": 1, "num_entries": 1081622, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732285469, "oldest_key_time": 0, "file_creation_time": 1732285469, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 231153, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-22:24:34.176600 140025154676288 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12684/att-00/231154.sst) /dev/shm/ToplingTemp/Topling-314164-asoIKP 2024/11/22-22:24:35.217914 140025154676288 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12684/att-00/231154.sst): first pass time = 1.04's, 128.899'MB/sec 2024/11/22-22:24:36.897795 140025154676288 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12684/att-00/231154.sst): old prealloc_size = 147639500, real_size = 33600224 2024/11/22-22:24:36.898482 140025154676288 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12684/att-00/231154.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 921023 prefix = 4 raw-key = 0.0147 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1084 GB zip-val = 0.0316 GB avg-val = 117.73 avg-zval = 34.33 2024/11/22-22:24:36.899219 140025154676288 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12684/att-00/231154.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-22:24:38.392638 140025154676288 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12684/att-00/231154.sst): second pass time = 1.68's, 64.580'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.49's, 24.885'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2623.934'MB/sec (index lex order gen) rebuild zvType time = 1.33's, 0.173'MB/sec write SST data time = 0.16's, 226.749'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.084'MB, throughput = 35673.832'MB/sec zip my value time = 1.68's, unzip length = 0.108'GB zip my value throughput = 64.580'MB/sec zip pipeline throughput = 64.580'MB/sec entries = 921023 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.73 avg-zval = 34.33 usrkeys = 921023 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.16 avg-zval = 34.33 TagRS{ kinds = RS_Key0_TagN bytes = 144000 } TagArray{ size = 714739 bytes = 2590944 } seq expand size = 5003173 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0184 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0316 GB dict = 1.08 MB all = 0.0372 GB } UnZip/Zip{ index = 10.5136 value = 3.4294 dict = 1.00 all = 3.6081 } Zip/UnZip{ index = 0.0951 value = 0.2916 dict = 1.00 all = 0.2772 } ---------------------------- total value len = 0.445985 GB avg = 0.115 KB (by entry num) total key len = 0.108223 GB avg = 0.028 KB total ukey len = 0.077302 GB avg = 0.020 KB total ukey num = 0.003865095 Billion total entry num = 0.003865095 Billion write speed all = 0.011371798 MB/sec (with seq num) write speed all = 0.010737335 MB/sec (without seq num) 2024/11/22-22:24:38.428106 140025154676288 [compaction_job.cc:1948] [default] [JOB 12684] Generated table #231154: 921023 keys, 37198560 bytes, temperature: kWarm 2024/11/22-22:24:38.428168 140025154676288 EVENT_LOG_v1 {"time_micros": 1732285478428136, "cf_name": "default", "job": 12684, "event": "table_file_creation", "file_number": 231154, "file_size": 37198560, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3570448224, "table_properties": {"data_size": 31617744, "index_size": 1752064, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25788644, "raw_average_key_size": 28, "raw_value_size": 108429146, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 921023, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732285474, "oldest_key_time": 0, "file_creation_time": 1732285474, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 231154, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-22:24:38.466570 140025154676288 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12684/att-00/231155.sst) /dev/shm/ToplingTemp/Topling-314164-jd674M 2024/11/22-22:24:39.305616 140025154676288 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12684/att-00/231155.sst): first pass time = 0.84's, 159.972'MB/sec 2024/11/22-22:24:41.383713 140025154676288 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12684/att-00/231155.sst): old prealloc_size = 147639500, real_size = 33528144 2024/11/22-22:24:41.384265 140025154676288 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12684/att-00/231155.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 924899 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0315 GB avg-val = 117.12 avg-zval = 34.10 2024/11/22-22:24:41.385030 140025154676288 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12684/att-00/231155.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-22:24:42.333830 140025154676288 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12684/att-00/231155.sst): second pass time = 2.08's, 52.144'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.95's, 39.476'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3288.628'MB/sec (index lex order gen) rebuild zvType time = 0.82's, 0.281'MB/sec write SST data time = 0.13's, 293.756'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 33165.741'MB/sec zip my value time = 2.08's, unzip length = 0.108'GB zip my value throughput = 52.144'MB/sec zip pipeline throughput = 90.462'MB/sec entries = 924899 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.12 avg-zval = 34.10 usrkeys = 924899 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.12 avg-zval = 34.10 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 924899 bytes = 3121552 } seq expand size = 6474293 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0315 GB dict = 1.08 MB all = 0.0375 GB } UnZip/Zip{ index = 10.5140 value = 3.4347 dict = 1.00 all = 3.5786 } Zip/UnZip{ index = 0.0951 value = 0.2911 dict = 1.00 all = 0.2794 } ---------------------------- total value len = 0.560780 GB avg = 0.117 KB (by entry num) total key len = 0.134120 GB avg = 0.028 KB total ukey len = 0.095800 GB avg = 0.020 KB total ukey num = 0.004789994 Billion total entry num = 0.004789994 Billion write speed all = 0.014257508 MB/sec (with seq num) write speed all = 0.013471284 MB/sec (without seq num) 2024/11/22-22:24:42.368998 140025154676288 [compaction_job.cc:1948] [default] [JOB 12684] Generated table #231155: 924899 keys, 37505442 bytes, temperature: kWarm 2024/11/22-22:24:42.369061 140025154676288 EVENT_LOG_v1 {"time_micros": 1732285482369028, "cf_name": "default", "job": 12684, "event": "table_file_creation", "file_number": 231155, "file_size": 37505442, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3487497056, "largest_seqno": 3607579757, "table_properties": {"data_size": 31537344, "index_size": 1759360, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25897172, "raw_average_key_size": 28, "raw_value_size": 108320618, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 924899, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732285478, "oldest_key_time": 0, "file_creation_time": 1732285478, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 231155, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-22:24:42.404922 140025154676288 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12684/att-00/231156.sst) /dev/shm/ToplingTemp/Topling-314164-78zc9M 2024/11/22-22:24:43.242802 140025154676288 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12684/att-00/231156.sst): first pass time = 0.84's, 160.195'MB/sec 2024/11/22-22:24:44.623650 140025154676288 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12684/att-00/231156.sst): old prealloc_size = 147639500, real_size = 32781056 2024/11/22-22:24:44.624286 140025154676288 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12684/att-00/231156.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 929904 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0308 GB avg-val = 116.34 avg-zval = 33.10 2024/11/22-22:24:44.625090 140025154676288 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12684/att-00/231156.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-22:24:45.751802 140025154676288 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12684/att-00/231156.sst): second pass time = 1.38's, 78.394'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.13's, 32.699'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2874.078'MB/sec (index lex order gen) rebuild zvType time = 0.97's, 0.240'MB/sec write SST data time = 0.16's, 230.695'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 31094.697'MB/sec zip my value time = 1.38's, unzip length = 0.108'GB zip my value throughput = 78.394'MB/sec zip pipeline throughput = 78.394'MB/sec entries = 929904 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.34 avg-zval = 33.10 usrkeys = 929904 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.34 avg-zval = 33.10 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 929904 bytes = 3254672 } seq expand size = 6509328 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0308 GB dict = 1.08 MB all = 0.0369 GB } UnZip/Zip{ index = 10.5132 value = 3.5147 dict = 1.00 all = 3.6385 } Zip/UnZip{ index = 0.0951 value = 0.2845 dict = 1.00 all = 0.2748 } ---------------------------- total value len = 0.675470 GB avg = 0.118 KB (by entry num) total key len = 0.160157 GB avg = 0.028 KB total ukey len = 0.114398 GB avg = 0.020 KB total ukey num = 0.005719898 Billion total entry num = 0.005719898 Billion write speed all = 0.017143654 MB/sec (with seq num) write speed all = 0.016204863 MB/sec (without seq num) 2024/11/22-22:24:45.786112 140025154676288 [compaction_job.cc:1948] [default] [JOB 12684] Generated table #231156: 929904 keys, 36888090 bytes, temperature: kWarm 2024/11/22-22:24:45.786176 140025154676288 EVENT_LOG_v1 {"time_micros": 1732285485786144, "cf_name": "default", "job": 12684, "event": "table_file_creation", "file_number": 231156, "file_size": 36888090, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3365258144, "largest_seqno": 3607578605, "table_properties": {"data_size": 30779376, "index_size": 1769024, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26037312, "raw_average_key_size": 28, "raw_value_size": 108180524, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 929904, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732285482, "oldest_key_time": 0, "file_creation_time": 1732285482, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 231156, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-22:24:45.824589 140025154676288 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12684/att-00/231157.sst) /dev/shm/ToplingTemp/Topling-314164-HXuliO 2024/11/22-22:24:46.903130 140025154676288 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12684/att-00/231157.sst): first pass time = 1.08's, 124.448'MB/sec 2024/11/22-22:24:48.430629 140025154676288 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12684/att-00/231157.sst): old prealloc_size = 147639500, real_size = 33570240 2024/11/22-22:24:48.431208 140025154676288 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12684/att-00/231157.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927368 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0316 GB avg-val = 116.73 avg-zval = 34.05 2024/11/22-22:24:48.431977 140025154676288 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12684/att-00/231157.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-22:24:49.334028 140025154676288 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12684/att-00/231157.sst): second pass time = 1.53's, 70.897'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.90's, 41.828'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3142.443'MB/sec (index lex order gen) rebuild zvType time = 0.77's, 0.299'MB/sec write SST data time = 0.13's, 294.830'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 33464.081'MB/sec zip my value time = 1.53's, unzip length = 0.108'GB zip my value throughput = 70.897'MB/sec zip pipeline throughput = 70.897'MB/sec entries = 927368 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.73 avg-zval = 34.05 usrkeys = 927368 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.73 avg-zval = 34.05 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 927368 bytes = 3361728 } seq expand size = 6491576 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0316 GB dict = 1.08 MB all = 0.0378 GB } UnZip/Zip{ index = 10.5130 value = 3.4285 dict = 1.00 all = 3.5520 } Zip/UnZip{ index = 0.0951 value = 0.2917 dict = 1.00 all = 0.2815 } ---------------------------- total value len = 0.790213 GB avg = 0.119 KB (by entry num) total key len = 0.186123 GB avg = 0.028 KB total ukey len = 0.132945 GB avg = 0.020 KB total ukey num = 0.006647266 Billion total entry num = 0.006647266 Billion write speed all = 0.020028964 MB/sec (with seq num) write speed all = 0.018938046 MB/sec (without seq num) 2024/11/22-22:24:49.368245 140025154676288 [compaction_job.cc:1948] [default] [JOB 12684] Generated table #231157: 927368 keys, 37786254 bytes, temperature: kWarm 2024/11/22-22:24:49.368305 140025154676288 EVENT_LOG_v1 {"time_micros": 1732285489368272, "cf_name": "default", "job": 12684, "event": "table_file_creation", "file_number": 231157, "file_size": 37786254, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3273701103, "largest_seqno": 3607579464, "table_properties": {"data_size": 31574000, "index_size": 1764224, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25966304, "raw_average_key_size": 28, "raw_value_size": 108251544, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927368, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732285485, "oldest_key_time": 0, "file_creation_time": 1732285485, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 231157, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-22:24:49.403393 140025154676288 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12684/att-00/231158.sst) /dev/shm/ToplingTemp/Topling-314164-wqOpKN 2024/11/22-22:24:50.194115 140025154676288 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12684/att-00/231158.sst): first pass time = 0.79's, 169.750'MB/sec 2024/11/22-22:24:51.530878 140025154676288 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12684/att-00/231158.sst): old prealloc_size = 147639500, real_size = 31700464 2024/11/22-22:24:51.531386 140025154676288 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12684/att-00/231158.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 924820 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0297 GB avg-val = 117.13 avg-zval = 32.12 2024/11/22-22:24:51.532160 140025154676288 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12684/att-00/231158.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-22:24:52.393532 140025154676288 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12684/att-00/231158.sst): second pass time = 1.34's, 81.102'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.86's, 41.627'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3628.561'MB/sec (index lex order gen) rebuild zvType time = 0.73's, 0.315'MB/sec write SST data time = 0.13's, 279.542'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 28359.569'MB/sec zip my value time = 1.34's, unzip length = 0.108'GB zip my value throughput = 81.102'MB/sec zip pipeline throughput = 81.102'MB/sec entries = 924820 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.13 avg-zval = 32.12 usrkeys = 924820 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.13 avg-zval = 32.12 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 924820 bytes = 3352480 } seq expand size = 6473740 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0297 GB dict = 1.08 MB all = 0.0359 GB } UnZip/Zip{ index = 10.5116 value = 3.6461 dict = 1.00 all = 3.7377 } Zip/UnZip{ index = 0.0951 value = 0.2743 dict = 1.00 all = 0.2675 } ---------------------------- total value len = 0.905010 GB avg = 0.120 KB (by entry num) total key len = 0.212018 GB avg = 0.028 KB total ukey len = 0.151442 GB avg = 0.020 KB total ukey num = 0.007572086 Billion total entry num = 0.007572086 Billion write speed all = 0.022913728 MB/sec (with seq num) write speed all = 0.021671111 MB/sec (without seq num) 2024/11/22-22:24:52.427312 140025154676288 [compaction_job.cc:1948] [default] [JOB 12684] Generated table #231158: 924820 keys, 35908922 bytes, temperature: kWarm 2024/11/22-22:24:52.427381 140025154676288 EVENT_LOG_v1 {"time_micros": 1732285492427343, "cf_name": "default", "job": 12684, "event": "table_file_creation", "file_number": 231158, "file_size": 35908922, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3326330223, "largest_seqno": 3607577242, "table_properties": {"data_size": 29709472, "index_size": 1759616, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25894960, "raw_average_key_size": 28, "raw_value_size": 108322776, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 924820, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732285489, "oldest_key_time": 0, "file_creation_time": 1732285489, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 231158, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-22:24:52.463720 140025154676288 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12684/att-00/231159.sst) /dev/shm/ToplingTemp/Topling-314164-B97G2M 2024/11/22-22:24:53.386887 140025154676288 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12684/att-00/231159.sst): first pass time = 0.92's, 145.396'MB/sec 2024/11/22-22:24:54.713327 140025154676288 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12684/att-00/231159.sst): old prealloc_size = 147639500, real_size = 32795296 2024/11/22-22:24:54.713880 140025154676288 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12684/att-00/231159.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 924796 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0308 GB avg-val = 117.13 avg-zval = 33.31 2024/11/22-22:24:54.714619 140025154676288 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12684/att-00/231159.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-22:24:55.617828 140025154676288 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12684/att-00/231159.sst): second pass time = 1.33's, 81.705'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.90's, 40.784'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3306.580'MB/sec (index lex order gen) rebuild zvType time = 0.78's, 0.298'MB/sec write SST data time = 0.13's, 290.523'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 30853.686'MB/sec zip my value time = 1.33's, unzip length = 0.108'GB zip my value throughput = 81.705'MB/sec zip pipeline throughput = 81.705'MB/sec entries = 924796 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.13 avg-zval = 33.31 usrkeys = 924796 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.13 avg-zval = 33.31 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 924796 bytes = 3236800 } seq expand size = 6473572 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0308 GB dict = 1.08 MB all = 0.0369 GB } UnZip/Zip{ index = 10.5144 value = 3.5164 dict = 1.00 all = 3.6385 } Zip/UnZip{ index = 0.0951 value = 0.2844 dict = 1.00 all = 0.2748 } ---------------------------- total value len = 1.019807 GB avg = 0.120 KB (by entry num) total key len = 0.237913 GB avg = 0.028 KB total ukey len = 0.169938 GB avg = 0.020 KB total ukey num = 0.008496882 Billion total entry num = 0.008496882 Billion write speed all = 0.025798041 MB/sec (with seq num) write speed all = 0.024403753 MB/sec (without seq num) 2024/11/22-22:24:55.651537 140025154676288 [compaction_job.cc:1948] [default] [JOB 12684] Generated table #231159: 924796 keys, 36887880 bytes, temperature: kWarm 2024/11/22-22:24:55.651601 140025154676288 EVENT_LOG_v1 {"time_micros": 1732285495651568, "cf_name": "default", "job": 12684, "event": "table_file_creation", "file_number": 231159, "file_size": 36887880, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3340156812, "largest_seqno": 3607259082, "table_properties": {"data_size": 30804816, "index_size": 1759104, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25894288, "raw_average_key_size": 28, "raw_value_size": 108323568, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 924796, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732285492, "oldest_key_time": 0, "file_creation_time": 1732285492, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 231159, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-22:24:55.686844 140025154676288 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12684/att-00/231160.sst) /dev/shm/ToplingTemp/Topling-314164-nSc7zN 2024/11/22-22:24:55.758882 140025154676288 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12684/att-00/231160.sst): first pass time = 0.07's, 233.219'MB/sec 2024/11/22-22:24:55.905347 140025154676288 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12684/att-00/231160.sst): old prealloc_size = 147639500, real_size = 5033088 2024/11/22-22:24:55.905464 140025154676288 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12684/att-00/231160.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 115005 prefix = 4 raw-key = 0.0018 GB zip-key = 0.0002 GB avg-key = 16.00 avg-zkey = 1.94 raw-val = 0.0136 GB zip-val = 0.0048 GB avg-val = 118.00 avg-zval = 41.57 2024/11/22-22:24:55.905587 140025154676288 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12684/att-00/231160.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0002 GB, waited 0.000 sec, Key+Value = 0.017 GB 2024/11/22-22:24:56.012206 140025154676288 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12684/att-00/231160.sst): second pass time = 0.15's, 93.018'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.11's, 51.536'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2372.969'MB/sec (index lex order gen) rebuild zvType time = 0.09's, 0.318'MB/sec write SST data time = 0.02's, 337.262'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.141'MB, throughput = 4924.209'MB/sec zip my value time = 0.15's, unzip length = 0.014'GB zip my value throughput = 93.018'MB/sec zip pipeline throughput = 93.018'MB/sec entries = 115005 avg-key = 28.00 avg-zkey = 1.94 avg-val = 118.00 avg-zval = 41.57 usrkeys = 115005 avg-key = 20.00 avg-zkey = 1.94 avg-val = 125.00 avg-zval = 41.57 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 115005 bytes = 359408 } seq expand size = 805035 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0023 GB value = 0.0136 GB dict = 0.14 MB all = 0.0168 GB } __ZipSize{ index = 0.0002 GB value = 0.0048 GB dict = 0.14 MB all = 0.0055 GB } UnZip/Zip{ index = 10.3155 value = 2.8383 dict = 1.00 all = 3.0493 } Zip/UnZip{ index = 0.0969 value = 0.3523 dict = 1.00 all = 0.3279 } ---------------------------- total value len = 1.034182 GB avg = 0.120 KB (by entry num) total key len = 0.241133 GB avg = 0.028 KB total ukey len = 0.172238 GB avg = 0.020 KB total ukey num = 0.008611887 Billion total entry num = 0.008611887 Billion write speed all = 0.026158749 MB/sec (with seq num) write speed all = 0.024745601 MB/sec (without seq num) 2024/11/22-22:24:56.023065 140025154676288 [compaction_job.cc:1948] [default] [JOB 12684] Generated table #231160: 115005 keys, 5506397 bytes, temperature: kWarm 2024/11/22-22:24:56.023125 140025154676288 EVENT_LOG_v1 {"time_micros": 1732285496023095, "cf_name": "default", "job": 12684, "event": "table_file_creation", "file_number": 231160, "file_size": 5506397, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3570128364, "largest_seqno": 3592342934, "table_properties": {"data_size": 4781168, "index_size": 222976, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 3220140, "raw_average_key_size": 28, "raw_value_size": 13570590, "raw_average_value_size": 118, "num_data_blocks": 1, "num_entries": 115005, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 118, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732285495, "oldest_key_time": 0, "file_creation_time": 1732285495, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 231160, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-22:24:56.037982 140025154676288 [compaction_job.cc:703] job-12684: subcompact[0], size: 0.339354 G, files: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-12684/att-00 [231151,231152,231153,231154,231155,231156,231157,231158,231159,231160] 2024/11/22-22:24:56.104392 140025154676288 (Original Log Time 2024/11/22-22:24:20.355729) EVENT_LOG_v1 {"time_micros": 1732285460355693, "job": 12684, "event": "compaction_started", "compaction_reason": "FilesMarkedForCompaction", "files_L2": [231139], "files_L3": [231077, 231078, 231079, 231080, 231081, 231082, 231102, 231103, 231104], "score": 0.999135, "input_data_size": 357055781, "oldest_snapshot_seqno": 3607604729} 2024/11/22-22:24:56.104395 140025154676288 (Original Log Time 2024/11/22-22:24:56.103775) [compaction_job.cc:2022] [default] [JOB 12684] Compacted 1@2 + 9@3 files to L3 => 339354372 bytes 2024/11/22-22:24:56.104397 140025154676288 (Original Log Time 2024/11/22-22:24:56.104328) [compaction_job.cc:1224] [default] compacted to: files[0 0 0 10 0 0 0] max score 0.01, MB/sec: 10.0 rd, 9.5 wr, level 3, files in(1, 9) out(10 +0 blob) MB in(21.0, 319.5 +0.0 blob) out(323.6 +0.0 blob), read-write-amplify(31.7) write-amplify(15.4) OK, records in: 8676295, records dropped: 64408 output_compression: Snappy 2024/11/22-22:24:56.104402 140025154676288 (Original Log Time 2024/11/22-22:24:56.104372) EVENT_LOG_v1 {"time_micros": 1732285496104352, "cf": "default", "job": 12684, "event": "compaction_finished", "compaction_time_micros": 35682262, "compaction_time_cpu_micros": 16014653, "output_level": 3, "num_output_files": 10, "total_output_size": 339354372, "num_input_records": 8676295, "num_output_records": 8611887, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "file_write_nanos": 240681233, "file_range_sync_nanos": 0, "file_fsync_nanos": 9180, "file_prepare_write_nanos": 26278, "lsm_state": [0, 0, 0, 10, 0, 0, 0]} 2024/11/22-22:24:56.244930 140025154676288 DEBG dcompact_worker.cpp:240: HttpPost: 200 OK: url = http://nlb-7zny4kaa1poal01o64.cn-shenzhen.nlb.aliyuncs.com:8443, body = {"instanceId":"nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137","labourId":"","dbId":"d89b4006-2803-486e-b7a2-759bcf348921","dbStarts":1732256054,"starts":1732285460,"executesMs":35869,"compactionJobId":12684,"attempt":0,"compactionInputRawBytes":1233896859,"compactionInputZipBytes":357055781,"compactionOutputRawBytes":0,"compactionOutputZipBytes":339354372,"headers":{"Accept":"*/*","Connection":"close","Host":"aliyun-topling-saas.topling.cn:18443","RemoteIp":"120.24.192.169","X-Forwarded-For":"120.24.192.169","region":"cn-shenzhen","token":"e6474c481bd4415abc537135cc03626b","instance-token":"e6474c481bd4415abc537135cc03626b","provider":"aliyun","CloudMarketInstanceId":"si-59c0ae5c955845588903","MeteringAssit":"","Transfer-Encoding":"chunked","traceparent":"00-5686f89560e0748f7473d6f706be05a0-499c62e246fe847b-00"}}, response = 2024/11/22-22:24:56.245006 140025154676288 INFO dcompact_worker.cpp:1459: finish /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-12684/att-00: olev 3, work 35.870 s, result 6.334 ms, install 0.646 ms, input{raw 1.149 GiB zip 340.515 MiB}