2024/11/22-20:38:05.771719 140025146283584 DEBG dcompact_worker.cpp:2214: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10429/att-00: fork to child time = 0.011501 sec 2024/11/22-20:38:05.772833 140025146283584 DEBG dcompact_worker.cpp:1013: Beg SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10429/att-00 2024/11/22-20:38:05.780194 140025146283584 DEBG dcompact_worker.cpp:1033: End SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10429/att-00 2024/11/22-20:38:05.780595 140025146283584 TRAC dcompact_worker.cpp:1083: INFO_LOG_LEVEL: rpc = INFO_LEVEL, env_var = undefined 2024/11/22-20:38:05.780909 140025146283584 [WARN] [column_family.cc:386] multiple cf_paths/db_paths and level_compaction_dynamic_level_bytes can't be used together 2024/11/22-20:38:05.828660 140025146283584 [version_set.cc:6208] Recovering from manifest file: /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-10429/att-00/MANIFEST-206347 2024/11/22-20:38:05.867581 140025146283584 [version_set.cc:6251] Recovered from manifest file:/worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-10429/att-00/MANIFEST-206347 succeeded,manifest_file_number is 206347, next_file_number is 226540, last_sequence is 3546105703, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 226337 2024/11/22-20:38:05.867591 140025146283584 [version_set.cc:6266] Column family [default] (ID 0), log number is 0 2024/11/22-20:38:05.867681 140025146283584 [version_set.cc:5721] Creating manifest 226540 2024/11/22-20:38:05.899810 140025146283584 DEBG dcompact_worker.cpp:1218: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10429/att-00: bottommost_level: fake = 1, rpc = 0 2024/11/22-20:38:05.921526 140025146283584 [compaction_job.cc:2437] [default] [JOB 10429] Compacting 1@2 + 9@3 files to L3, score 1.00, subcompactions 1 : 1 2024/11/22-20:38:05.921547 140025146283584 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 7878 Base level 2, inputs: [226476(23MB)], [226400(36MB) 226402(37MB) 226435(36MB) 226436(38MB) 226437(35MB) 226438(35MB) 226439(34MB) 226440(36MB) 226523(36MB)] 2024/11/22-20:38:05.928858 140025146283584 [top_zip_table.cc:59] core git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/22-20:38:05.928898 140025146283584 [top_zip_table.cc:60] fsa git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/22-20:38:05.928918 140025146283584 [top_zip_table.cc:61] zbs git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/22-20:38:05.928924 140025146283584 [top_zip_table.cc:62] topling-zip_table_reader: git_version_hash_info_is: commit a4a382006cb82713acf5b3425835f22711877681 Author: leipeng Date: 2024-04-11 19:44:14 +0800 fixed_len_hole_index.cc: Add env bool FixedLenHoleIndexUseAVX512 for ut & debug 1. FixedLenHoleIndexUseAVX512 is only in unit tests or debug 2. In release mode, use avx512 by compile options(-march=) g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/22-20:38:05.928934 140025146283584 [top_zip_table.cc:64] topling-rocks git_version_hash_info_is: commit feab587e468621ba0204d47b4ffacc52e7c4290d Author: leipeng Date: 2024-03-22 13:35:06 +0800 ToplingZipTableBuilder::Add: immediately return after error This function returns void, and caller does not check builder->status() after calling this function and graceful abandon. So immediately return after error, and return error status in Finish(). g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/22-20:38:06.352444 140025146283584 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10429/att-00/226541.sst) /dev/shm/ToplingTemp/Topling-282165-tU8h0c 2024/11/22-20:38:06.911042 140025146283584 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10429/att-00/226541.sst): first pass time = 0.56's, 240.296'MB/sec 2024/11/22-20:38:08.513838 140025146283584 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10429/att-00/226541.sst): old prealloc_size = 147639500, real_size = 34668032 2024/11/22-20:38:08.514421 140025146283584 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10429/att-00/226541.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 928094 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0327 GB avg-val = 116.62 avg-zval = 35.20 2024/11/22-20:38:08.515197 140025146283584 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10429/att-00/226541.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-20:38:09.431621 140025146283584 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10429/att-00/226541.sst): second pass time = 1.60's, 67.596'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.92's, 42.116'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3146.191'MB/sec (index lex order gen) rebuild zvType time = 0.78's, 0.298'MB/sec write SST data time = 0.14's, 281.284'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 30010.284'MB/sec zip my value time = 1.60's, unzip length = 0.108'GB zip my value throughput = 67.596'MB/sec zip pipeline throughput = 132.254'MB/sec entries = 928094 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.62 avg-zval = 35.20 usrkeys = 928094 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.62 avg-zval = 35.20 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 928094 bytes = 3132336 } seq expand size = 6496658 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0327 GB dict = 1.08 MB all = 0.0387 GB } UnZip/Zip{ index = 10.5148 value = 3.3128 dict = 1.00 all = 3.4723 } Zip/UnZip{ index = 0.0951 value = 0.3019 dict = 1.00 all = 0.2880 } ---------------------------- total value len = 0.114728 GB avg = 0.124 KB (by entry num) total key len = 0.025987 GB avg = 0.028 KB total ukey len = 0.018562 GB avg = 0.020 KB total ukey num = 0.000928094 Billion total entry num = 0.000928094 Billion write speed all = 0.003322942 MB/sec (with seq num) write speed all = 0.003147608 MB/sec (without seq num) 2024/11/22-20:38:09.485594 140025146283584 [compaction_job.cc:1948] [default] [JOB 10429] Generated table #226541: 928094 keys, 38653900 bytes, temperature: kWarm 2024/11/22-20:38:09.485720 140025146283584 EVENT_LOG_v1 {"time_micros": 1732279089485630, "cf_name": "default", "job": 10429, "event": "table_file_creation", "file_number": 226541, "file_size": 38653900, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3434038037, "largest_seqno": 3545479185, "table_properties": {"data_size": 32670512, "index_size": 1765312, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25986632, "raw_average_key_size": 28, "raw_value_size": 108231144, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 928094, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732279086, "oldest_key_time": 0, "file_creation_time": 1732279086, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 226541, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-20:38:09.520253 140025146283584 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10429/att-00/226542.sst) /dev/shm/ToplingTemp/Topling-282165-ep4ZP9 2024/11/22-20:38:10.407435 140025146283584 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10429/att-00/226542.sst): first pass time = 0.89's, 151.292'MB/sec 2024/11/22-20:38:12.017592 140025146283584 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10429/att-00/226542.sst): old prealloc_size = 147639500, real_size = 35535328 2024/11/22-20:38:12.018178 140025146283584 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10429/att-00/226542.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 929503 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0335 GB avg-val = 116.40 avg-zval = 36.08 2024/11/22-20:38:12.018964 140025146283584 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10429/att-00/226542.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-20:38:12.902160 140025146283584 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10429/att-00/226542.sst): second pass time = 1.61's, 67.223'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.88's, 44.683'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3053.993'MB/sec (index lex order gen) rebuild zvType time = 0.74's, 0.314'MB/sec write SST data time = 0.14's, 274.903'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 31237.610'MB/sec zip my value time = 1.61's, unzip length = 0.108'GB zip my value throughput = 67.223'MB/sec zip pipeline throughput = 111.017'MB/sec entries = 929503 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.40 avg-zval = 36.08 usrkeys = 929503 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.40 avg-zval = 36.08 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 929503 bytes = 3137088 } seq expand size = 6506521 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0335 GB dict = 1.08 MB all = 0.0395 GB } UnZip/Zip{ index = 10.5128 value = 3.2263 dict = 1.00 all = 3.3958 } Zip/UnZip{ index = 0.0951 value = 0.3100 dict = 1.00 all = 0.2945 } ---------------------------- total value len = 0.229426 GB avg = 0.124 KB (by entry num) total key len = 0.052013 GB avg = 0.028 KB total ukey len = 0.037152 GB avg = 0.020 KB total ukey num = 0.001857597 Billion total entry num = 0.001857597 Billion write speed all = 0.006645572 MB/sec (with seq num) write speed all = 0.006294667 MB/sec (without seq num) 2024/11/22-20:38:12.937371 140025146283584 [compaction_job.cc:1948] [default] [JOB 10429] Generated table #226542: 929503 keys, 39524976 bytes, temperature: kWarm 2024/11/22-20:38:12.937435 140025146283584 EVENT_LOG_v1 {"time_micros": 1732279092937401, "cf_name": "default", "job": 10429, "event": "table_file_creation", "file_number": 226542, "file_size": 39524976, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3434038075, "largest_seqno": 3545479308, "table_properties": {"data_size": 33534480, "index_size": 1768320, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26026084, "raw_average_key_size": 28, "raw_value_size": 108191662, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 929503, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732279089, "oldest_key_time": 0, "file_creation_time": 1732279089, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 226542, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-20:38:12.973638 140025146283584 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10429/att-00/226543.sst) /dev/shm/ToplingTemp/Topling-282165-cIeRqc 2024/11/22-20:38:13.916945 140025146283584 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10429/att-00/226543.sst): first pass time = 0.94's, 142.291'MB/sec 2024/11/22-20:38:15.479428 140025146283584 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10429/att-00/226543.sst): old prealloc_size = 147639500, real_size = 34159360 2024/11/22-20:38:15.479983 140025146283584 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10429/att-00/226543.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 929768 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1082 GB zip-val = 0.0321 GB avg-val = 116.36 avg-zval = 34.57 2024/11/22-20:38:15.480731 140025146283584 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10429/att-00/226543.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-20:38:16.404611 140025146283584 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10429/att-00/226543.sst): second pass time = 1.56's, 69.271'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.93's, 41.236'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3342.285'MB/sec (index lex order gen) rebuild zvType time = 0.79's, 0.293'MB/sec write SST data time = 0.13's, 290.777'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 34571.300'MB/sec zip my value time = 1.56's, unzip length = 0.108'GB zip my value throughput = 69.271'MB/sec zip pipeline throughput = 88.349'MB/sec entries = 929768 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.36 avg-zval = 34.57 usrkeys = 929768 avg-key = 20.00 avg-zkey = 1.91 avg-val = 123.36 avg-zval = 34.57 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 929768 bytes = 3137984 } seq expand size = 6508376 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0321 GB dict = 1.08 MB all = 0.0382 GB } UnZip/Zip{ index = 10.4451 value = 3.3654 dict = 1.00 all = 3.5182 } Zip/UnZip{ index = 0.0957 value = 0.2971 dict = 1.00 all = 0.2842 } ---------------------------- total value len = 0.344119 GB avg = 0.123 KB (by entry num) total key len = 0.078046 GB avg = 0.028 KB total ukey len = 0.055747 GB avg = 0.020 KB total ukey num = 0.002787365 Billion total entry num = 0.002787365 Billion write speed all = 0.009967697 MB/sec (with seq num) write speed all = 0.009441199 MB/sec (without seq num) 2024/11/22-20:38:16.456288 140025146283584 [compaction_job.cc:1948] [default] [JOB 10429] Generated table #226543: 929768 keys, 38150052 bytes, temperature: kWarm 2024/11/22-20:38:16.456352 140025146283584 EVENT_LOG_v1 {"time_micros": 1732279096456319, "cf_name": "default", "job": 10429, "event": "table_file_creation", "file_number": 226543, "file_size": 38150052, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3434038136, "largest_seqno": 3545479442, "table_properties": {"data_size": 32146416, "index_size": 1780288, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26033504, "raw_average_key_size": 28, "raw_value_size": 108184356, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 929768, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732279092, "oldest_key_time": 0, "file_creation_time": 1732279092, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 226543, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-20:38:16.493560 140025146283584 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10429/att-00/226544.sst) /dev/shm/ToplingTemp/Topling-282165-Vgyoac 2024/11/22-20:38:17.340976 140025146283584 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10429/att-00/226544.sst): first pass time = 0.85's, 158.392'MB/sec 2024/11/22-20:38:19.001651 140025146283584 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10429/att-00/226544.sst): old prealloc_size = 147639500, real_size = 36121264 2024/11/22-20:38:19.002221 140025146283584 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10429/att-00/226544.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927572 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0341 GB avg-val = 116.70 avg-zval = 36.79 2024/11/22-20:38:19.002989 140025146283584 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10429/att-00/226544.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-20:38:19.871490 140025146283584 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10429/att-00/226544.sst): second pass time = 1.66's, 65.231'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.87's, 46.287'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3242.382'MB/sec (index lex order gen) rebuild zvType time = 0.74's, 0.315'MB/sec write SST data time = 0.13's, 302.667'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 31586.362'MB/sec zip my value time = 1.66's, unzip length = 0.108'GB zip my value throughput = 65.231'MB/sec zip pipeline throughput = 107.759'MB/sec entries = 927572 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.70 avg-zval = 36.79 usrkeys = 927572 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.23 avg-zval = 36.79 TagRS{ kinds = RS_Key0_TagN bytes = 145040 } TagArray{ size = 865382 bytes = 3137024 } seq expand size = 6057674 multi value expand size = 0 cnt WriteAppend = 16 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0341 GB dict = 1.08 MB all = 0.0403 GB } UnZip/Zip{ index = 10.5131 value = 3.1721 dict = 1.00 all = 3.3337 } Zip/UnZip{ index = 0.0951 value = 0.3153 dict = 1.00 all = 0.3000 } ---------------------------- total value len = 0.458422 GB avg = 0.123 KB (by entry num) total key len = 0.104018 GB avg = 0.028 KB total ukey len = 0.074299 GB avg = 0.020 KB total ukey num = 0.003714937 Billion total entry num = 0.003714937 Billion write speed all = 0.013278640 MB/sec (with seq num) write speed all = 0.012576993 MB/sec (without seq num) 2024/11/22-20:38:19.906604 140025146283584 [compaction_job.cc:1948] [default] [JOB 10429] Generated table #226544: 927572 keys, 40261230 bytes, temperature: kWarm 2024/11/22-20:38:19.906670 140025146283584 EVENT_LOG_v1 {"time_micros": 1732279099906637, "cf_name": "default", "job": 10429, "event": "table_file_creation", "file_number": 226544, "file_size": 40261230, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3545478868, "table_properties": {"data_size": 34124576, "index_size": 1764608, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25972016, "raw_average_key_size": 28, "raw_value_size": 108245728, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927572, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732279096, "oldest_key_time": 0, "file_creation_time": 1732279096, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 226544, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-20:38:19.942951 140025146283584 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10429/att-00/226545.sst) /dev/shm/ToplingTemp/Topling-282165-sD7N1a 2024/11/22-20:38:20.743421 140025146283584 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10429/att-00/226545.sst): first pass time = 0.80's, 167.681'MB/sec 2024/11/22-20:38:22.584739 140025146283584 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10429/att-00/226545.sst): old prealloc_size = 147639500, real_size = 36406240 2024/11/22-20:38:22.585294 140025146283584 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10429/att-00/226545.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 926901 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.89 raw-val = 0.1083 GB zip-val = 0.0344 GB avg-val = 116.80 avg-zval = 37.14 2024/11/22-20:38:22.585339 140025146283584 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10429/att-00/226545.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-20:38:23.230676 140025146283584 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10429/att-00/226545.sst): second pass time = 1.84's, 58.819'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.65's, 57.691'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3274.908'MB/sec (index lex order gen) rebuild zvType time = 0.52's, 0.446'MB/sec write SST data time = 0.13's, 295.548'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 26677.537'MB/sec zip my value time = 1.84's, unzip length = 0.108'GB zip my value throughput = 58.819'MB/sec zip pipeline throughput = 105.072'MB/sec entries = 926901 avg-key = 28.00 avg-zkey = 1.89 avg-val = 116.80 avg-zval = 37.14 usrkeys = 926901 avg-key = 20.00 avg-zkey = 1.89 avg-val = 116.80 avg-zval = 37.14 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 8 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0344 GB dict = 1.08 MB all = 0.0373 GB } UnZip/Zip{ index = 10.5838 value = 3.1451 dict = 1.00 all = 3.6018 } Zip/UnZip{ index = 0.0945 value = 0.3180 dict = 1.00 all = 0.2776 } ---------------------------- total value len = 0.566687 GB avg = 0.122 KB (by entry num) total key len = 0.129971 GB avg = 0.028 KB total ukey len = 0.092837 GB avg = 0.020 KB total ukey num = 0.004641838 Billion total entry num = 0.004641838 Billion write speed all = 0.016446081 MB/sec (with seq num) write speed all = 0.015569438 MB/sec (without seq num) 2024/11/22-20:38:23.263145 140025146283584 [compaction_job.cc:1948] [default] [JOB 10429] Generated table #226545: 926901 keys, 37263818 bytes, temperature: kWarm 2024/11/22-20:38:23.263209 140025146283584 EVENT_LOG_v1 {"time_micros": 1732279103263176, "cf_name": "default", "job": 10429, "event": "table_file_creation", "file_number": 226545, "file_size": 37263818, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 34422800, "index_size": 1751552, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25953228, "raw_average_key_size": 28, "raw_value_size": 108264630, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 926901, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732279099, "oldest_key_time": 0, "file_creation_time": 1732279099, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 226545, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-20:38:23.301351 140025146283584 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10429/att-00/226546.sst) /dev/shm/ToplingTemp/Topling-282165-Jl8zoc 2024/11/22-20:38:24.142742 140025146283584 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10429/att-00/226546.sst): first pass time = 0.84's, 159.527'MB/sec 2024/11/22-20:38:25.957601 140025146283584 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10429/att-00/226546.sst): old prealloc_size = 147639500, real_size = 36426256 2024/11/22-20:38:25.958165 140025146283584 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10429/att-00/226546.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927074 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.89 raw-val = 0.1083 GB zip-val = 0.0344 GB avg-val = 116.78 avg-zval = 37.15 2024/11/22-20:38:25.958205 140025146283584 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10429/att-00/226546.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-20:38:26.602258 140025146283584 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10429/att-00/226546.sst): second pass time = 1.81's, 59.675'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.64's, 57.837'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3218.965'MB/sec (index lex order gen) rebuild zvType time = 0.52's, 0.446'MB/sec write SST data time = 0.12's, 298.377'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 30902.177'MB/sec zip my value time = 1.81's, unzip length = 0.108'GB zip my value throughput = 59.675'MB/sec zip pipeline throughput = 112.687'MB/sec entries = 927074 avg-key = 28.00 avg-zkey = 1.89 avg-val = 116.78 avg-zval = 37.15 usrkeys = 927074 avg-key = 20.00 avg-zkey = 1.89 avg-val = 116.78 avg-zval = 37.15 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0344 GB dict = 1.08 MB all = 0.0373 GB } UnZip/Zip{ index = 10.5819 value = 3.1432 dict = 1.00 all = 3.5999 } Zip/UnZip{ index = 0.0945 value = 0.3181 dict = 1.00 all = 0.2778 } ---------------------------- total value len = 0.674946 GB avg = 0.121 KB (by entry num) total key len = 0.155930 GB avg = 0.028 KB total ukey len = 0.111378 GB avg = 0.020 KB total ukey num = 0.005568912 Billion total entry num = 0.005568912 Billion write speed all = 0.019613013 MB/sec (with seq num) write speed all = 0.018561370 MB/sec (without seq num) 2024/11/22-20:38:26.636491 140025146283584 [compaction_job.cc:1948] [default] [JOB 10429] Generated table #226546: 927074 keys, 37284032 bytes, temperature: kWarm 2024/11/22-20:38:26.636557 140025146283584 EVENT_LOG_v1 {"time_micros": 1732279106636523, "cf_name": "default", "job": 10429, "event": "table_file_creation", "file_number": 226546, "file_size": 37284032, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 34442112, "index_size": 1752192, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25958072, "raw_average_key_size": 28, "raw_value_size": 108259712, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927074, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732279103, "oldest_key_time": 0, "file_creation_time": 1732279103, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 226546, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-20:38:26.674670 140025146283584 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10429/att-00/226547.sst) /dev/shm/ToplingTemp/Topling-282165-YDYd9b 2024/11/22-20:38:27.541966 140025146283584 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10429/att-00/226547.sst): first pass time = 0.87's, 154.762'MB/sec 2024/11/22-20:38:29.032839 140025146283584 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10429/att-00/226547.sst): old prealloc_size = 147639500, real_size = 34072544 2024/11/22-20:38:29.033420 140025146283584 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10429/att-00/226547.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 921415 prefix = 4 raw-key = 0.0147 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1084 GB zip-val = 0.0321 GB avg-val = 117.66 avg-zval = 34.83 2024/11/22-20:38:29.034039 140025146283584 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10429/att-00/226547.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-20:38:29.920617 140025146283584 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10429/att-00/226547.sst): second pass time = 1.49's, 72.758'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.89's, 42.116'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3142.911'MB/sec (index lex order gen) rebuild zvType time = 0.76's, 0.305'MB/sec write SST data time = 0.13's, 283.942'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.084'MB, throughput = 29647.126'MB/sec zip my value time = 1.49's, unzip length = 0.108'GB zip my value throughput = 72.758'MB/sec zip pipeline throughput = 72.758'MB/sec entries = 921415 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.66 avg-zval = 34.83 usrkeys = 921415 avg-key = 20.00 avg-zkey = 1.90 avg-val = 122.68 avg-zval = 34.83 TagRS{ kinds = RS_Key0_TagN bytes = 144080 } TagArray{ size = 659809 bytes = 2309344 } seq expand size = 4618663 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0184 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0321 GB dict = 1.08 MB all = 0.0374 GB } UnZip/Zip{ index = 10.5100 value = 3.3787 dict = 1.00 all = 3.5898 } Zip/UnZip{ index = 0.0951 value = 0.2960 dict = 1.00 all = 0.2786 } ---------------------------- total value len = 0.787983 GB avg = 0.121 KB (by entry num) total key len = 0.181729 GB avg = 0.028 KB total ukey len = 0.129807 GB avg = 0.020 KB total ukey num = 0.006490327 Billion total entry num = 0.006490327 Billion write speed all = 0.022888484 MB/sec (with seq num) write speed all = 0.021662935 MB/sec (without seq num) 2024/11/22-20:38:29.956502 140025146283584 [compaction_job.cc:1948] [default] [JOB 10429] Generated table #226547: 921415 keys, 37388658 bytes, temperature: kWarm 2024/11/22-20:38:29.956571 140025146283584 EVENT_LOG_v1 {"time_micros": 1732279109956534, "cf_name": "default", "job": 10429, "event": "table_file_creation", "file_number": 226547, "file_size": 37388658, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3440743926, "table_properties": {"data_size": 32088592, "index_size": 1753408, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25799620, "raw_average_key_size": 28, "raw_value_size": 108418122, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 921415, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732279106, "oldest_key_time": 0, "file_creation_time": 1732279106, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 226547, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-20:38:29.994016 140025146283584 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10429/att-00/226548.sst) /dev/shm/ToplingTemp/Topling-282165-s4d2sb 2024/11/22-20:38:30.841852 140025146283584 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10429/att-00/226548.sst): first pass time = 0.85's, 158.314'MB/sec 2024/11/22-20:38:32.311223 140025146283584 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10429/att-00/226548.sst): old prealloc_size = 147639500, real_size = 33254960 2024/11/22-20:38:32.311824 140025146283584 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10429/att-00/226548.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 926898 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1083 GB zip-val = 0.0312 GB avg-val = 116.80 avg-zval = 33.71 2024/11/22-20:38:32.312572 140025146283584 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10429/att-00/226548.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-20:38:33.277016 140025146283584 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10429/att-00/226548.sst): second pass time = 1.47's, 73.719'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.97's, 38.557'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3063.779'MB/sec (index lex order gen) rebuild zvType time = 0.83's, 0.278'MB/sec write SST data time = 0.13's, 282.979'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 31671.749'MB/sec zip my value time = 1.47's, unzip length = 0.108'GB zip my value throughput = 73.719'MB/sec zip pipeline throughput = 82.880'MB/sec entries = 926898 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.80 avg-zval = 33.71 usrkeys = 926898 avg-key = 20.00 avg-zkey = 1.91 avg-val = 123.80 avg-zval = 33.71 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 926898 bytes = 3128288 } seq expand size = 6488286 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0312 GB dict = 1.08 MB all = 0.0372 GB } UnZip/Zip{ index = 10.4441 value = 3.4647 dict = 1.00 all = 3.6044 } Zip/UnZip{ index = 0.0957 value = 0.2886 dict = 1.00 all = 0.2774 } ---------------------------- total value len = 0.902736 GB avg = 0.122 KB (by entry num) total key len = 0.207682 GB avg = 0.028 KB total ukey len = 0.148344 GB avg = 0.020 KB total ukey num = 0.007417225 Billion total entry num = 0.007417225 Billion write speed all = 0.026207546 MB/sec (with seq num) write speed all = 0.024807085 MB/sec (without seq num) 2024/11/22-20:38:33.309828 140025146283584 [compaction_job.cc:1948] [default] [JOB 10429] Generated table #226548: 926898 keys, 37237588 bytes, temperature: kWarm 2024/11/22-20:38:33.309895 140025146283584 EVENT_LOG_v1 {"time_micros": 1732279113309860, "cf_name": "default", "job": 10429, "event": "table_file_creation", "file_number": 226548, "file_size": 37237588, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3440744573, "largest_seqno": 3545479328, "table_properties": {"data_size": 31248096, "index_size": 1774976, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25953144, "raw_average_key_size": 28, "raw_value_size": 108264648, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 926898, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732279109, "oldest_key_time": 0, "file_creation_time": 1732279109, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 226548, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-20:38:33.344921 140025146283584 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10429/att-00/226549.sst) /dev/shm/ToplingTemp/Topling-282165-ZAt7sa 2024/11/22-20:38:34.178426 140025146283584 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10429/att-00/226549.sst): first pass time = 0.83's, 161.040'MB/sec 2024/11/22-20:38:35.617647 140025146283584 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10429/att-00/226549.sst): old prealloc_size = 147639500, real_size = 34174112 2024/11/22-20:38:35.618217 140025146283584 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10429/att-00/226549.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 925313 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1083 GB zip-val = 0.0322 GB avg-val = 117.05 avg-zval = 34.77 2024/11/22-20:38:35.619006 140025146283584 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10429/att-00/226549.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-20:38:36.544729 140025146283584 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10429/att-00/226549.sst): second pass time = 1.44's, 75.292'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.93's, 41.403'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3235.522'MB/sec (index lex order gen) rebuild zvType time = 0.80's, 0.290'MB/sec write SST data time = 0.13's, 297.203'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 32724.101'MB/sec zip my value time = 1.44's, unzip length = 0.108'GB zip my value throughput = 75.292'MB/sec zip pipeline throughput = 75.292'MB/sec entries = 925313 avg-key = 28.00 avg-zkey = 1.92 avg-val = 117.05 avg-zval = 34.77 usrkeys = 925313 avg-key = 20.00 avg-zkey = 1.92 avg-val = 124.05 avg-zval = 34.77 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 925313 bytes = 3354272 } seq expand size = 6477191 multi value expand size = 0 cnt WriteAppend = 15 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0322 GB dict = 1.08 MB all = 0.0384 GB } UnZip/Zip{ index = 10.4428 value = 3.3667 dict = 1.00 all = 3.4968 } Zip/UnZip{ index = 0.0958 value = 0.2970 dict = 1.00 all = 0.2860 } ---------------------------- total value len = 1.017522 GB avg = 0.122 KB (by entry num) total key len = 0.233591 GB avg = 0.028 KB total ukey len = 0.166851 GB avg = 0.020 KB total ukey num = 0.008342538 Billion total entry num = 0.008342538 Billion write speed all = 0.029525883 MB/sec (with seq num) write speed all = 0.027950833 MB/sec (without seq num) 2024/11/22-20:38:36.578143 140025146283584 [compaction_job.cc:1948] [default] [JOB 10429] Generated table #226549: 925313 keys, 38383448 bytes, temperature: kWarm 2024/11/22-20:38:36.578206 140025146283584 EVENT_LOG_v1 {"time_micros": 1732279116578174, "cf_name": "default", "job": 10429, "event": "table_file_creation", "file_number": 226549, "file_size": 38383448, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3273701386, "largest_seqno": 3545478666, "table_properties": {"data_size": 32170448, "index_size": 1772160, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25908764, "raw_average_key_size": 28, "raw_value_size": 108309046, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 925313, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732279113, "oldest_key_time": 0, "file_creation_time": 1732279113, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 226549, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-20:38:36.613270 140025146283584 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10429/att-00/226550.sst) /dev/shm/ToplingTemp/Topling-282165-cOyQXd 2024/11/22-20:38:36.705843 140025146283584 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10429/att-00/226550.sst): first pass time = 0.09's, 237.638'MB/sec 2024/11/22-20:38:36.899581 140025146283584 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10429/att-00/226550.sst): old prealloc_size = 147639500, real_size = 6428032 2024/11/22-20:38:36.899722 140025146283584 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10429/att-00/226550.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 150607 prefix = 4 raw-key = 0.0024 GB zip-key = 0.0003 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.0178 GB zip-val = 0.0061 GB avg-val = 118.00 avg-zval = 40.51 2024/11/22-20:38:36.899885 140025146283584 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10429/att-00/226550.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.022 GB 2024/11/22-20:38:37.044834 140025146283584 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10429/att-00/226550.sst): second pass time = 0.19's, 92.032'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.15's, 48.537'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2496.867'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.305'MB/sec write SST data time = 0.02's, 327.821'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.186'MB, throughput = 3844.916'MB/sec zip my value time = 0.19's, unzip length = 0.018'GB zip my value throughput = 92.032'MB/sec zip pipeline throughput = 92.032'MB/sec entries = 150607 avg-key = 28.00 avg-zkey = 1.92 avg-val = 118.00 avg-zval = 40.51 usrkeys = 150607 avg-key = 20.00 avg-zkey = 1.92 avg-val = 125.00 avg-zval = 40.51 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 150607 bytes = 470656 } seq expand size = 1054249 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0030 GB value = 0.0178 GB dict = 0.19 MB all = 0.0220 GB } __ZipSize{ index = 0.0003 GB value = 0.0061 GB dict = 0.19 MB all = 0.0070 GB } UnZip/Zip{ index = 10.3987 value = 2.9131 dict = 1.00 all = 3.1194 } Zip/UnZip{ index = 0.0962 value = 0.3433 dict = 1.00 all = 0.3206 } ---------------------------- total value len = 1.036348 GB avg = 0.122 KB (by entry num) total key len = 0.237808 GB avg = 0.028 KB total ukey len = 0.169863 GB avg = 0.020 KB total ukey num = 0.008493145 Billion total entry num = 0.008493145 Billion write speed all = 0.030069332 MB/sec (with seq num) write speed all = 0.028465867 MB/sec (without seq num) 2024/11/22-20:38:37.057678 140025146283584 [compaction_job.cc:1948] [default] [JOB 10429] Generated table #226550: 150607 keys, 7048999 bytes, temperature: kWarm 2024/11/22-20:38:37.057737 140025146283584 EVENT_LOG_v1 {"time_micros": 1732279117057705, "cf_name": "default", "job": 10429, "event": "table_file_creation", "file_number": 226550, "file_size": 7048999, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3426869336, "largest_seqno": 3457595389, "table_properties": {"data_size": 6100528, "index_size": 289664, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 4216996, "raw_average_key_size": 28, "raw_value_size": 17771626, "raw_average_value_size": 118, "num_data_blocks": 1, "num_entries": 150607, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 118, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732279116, "oldest_key_time": 0, "file_creation_time": 1732279116, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 226550, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-20:38:37.069945 140025146283584 [compaction_job.cc:703] job-10429: subcompact[0], size: 0.351197 G, files: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10429/att-00 [226541,226542,226543,226544,226545,226546,226547,226548,226549,226550] 2024/11/22-20:38:37.136474 140025146283584 (Original Log Time 2024/11/22-20:38:05.921606) EVENT_LOG_v1 {"time_micros": 1732279085921562, "job": 10429, "event": "compaction_started", "compaction_reason": "FilesMarkedForCompaction", "files_L2": [226476], "files_L3": [226400, 226402, 226435, 226436, 226437, 226438, 226439, 226440, 226523], "score": 0.998153, "input_data_size": 368236030, "oldest_snapshot_seqno": 3546105671} 2024/11/22-20:38:37.136477 140025146283584 (Original Log Time 2024/11/22-20:38:37.135852) [compaction_job.cc:2022] [default] [JOB 10429] Compacted 1@2 + 9@3 files to L3 => 351196701 bytes 2024/11/22-20:38:37.136479 140025146283584 (Original Log Time 2024/11/22-20:38:37.136409) [compaction_job.cc:1224] [default] compacted to: files[0 0 0 10 0 0 0] max score 0.01, MB/sec: 11.8 rd, 11.3 wr, level 3, files in(1, 9) out(10 +0 blob) MB in(23.6, 327.6 +0.0 blob) out(334.9 +0.0 blob), read-write-amplify(29.0) write-amplify(14.2) OK, records in: 8544104, records dropped: 50959 output_compression: Snappy 2024/11/22-20:38:37.136485 140025146283584 (Original Log Time 2024/11/22-20:38:37.136454) EVENT_LOG_v1 {"time_micros": 1732279117136434, "cf": "default", "job": 10429, "event": "compaction_finished", "compaction_time_micros": 31148348, "compaction_time_cpu_micros": 12949691, "output_level": 3, "num_output_files": 10, "total_output_size": 351196701, "num_input_records": 8544104, "num_output_records": 8493145, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "file_write_nanos": 225006111, "file_range_sync_nanos": 0, "file_fsync_nanos": 9734, "file_prepare_write_nanos": 21095, "lsm_state": [0, 0, 0, 10, 0, 0, 0]} 2024/11/22-20:38:37.272827 140025146283584 DEBG dcompact_worker.cpp:240: HttpPost: 200 OK: url = http://nlb-7zny4kaa1poal01o64.cn-shenzhen.nlb.aliyuncs.com:8443, body = {"instanceId":"nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137","labourId":"","dbId":"d89b4006-2803-486e-b7a2-759bcf348921","dbStarts":1732256054,"starts":1732279085,"executesMs":31357,"compactionJobId":10429,"attempt":0,"compactionInputRawBytes":1237184912,"compactionInputZipBytes":368236030,"compactionOutputRawBytes":0,"compactionOutputZipBytes":351196701,"headers":{"Accept":"*/*","Connection":"close","Host":"aliyun-topling-saas.topling.cn:18443","RemoteIp":"120.24.192.169","X-Forwarded-For":"120.24.192.169","region":"cn-shenzhen","token":"e6474c481bd4415abc537135cc03626b","instance-token":"e6474c481bd4415abc537135cc03626b","provider":"aliyun","CloudMarketInstanceId":"si-59c0ae5c955845588903","MeteringAssit":"","Transfer-Encoding":"chunked","traceparent":"00-979f85c3de4072329f2efdefa46c6224-85ef3aab0bde250a-00"}}, response = 2024/11/22-20:38:37.272918 140025146283584 INFO dcompact_worker.cpp:1459: finish /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-10429/att-00: olev 3, work 31.358 s, result 6.405 ms, install 0.654 ms, input{raw 1.152 GiB zip 351.177 MiB}