2024/11/23-12:27:21.690453 139957659977280 DEBG dcompact_worker.cpp:2214: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-25987/att-00: fork to child time = 0.007437 sec 2024/11/23-12:27:21.691164 139957659977280 DEBG dcompact_worker.cpp:1013: Beg SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-25987/att-00 2024/11/23-12:27:21.698117 139957659977280 DEBG dcompact_worker.cpp:1033: End SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-25987/att-00 2024/11/23-12:27:21.699021 139957659977280 TRAC dcompact_worker.cpp:1083: INFO_LOG_LEVEL: rpc = INFO_LEVEL, env_var = undefined 2024/11/23-12:27:21.699283 139957659977280 [WARN] [column_family.cc:386] multiple cf_paths/db_paths and level_compaction_dynamic_level_bytes can't be used together 2024/11/23-12:27:21.753363 139957659977280 [version_set.cc:6208] Recovering from manifest file: /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-25987/att-00/MANIFEST-206347 2024/11/23-12:27:21.784473 139957659977280 [version_set.cc:6251] Recovered from manifest file:/worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-25987/att-00/MANIFEST-206347 succeeded,manifest_file_number is 206347, next_file_number is 259482, last_sequence is 3974029369, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 259269 2024/11/23-12:27:21.784479 139957659977280 [version_set.cc:6266] Column family [default] (ID 0), log number is 0 2024/11/23-12:27:21.784581 139957659977280 [version_set.cc:5721] Creating manifest 259482 2024/11/23-12:27:21.834277 139957659977280 DEBG dcompact_worker.cpp:1218: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-25987/att-00: bottommost_level: fake = 1, rpc = 0 2024/11/23-12:27:21.855756 139957659977280 [compaction_job.cc:2437] [default] [JOB 25987] Compacting 1@2 + 14@3 files to L3, score 1.00, subcompactions 1 : 1 2024/11/23-12:27:21.855769 139957659977280 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 19481 Base level 2, inputs: [259414(25MB)], [259479(34MB) 259480(8672KB) 259369(36MB) 259370(33MB) 259371(35MB) 259372(35MB) 259373(35MB) 259374(36MB) 259375(33MB) 259376(34MB) 259377(33MB) 259378(33MB) 259379(33MB) 259458(35MB)] 2024/11/23-12:27:21.861896 139957659977280 [top_zip_table.cc:59] core git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-12:27:21.861926 139957659977280 [top_zip_table.cc:60] fsa git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-12:27:21.861945 139957659977280 [top_zip_table.cc:61] zbs git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-12:27:21.861951 139957659977280 [top_zip_table.cc:62] topling-zip_table_reader: git_version_hash_info_is: commit a4a382006cb82713acf5b3425835f22711877681 Author: leipeng Date: 2024-04-11 19:44:14 +0800 fixed_len_hole_index.cc: Add env bool FixedLenHoleIndexUseAVX512 for ut & debug 1. FixedLenHoleIndexUseAVX512 is only in unit tests or debug 2. In release mode, use avx512 by compile options(-march=) g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/23-12:27:21.861961 139957659977280 [top_zip_table.cc:64] topling-rocks git_version_hash_info_is: commit feab587e468621ba0204d47b4ffacc52e7c4290d Author: leipeng Date: 2024-03-22 13:35:06 +0800 ToplingZipTableBuilder::Add: immediately return after error This function returns void, and caller does not check builder->status() after calling this function and graceful abandon. So immediately return after error, and return error status in Finish(). g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/23-12:27:22.413188 139957659977280 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-25987/att-00/259483.sst) /dev/shm/ToplingTemp/Topling-48313-5Eiuhn 2024/11/23-12:27:22.980058 139957659977280 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-25987/att-00/259483.sst): first pass time = 0.57's, 236.788'MB/sec 2024/11/23-12:27:24.452172 139957659977280 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-25987/att-00/259483.sst): old prealloc_size = 147639500, real_size = 31819232 2024/11/23-12:27:24.452709 139957659977280 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-25987/att-00/259483.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 937229 prefix = 4 raw-key = 0.0150 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1080 GB zip-val = 0.0298 GB avg-val = 115.21 avg-zval = 31.79 2024/11/23-12:27:24.453578 139957659977280 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-25987/att-00/259483.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-12:27:25.515264 139957659977280 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-25987/att-00/259483.sst): second pass time = 1.47's, 73.392'MB/sec, value only(80.4% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.06's, 33.925'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3485.823'MB/sec (index lex order gen) rebuild zvType time = 0.94's, 0.250'MB/sec write SST data time = 0.13's, 286.407'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.077'MB, throughput = 35909.555'MB/sec zip my value time = 1.47's, unzip length = 0.108'GB zip my value throughput = 73.392'MB/sec zip pipeline throughput = 73.392'MB/sec entries = 937229 avg-key = 28.00 avg-zkey = 1.91 avg-val = 115.21 avg-zval = 31.79 usrkeys = 937229 avg-key = 20.00 avg-zkey = 1.91 avg-val = 122.21 avg-zval = 31.79 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 937229 bytes = 3397472 } seq expand size = 6560603 multi value expand size = 0 cnt WriteAppend = 15 UnZipSize{ index = 0.0187 GB value = 0.1080 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0298 GB dict = 1.08 MB all = 0.0361 GB } UnZip/Zip{ index = 10.4460 value = 3.6245 dict = 1.00 all = 3.7215 } Zip/UnZip{ index = 0.0957 value = 0.2759 dict = 1.00 all = 0.2687 } ---------------------------- total value len = 8.963156 GB avg = 0.168 KB (by entry num) total key len = 1.467063 GB avg = 0.028 KB total ukey len = 1.016623 GB avg = 0.015 KB total ukey num = 0.066487664 Billion total entry num = 0.053295393 Billion write speed all = 0.819129277 MB/sec (with seq num) write speed all = 0.785645174 MB/sec (without seq num) 2024/11/23-12:27:25.564810 139957659977280 [compaction_job.cc:1948] [default] [JOB 25987] Generated table #259483: 937229 keys, 36065052 bytes, temperature: kWarm 2024/11/23-12:27:25.564905 139957659977280 EVENT_LOG_v1 {"time_micros": 1732336045564846, "cf_name": "default", "job": 25987, "event": "table_file_creation", "file_number": 259483, "file_size": 36065052, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3621075956, "largest_seqno": 3973691517, "table_properties": {"data_size": 29790288, "index_size": 1794432, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26242412, "raw_average_key_size": 28, "raw_value_size": 107975438, "raw_average_value_size": 115, "num_data_blocks": 1, "num_entries": 937229, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732336042, "oldest_key_time": 0, "file_creation_time": 1732336042, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 259483, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-12:27:25.599241 139957659977280 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-25987/att-00/259484.sst) /dev/shm/ToplingTemp/Topling-48313-9Iainn 2024/11/23-12:27:26.635143 139957659977280 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-25987/att-00/259484.sst): first pass time = 1.04's, 129.570'MB/sec 2024/11/23-12:27:28.264737 139957659977280 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-25987/att-00/259484.sst): old prealloc_size = 147639500, real_size = 34732656 2024/11/23-12:27:28.265495 139957659977280 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-25987/att-00/259484.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 930901 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.93 raw-val = 0.1082 GB zip-val = 0.0327 GB avg-val = 116.18 avg-zval = 35.13 2024/11/23-12:27:28.266418 139957659977280 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-25987/att-00/259484.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-12:27:29.315196 139957659977280 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-25987/att-00/259484.sst): second pass time = 1.63's, 66.402'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.05's, 37.199'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2434.246'MB/sec (index lex order gen) rebuild zvType time = 0.90's, 0.260'MB/sec write SST data time = 0.15's, 252.713'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 37860.735'MB/sec zip my value time = 1.63's, unzip length = 0.108'GB zip my value throughput = 66.402'MB/sec zip pipeline throughput = 66.402'MB/sec entries = 930901 avg-key = 28.00 avg-zkey = 1.93 avg-val = 116.18 avg-zval = 35.13 usrkeys = 930901 avg-key = 20.00 avg-zkey = 1.93 avg-val = 123.18 avg-zval = 35.13 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 930901 bytes = 3490896 } seq expand size = 6516307 multi value expand size = 0 cnt WriteAppend = 16 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0327 GB dict = 1.08 MB all = 0.0391 GB } UnZip/Zip{ index = 10.3795 value = 3.3068 dict = 1.00 all = 3.4349 } Zip/UnZip{ index = 0.0963 value = 0.3024 dict = 1.00 all = 0.2911 } ---------------------------- total value len = 9.077825 GB avg = 0.167 KB (by entry num) total key len = 1.493129 GB avg = 0.028 KB total ukey len = 1.035241 GB avg = 0.015 KB total ukey num = 0.067418565 Billion total entry num = 0.054226294 Billion write speed all = 0.829934048 MB/sec (with seq num) write speed all = 0.795875249 MB/sec (without seq num) 2024/11/23-12:27:29.369325 139957659977280 [compaction_job.cc:1948] [default] [JOB 25987] Generated table #259484: 930901 keys, 39074886 bytes, temperature: kWarm 2024/11/23-12:27:29.369407 139957659977280 EVENT_LOG_v1 {"time_micros": 1732336049369355, "cf_name": "default", "job": 25987, "event": "table_file_creation", "file_number": 259484, "file_size": 39074886, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3376774746, "largest_seqno": 3973691546, "table_properties": {"data_size": 32706016, "index_size": 1793728, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26065228, "raw_average_key_size": 28, "raw_value_size": 108152554, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 930901, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732336045, "oldest_key_time": 0, "file_creation_time": 1732336045, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 259484, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-12:27:29.404321 139957659977280 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-25987/att-00/259485.sst) /dev/shm/ToplingTemp/Topling-48313-7kxRIm 2024/11/23-12:27:30.398013 139957659977280 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-25987/att-00/259485.sst): first pass time = 0.99's, 135.076'MB/sec 2024/11/23-12:27:31.721623 139957659977280 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-25987/att-00/259485.sst): old prealloc_size = 147639500, real_size = 30954960 2024/11/23-12:27:31.722172 139957659977280 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-25987/att-00/259485.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 925287 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1083 GB zip-val = 0.0290 GB avg-val = 117.06 avg-zval = 31.29 2024/11/23-12:27:31.722946 139957659977280 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-25987/att-00/259485.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-12:27:32.537504 139957659977280 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-25987/att-00/259485.sst): second pass time = 1.32's, 81.885'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.82's, 42.957'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3369.645'MB/sec (index lex order gen) rebuild zvType time = 0.69's, 0.334'MB/sec write SST data time = 0.12's, 283.711'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 37846.003'MB/sec zip my value time = 1.32's, unzip length = 0.108'GB zip my value throughput = 81.885'MB/sec zip pipeline throughput = 81.885'MB/sec entries = 925287 avg-key = 28.00 avg-zkey = 1.91 avg-val = 117.06 avg-zval = 31.29 usrkeys = 925287 avg-key = 20.00 avg-zkey = 1.91 avg-val = 124.06 avg-zval = 31.29 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 925287 bytes = 3238512 } seq expand size = 6477009 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0290 GB dict = 1.08 MB all = 0.0350 GB } UnZip/Zip{ index = 10.4455 value = 3.7410 dict = 1.00 all = 3.8297 } Zip/UnZip{ index = 0.0957 value = 0.2673 dict = 1.00 all = 0.2611 } ---------------------------- total value len = 9.192612 GB avg = 0.167 KB (by entry num) total key len = 1.519037 GB avg = 0.028 KB total ukey len = 1.053746 GB avg = 0.015 KB total ukey num = 0.068343852 Billion total entry num = 0.055151581 Billion write speed all = 0.840767413 MB/sec (with seq num) write speed all = 0.806136214 MB/sec (without seq num) 2024/11/23-12:27:32.584014 139957659977280 [compaction_job.cc:1948] [default] [JOB 25987] Generated table #259485: 925287 keys, 35046940 bytes, temperature: kWarm 2024/11/23-12:27:32.584085 139957659977280 EVENT_LOG_v1 {"time_micros": 1732336052584050, "cf_name": "default", "job": 25987, "event": "table_file_creation", "file_number": 259485, "file_size": 35046940, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3831817090, "largest_seqno": 3973691558, "table_properties": {"data_size": 28951808, "index_size": 1771648, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25908036, "raw_average_key_size": 28, "raw_value_size": 108309822, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 925287, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732336049, "oldest_key_time": 0, "file_creation_time": 1732336049, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 259485, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-12:27:32.618763 139957659977280 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-25987/att-00/259486.sst) /dev/shm/ToplingTemp/Topling-48313-Wl6Urn 2024/11/23-12:27:33.456265 139957659977280 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-25987/att-00/259486.sst): first pass time = 0.84's, 160.266'MB/sec 2024/11/23-12:27:34.797304 139957659977280 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-25987/att-00/259486.sst): old prealloc_size = 147639500, real_size = 34007472 2024/11/23-12:27:34.797836 139957659977280 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-25987/att-00/259486.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 932899 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1081 GB zip-val = 0.0320 GB avg-val = 115.87 avg-zval = 34.30 2024/11/23-12:27:34.798506 139957659977280 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-25987/att-00/259486.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-12:27:35.616832 139957659977280 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-25987/att-00/259486.sst): second pass time = 1.34's, 80.653'MB/sec, value only(80.5% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.82's, 45.720'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3467.420'MB/sec (index lex order gen) rebuild zvType time = 0.69's, 0.337'MB/sec write SST data time = 0.13's, 294.427'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 33846.676'MB/sec zip my value time = 1.34's, unzip length = 0.108'GB zip my value throughput = 80.653'MB/sec zip pipeline throughput = 80.653'MB/sec entries = 932899 avg-key = 28.00 avg-zkey = 1.90 avg-val = 115.87 avg-zval = 34.30 usrkeys = 932899 avg-key = 20.00 avg-zkey = 1.90 avg-val = 121.15 avg-zval = 34.30 TagRS{ kinds = RS_Key0_TagN bytes = 145880 } TagArray{ size = 702979 bytes = 2460448 } seq expand size = 4920853 multi value expand size = 0 cnt WriteAppend = 17 UnZipSize{ index = 0.0187 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0320 GB dict = 1.08 MB all = 0.0375 GB } UnZip/Zip{ index = 10.5159 value = 3.3780 dict = 1.00 all = 3.5822 } Zip/UnZip{ index = 0.0951 value = 0.2960 dict = 1.00 all = 0.2792 } ---------------------------- total value len = 9.305629 GB avg = 0.166 KB (by entry num) total key len = 1.545158 GB avg = 0.028 KB total ukey len = 1.072404 GB avg = 0.015 KB total ukey num = 0.069276751 Billion total entry num = 0.056084480 Billion write speed all = 0.851482732 MB/sec (with seq num) write speed all = 0.816274251 MB/sec (without seq num) 2024/11/23-12:27:35.665308 139957659977280 [compaction_job.cc:1948] [default] [JOB 25987] Generated table #259486: 932899 keys, 37467808 bytes, temperature: kWarm 2024/11/23-12:27:35.665382 139957659977280 EVENT_LOG_v1 {"time_micros": 1732336055665340, "cf_name": "default", "job": 25987, "event": "table_file_creation", "file_number": 259486, "file_size": 37467808, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3973691571, "table_properties": {"data_size": 31999776, "index_size": 1774272, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26121172, "raw_average_key_size": 28, "raw_value_size": 108096602, "raw_average_value_size": 115, "num_data_blocks": 1, "num_entries": 932899, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732336052, "oldest_key_time": 0, "file_creation_time": 1732336052, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 259486, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-12:27:35.703672 139957659977280 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-25987/att-00/259487.sst) /dev/shm/ToplingTemp/Topling-48313-r9lelq 2024/11/23-12:27:36.653067 139957659977280 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-25987/att-00/259487.sst): first pass time = 0.95's, 141.378'MB/sec 2024/11/23-12:27:38.034029 139957659977280 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-25987/att-00/259487.sst): old prealloc_size = 147639500, real_size = 34944080 2024/11/23-12:27:38.034638 139957659977280 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-25987/att-00/259487.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 1081418 prefix = 4 raw-key = 0.0173 GB zip-key = 0.0021 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1039 GB zip-val = 0.0326 GB avg-val = 96.11 avg-zval = 30.15 2024/11/23-12:27:38.034676 139957659977280 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-25987/att-00/259487.sst: sumWaitingMem = 0.003 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0028 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-12:27:38.712272 139957659977280 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-25987/att-00/259487.sst): second pass time = 1.38's, 75.309'MB/sec, value only(77.4% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.68's, 52.668'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3538.104'MB/sec (index lex order gen) rebuild zvType time = 0.54's, 0.499'MB/sec write SST data time = 0.14's, 262.284'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.036'MB, throughput = 32860.356'MB/sec zip my value time = 1.38's, unzip length = 0.104'GB zip my value throughput = 75.309'MB/sec zip pipeline throughput = 75.309'MB/sec entries = 1081418 avg-key = 28.00 avg-zkey = 1.91 avg-val = 96.11 avg-zval = 30.15 usrkeys = 1081418 avg-key = 20.00 avg-zkey = 1.91 avg-val = 96.11 avg-zval = 30.15 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0216 GB value = 0.1039 GB dict = 1.04 MB all = 0.1342 GB } __ZipSize{ index = 0.0021 GB value = 0.0326 GB dict = 1.04 MB all = 0.0357 GB } UnZip/Zip{ index = 10.4471 value = 3.1880 dict = 1.00 all = 3.7574 } Zip/UnZip{ index = 0.0957 value = 0.3137 dict = 1.00 all = 0.2661 } ---------------------------- total value len = 9.409567 GB avg = 0.165 KB (by entry num) total key len = 1.575438 GB avg = 0.028 KB total ukey len = 1.094033 GB avg = 0.016 KB total ukey num = 0.070358169 Billion total entry num = 0.057165898 Billion write speed all = 0.861805732 MB/sec (with seq num) write speed all = 0.825927078 MB/sec (without seq num) 2024/11/23-12:27:38.757447 139957659977280 [compaction_job.cc:1948] [default] [JOB 25987] Generated table #259487: 1081418 keys, 35720531 bytes, temperature: kWarm 2024/11/23-12:27:38.757514 139957659977280 EVENT_LOG_v1 {"time_micros": 1732336058757480, "cf_name": "default", "job": 25987, "event": "table_file_creation", "file_number": 259487, "file_size": 35720531, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 32603264, "index_size": 2070272, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 30279704, "raw_average_key_size": 28, "raw_value_size": 103938101, "raw_average_value_size": 96, "num_data_blocks": 1, "num_entries": 1081418, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732336055, "oldest_key_time": 0, "file_creation_time": 1732336055, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 259487, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-12:27:38.801454 139957659977280 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-25987/att-00/259488.sst) /dev/shm/ToplingTemp/Topling-48313-exaeSo 2024/11/23-12:27:39.789303 139957659977280 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-25987/att-00/259488.sst): first pass time = 0.99's, 135.874'MB/sec 2024/11/23-12:27:41.102080 139957659977280 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-25987/att-00/259488.sst): old prealloc_size = 147639500, real_size = 31925824 2024/11/23-12:27:41.102614 139957659977280 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-25987/att-00/259488.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 930024 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0299 GB avg-val = 116.32 avg-zval = 32.18 2024/11/23-12:27:41.103409 139957659977280 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-25987/att-00/259488.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-12:27:41.934112 139957659977280 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-25987/att-00/259488.sst): second pass time = 1.31's, 82.451'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.83's, 43.420'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3441.077'MB/sec (index lex order gen) rebuild zvType time = 0.70's, 0.331'MB/sec write SST data time = 0.13's, 281.231'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 34302.356'MB/sec zip my value time = 1.31's, unzip length = 0.108'GB zip my value throughput = 82.451'MB/sec zip pipeline throughput = 82.451'MB/sec entries = 930024 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.32 avg-zval = 32.18 usrkeys = 930024 avg-key = 20.00 avg-zkey = 1.90 avg-val = 122.74 avg-zval = 32.18 TagRS{ kinds = RS_Key0_TagN bytes = 145400 } TagArray{ size = 852959 bytes = 3198608 } seq expand size = 5970713 multi value expand size = 0 cnt WriteAppend = 15 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0299 GB dict = 1.08 MB all = 0.0361 GB } UnZip/Zip{ index = 10.5134 value = 3.6151 dict = 1.00 all = 3.7153 } Zip/UnZip{ index = 0.0951 value = 0.2766 dict = 1.00 all = 0.2692 } ---------------------------- total value len = 9.523715 GB avg = 0.164 KB (by entry num) total key len = 1.601478 GB avg = 0.028 KB total ukey len = 1.112633 GB avg = 0.016 KB total ukey num = 0.071288193 Billion total entry num = 0.058095922 Billion write speed all = 0.872583373 MB/sec (with seq num) write speed all = 0.836130228 MB/sec (without seq num) 2024/11/23-12:27:41.977890 139957659977280 [compaction_job.cc:1948] [default] [JOB 25987] Generated table #259488: 930024 keys, 36125776 bytes, temperature: kWarm 2024/11/23-12:27:41.977960 139957659977280 EVENT_LOG_v1 {"time_micros": 1732336061977924, "cf_name": "default", "job": 25987, "event": "table_file_creation", "file_number": 259488, "file_size": 36125776, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3973690829, "table_properties": {"data_size": 29923888, "index_size": 1769216, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26040672, "raw_average_key_size": 28, "raw_value_size": 108177120, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 930024, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732336058, "oldest_key_time": 0, "file_creation_time": 1732336058, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 259488, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-12:27:42.013466 139957659977280 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-25987/att-00/259489.sst) /dev/shm/ToplingTemp/Topling-48313-Bs95kq 2024/11/23-12:27:43.048565 139957659977280 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-25987/att-00/259489.sst): first pass time = 1.04's, 129.671'MB/sec 2024/11/23-12:27:44.361592 139957659977280 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-25987/att-00/259489.sst): old prealloc_size = 147639500, real_size = 33013600 2024/11/23-12:27:44.362125 139957659977280 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-25987/att-00/259489.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 929918 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0310 GB avg-val = 116.33 avg-zval = 33.35 2024/11/23-12:27:44.362948 139957659977280 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-25987/att-00/259489.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-12:27:45.217840 139957659977280 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-25987/att-00/259489.sst): second pass time = 1.31's, 82.438'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.86's, 43.354'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3429.092'MB/sec (index lex order gen) rebuild zvType time = 0.73's, 0.317'MB/sec write SST data time = 0.12's, 300.924'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 38479.746'MB/sec zip my value time = 1.31's, unzip length = 0.108'GB zip my value throughput = 82.438'MB/sec zip pipeline throughput = 82.438'MB/sec entries = 929918 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.33 avg-zval = 33.35 usrkeys = 929918 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.33 avg-zval = 33.35 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 929918 bytes = 3254720 } seq expand size = 6509426 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0310 GB dict = 1.08 MB all = 0.0371 GB } UnZip/Zip{ index = 10.5133 value = 3.4883 dict = 1.00 all = 3.6157 } Zip/UnZip{ index = 0.0951 value = 0.2867 dict = 1.00 all = 0.2766 } ---------------------------- total value len = 9.638404 GB avg = 0.163 KB (by entry num) total key len = 1.627516 GB avg = 0.028 KB total ukey len = 1.131232 GB avg = 0.016 KB total ukey num = 0.072218111 Billion total entry num = 0.059025840 Billion write speed all = 0.883393529 MB/sec (with seq num) write speed all = 0.846366429 MB/sec (without seq num) 2024/11/23-12:27:45.263096 139957659977280 [compaction_job.cc:1948] [default] [JOB 25987] Generated table #259489: 929918 keys, 37120806 bytes, temperature: kWarm 2024/11/23-12:27:45.263163 139957659977280 EVENT_LOG_v1 {"time_micros": 1732336065263129, "cf_name": "default", "job": 25987, "event": "table_file_creation", "file_number": 259489, "file_size": 37120806, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3799154430, "largest_seqno": 3973691360, "table_properties": {"data_size": 31011920, "index_size": 1769024, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26037704, "raw_average_key_size": 28, "raw_value_size": 108180144, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 929918, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732336062, "oldest_key_time": 0, "file_creation_time": 1732336062, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 259489, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-12:27:45.298299 139957659977280 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-25987/att-00/259490.sst) /dev/shm/ToplingTemp/Topling-48313-N7zoGp 2024/11/23-12:27:46.291119 139957659977280 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-25987/att-00/259490.sst): first pass time = 0.99's, 135.194'MB/sec 2024/11/23-12:27:47.602095 139957659977280 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-25987/att-00/259490.sst): old prealloc_size = 147639500, real_size = 32746128 2024/11/23-12:27:47.602600 139957659977280 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-25987/att-00/259490.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 922679 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1084 GB zip-val = 0.0308 GB avg-val = 117.47 avg-zval = 33.34 2024/11/23-12:27:47.603436 139957659977280 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-25987/att-00/259490.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-12:27:48.429367 139957659977280 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-25987/att-00/259490.sst): second pass time = 1.31's, 82.726'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.83's, 44.805'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3635.888'MB/sec (index lex order gen) rebuild zvType time = 0.70's, 0.328'MB/sec write SST data time = 0.12's, 302.542'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.083'MB, throughput = 32818.680'MB/sec zip my value time = 1.31's, unzip length = 0.108'GB zip my value throughput = 82.726'MB/sec zip pipeline throughput = 82.726'MB/sec entries = 922679 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.47 avg-zval = 33.34 usrkeys = 922679 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.47 avg-zval = 33.34 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 922679 bytes = 3460064 } seq expand size = 6458753 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0308 GB dict = 1.08 MB all = 0.0371 GB } UnZip/Zip{ index = 10.5125 value = 3.5235 dict = 1.00 all = 3.6212 } Zip/UnZip{ index = 0.0951 value = 0.2838 dict = 1.00 all = 0.2762 } ---------------------------- total value len = 9.753246 GB avg = 0.163 KB (by entry num) total key len = 1.653351 GB avg = 0.028 KB total ukey len = 1.149685 GB avg = 0.016 KB total ukey num = 0.073140790 Billion total entry num = 0.059948519 Billion write speed all = 0.894199200 MB/sec (with seq num) write speed all = 0.856602768 MB/sec (without seq num) 2024/11/23-12:27:48.475277 139957659977280 [compaction_job.cc:1948] [default] [JOB 25987] Generated table #259490: 922679 keys, 37064246 bytes, temperature: kWarm 2024/11/23-12:27:48.475346 139957659977280 EVENT_LOG_v1 {"time_micros": 1732336068475311, "cf_name": "default", "job": 25987, "event": "table_file_creation", "file_number": 259490, "file_size": 37064246, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3273701103, "largest_seqno": 3973691273, "table_properties": {"data_size": 30759872, "index_size": 1755392, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25835012, "raw_average_key_size": 28, "raw_value_size": 108382726, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 922679, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732336065, "oldest_key_time": 0, "file_creation_time": 1732336065, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 259490, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-12:27:48.510749 139957659977280 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-25987/att-00/259491.sst) /dev/shm/ToplingTemp/Topling-48313-5cHgxn 2024/11/23-12:27:49.325967 139957659977280 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-25987/att-00/259491.sst): first pass time = 0.82's, 164.649'MB/sec 2024/11/23-12:27:50.608389 139957659977280 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-25987/att-00/259491.sst): old prealloc_size = 147639500, real_size = 32523472 2024/11/23-12:27:50.608896 139957659977280 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-25987/att-00/259491.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 931031 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1081 GB zip-val = 0.0305 GB avg-val = 116.16 avg-zval = 32.78 2024/11/23-12:27:50.609699 139957659977280 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-25987/att-00/259491.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-12:27:51.460255 139957659977280 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-25987/att-00/259491.sst): second pass time = 1.28's, 84.387'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.85's, 43.141'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3639.421'MB/sec (index lex order gen) rebuild zvType time = 0.73's, 0.320'MB/sec write SST data time = 0.12's, 294.291'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 23619.840'MB/sec zip my value time = 1.28's, unzip length = 0.108'GB zip my value throughput = 84.387'MB/sec zip pipeline throughput = 84.387'MB/sec entries = 931031 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.16 avg-zval = 32.78 usrkeys = 931031 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.16 avg-zval = 32.78 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 931031 bytes = 3375008 } seq expand size = 6517217 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0305 GB dict = 1.08 MB all = 0.0368 GB } UnZip/Zip{ index = 10.5122 value = 3.5436 dict = 1.00 all = 3.6522 } Zip/UnZip{ index = 0.0951 value = 0.2822 dict = 1.00 all = 0.2738 } ---------------------------- total value len = 9.867912 GB avg = 0.162 KB (by entry num) total key len = 1.679420 GB avg = 0.028 KB total ukey len = 1.168306 GB avg = 0.016 KB total ukey num = 0.074071821 Billion total entry num = 0.060879550 Billion write speed all = 0.905016827 MB/sec (with seq num) write speed all = 0.866845573 MB/sec (without seq num) 2024/11/23-12:27:51.506089 139957659977280 [compaction_job.cc:1948] [default] [JOB 25987] Generated table #259491: 931031 keys, 36750168 bytes, temperature: kWarm 2024/11/23-12:27:51.506158 139957659977280 EVENT_LOG_v1 {"time_micros": 1732336071506124, "cf_name": "default", "job": 25987, "event": "table_file_creation", "file_number": 259491, "file_size": 36750168, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3680980241, "largest_seqno": 3973691334, "table_properties": {"data_size": 30519232, "index_size": 1771328, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26068868, "raw_average_key_size": 28, "raw_value_size": 108148902, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 931031, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732336068, "oldest_key_time": 0, "file_creation_time": 1732336068, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 259491, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-12:27:51.545335 139957659977280 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-25987/att-00/259492.sst) /dev/shm/ToplingTemp/Topling-48313-Mwncrn 2024/11/23-12:27:52.500776 139957659977280 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-25987/att-00/259492.sst): first pass time = 0.96's, 140.485'MB/sec 2024/11/23-12:27:53.794922 139957659977280 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-25987/att-00/259492.sst): old prealloc_size = 147639500, real_size = 33211056 2024/11/23-12:27:53.795497 139957659977280 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-25987/att-00/259492.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927887 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1082 GB zip-val = 0.0312 GB avg-val = 116.65 avg-zval = 33.63 2024/11/23-12:27:53.796356 139957659977280 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-25987/att-00/259492.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-12:27:54.656728 139957659977280 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-25987/att-00/259492.sst): second pass time = 1.29's, 83.690'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.86's, 43.566'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3221.739'MB/sec (index lex order gen) rebuild zvType time = 0.74's, 0.315'MB/sec write SST data time = 0.12's, 300.731'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 37347.447'MB/sec zip my value time = 1.29's, unzip length = 0.108'GB zip my value throughput = 83.690'MB/sec zip pipeline throughput = 83.690'MB/sec entries = 927887 avg-key = 28.00 avg-zkey = 1.92 avg-val = 116.65 avg-zval = 33.63 usrkeys = 927887 avg-key = 20.00 avg-zkey = 1.92 avg-val = 123.65 avg-zval = 33.63 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 927887 bytes = 3479584 } seq expand size = 6495209 multi value expand size = 0 cnt WriteAppend = 15 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0312 GB dict = 1.08 MB all = 0.0375 GB } UnZip/Zip{ index = 10.4432 value = 3.4689 dict = 1.00 all = 3.5749 } Zip/UnZip{ index = 0.0958 value = 0.2883 dict = 1.00 all = 0.2797 } ---------------------------- total value len = 9.982644 GB avg = 0.162 KB (by entry num) total key len = 1.705401 GB avg = 0.028 KB total ukey len = 1.186863 GB avg = 0.016 KB total ukey num = 0.074999708 Billion total entry num = 0.061807437 Billion write speed all = 0.915815715 MB/sec (with seq num) write speed all = 0.877072386 MB/sec (without seq num) 2024/11/23-12:27:54.702297 139957659977280 [compaction_job.cc:1948] [default] [JOB 25987] Generated table #259492: 927887 keys, 37544168 bytes, temperature: kWarm 2024/11/23-12:27:54.702373 139957659977280 EVENT_LOG_v1 {"time_micros": 1732336074702329, "cf_name": "default", "job": 25987, "event": "table_file_creation", "file_number": 259492, "file_size": 37544168, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3369194706, "largest_seqno": 3973691376, "table_properties": {"data_size": 31201888, "index_size": 1777024, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25980836, "raw_average_key_size": 28, "raw_value_size": 108236998, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927887, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732336071, "oldest_key_time": 0, "file_creation_time": 1732336071, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 259492, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-12:27:54.740603 139957659977280 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-25987/att-00/259493.sst) /dev/shm/ToplingTemp/Topling-48313-72ZTEq 2024/11/23-12:27:55.744703 139957659977280 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-25987/att-00/259493.sst): first pass time = 1.00's, 133.675'MB/sec 2024/11/23-12:27:57.084972 139957659977280 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-25987/att-00/259493.sst): old prealloc_size = 147639500, real_size = 33049632 2024/11/23-12:27:57.085581 139957659977280 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-25987/att-00/259493.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 929653 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0310 GB avg-val = 116.37 avg-zval = 33.40 2024/11/23-12:27:57.086393 139957659977280 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-25987/att-00/259493.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-12:27:57.947248 139957659977280 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-25987/att-00/259493.sst): second pass time = 1.34's, 80.801'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.86's, 43.227'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3195.132'MB/sec (index lex order gen) rebuild zvType time = 0.73's, 0.316'MB/sec write SST data time = 0.13's, 293.056'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 34899.812'MB/sec zip my value time = 1.34's, unzip length = 0.108'GB zip my value throughput = 80.801'MB/sec zip pipeline throughput = 80.801'MB/sec entries = 929653 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.37 avg-zval = 33.40 usrkeys = 929653 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.37 avg-zval = 33.40 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 929653 bytes = 3370000 } seq expand size = 6507571 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0310 GB dict = 1.08 MB all = 0.0373 GB } UnZip/Zip{ index = 10.5145 value = 3.4844 dict = 1.00 all = 3.6010 } Zip/UnZip{ index = 0.0951 value = 0.2870 dict = 1.00 all = 0.2777 } ---------------------------- total value len = 10.097339 GB avg = 0.161 KB (by entry num) total key len = 1.731431 GB avg = 0.028 KB total ukey len = 1.205457 GB avg = 0.016 KB total ukey num = 0.075929361 Billion total entry num = 0.062737090 Billion write speed all = 0.926603339 MB/sec (with seq num) write speed all = 0.887287403 MB/sec (without seq num) 2024/11/23-12:27:57.993231 139957659977280 [compaction_job.cc:1948] [default] [JOB 25987] Generated table #259493: 929653 keys, 37272212 bytes, temperature: kWarm 2024/11/23-12:27:57.993301 139957659977280 EVENT_LOG_v1 {"time_micros": 1732336077993266, "cf_name": "default", "job": 25987, "event": "table_file_creation", "file_number": 259493, "file_size": 37272212, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3514720078, "largest_seqno": 3973691402, "table_properties": {"data_size": 31048720, "index_size": 1768320, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26030284, "raw_average_key_size": 28, "raw_value_size": 108187578, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 929653, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732336074, "oldest_key_time": 0, "file_creation_time": 1732336074, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 259493, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-12:27:58.029970 139957659977280 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-25987/att-00/259494.sst) /dev/shm/ToplingTemp/Topling-48313-POC9Mq 2024/11/23-12:27:58.868220 139957659977280 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-25987/att-00/259494.sst): first pass time = 0.84's, 160.135'MB/sec 2024/11/23-12:28:00.166573 139957659977280 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-25987/att-00/259494.sst): old prealloc_size = 147639500, real_size = 32607248 2024/11/23-12:28:00.167178 139957659977280 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-25987/att-00/259494.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 933187 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1081 GB zip-val = 0.0306 GB avg-val = 115.83 avg-zval = 32.78 2024/11/23-12:28:00.167997 139957659977280 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-25987/att-00/259494.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-12:28:01.029479 139957659977280 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-25987/att-00/259494.sst): second pass time = 1.30's, 83.298'MB/sec, value only(80.5% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.86's, 42.695'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3076.679'MB/sec (index lex order gen) rebuild zvType time = 0.74's, 0.317'MB/sec write SST data time = 0.13's, 292.336'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 35842.900'MB/sec zip my value time = 1.30's, unzip length = 0.108'GB zip my value throughput = 83.298'MB/sec zip pipeline throughput = 83.298'MB/sec entries = 933187 avg-key = 28.00 avg-zkey = 1.92 avg-val = 115.83 avg-zval = 32.78 usrkeys = 933187 avg-key = 20.00 avg-zkey = 1.92 avg-val = 122.83 avg-zval = 32.78 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 933187 bytes = 3382816 } seq expand size = 6532309 multi value expand size = 0 cnt WriteAppend = 16 UnZipSize{ index = 0.0187 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0306 GB dict = 1.08 MB all = 0.0368 GB } UnZip/Zip{ index = 10.4430 value = 3.5339 dict = 1.00 all = 3.6432 } Zip/UnZip{ index = 0.0958 value = 0.2830 dict = 1.00 all = 0.2745 } ---------------------------- total value len = 10.211960 GB avg = 0.160 KB (by entry num) total key len = 1.757560 GB avg = 0.028 KB total ukey len = 1.224120 GB avg = 0.016 KB total ukey num = 0.076862548 Billion total entry num = 0.063670277 Billion write speed all = 0.937402623 MB/sec (with seq num) write speed all = 0.897511511 MB/sec (without seq num) 2024/11/23-12:28:01.076628 139957659977280 [compaction_job.cc:1948] [default] [JOB 25987] Generated table #259494: 933187 keys, 36840436 bytes, temperature: kWarm 2024/11/23-12:28:01.076698 139957659977280 EVENT_LOG_v1 {"time_micros": 1732336081076663, "cf_name": "default", "job": 25987, "event": "table_file_creation", "file_number": 259494, "file_size": 36840436, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3610601794, "largest_seqno": 3973690934, "table_properties": {"data_size": 30586560, "index_size": 1787200, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26129236, "raw_average_key_size": 28, "raw_value_size": 108088514, "raw_average_value_size": 115, "num_data_blocks": 1, "num_entries": 933187, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732336078, "oldest_key_time": 0, "file_creation_time": 1732336078, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 259494, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-12:28:01.114167 139957659977280 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-25987/att-00/259495.sst) /dev/shm/ToplingTemp/Topling-48313-XiAXKp 2024/11/23-12:28:02.087507 139957659977280 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-25987/att-00/259495.sst): first pass time = 0.97's, 137.900'MB/sec 2024/11/23-12:28:03.430287 139957659977280 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-25987/att-00/259495.sst): old prealloc_size = 147639500, real_size = 34682160 2024/11/23-12:28:03.430865 139957659977280 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-25987/att-00/259495.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 929210 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0327 GB avg-val = 116.44 avg-zval = 35.17 2024/11/23-12:28:03.431698 139957659977280 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-25987/att-00/259495.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-12:28:04.273282 139957659977280 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-25987/att-00/259495.sst): second pass time = 1.34's, 80.630'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.84's, 46.288'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3172.241'MB/sec (index lex order gen) rebuild zvType time = 0.72's, 0.324'MB/sec write SST data time = 0.13's, 309.563'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 26348.752'MB/sec zip my value time = 1.34's, unzip length = 0.108'GB zip my value throughput = 80.630'MB/sec zip pipeline throughput = 80.630'MB/sec entries = 929210 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.44 avg-zval = 35.17 usrkeys = 929210 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.44 avg-zval = 35.17 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 929210 bytes = 3484560 } seq expand size = 6504470 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0327 GB dict = 1.08 MB all = 0.0390 GB } UnZip/Zip{ index = 10.5129 value = 3.3107 dict = 1.00 all = 3.4398 } Zip/UnZip{ index = 0.0951 value = 0.3021 dict = 1.00 all = 0.2907 } ---------------------------- total value len = 10.326665 GB avg = 0.160 KB (by entry num) total key len = 1.783578 GB avg = 0.028 KB total ukey len = 1.242704 GB avg = 0.016 KB total ukey num = 0.077791758 Billion total entry num = 0.064599487 Billion write speed all = 0.948182520 MB/sec (with seq num) write speed all = 0.907719514 MB/sec (without seq num) 2024/11/23-12:28:04.322015 139957659977280 [compaction_job.cc:1948] [default] [JOB 25987] Generated table #259495: 929210 keys, 39019180 bytes, temperature: kWarm 2024/11/23-12:28:04.322088 139957659977280 EVENT_LOG_v1 {"time_micros": 1732336084322051, "cf_name": "default", "job": 25987, "event": "table_file_creation", "file_number": 259495, "file_size": 39019180, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3369353416, "largest_seqno": 3973691186, "table_properties": {"data_size": 32681952, "index_size": 1767744, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26017880, "raw_average_key_size": 28, "raw_value_size": 108199888, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 929210, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732336081, "oldest_key_time": 0, "file_creation_time": 1732336081, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 259495, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-12:28:04.359280 139957659977280 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-25987/att-00/259496.sst) /dev/shm/ToplingTemp/Topling-48313-WykRkq 2024/11/23-12:28:04.578057 139957659977280 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-25987/att-00/259496.sst): first pass time = 0.22's, 244.216'MB/sec 2024/11/23-12:28:05.101903 139957659977280 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-25987/att-00/259496.sst): old prealloc_size = 147639500, real_size = 13909792 2024/11/23-12:28:05.102188 139957659977280 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-25987/att-00/259496.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 369300 prefix = 4 raw-key = 0.0059 GB zip-key = 0.0007 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.0431 GB zip-val = 0.0131 GB avg-val = 116.65 avg-zval = 35.50 2024/11/23-12:28:05.102533 139957659977280 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-25987/att-00/259496.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0009 GB, waited 0.000 sec, Key+Value = 0.053 GB 2024/11/23-12:28:05.439780 139957659977280 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-25987/att-00/259496.sst): second pass time = 0.52's, 82.355'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.34's, 45.881'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2707.894'MB/sec (index lex order gen) rebuild zvType time = 0.29's, 0.322'MB/sec write SST data time = 0.05's, 304.931'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.435'MB, throughput = 11139.675'MB/sec zip my value time = 0.52's, unzip length = 0.043'GB zip my value throughput = 82.355'MB/sec zip pipeline throughput = 82.355'MB/sec entries = 369300 avg-key = 28.00 avg-zkey = 1.92 avg-val = 116.65 avg-zval = 35.50 usrkeys = 369300 avg-key = 20.00 avg-zkey = 1.92 avg-val = 123.65 avg-zval = 35.50 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 369300 bytes = 1246400 } seq expand size = 2585100 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0074 GB value = 0.0431 GB dict = 0.44 MB all = 0.0534 GB } __ZipSize{ index = 0.0007 GB value = 0.0131 GB dict = 0.44 MB all = 0.0155 GB } UnZip/Zip{ index = 10.4327 value = 3.2861 dict = 1.00 all = 3.4462 } Zip/UnZip{ index = 0.0959 value = 0.3043 dict = 1.00 all = 0.2902 } ---------------------------- total value len = 10.372329 GB avg = 0.160 KB (by entry num) total key len = 1.793919 GB avg = 0.028 KB total ukey len = 1.250090 GB avg = 0.016 KB total ukey num = 0.078161058 Billion total entry num = 0.064968787 Billion write speed all = 0.952480458 MB/sec (with seq num) write speed all = 0.911789850 MB/sec (without seq num) 2024/11/23-12:28:05.462438 139957659977280 [compaction_job.cc:1948] [default] [JOB 25987] Generated table #259496: 369300 keys, 15500945 bytes, temperature: kWarm 2024/11/23-12:28:05.462513 139957659977280 EVENT_LOG_v1 {"time_micros": 1732336085462478, "cf_name": "default", "job": 25987, "event": "table_file_creation", "file_number": 259496, "file_size": 15500945, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3898616840, "largest_seqno": 3973690968, "table_properties": {"data_size": 13109328, "index_size": 707968, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 10340400, "raw_average_key_size": 28, "raw_value_size": 43079068, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 369300, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732336084, "oldest_key_time": 0, "file_creation_time": 1732336084, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 259496, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-12:28:05.477275 139957659977280 [compaction_job.cc:703] job-25987: subcompact[0], size: 0.496613 G, files: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-25987/att-00 [259483,259484,259485,259486,259487,259488,259489,259490,259491,259492,259493,259494,259495,259496] 2024/11/23-12:28:05.562166 139957659977280 (Original Log Time 2024/11/23-12:27:21.855818) EVENT_LOG_v1 {"time_micros": 1732336041855780, "job": 25987, "event": "compaction_started", "compaction_reason": "FilesMarkedForCompaction", "files_L2": [259414], "files_L3": [259479, 259480, 259369, 259370, 259371, 259372, 259373, 259374, 259375, 259376, 259377, 259378, 259379, 259458], "score": 0.999621, "input_data_size": 509782442, "oldest_snapshot_seqno": 3974029327} 2024/11/23-12:28:05.562171 139957659977280 (Original Log Time 2024/11/23-12:28:05.560879) [compaction_job.cc:2022] [default] [JOB 25987] Compacted 1@2 + 14@3 files to L3 => 496613154 bytes 2024/11/23-12:28:05.562172 139957659977280 (Original Log Time 2024/11/23-12:28:05.562091) [compaction_job.cc:1224] [default] compacted to: files[0 0 0 14 0 0 0] max score 0.02, MB/sec: 11.7 rd, 11.4 wr, level 3, files in(1, 14) out(14 +0 blob) MB in(25.2, 460.9 +0.0 blob) out(473.6 +0.0 blob), read-write-amplify(38.0) write-amplify(18.8) OK, records in: 12647346, records dropped: 36723 output_compression: Snappy 2024/11/23-12:28:05.562179 139957659977280 (Original Log Time 2024/11/23-12:28:05.562142) EVENT_LOG_v1 {"time_micros": 1732336085562116, "cf": "default", "job": 25987, "event": "compaction_finished", "compaction_time_micros": 43621466, "compaction_time_cpu_micros": 18812294, "output_level": 3, "num_output_files": 14, "total_output_size": 496613154, "num_input_records": 12647346, "num_output_records": 12610623, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "file_write_nanos": 354582132, "file_range_sync_nanos": 0, "file_fsync_nanos": 10791, "file_prepare_write_nanos": 41020, "lsm_state": [0, 0, 0, 14, 0, 0, 0]} 2024/11/23-12:28:05.674227 139957659977280 DEBG dcompact_worker.cpp:240: HttpPost: 200 OK: url = http://nlb-7zny4kaa1poal01o64.cn-shenzhen.nlb.aliyuncs.com:8443, body = {"instanceId":"nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137","labourId":"","dbId":"d89b4006-2803-486e-b7a2-759bcf348921","dbStarts":1732256054,"starts":1732336041,"executesMs":43862,"compactionJobId":25987,"attempt":0,"compactionInputRawBytes":1803465565,"compactionInputZipBytes":509782442,"compactionOutputRawBytes":0,"compactionOutputZipBytes":496613154,"headers":{"Accept":"*/*","Connection":"close","Host":"aliyun-topling-saas.topling.cn:18443","RemoteIp":"120.24.192.169","X-Forwarded-For":"120.24.192.169","region":"cn-shenzhen","token":"e6474c481bd4415abc537135cc03626b","instance-token":"e6474c481bd4415abc537135cc03626b","provider":"aliyun","CloudMarketInstanceId":"si-59c0ae5c955845588903","MeteringAssit":"","Transfer-Encoding":"chunked","traceparent":"00-e6ed3e169c67be7eb23359d1af38aab9-7823e7bdacab157a-00"}}, response = 2024/11/23-12:28:05.674313 139957659977280 INFO dcompact_worker.cpp:1459: finish /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-25987/att-00: olev 3, work 43.863 s, result 7.730 ms, install 1.316 ms, input{raw 1.680 GiB zip 486.166 MiB}