2024/11/23-00:11:28.982091 140024793790016 DEBG dcompact_worker.cpp:2214: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14885/att-00: fork to child time = 0.011454 sec 2024/11/23-00:11:28.983005 140024793790016 DEBG dcompact_worker.cpp:1013: Beg SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14885/att-00 2024/11/23-00:11:28.989692 140024793790016 DEBG dcompact_worker.cpp:1033: End SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14885/att-00 2024/11/23-00:11:28.990824 140024793790016 TRAC dcompact_worker.cpp:1083: INFO_LOG_LEVEL: rpc = INFO_LEVEL, env_var = undefined 2024/11/23-00:11:28.991077 140024793790016 [WARN] [column_family.cc:386] multiple cf_paths/db_paths and level_compaction_dynamic_level_bytes can't be used together 2024/11/23-00:11:29.049436 140024793790016 [version_set.cc:6208] Recovering from manifest file: /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-14885/att-00/MANIFEST-206347 2024/11/23-00:11:29.088370 140024793790016 [version_set.cc:6251] Recovered from manifest file:/worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-14885/att-00/MANIFEST-206347 succeeded,manifest_file_number is 206347, next_file_number is 235663, last_sequence is 3666374787, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 235492 2024/11/23-00:11:29.088378 140024793790016 [version_set.cc:6266] Column family [default] (ID 0), log number is 0 2024/11/23-00:11:29.088470 140024793790016 [version_set.cc:5721] Creating manifest 235663 2024/11/23-00:11:29.126770 140024793790016 DEBG dcompact_worker.cpp:1218: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14885/att-00: bottommost_level: fake = 1, rpc = 0 2024/11/23-00:11:29.147738 140024793790016 [compaction_job.cc:2437] [default] [JOB 14885] Compacting 1@2 + 15@3 files to L3, score 0.99, subcompactions 1 : 1 2024/11/23-00:11:29.147757 140024793790016 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 11155 Base level 2, inputs: [235600(27MB)], [235660(35MB) 235661(7397KB) 235552(7803KB) 235510(35MB) 235553(35MB) 235554(35MB) 235555(34MB) 235556(34MB) 235557(35MB) 235558(35MB) 235559(36MB) 235560(36MB) 235561(35MB) 235562(34MB) 235638(33MB)] 2024/11/23-00:11:29.153636 140024793790016 [top_zip_table.cc:59] core git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-00:11:29.153669 140024793790016 [top_zip_table.cc:60] fsa git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-00:11:29.153690 140024793790016 [top_zip_table.cc:61] zbs git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-00:11:29.153695 140024793790016 [top_zip_table.cc:62] topling-zip_table_reader: git_version_hash_info_is: commit a4a382006cb82713acf5b3425835f22711877681 Author: leipeng Date: 2024-04-11 19:44:14 +0800 fixed_len_hole_index.cc: Add env bool FixedLenHoleIndexUseAVX512 for ut & debug 1. FixedLenHoleIndexUseAVX512 is only in unit tests or debug 2. In release mode, use avx512 by compile options(-march=) g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/23-00:11:29.153707 140024793790016 [top_zip_table.cc:64] topling-rocks git_version_hash_info_is: commit feab587e468621ba0204d47b4ffacc52e7c4290d Author: leipeng Date: 2024-03-22 13:35:06 +0800 ToplingZipTableBuilder::Add: immediately return after error This function returns void, and caller does not check builder->status() after calling this function and graceful abandon. So immediately return after error, and return error status in Finish(). g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/23-00:11:29.610237 140024793790016 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14885/att-00/235664.sst) /dev/shm/ToplingTemp/Topling-345635-l5JdRw 2024/11/23-00:11:30.159172 140024793790016 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14885/att-00/235664.sst): first pass time = 0.55's, 244.528'MB/sec 2024/11/23-00:11:31.534489 140024793790016 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14885/att-00/235664.sst): old prealloc_size = 147639500, real_size = 32976624 2024/11/23-00:11:31.535070 140024793790016 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14885/att-00/235664.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 929583 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1082 GB zip-val = 0.0310 GB avg-val = 116.39 avg-zval = 33.31 2024/11/23-00:11:31.535838 140024793790016 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14885/att-00/235664.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-00:11:32.649206 140024793790016 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14885/att-00/235664.sst): second pass time = 1.37's, 78.712'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.11's, 33.164'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3173.158'MB/sec (index lex order gen) rebuild zvType time = 0.88's, 0.265'MB/sec write SST data time = 0.24's, 155.908'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 32752.503'MB/sec zip my value time = 1.37's, unzip length = 0.108'GB zip my value throughput = 78.712'MB/sec zip pipeline throughput = 78.712'MB/sec entries = 929583 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.39 avg-zval = 33.31 usrkeys = 929583 avg-key = 20.00 avg-zkey = 1.91 avg-val = 123.39 avg-zval = 33.31 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 929583 bytes = 3137360 } seq expand size = 6507081 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0310 GB dict = 1.08 MB all = 0.0370 GB } UnZip/Zip{ index = 10.4457 value = 3.4940 dict = 1.00 all = 3.6307 } Zip/UnZip{ index = 0.0957 value = 0.2862 dict = 1.00 all = 0.2754 } ---------------------------- total value len = 0.114697 GB avg = 0.123 KB (by entry num) total key len = 0.026028 GB avg = 0.028 KB total ukey len = 0.018592 GB avg = 0.020 KB total ukey num = 0.000929583 Billion total entry num = 0.000929583 Billion write speed all = 0.002551697 MB/sec (with seq num) write speed all = 0.002416851 MB/sec (without seq num) 2024/11/23-00:11:32.686339 140024793790016 [compaction_job.cc:1948] [default] [JOB 14885] Generated table #235664: 929583 keys, 36967028 bytes, temperature: kWarm 2024/11/23-00:11:32.686459 140024793790016 EVENT_LOG_v1 {"time_micros": 1732291892686384, "cf_name": "default", "job": 14885, "event": "table_file_creation", "file_number": 235664, "file_size": 36967028, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3598522996, "largest_seqno": 3665858273, "table_properties": {"data_size": 30964192, "index_size": 1779840, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26028324, "raw_average_key_size": 28, "raw_value_size": 108189526, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 929583, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732291889, "oldest_key_time": 0, "file_creation_time": 1732291889, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 235664, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-00:11:32.737927 140024793790016 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14885/att-00/235665.sst) /dev/shm/ToplingTemp/Topling-345635-3pAr6u 2024/11/23-00:11:33.672555 140024793790016 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14885/att-00/235665.sst): first pass time = 0.93's, 143.614'MB/sec 2024/11/23-00:11:35.033207 140024793790016 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14885/att-00/235665.sst): old prealloc_size = 147639500, real_size = 31949184 2024/11/23-00:11:35.033762 140024793790016 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14885/att-00/235665.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 928713 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0300 GB avg-val = 116.52 avg-zval = 32.25 2024/11/23-00:11:35.034568 140024793790016 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14885/att-00/235665.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-00:11:35.931904 140024793790016 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14885/att-00/235665.sst): second pass time = 1.36's, 79.573'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.90's, 40.247'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3329.497'MB/sec (index lex order gen) rebuild zvType time = 0.77's, 0.302'MB/sec write SST data time = 0.13's, 280.177'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 30727.495'MB/sec zip my value time = 1.36's, unzip length = 0.108'GB zip my value throughput = 79.573'MB/sec zip pipeline throughput = 79.573'MB/sec entries = 928713 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.52 avg-zval = 32.25 usrkeys = 928713 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.52 avg-zval = 32.25 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 928713 bytes = 3366592 } seq expand size = 6500991 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0300 GB dict = 1.08 MB all = 0.0362 GB } UnZip/Zip{ index = 10.5146 value = 3.6131 dict = 1.00 all = 3.7108 } Zip/UnZip{ index = 0.0951 value = 0.2768 dict = 1.00 all = 0.2695 } ---------------------------- total value len = 0.229411 GB avg = 0.123 KB (by entry num) total key len = 0.052032 GB avg = 0.028 KB total ukey len = 0.037166 GB avg = 0.020 KB total ukey num = 0.001858296 Billion total entry num = 0.001858296 Billion write speed all = 0.005102979 MB/sec (with seq num) write speed all = 0.004833430 MB/sec (without seq num) 2024/11/23-00:11:35.963979 140024793790016 [compaction_job.cc:1948] [default] [JOB 14885] Generated table #235665: 928713 keys, 36169160 bytes, temperature: kWarm 2024/11/23-00:11:35.964039 140024793790016 EVENT_LOG_v1 {"time_micros": 1732291895964008, "cf_name": "default", "job": 14885, "event": "table_file_creation", "file_number": 235665, "file_size": 36169160, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3376774746, "largest_seqno": 3665858283, "table_properties": {"data_size": 29950320, "index_size": 1766528, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26003964, "raw_average_key_size": 28, "raw_value_size": 108213850, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 928713, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732291892, "oldest_key_time": 0, "file_creation_time": 1732291892, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 235665, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-00:11:36.002627 140024793790016 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14885/att-00/235666.sst) /dev/shm/ToplingTemp/Topling-345635-vpLm1v 2024/11/23-00:11:36.884480 140024793790016 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14885/att-00/235666.sst): first pass time = 0.88's, 152.207'MB/sec 2024/11/23-00:11:38.213727 140024793790016 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14885/att-00/235666.sst): old prealloc_size = 147639500, real_size = 32783088 2024/11/23-00:11:38.214283 140024793790016 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14885/att-00/235666.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 925951 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1083 GB zip-val = 0.0308 GB avg-val = 116.95 avg-zval = 33.24 2024/11/23-00:11:38.215048 140024793790016 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14885/att-00/235666.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-00:11:39.117295 140024793790016 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14885/att-00/235666.sst): second pass time = 1.33's, 81.514'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.90's, 40.815'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3327.766'MB/sec (index lex order gen) rebuild zvType time = 0.78's, 0.299'MB/sec write SST data time = 0.13's, 289.028'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 31500.321'MB/sec zip my value time = 1.33's, unzip length = 0.108'GB zip my value throughput = 81.514'MB/sec zip pipeline throughput = 81.514'MB/sec entries = 925951 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.95 avg-zval = 33.24 usrkeys = 925951 avg-key = 20.00 avg-zkey = 1.91 avg-val = 123.95 avg-zval = 33.24 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 925951 bytes = 3240848 } seq expand size = 6481657 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0308 GB dict = 1.08 MB all = 0.0369 GB } UnZip/Zip{ index = 10.4458 value = 3.5184 dict = 1.00 all = 3.6394 } Zip/UnZip{ index = 0.0957 value = 0.2842 dict = 1.00 all = 0.2748 } ---------------------------- total value len = 0.344184 GB avg = 0.124 KB (by entry num) total key len = 0.077959 GB avg = 0.028 KB total ukey len = 0.055685 GB avg = 0.020 KB total ukey num = 0.002784247 Billion total entry num = 0.002784247 Billion write speed all = 0.007653619 MB/sec (with seq num) write speed all = 0.007249783 MB/sec (without seq num) 2024/11/23-00:11:39.156362 140024793790016 [compaction_job.cc:1948] [default] [JOB 14885] Generated table #235666: 925951 keys, 36878684 bytes, temperature: kWarm 2024/11/23-00:11:39.156429 140024793790016 EVENT_LOG_v1 {"time_micros": 1732291899156394, "cf_name": "default", "job": 14885, "event": "table_file_creation", "file_number": 235666, "file_size": 36878684, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3504428200, "largest_seqno": 3665858298, "table_properties": {"data_size": 30778528, "index_size": 1772864, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25926628, "raw_average_key_size": 28, "raw_value_size": 108291150, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 925951, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732291895, "oldest_key_time": 0, "file_creation_time": 1732291895, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 235666, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-00:11:39.191242 140024793790016 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14885/att-00/235667.sst) /dev/shm/ToplingTemp/Topling-345635-t6f16t 2024/11/23-00:11:40.026036 140024793790016 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14885/att-00/235667.sst): first pass time = 0.83's, 160.788'MB/sec 2024/11/23-00:11:41.532903 140024793790016 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14885/att-00/235667.sst): old prealloc_size = 147639500, real_size = 33106176 2024/11/23-00:11:41.533432 140024793790016 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14885/att-00/235667.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 928145 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0311 GB avg-val = 116.61 avg-zval = 33.52 2024/11/23-00:11:41.534183 140024793790016 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14885/att-00/235667.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-00:11:42.483413 140024793790016 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14885/att-00/235667.sst): second pass time = 1.51's, 71.857'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.95's, 39.024'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3464.923'MB/sec (index lex order gen) rebuild zvType time = 0.82's, 0.283'MB/sec write SST data time = 0.13's, 286.077'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 33378.272'MB/sec zip my value time = 1.51's, unzip length = 0.108'GB zip my value throughput = 71.857'MB/sec zip pipeline throughput = 74.609'MB/sec entries = 928145 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.61 avg-zval = 33.52 usrkeys = 928145 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.61 avg-zval = 33.52 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 928145 bytes = 3132512 } seq expand size = 6497015 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0311 GB dict = 1.08 MB all = 0.0371 GB } UnZip/Zip{ index = 10.5169 value = 3.4791 dict = 1.00 all = 3.6185 } Zip/UnZip{ index = 0.0951 value = 0.2874 dict = 1.00 all = 0.2764 } ---------------------------- total value len = 0.458911 GB avg = 0.124 KB (by entry num) total key len = 0.103947 GB avg = 0.028 KB total ukey len = 0.074248 GB avg = 0.020 KB total ukey num = 0.003712392 Billion total entry num = 0.003712392 Billion write speed all = 0.010204209 MB/sec (with seq num) write speed all = 0.009665785 MB/sec (without seq num) 2024/11/23-00:11:42.516753 140024793790016 [compaction_job.cc:1948] [default] [JOB 14885] Generated table #235667: 928145 keys, 37092450 bytes, temperature: kWarm 2024/11/23-00:11:42.516827 140024793790016 EVENT_LOG_v1 {"time_micros": 1732291902516792, "cf_name": "default", "job": 14885, "event": "table_file_creation", "file_number": 235667, "file_size": 37092450, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3587898319, "largest_seqno": 3665858967, "table_properties": {"data_size": 31108912, "index_size": 1765056, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25988060, "raw_average_key_size": 28, "raw_value_size": 108229678, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 928145, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732291899, "oldest_key_time": 0, "file_creation_time": 1732291899, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 235667, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-00:11:42.555468 140024793790016 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14885/att-00/235668.sst) /dev/shm/ToplingTemp/Topling-345635-GpuAIt 2024/11/23-00:11:43.415855 140024793790016 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14885/att-00/235668.sst): first pass time = 0.86's, 156.005'MB/sec 2024/11/23-00:11:44.789086 140024793790016 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14885/att-00/235668.sst): old prealloc_size = 147639500, real_size = 34859200 2024/11/23-00:11:44.789739 140024793790016 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14885/att-00/235668.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 1084672 prefix = 4 raw-key = 0.0174 GB zip-key = 0.0021 GB avg-key = 16.00 avg-zkey = 1.93 raw-val = 0.1038 GB zip-val = 0.0325 GB avg-val = 95.74 avg-zval = 29.96 2024/11/23-00:11:44.790002 140024793790016 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14885/att-00/235668.sst: sumWaitingMem = 0.003 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0028 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-00:11:45.460884 140024793790016 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14885/att-00/235668.sst): second pass time = 1.37's, 75.663'MB/sec, value only(77.4% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.67's, 54.046'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3329.269'MB/sec (index lex order gen) rebuild zvType time = 0.53's, 0.513'MB/sec write SST data time = 0.14's, 254.181'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.034'MB, throughput = 30032.859'MB/sec zip my value time = 1.37's, unzip length = 0.104'GB zip my value throughput = 75.663'MB/sec zip pipeline throughput = 75.663'MB/sec entries = 1084672 avg-key = 28.00 avg-zkey = 1.93 avg-val = 95.74 avg-zval = 29.96 usrkeys = 1084672 avg-key = 20.00 avg-zkey = 1.93 avg-val = 96.78 avg-zval = 29.96 TagRS{ kinds = RS_Key0_TagN bytes = 169560 } TagArray{ size = 161492 bytes = 504672 } seq expand size = 1130444 multi value expand size = 0 cnt WriteAppend = 17 UnZipSize{ index = 0.0217 GB value = 0.1038 GB dict = 1.03 MB all = 0.1342 GB } __ZipSize{ index = 0.0021 GB value = 0.0325 GB dict = 1.03 MB all = 0.0363 GB } UnZip/Zip{ index = 10.3807 value = 3.1955 dict = 1.00 all = 3.6967 } Zip/UnZip{ index = 0.0963 value = 0.3129 dict = 1.00 all = 0.2705 } ---------------------------- total value len = 0.563888 GB avg = 0.118 KB (by entry num) total key len = 0.134318 GB avg = 0.028 KB total ukey len = 0.095941 GB avg = 0.020 KB total ukey num = 0.004797064 Billion total entry num = 0.004797064 Billion write speed all = 0.012657291 MB/sec (with seq num) write speed all = 0.011961590 MB/sec (without seq num) 2024/11/23-00:11:45.493000 140024793790016 [compaction_job.cc:1948] [default] [JOB 14885] Generated table #235668: 1084672 keys, 36307026 bytes, temperature: kWarm 2024/11/23-00:11:45.493066 140024793790016 EVENT_LOG_v1 {"time_micros": 1732291905493033, "cf_name": "default", "job": 14885, "event": "table_file_creation", "file_number": 235668, "file_size": 36307026, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3665858795, "table_properties": {"data_size": 32498032, "index_size": 2089792, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 30370816, "raw_average_key_size": 28, "raw_value_size": 103846921, "raw_average_value_size": 95, "num_data_blocks": 1, "num_entries": 1084672, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732291902, "oldest_key_time": 0, "file_creation_time": 1732291902, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 235668, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-00:11:45.529905 140024793790016 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14885/att-00/235669.sst) /dev/shm/ToplingTemp/Topling-345635-WgIYAv 2024/11/23-00:11:46.420802 140024793790016 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14885/att-00/235669.sst): first pass time = 0.89's, 150.663'MB/sec 2024/11/23-00:11:47.851333 140024793790016 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14885/att-00/235669.sst): old prealloc_size = 147639500, real_size = 35665344 2024/11/23-00:11:47.851937 140024793790016 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14885/att-00/235669.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 923173 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1084 GB zip-val = 0.0337 GB avg-val = 117.39 avg-zval = 36.47 2024/11/23-00:11:47.852395 140024793790016 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14885/att-00/235669.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-00:11:48.647380 140024793790016 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14885/att-00/235669.sst): second pass time = 1.43's, 75.789'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.80's, 48.081'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3057.973'MB/sec (index lex order gen) rebuild zvType time = 0.67's, 0.346'MB/sec write SST data time = 0.13's, 296.820'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.083'MB, throughput = 31536.230'MB/sec zip my value time = 1.43's, unzip length = 0.108'GB zip my value throughput = 75.789'MB/sec zip pipeline throughput = 75.789'MB/sec entries = 923173 avg-key = 28.00 avg-zkey = 1.91 avg-val = 117.39 avg-zval = 36.47 usrkeys = 923173 avg-key = 20.00 avg-zkey = 1.91 avg-val = 120.86 avg-zval = 36.47 TagRS{ kinds = RS_Key0_TagN bytes = 144360 } TagArray{ size = 457950 bytes = 1602832 } seq expand size = 3205650 multi value expand size = 0 cnt WriteAppend = 15 UnZipSize{ index = 0.0185 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0337 GB dict = 1.08 MB all = 0.0383 GB } UnZip/Zip{ index = 10.4443 value = 3.2189 dict = 1.00 all = 3.5067 } Zip/UnZip{ index = 0.0957 value = 0.3107 dict = 1.00 all = 0.2852 } ---------------------------- total value len = 0.675463 GB avg = 0.118 KB (by entry num) total key len = 0.160167 GB avg = 0.028 KB total ukey len = 0.114405 GB avg = 0.020 KB total ukey num = 0.005720237 Billion total entry num = 0.005720237 Billion write speed all = 0.015147669 MB/sec (with seq num) write speed all = 0.014318132 MB/sec (without seq num) 2024/11/23-00:11:48.684824 140024793790016 [compaction_job.cc:1948] [default] [JOB 14885] Generated table #235669: 923173 keys, 38274203 bytes, temperature: kWarm 2024/11/23-00:11:48.684890 140024793790016 EVENT_LOG_v1 {"time_micros": 1732291908684856, "cf_name": "default", "job": 14885, "event": "table_file_creation", "file_number": 235669, "file_size": 38274203, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3469223809, "table_properties": {"data_size": 33666544, "index_size": 1767808, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25848844, "raw_average_key_size": 28, "raw_value_size": 108368938, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 923173, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732291905, "oldest_key_time": 0, "file_creation_time": 1732291905, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 235669, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-00:11:48.720424 140024793790016 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14885/att-00/235670.sst) /dev/shm/ToplingTemp/Topling-345635-XOPwiw 2024/11/23-00:11:49.610102 140024793790016 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14885/att-00/235670.sst): first pass time = 0.89's, 150.868'MB/sec 2024/11/23-00:11:50.918371 140024793790016 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14885/att-00/235670.sst): old prealloc_size = 147639500, real_size = 30985360 2024/11/23-00:11:50.918943 140024793790016 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14885/att-00/235670.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 924067 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.93 raw-val = 0.1083 GB zip-val = 0.0290 GB avg-val = 117.25 avg-zval = 31.35 2024/11/23-00:11:50.919724 140024793790016 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14885/att-00/235670.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-00:11:51.767991 140024793790016 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14885/att-00/235670.sst): second pass time = 1.31's, 82.857'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.85's, 41.284'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3249.725'MB/sec (index lex order gen) rebuild zvType time = 0.72's, 0.320'MB/sec write SST data time = 0.13's, 273.980'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.082'MB, throughput = 22753.758'MB/sec zip my value time = 1.31's, unzip length = 0.108'GB zip my value throughput = 82.857'MB/sec zip pipeline throughput = 82.857'MB/sec entries = 924067 avg-key = 28.00 avg-zkey = 1.93 avg-val = 117.25 avg-zval = 31.35 usrkeys = 924067 avg-key = 20.00 avg-zkey = 1.93 avg-val = 124.25 avg-zval = 31.35 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 924067 bytes = 3234256 } seq expand size = 6468469 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0290 GB dict = 1.08 MB all = 0.0351 GB } UnZip/Zip{ index = 10.3759 value = 3.7395 dict = 1.00 all = 3.8266 } Zip/UnZip{ index = 0.0964 value = 0.2674 dict = 1.00 all = 0.2613 } ---------------------------- total value len = 0.790275 GB avg = 0.119 KB (by entry num) total key len = 0.186041 GB avg = 0.028 KB total ukey len = 0.132886 GB avg = 0.020 KB total ukey num = 0.006644304 Billion total entry num = 0.006644304 Billion write speed all = 0.017696924 MB/sec (with seq num) write speed all = 0.016733435 MB/sec (without seq num) 2024/11/23-00:11:51.797857 140024793790016 [compaction_job.cc:1948] [default] [JOB 14885] Generated table #235670: 924067 keys, 35074738 bytes, temperature: kWarm 2024/11/23-00:11:51.797925 140024793790016 EVENT_LOG_v1 {"time_micros": 1732291911797889, "cf_name": "default", "job": 14885, "event": "table_file_creation", "file_number": 235670, "file_size": 35074738, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3469223810, "largest_seqno": 3665857811, "table_properties": {"data_size": 28972992, "index_size": 1781184, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25873876, "raw_average_key_size": 28, "raw_value_size": 108343922, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 924067, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732291908, "oldest_key_time": 0, "file_creation_time": 1732291908, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 235670, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-00:11:51.840350 140024793790016 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14885/att-00/235671.sst) /dev/shm/ToplingTemp/Topling-345635-nLbgHw 2024/11/23-00:11:52.714050 140024793790016 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14885/att-00/235671.sst): first pass time = 0.87's, 153.628'MB/sec 2024/11/23-00:11:54.036210 140024793790016 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14885/att-00/235671.sst): old prealloc_size = 147639500, real_size = 33862976 2024/11/23-00:11:54.036751 140024793790016 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14885/att-00/235671.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927738 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0319 GB avg-val = 116.67 avg-zval = 34.35 2024/11/23-00:11:54.037548 140024793790016 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14885/att-00/235671.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-00:11:54.961977 140024793790016 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14885/att-00/235671.sst): second pass time = 1.32's, 81.907'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.93's, 41.135'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3410.549'MB/sec (index lex order gen) rebuild zvType time = 0.80's, 0.292'MB/sec write SST data time = 0.13's, 293.241'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 20893.453'MB/sec zip my value time = 1.32's, unzip length = 0.108'GB zip my value throughput = 81.907'MB/sec zip pipeline throughput = 81.907'MB/sec entries = 927738 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.67 avg-zval = 34.35 usrkeys = 927738 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.67 avg-zval = 34.35 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 927738 bytes = 3363072 } seq expand size = 6494166 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0319 GB dict = 1.08 MB all = 0.0381 GB } UnZip/Zip{ index = 10.5115 value = 3.3968 dict = 1.00 all = 3.5246 } Zip/UnZip{ index = 0.0951 value = 0.2944 dict = 1.00 all = 0.2837 } ---------------------------- total value len = 0.905011 GB avg = 0.120 KB (by entry num) total key len = 0.212017 GB avg = 0.028 KB total ukey len = 0.151441 GB avg = 0.020 KB total ukey num = 0.007572042 Billion total entry num = 0.007572042 Billion write speed all = 0.020246329 MB/sec (with seq num) write speed all = 0.019148372 MB/sec (without seq num) 2024/11/23-00:11:54.995682 140024793790016 [compaction_job.cc:1948] [default] [JOB 14885] Generated table #235671: 927738 keys, 38080248 bytes, temperature: kWarm 2024/11/23-00:11:54.995751 140024793790016 EVENT_LOG_v1 {"time_micros": 1732291914995717, "cf_name": "default", "job": 14885, "event": "table_file_creation", "file_number": 235671, "file_size": 38080248, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3375334738, "largest_seqno": 3665858891, "table_properties": {"data_size": 31865648, "index_size": 1765184, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25976664, "raw_average_key_size": 28, "raw_value_size": 108241116, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927738, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732291911, "oldest_key_time": 0, "file_creation_time": 1732291911, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 235671, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-00:11:55.031981 140024793790016 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14885/att-00/235672.sst) /dev/shm/ToplingTemp/Topling-345635-xGeBcu 2024/11/23-00:11:55.839984 140024793790016 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14885/att-00/235672.sst): first pass time = 0.81's, 166.120'MB/sec 2024/11/23-00:11:57.161291 140024793790016 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14885/att-00/235672.sst): old prealloc_size = 147639500, real_size = 33320528 2024/11/23-00:11:57.161856 140024793790016 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14885/att-00/235672.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 925946 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0313 GB avg-val = 116.95 avg-zval = 33.83 2024/11/23-00:11:57.163533 140024793790016 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14885/att-00/235672.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-00:11:58.093036 140024793790016 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14885/att-00/235672.sst): second pass time = 1.32's, 82.003'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.93's, 40.282'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3247.555'MB/sec (index lex order gen) rebuild zvType time = 0.80's, 0.289'MB/sec write SST data time = 0.13's, 288.279'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 27766.223'MB/sec zip my value time = 1.32's, unzip length = 0.108'GB zip my value throughput = 82.003'MB/sec zip pipeline throughput = 82.003'MB/sec entries = 925946 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.95 avg-zval = 33.83 usrkeys = 925946 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.95 avg-zval = 33.83 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 925946 bytes = 3356576 } seq expand size = 6481622 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0313 GB dict = 1.08 MB all = 0.0375 GB } UnZip/Zip{ index = 10.5141 value = 3.4568 dict = 1.00 all = 3.5761 } Zip/UnZip{ index = 0.0951 value = 0.2893 dict = 1.00 all = 0.2796 } ---------------------------- total value len = 1.019784 GB avg = 0.120 KB (by entry num) total key len = 0.237944 GB avg = 0.028 KB total ukey len = 0.169960 GB avg = 0.020 KB total ukey num = 0.008497988 Billion total entry num = 0.008497988 Billion write speed all = 0.022795238 MB/sec (with seq num) write speed all = 0.021563087 MB/sec (without seq num) 2024/11/23-00:11:58.126870 140024793790016 [compaction_job.cc:1948] [default] [JOB 14885] Generated table #235672: 925946 keys, 37532236 bytes, temperature: kWarm 2024/11/23-00:11:58.126937 140024793790016 EVENT_LOG_v1 {"time_micros": 1732291918126901, "cf_name": "default", "job": 14885, "event": "table_file_creation", "file_number": 235672, "file_size": 37532236, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3273701103, "largest_seqno": 3665857839, "table_properties": {"data_size": 31327488, "index_size": 1761344, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25926488, "raw_average_key_size": 28, "raw_value_size": 108291316, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 925946, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732291915, "oldest_key_time": 0, "file_creation_time": 1732291915, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 235672, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-00:11:58.161437 140024793790016 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14885/att-00/235673.sst) /dev/shm/ToplingTemp/Topling-345635-TgUD2t 2024/11/23-00:11:59.094833 140024793790016 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14885/att-00/235673.sst): first pass time = 0.93's, 143.802'MB/sec 2024/11/23-00:12:00.426588 140024793790016 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14885/att-00/235673.sst): old prealloc_size = 147639500, real_size = 33884480 2024/11/23-00:12:00.427119 140024793790016 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14885/att-00/235673.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 932222 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1081 GB zip-val = 0.0319 GB avg-val = 115.98 avg-zval = 34.20 2024/11/23-00:12:00.427923 140024793790016 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14885/att-00/235673.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-00:12:01.338573 140024793790016 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14885/att-00/235673.sst): second pass time = 1.33's, 81.224'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.91's, 41.793'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3488.252'MB/sec (index lex order gen) rebuild zvType time = 0.78's, 0.297'MB/sec write SST data time = 0.13's, 297.680'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 32854.469'MB/sec zip my value time = 1.33's, unzip length = 0.108'GB zip my value throughput = 81.224'MB/sec zip pipeline throughput = 81.224'MB/sec entries = 932222 avg-key = 28.00 avg-zkey = 1.90 avg-val = 115.98 avg-zval = 34.20 usrkeys = 932222 avg-key = 20.00 avg-zkey = 1.90 avg-val = 122.98 avg-zval = 34.20 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 932222 bytes = 3379312 } seq expand size = 6525554 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0319 GB dict = 1.08 MB all = 0.0381 GB } UnZip/Zip{ index = 10.5128 value = 3.3916 dict = 1.00 all = 3.5215 } Zip/UnZip{ index = 0.0951 value = 0.2948 dict = 1.00 all = 0.2840 } ---------------------------- total value len = 1.134425 GB avg = 0.120 KB (by entry num) total key len = 0.264046 GB avg = 0.028 KB total ukey len = 0.188604 GB avg = 0.020 KB total ukey num = 0.009430210 Billion total entry num = 0.009430210 Billion write speed all = 0.025344601 MB/sec (with seq num) write speed all = 0.023977365 MB/sec (without seq num) 2024/11/23-00:12:01.374982 140024793790016 [compaction_job.cc:1948] [default] [JOB 14885] Generated table #235673: 932222 keys, 38114318 bytes, temperature: kWarm 2024/11/23-00:12:01.375048 140024793790016 EVENT_LOG_v1 {"time_micros": 1732291921375015, "cf_name": "default", "job": 14885, "event": "table_file_creation", "file_number": 235673, "file_size": 38114318, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3369194706, "largest_seqno": 3665858615, "table_properties": {"data_size": 31877744, "index_size": 1773504, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26102216, "raw_average_key_size": 28, "raw_value_size": 108115608, "raw_average_value_size": 115, "num_data_blocks": 1, "num_entries": 932222, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732291918, "oldest_key_time": 0, "file_creation_time": 1732291918, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 235673, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-00:12:01.415662 140024793790016 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14885/att-00/235674.sst) /dev/shm/ToplingTemp/Topling-345635-vwe8Sv 2024/11/23-00:12:02.324419 140024793790016 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14885/att-00/235674.sst): first pass time = 0.91's, 147.701'MB/sec 2024/11/23-00:12:03.644372 140024793790016 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14885/att-00/235674.sst): old prealloc_size = 147639500, real_size = 32363600 2024/11/23-00:12:03.644938 140024793790016 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14885/att-00/235674.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 925078 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0304 GB avg-val = 117.09 avg-zval = 32.83 2024/11/23-00:12:03.645706 140024793790016 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14885/att-00/235674.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-00:12:04.546542 140024793790016 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14885/att-00/235674.sst): second pass time = 1.32's, 82.104'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.90's, 40.539'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3228.212'MB/sec (index lex order gen) rebuild zvType time = 0.77's, 0.299'MB/sec write SST data time = 0.13's, 283.611'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 28763.940'MB/sec zip my value time = 1.32's, unzip length = 0.108'GB zip my value throughput = 82.104'MB/sec zip pipeline throughput = 82.104'MB/sec entries = 925078 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.09 avg-zval = 32.83 usrkeys = 925078 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.09 avg-zval = 32.83 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 925078 bytes = 3353424 } seq expand size = 6475546 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0304 GB dict = 1.08 MB all = 0.0366 GB } UnZip/Zip{ index = 10.5134 value = 3.5663 dict = 1.00 all = 3.6699 } Zip/UnZip{ index = 0.0951 value = 0.2804 dict = 1.00 all = 0.2725 } ---------------------------- total value len = 1.249216 GB avg = 0.121 KB (by entry num) total key len = 0.289948 GB avg = 0.028 KB total ukey len = 0.207106 GB avg = 0.020 KB total ukey num = 0.010355288 Billion total entry num = 0.010355288 Billion write speed all = 0.027892778 MB/sec (with seq num) write speed all = 0.026391507 MB/sec (without seq num) 2024/11/23-00:12:04.581074 140024793790016 [compaction_job.cc:1948] [default] [JOB 14885] Generated table #235674: 925078 keys, 36572290 bytes, temperature: kWarm 2024/11/23-00:12:04.581142 140024793790016 EVENT_LOG_v1 {"time_micros": 1732291924581108, "cf_name": "default", "job": 14885, "event": "table_file_creation", "file_number": 235674, "file_size": 36572290, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3326330223, "largest_seqno": 3665857900, "table_properties": {"data_size": 30372352, "index_size": 1759808, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25902184, "raw_average_key_size": 28, "raw_value_size": 108315664, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 925078, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732291921, "oldest_key_time": 0, "file_creation_time": 1732291921, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 235674, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-00:12:04.616662 140024793790016 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14885/att-00/235675.sst) /dev/shm/ToplingTemp/Topling-345635-u6BV6s 2024/11/23-00:12:05.528788 140024793790016 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14885/att-00/235675.sst): first pass time = 0.91's, 147.157'MB/sec 2024/11/23-00:12:06.856711 140024793790016 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14885/att-00/235675.sst): old prealloc_size = 147639500, real_size = 33843376 2024/11/23-00:12:06.857255 140024793790016 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14885/att-00/235675.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 930627 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0318 GB avg-val = 116.22 avg-zval = 34.21 2024/11/23-00:12:06.858046 140024793790016 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14885/att-00/235675.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-00:12:07.767949 140024793790016 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14885/att-00/235675.sst): second pass time = 1.33's, 81.529'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.91's, 41.649'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3403.190'MB/sec (index lex order gen) rebuild zvType time = 0.78's, 0.297'MB/sec write SST data time = 0.13's, 297.214'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 26047.947'MB/sec zip my value time = 1.33's, unzip length = 0.108'GB zip my value throughput = 81.529'MB/sec zip pipeline throughput = 81.529'MB/sec entries = 930627 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.22 avg-zval = 34.21 usrkeys = 930627 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.22 avg-zval = 34.21 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 930627 bytes = 3257216 } seq expand size = 6514389 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0318 GB dict = 1.08 MB all = 0.0380 GB } UnZip/Zip{ index = 10.5145 value = 3.3970 dict = 1.00 all = 3.5365 } Zip/UnZip{ index = 0.0951 value = 0.2944 dict = 1.00 all = 0.2828 } ---------------------------- total value len = 1.363890 GB avg = 0.121 KB (by entry num) total key len = 0.316006 GB avg = 0.028 KB total ukey len = 0.225718 GB avg = 0.020 KB total ukey num = 0.011285915 Billion total entry num = 0.011285915 Billion write speed all = 0.030441353 MB/sec (with seq num) write speed all = 0.028805259 MB/sec (without seq num) 2024/11/23-00:12:07.807223 140024793790016 [compaction_job.cc:1948] [default] [JOB 14885] Generated table #235675: 930627 keys, 37951646 bytes, temperature: kWarm 2024/11/23-00:12:07.807289 140024793790016 EVENT_LOG_v1 {"time_micros": 1732291927807256, "cf_name": "default", "job": 14885, "event": "table_file_creation", "file_number": 235675, "file_size": 37951646, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3516470397, "largest_seqno": 3665858927, "table_properties": {"data_size": 31840352, "index_size": 1770176, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26057556, "raw_average_key_size": 28, "raw_value_size": 108160206, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 930627, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732291924, "oldest_key_time": 0, "file_creation_time": 1732291924, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 235675, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-00:12:07.841612 140024793790016 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14885/att-00/235676.sst) /dev/shm/ToplingTemp/Topling-345635-Nz9Yjt 2024/11/23-00:12:08.694777 140024793790016 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14885/att-00/235676.sst): first pass time = 0.85's, 157.326'MB/sec 2024/11/23-00:12:10.060148 140024793790016 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14885/att-00/235676.sst): old prealloc_size = 147639500, real_size = 33531696 2024/11/23-00:12:10.060708 140024793790016 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14885/att-00/235676.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 925960 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1083 GB zip-val = 0.0315 GB avg-val = 116.95 avg-zval = 34.05 2024/11/23-00:12:10.061494 140024793790016 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14885/att-00/235676.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-00:12:11.011256 140024793790016 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14885/att-00/235676.sst): second pass time = 1.36's, 79.355'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.95's, 39.684'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3328.458'MB/sec (index lex order gen) rebuild zvType time = 0.82's, 0.282'MB/sec write SST data time = 0.13's, 291.896'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 29422.404'MB/sec zip my value time = 1.36's, unzip length = 0.108'GB zip my value throughput = 79.355'MB/sec zip pipeline throughput = 79.355'MB/sec entries = 925960 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.95 avg-zval = 34.05 usrkeys = 925960 avg-key = 20.00 avg-zkey = 1.91 avg-val = 123.95 avg-zval = 34.05 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 925960 bytes = 3356624 } seq expand size = 6481720 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0315 GB dict = 1.08 MB all = 0.0377 GB } UnZip/Zip{ index = 10.4463 value = 3.4348 dict = 1.00 all = 3.5561 } Zip/UnZip{ index = 0.0957 value = 0.2911 dict = 1.00 all = 0.2812 } ---------------------------- total value len = 1.478663 GB avg = 0.121 KB (by entry num) total key len = 0.341932 GB avg = 0.028 KB total ukey len = 0.244237 GB avg = 0.020 KB total ukey num = 0.012211875 Billion total entry num = 0.012211875 Billion write speed all = 0.032989028 MB/sec (with seq num) write speed all = 0.031218804 MB/sec (without seq num) 2024/11/23-00:12:11.046208 140024793790016 [compaction_job.cc:1948] [default] [JOB 14885] Generated table #235676: 925960 keys, 37743504 bytes, temperature: kWarm 2024/11/23-00:12:11.046275 140024793790016 EVENT_LOG_v1 {"time_micros": 1732291931046242, "cf_name": "default", "job": 14885, "event": "table_file_creation", "file_number": 235676, "file_size": 37743504, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3369353416, "largest_seqno": 3665858726, "table_properties": {"data_size": 31527200, "index_size": 1772800, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25926880, "raw_average_key_size": 28, "raw_value_size": 108290984, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 925960, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732291927, "oldest_key_time": 0, "file_creation_time": 1732291927, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 235676, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-00:12:11.084574 140024793790016 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14885/att-00/235677.sst) /dev/shm/ToplingTemp/Topling-345635-J8NHTu 2024/11/23-00:12:11.368898 140024793790016 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14885/att-00/235677.sst): first pass time = 0.28's, 244.964'MB/sec 2024/11/23-00:12:12.051361 140024793790016 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14885/att-00/235677.sst): old prealloc_size = 147639500, real_size = 17233216 2024/11/23-00:12:12.051687 140024793790016 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14885/att-00/235677.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 483457 prefix = 4 raw-key = 0.0077 GB zip-key = 0.0009 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.0561 GB zip-val = 0.0162 GB avg-val = 116.04 avg-zval = 33.48 2024/11/23-00:12:12.052092 140024793790016 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14885/att-00/235677.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0011 GB, waited 0.000 sec, Key+Value = 0.070 GB 2024/11/23-00:12:12.560915 140024793790016 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14885/att-00/235677.sst): second pass time = 0.68's, 82.290'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.51's, 37.775'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3080.794'MB/sec (index lex order gen) rebuild zvType time = 0.44's, 0.274'MB/sec write SST data time = 0.07's, 282.364'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.562'MB, throughput = 16742.241'MB/sec zip my value time = 0.68's, unzip length = 0.056'GB zip my value throughput = 82.290'MB/sec zip pipeline throughput = 82.290'MB/sec entries = 483457 avg-key = 28.00 avg-zkey = 1.92 avg-val = 116.04 avg-zval = 33.48 usrkeys = 483457 avg-key = 20.00 avg-zkey = 1.92 avg-val = 123.04 avg-zval = 33.48 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 483457 bytes = 1571248 } seq expand size = 3384199 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0097 GB value = 0.0561 GB dict = 0.56 MB all = 0.0696 GB } __ZipSize{ index = 0.0009 GB value = 0.0162 GB dict = 0.56 MB all = 0.0192 GB } UnZip/Zip{ index = 10.4352 value = 3.4662 dict = 1.00 all = 3.6179 } Zip/UnZip{ index = 0.0958 value = 0.2885 dict = 1.00 all = 0.2764 } ---------------------------- total value len = 1.538149 GB avg = 0.121 KB (by entry num) total key len = 0.355469 GB avg = 0.028 KB total ukey len = 0.253907 GB avg = 0.020 KB total ukey num = 0.012695332 Billion total entry num = 0.012695332 Billion write speed all = 0.034311234 MB/sec (with seq num) write speed all = 0.032470980 MB/sec (without seq num) 2024/11/23-00:12:12.582860 140024793790016 [compaction_job.cc:1948] [default] [JOB 14885] Generated table #235677: 483457 keys, 19248327 bytes, temperature: kWarm 2024/11/23-00:12:12.582924 140024793790016 EVENT_LOG_v1 {"time_micros": 1732291932582892, "cf_name": "default", "job": 14885, "event": "table_file_creation", "file_number": 235677, "file_size": 19248327, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3618120596, "largest_seqno": 3665857944, "table_properties": {"data_size": 16185584, "index_size": 926592, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 13536796, "raw_average_key_size": 28, "raw_value_size": 56101970, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 483457, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732291931, "oldest_key_time": 0, "file_creation_time": 1732291931, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 235677, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-00:12:12.601062 140024793790016 [compaction_job.cc:703] job-14885: subcompact[0], size: 0.502006 G, files: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14885/att-00 [235664,235665,235666,235667,235668,235669,235670,235671,235672,235673,235674,235675,235676,235677] 2024/11/23-00:12:12.687690 140024793790016 (Original Log Time 2024/11/23-00:11:29.147814) EVENT_LOG_v1 {"time_micros": 1732291889147770, "job": 14885, "event": "compaction_started", "compaction_reason": "FilesMarkedForCompaction", "files_L2": [235600], "files_L3": [235660, 235661, 235552, 235510, 235553, 235554, 235555, 235556, 235557, 235558, 235559, 235560, 235561, 235562, 235638], "score": 0.994903, "input_data_size": 523003358, "oldest_snapshot_seqno": 3666374586} 2024/11/23-00:12:12.687694 140024793790016 (Original Log Time 2024/11/23-00:12:12.686952) [compaction_job.cc:2022] [default] [JOB 14885] Compacted 1@2 + 15@3 files to L3 => 502005858 bytes 2024/11/23-00:12:12.687695 140024793790016 (Original Log Time 2024/11/23-00:12:12.687623) [compaction_job.cc:1224] [default] compacted to: files[0 0 0 14 0 0 0] max score 0.02, MB/sec: 12.0 rd, 11.6 wr, level 3, files in(1, 15) out(14 +0 blob) MB in(27.1, 471.7 +0.0 blob) out(478.8 +0.0 blob), read-write-amplify(36.1) write-amplify(17.7) OK, records in: 12781684, records dropped: 86352 output_compression: Snappy 2024/11/23-00:12:12.687700 140024793790016 (Original Log Time 2024/11/23-00:12:12.687669) EVENT_LOG_v1 {"time_micros": 1732291932687647, "cf": "default", "job": 14885, "event": "compaction_finished", "compaction_time_micros": 43453256, "compaction_time_cpu_micros": 19864616, "output_level": 3, "num_output_files": 14, "total_output_size": 502005858, "num_input_records": 12781684, "num_output_records": 12695332, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "file_write_nanos": 323521068, "file_range_sync_nanos": 0, "file_fsync_nanos": 14198, "file_prepare_write_nanos": 32788, "lsm_state": [0, 0, 0, 14, 0, 0, 0]} 2024/11/23-00:12:12.836342 140024793790016 DEBG dcompact_worker.cpp:240: HttpPost: 200 OK: url = http://nlb-7zny4kaa1poal01o64.cn-shenzhen.nlb.aliyuncs.com:8443, body = {"instanceId":"nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137","labourId":"","dbId":"d89b4006-2803-486e-b7a2-759bcf348921","dbStarts":1732256054,"starts":1732291888,"executesMs":43699,"compactionJobId":14885,"attempt":0,"compactionInputRawBytes":1826732129,"compactionInputZipBytes":523003358,"compactionOutputRawBytes":0,"compactionOutputZipBytes":502005858,"headers":{"Accept":"*/*","Connection":"close","Host":"aliyun-topling-saas.topling.cn:18443","RemoteIp":"120.24.192.169","X-Forwarded-For":"120.24.192.169","region":"cn-shenzhen","token":"e6474c481bd4415abc537135cc03626b","instance-token":"e6474c481bd4415abc537135cc03626b","provider":"aliyun","CloudMarketInstanceId":"si-59c0ae5c955845588903","MeteringAssit":"","Transfer-Encoding":"chunked","traceparent":"00-08fcbd07712b5be92f328300ecf749e6-b31425326c34ff3e-00"}}, response = 2024/11/23-00:12:12.836430 140024793790016 INFO dcompact_worker.cpp:1459: finish /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-14885/att-00: olev 3, work 43.700 s, result 4.936 ms, install 0.766 ms, input{raw 1.701 GiB zip 498.775 MiB}