2024/11/22-20:32:32.966825 140025028785728 DEBG dcompact_worker.cpp:2214: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10310/att-00: fork to child time = 0.009247 sec 2024/11/22-20:32:32.967659 140025028785728 DEBG dcompact_worker.cpp:1013: Beg SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10310/att-00 2024/11/22-20:32:32.974933 140025028785728 DEBG dcompact_worker.cpp:1033: End SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10310/att-00 2024/11/22-20:32:32.976062 140025028785728 TRAC dcompact_worker.cpp:1083: INFO_LOG_LEVEL: rpc = INFO_LEVEL, env_var = undefined 2024/11/22-20:32:32.976331 140025028785728 [WARN] [column_family.cc:386] multiple cf_paths/db_paths and level_compaction_dynamic_level_bytes can't be used together 2024/11/22-20:32:33.034942 140025028785728 [version_set.cc:6208] Recovering from manifest file: /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-10310/att-00/MANIFEST-206347 2024/11/22-20:32:33.066190 140025028785728 [version_set.cc:6251] Recovered from manifest file:/worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-10310/att-00/MANIFEST-206347 succeeded,manifest_file_number is 206347, next_file_number is 226299, last_sequence is 3542809176, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 226110 2024/11/22-20:32:33.066201 140025028785728 [version_set.cc:6266] Column family [default] (ID 0), log number is 0 2024/11/22-20:32:33.066434 140025028785728 [version_set.cc:5721] Creating manifest 226299 2024/11/22-20:32:33.097426 140025028785728 DEBG dcompact_worker.cpp:1218: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10310/att-00: bottommost_level: fake = 1, rpc = 0 2024/11/22-20:32:33.118118 140025028785728 [compaction_job.cc:2437] [default] [JOB 10310] Compacting 1@2 + 14@3 files to L3, score 1.00, subcompactions 1 : 1 2024/11/22-20:32:33.118144 140025028785728 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 7795 Base level 2, inputs: [226250(27MB)], [226219(36MB) 226220(6860KB) 226172(35MB) 226173(35MB) 226174(35MB) 226175(35MB) 226176(35MB) 226177(34MB) 226178(34MB) 226197(36MB) 226198(36MB) 226199(35MB) 226200(35MB) 226289(36MB)] 2024/11/22-20:32:33.124156 140025028785728 [top_zip_table.cc:59] core git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/22-20:32:33.124190 140025028785728 [top_zip_table.cc:60] fsa git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/22-20:32:33.124211 140025028785728 [top_zip_table.cc:61] zbs git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/22-20:32:33.124217 140025028785728 [top_zip_table.cc:62] topling-zip_table_reader: git_version_hash_info_is: commit a4a382006cb82713acf5b3425835f22711877681 Author: leipeng Date: 2024-04-11 19:44:14 +0800 fixed_len_hole_index.cc: Add env bool FixedLenHoleIndexUseAVX512 for ut & debug 1. FixedLenHoleIndexUseAVX512 is only in unit tests or debug 2. In release mode, use avx512 by compile options(-march=) g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/22-20:32:33.124228 140025028785728 [top_zip_table.cc:64] topling-rocks git_version_hash_info_is: commit feab587e468621ba0204d47b4ffacc52e7c4290d Author: leipeng Date: 2024-03-22 13:35:06 +0800 ToplingZipTableBuilder::Add: immediately return after error This function returns void, and caller does not check builder->status() after calling this function and graceful abandon. So immediately return after error, and return error status in Finish(). g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/22-20:32:33.628360 140025028785728 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10310/att-00/226300.sst) /dev/shm/ToplingTemp/Topling-280575-AjyOc0 2024/11/22-20:32:34.182432 140025028785728 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10310/att-00/226300.sst): first pass time = 0.55's, 242.258'MB/sec 2024/11/22-20:32:35.717493 140025028785728 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10310/att-00/226300.sst): old prealloc_size = 147639500, real_size = 33720672 2024/11/22-20:32:35.718051 140025028785728 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10310/att-00/226300.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 924096 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0317 GB avg-val = 117.24 avg-zval = 34.34 2024/11/22-20:32:35.718847 140025028785728 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10310/att-00/226300.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-20:32:36.666543 140025028785728 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10310/att-00/226300.sst): second pass time = 1.53's, 70.637'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.95's, 39.842'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3237.953'MB/sec (index lex order gen) rebuild zvType time = 0.82's, 0.283'MB/sec write SST data time = 0.13's, 288.175'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.082'MB, throughput = 32879.604'MB/sec zip my value time = 1.53's, unzip length = 0.108'GB zip my value throughput = 70.637'MB/sec zip pipeline throughput = 112.577'MB/sec entries = 924096 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.24 avg-zval = 34.34 usrkeys = 924096 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.24 avg-zval = 34.34 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 924096 bytes = 3234352 } seq expand size = 6468672 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0317 GB dict = 1.08 MB all = 0.0378 GB } UnZip/Zip{ index = 10.5152 value = 3.4143 dict = 1.00 all = 3.5496 } Zip/UnZip{ index = 0.0951 value = 0.2929 dict = 1.00 all = 0.2817 } ---------------------------- total value len = 0.114812 GB avg = 0.124 KB (by entry num) total key len = 0.025875 GB avg = 0.028 KB total ukey len = 0.018482 GB avg = 0.020 KB total ukey num = 0.000924096 Billion total entry num = 0.000924096 Billion write speed all = 0.003348597 MB/sec (with seq num) write speed all = 0.003172636 MB/sec (without seq num) 2024/11/22-20:32:36.700499 140025028785728 [compaction_job.cc:1948] [default] [JOB 10310] Generated table #226300: 924096 keys, 37811810 bytes, temperature: kWarm 2024/11/22-20:32:36.700592 140025028785728 EVENT_LOG_v1 {"time_micros": 1732278756700537, "cf_name": "default", "job": 10310, "event": "table_file_creation", "file_number": 226300, "file_size": 37811810, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3376774746, "largest_seqno": 3542443847, "table_properties": {"data_size": 31731856, "index_size": 1757632, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25874688, "raw_average_key_size": 28, "raw_value_size": 108343164, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 924096, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732278753, "oldest_key_time": 0, "file_creation_time": 1732278753, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 226300, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-20:32:36.740053 140025028785728 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10310/att-00/226301.sst) /dev/shm/ToplingTemp/Topling-280575-xXAMEV 2024/11/22-20:32:37.692883 140025028785728 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10310/att-00/226301.sst): first pass time = 0.95's, 140.868'MB/sec 2024/11/22-20:32:39.114505 140025028785728 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10310/att-00/226301.sst): old prealloc_size = 147639500, real_size = 33716352 2024/11/22-20:32:39.115060 140025028785728 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10310/att-00/226301.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 923898 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0317 GB avg-val = 117.27 avg-zval = 34.34 2024/11/22-20:32:39.115830 140025028785728 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10310/att-00/226301.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-20:32:40.057030 140025028785728 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10310/att-00/226301.sst): second pass time = 1.42's, 76.288'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.94's, 40.113'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3276.573'MB/sec (index lex order gen) rebuild zvType time = 0.81's, 0.284'MB/sec write SST data time = 0.13's, 291.951'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.082'MB, throughput = 38125.110'MB/sec zip my value time = 1.42's, unzip length = 0.108'GB zip my value throughput = 76.288'MB/sec zip pipeline throughput = 76.422'MB/sec entries = 923898 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.27 avg-zval = 34.34 usrkeys = 923898 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.27 avg-zval = 34.34 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 923898 bytes = 3233664 } seq expand size = 6467286 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0317 GB dict = 1.08 MB all = 0.0378 GB } UnZip/Zip{ index = 10.5122 value = 3.4150 dict = 1.00 all = 3.5501 } Zip/UnZip{ index = 0.0951 value = 0.2928 dict = 1.00 all = 0.2817 } ---------------------------- total value len = 0.229628 GB avg = 0.124 KB (by entry num) total key len = 0.051744 GB avg = 0.028 KB total ukey len = 0.036960 GB avg = 0.020 KB total ukey num = 0.001847994 Billion total entry num = 0.001847994 Billion write speed all = 0.006696620 MB/sec (with seq num) write speed all = 0.006344763 MB/sec (without seq num) 2024/11/22-20:32:40.090576 140025028785728 [compaction_job.cc:1948] [default] [JOB 10310] Generated table #226301: 923898 keys, 37807290 bytes, temperature: kWarm 2024/11/22-20:32:40.090639 140025028785728 EVENT_LOG_v1 {"time_micros": 1732278760090606, "cf_name": "default", "job": 10310, "event": "table_file_creation", "file_number": 226301, "file_size": 37807290, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3376774766, "largest_seqno": 3542445865, "table_properties": {"data_size": 31727408, "index_size": 1757760, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25869144, "raw_average_key_size": 28, "raw_value_size": 108348652, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 923898, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732278756, "oldest_key_time": 0, "file_creation_time": 1732278756, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 226301, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-20:32:40.126955 140025028785728 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10310/att-00/226302.sst) /dev/shm/ToplingTemp/Topling-280575-reFMgY 2024/11/22-20:32:41.027166 140025028785728 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10310/att-00/226302.sst): first pass time = 0.90's, 149.102'MB/sec 2024/11/22-20:32:42.451914 140025028785728 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10310/att-00/226302.sst): old prealloc_size = 147639500, real_size = 33610176 2024/11/22-20:32:42.452432 140025028785728 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10310/att-00/226302.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 923909 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0316 GB avg-val = 117.27 avg-zval = 34.23 2024/11/22-20:32:42.453214 140025028785728 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10310/att-00/226302.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-20:32:43.394998 140025028785728 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10310/att-00/226302.sst): second pass time = 1.42's, 76.104'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.94's, 39.977'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3570.608'MB/sec (index lex order gen) rebuild zvType time = 0.81's, 0.284'MB/sec write SST data time = 0.13's, 289.304'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.082'MB, throughput = 35454.897'MB/sec zip my value time = 1.42's, unzip length = 0.108'GB zip my value throughput = 76.104'MB/sec zip pipeline throughput = 76.104'MB/sec entries = 923909 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.27 avg-zval = 34.23 usrkeys = 923909 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.27 avg-zval = 34.23 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 923909 bytes = 3233696 } seq expand size = 6467363 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0316 GB dict = 1.08 MB all = 0.0377 GB } UnZip/Zip{ index = 10.5131 value = 3.4264 dict = 1.00 all = 3.5600 } Zip/UnZip{ index = 0.0951 value = 0.2918 dict = 1.00 all = 0.2809 } ---------------------------- total value len = 0.344443 GB avg = 0.124 KB (by entry num) total key len = 0.077613 GB avg = 0.028 KB total ukey len = 0.055438 GB avg = 0.020 KB total ukey num = 0.002771903 Billion total entry num = 0.002771903 Billion write speed all = 0.010044116 MB/sec (with seq num) write speed all = 0.009516390 MB/sec (without seq num) 2024/11/22-20:32:43.431253 140025028785728 [compaction_job.cc:1948] [default] [JOB 10310] Generated table #226302: 923909 keys, 37701142 bytes, temperature: kWarm 2024/11/22-20:32:43.431319 140025028785728 EVENT_LOG_v1 {"time_micros": 1732278763431283, "cf_name": "default", "job": 10310, "event": "table_file_creation", "file_number": 226302, "file_size": 37701142, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3376774786, "largest_seqno": 3542445885, "table_properties": {"data_size": 31621360, "index_size": 1757632, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25869452, "raw_average_key_size": 28, "raw_value_size": 108348350, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 923909, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732278760, "oldest_key_time": 0, "file_creation_time": 1732278760, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 226302, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-20:32:43.465844 140025028785728 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10310/att-00/226303.sst) /dev/shm/ToplingTemp/Topling-280575-tREM6X 2024/11/22-20:32:44.355449 140025028785728 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10310/att-00/226303.sst): first pass time = 0.89's, 150.879'MB/sec 2024/11/22-20:32:45.817826 140025028785728 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10310/att-00/226303.sst): old prealloc_size = 147639500, real_size = 33514176 2024/11/22-20:32:45.818383 140025028785728 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10310/att-00/226303.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 923965 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1083 GB zip-val = 0.0315 GB avg-val = 117.26 avg-zval = 34.11 2024/11/22-20:32:45.819150 140025028785728 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10310/att-00/226303.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-20:32:46.750023 140025028785728 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10310/att-00/226303.sst): second pass time = 1.46's, 74.125'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.93's, 40.341'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3320.758'MB/sec (index lex order gen) rebuild zvType time = 0.80's, 0.288'MB/sec write SST data time = 0.13's, 292.927'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.082'MB, throughput = 35041.567'MB/sec zip my value time = 1.46's, unzip length = 0.108'GB zip my value throughput = 74.125'MB/sec zip pipeline throughput = 74.125'MB/sec entries = 923965 avg-key = 28.00 avg-zkey = 1.91 avg-val = 117.26 avg-zval = 34.11 usrkeys = 923965 avg-key = 20.00 avg-zkey = 1.91 avg-val = 124.26 avg-zval = 34.11 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 923965 bytes = 3233888 } seq expand size = 6467755 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0315 GB dict = 1.08 MB all = 0.0376 GB } UnZip/Zip{ index = 10.4487 value = 3.4380 dict = 1.00 all = 3.5691 } Zip/UnZip{ index = 0.0957 value = 0.2909 dict = 1.00 all = 0.2802 } ---------------------------- total value len = 0.459258 GB avg = 0.124 KB (by entry num) total key len = 0.103484 GB avg = 0.028 KB total ukey len = 0.073917 GB avg = 0.020 KB total ukey num = 0.003695868 Billion total entry num = 0.003695868 Billion write speed all = 0.013391084 MB/sec (with seq num) write speed all = 0.012687505 MB/sec (without seq num) 2024/11/22-20:32:46.782710 140025028785728 [compaction_job.cc:1948] [default] [JOB 10310] Generated table #226303: 923965 keys, 37605394 bytes, temperature: kWarm 2024/11/22-20:32:46.782776 140025028785728 EVENT_LOG_v1 {"time_micros": 1732278766782743, "cf_name": "default", "job": 10310, "event": "table_file_creation", "file_number": 226303, "file_size": 37605394, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3376774802, "largest_seqno": 3542445895, "table_properties": {"data_size": 31514416, "index_size": 1768576, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25871020, "raw_average_key_size": 28, "raw_value_size": 108346734, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 923965, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732278763, "oldest_key_time": 0, "file_creation_time": 1732278763, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 226303, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-20:32:46.819511 140025028785728 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10310/att-00/226304.sst) /dev/shm/ToplingTemp/Topling-280575-Il8qlY 2024/11/22-20:32:47.627467 140025028785728 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10310/att-00/226304.sst): first pass time = 0.81's, 166.129'MB/sec 2024/11/22-20:32:49.113668 140025028785728 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10310/att-00/226304.sst): old prealloc_size = 147639500, real_size = 33806992 2024/11/22-20:32:49.114197 140025028785728 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10310/att-00/226304.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 926259 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0318 GB avg-val = 116.90 avg-zval = 34.35 2024/11/22-20:32:49.114801 140025028785728 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10310/att-00/226304.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-20:32:49.980790 140025028785728 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10310/att-00/226304.sst): second pass time = 1.49's, 72.891'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.87's, 42.639'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3525.155'MB/sec (index lex order gen) rebuild zvType time = 0.74's, 0.315'MB/sec write SST data time = 0.13's, 282.144'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 27360.740'MB/sec zip my value time = 1.49's, unzip length = 0.108'GB zip my value throughput = 72.891'MB/sec zip pipeline throughput = 75.937'MB/sec entries = 926259 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.90 avg-zval = 34.35 usrkeys = 926259 avg-key = 20.00 avg-zkey = 1.90 avg-val = 121.75 avg-zval = 34.35 TagRS{ kinds = RS_Key0_TagN bytes = 144840 } TagArray{ size = 640776 bytes = 2162640 } seq expand size = 4485432 multi value expand size = 0 cnt WriteAppend = 16 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0318 GB dict = 1.08 MB all = 0.0370 GB } UnZip/Zip{ index = 10.5131 value = 3.4037 dict = 1.00 all = 3.6302 } Zip/UnZip{ index = 0.0951 value = 0.2938 dict = 1.00 all = 0.2755 } ---------------------------- total value len = 0.572026 GB avg = 0.124 KB (by entry num) total key len = 0.129420 GB avg = 0.028 KB total ukey len = 0.092443 GB avg = 0.020 KB total ukey num = 0.004622127 Billion total entry num = 0.004622127 Billion write speed all = 0.016690399 MB/sec (with seq num) write speed all = 0.015810557 MB/sec (without seq num) 2024/11/22-20:32:50.013555 140025028785728 [compaction_job.cc:1948] [default] [JOB 10310] Generated table #226304: 926259 keys, 36972762 bytes, temperature: kWarm 2024/11/22-20:32:50.013616 140025028785728 EVENT_LOG_v1 {"time_micros": 1732278770013586, "cf_name": "default", "job": 10310, "event": "table_file_creation", "file_number": 226304, "file_size": 36972762, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3542445910, "table_properties": {"data_size": 31813120, "index_size": 1762112, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25935252, "raw_average_key_size": 28, "raw_value_size": 108282522, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 926259, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732278766, "oldest_key_time": 0, "file_creation_time": 1732278766, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 226304, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-20:32:50.054031 140025028785728 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10310/att-00/226305.sst) /dev/shm/ToplingTemp/Topling-280575-12U2YV 2024/11/22-20:32:50.882938 140025028785728 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10310/att-00/226305.sst): first pass time = 0.83's, 161.929'MB/sec 2024/11/22-20:32:52.302753 140025028785728 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10310/att-00/226305.sst): old prealloc_size = 147639500, real_size = 34948768 2024/11/22-20:32:52.303374 140025028785728 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10310/att-00/226305.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 1081472 prefix = 4 raw-key = 0.0173 GB zip-key = 0.0021 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1039 GB zip-val = 0.0326 GB avg-val = 96.11 avg-zval = 30.16 2024/11/22-20:32:52.303414 140025028785728 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10310/att-00/226305.sst: sumWaitingMem = 0.003 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0028 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-20:32:52.931557 140025028785728 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10310/att-00/226305.sst): second pass time = 1.42's, 73.257'MB/sec, value only(77.4% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.63's, 56.813'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3486.698'MB/sec (index lex order gen) rebuild zvType time = 0.48's, 0.558'MB/sec write SST data time = 0.14's, 248.607'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.034'MB, throughput = 32712.289'MB/sec zip my value time = 1.42's, unzip length = 0.104'GB zip my value throughput = 73.257'MB/sec zip pipeline throughput = 73.257'MB/sec entries = 1081472 avg-key = 28.00 avg-zkey = 1.90 avg-val = 96.11 avg-zval = 30.16 usrkeys = 1081472 avg-key = 20.00 avg-zkey = 1.90 avg-val = 96.11 avg-zval = 30.16 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 10 UnZipSize{ index = 0.0216 GB value = 0.1039 GB dict = 1.03 MB all = 0.1342 GB } __ZipSize{ index = 0.0021 GB value = 0.0326 GB dict = 1.03 MB all = 0.0357 GB } UnZip/Zip{ index = 10.5162 value = 3.1861 dict = 1.00 all = 3.7571 } Zip/UnZip{ index = 0.0951 value = 0.3139 dict = 1.00 all = 0.2662 } ---------------------------- total value len = 0.675963 GB avg = 0.119 KB (by entry num) total key len = 0.159701 GB avg = 0.028 KB total ukey len = 0.114072 GB avg = 0.020 KB total ukey num = 0.005703599 Billion total entry num = 0.005703599 Billion write speed all = 0.019882622 MB/sec (with seq num) write speed all = 0.018796993 MB/sec (without seq num) 2024/11/22-20:32:52.966263 140025028785728 [compaction_job.cc:1948] [default] [JOB 10310] Generated table #226305: 1081472 keys, 35723774 bytes, temperature: kWarm 2024/11/22-20:32:52.966318 140025028785728 EVENT_LOG_v1 {"time_micros": 1732278772966288, "cf_name": "default", "job": 10310, "event": "table_file_creation", "file_number": 226305, "file_size": 35723774, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 32621456, "index_size": 2056768, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 30281216, "raw_average_key_size": 28, "raw_value_size": 103936621, "raw_average_value_size": 96, "num_data_blocks": 1, "num_entries": 1081472, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732278770, "oldest_key_time": 0, "file_creation_time": 1732278770, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 226305, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-20:32:53.010708 140025028785728 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10310/att-00/226306.sst) /dev/shm/ToplingTemp/Topling-280575-Xq3ajY 2024/11/22-20:32:53.852187 140025028785728 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10310/att-00/226306.sst): first pass time = 0.84's, 159.509'MB/sec 2024/11/22-20:32:55.155776 140025028785728 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10310/att-00/226306.sst): old prealloc_size = 147639500, real_size = 31593536 2024/11/22-20:32:55.156311 140025028785728 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10310/att-00/226306.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 921245 prefix = 4 raw-key = 0.0147 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1084 GB zip-val = 0.0296 GB avg-val = 117.69 avg-zval = 32.13 2024/11/22-20:32:55.157102 140025028785728 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10310/att-00/226306.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-20:32:56.015762 140025028785728 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10310/att-00/226306.sst): second pass time = 1.30's, 83.211'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.86's, 41.702'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3502.742'MB/sec (index lex order gen) rebuild zvType time = 0.73's, 0.317'MB/sec write SST data time = 0.13's, 267.468'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.084'MB, throughput = 33549.729'MB/sec zip my value time = 1.30's, unzip length = 0.108'GB zip my value throughput = 83.211'MB/sec zip pipeline throughput = 83.211'MB/sec entries = 921245 avg-key = 28.00 avg-zkey = 1.92 avg-val = 117.69 avg-zval = 32.13 usrkeys = 921245 avg-key = 20.00 avg-zkey = 1.92 avg-val = 124.53 avg-zval = 32.13 TagRS{ kinds = RS_Key0_TagN bytes = 144040 } TagArray{ size = 899797 bytes = 3261776 } seq expand size = 6298579 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0184 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0296 GB dict = 1.08 MB all = 0.0359 GB } UnZip/Zip{ index = 10.4429 value = 3.6631 dict = 1.00 all = 3.7426 } Zip/UnZip{ index = 0.0958 value = 0.2730 dict = 1.00 all = 0.2672 } ---------------------------- total value len = 0.790684 GB avg = 0.119 KB (by entry num) total key len = 0.185496 GB avg = 0.028 KB total ukey len = 0.132497 GB avg = 0.020 KB total ukey num = 0.006624844 Billion total entry num = 0.006624844 Billion write speed all = 0.023224172 MB/sec (with seq num) write speed all = 0.021963285 MB/sec (without seq num) 2024/11/22-20:32:56.051870 140025028785728 [compaction_job.cc:1948] [default] [JOB 10310] Generated table #226306: 921245 keys, 35862400 bytes, temperature: kWarm 2024/11/22-20:32:56.051930 140025028785728 EVENT_LOG_v1 {"time_micros": 1732278776051900, "cf_name": "default", "job": 10310, "event": "table_file_creation", "file_number": 226306, "file_size": 35862400, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3542444092, "table_properties": {"data_size": 29598704, "index_size": 1764352, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25794860, "raw_average_key_size": 28, "raw_value_size": 108422986, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 921245, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732278772, "oldest_key_time": 0, "file_creation_time": 1732278772, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 226306, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-20:32:56.089074 140025028785728 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10310/att-00/226307.sst) /dev/shm/ToplingTemp/Topling-280575-ifJY5X 2024/11/22-20:32:56.949207 140025028785728 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10310/att-00/226307.sst): first pass time = 0.86's, 156.051'MB/sec 2024/11/22-20:32:58.246907 140025028785728 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10310/att-00/226307.sst): old prealloc_size = 147639500, real_size = 32185728 2024/11/22-20:32:58.247426 140025028785728 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10310/att-00/226307.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 923537 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1084 GB zip-val = 0.0302 GB avg-val = 117.33 avg-zval = 32.70 2024/11/22-20:32:58.248175 140025028785728 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10310/att-00/226307.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-20:32:59.129281 140025028785728 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10310/att-00/226307.sst): second pass time = 1.30's, 83.545'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.88's, 41.112'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3532.287'MB/sec (index lex order gen) rebuild zvType time = 0.75's, 0.307'MB/sec write SST data time = 0.13's, 281.580'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.083'MB, throughput = 36579.788'MB/sec zip my value time = 1.30's, unzip length = 0.108'GB zip my value throughput = 83.545'MB/sec zip pipeline throughput = 83.545'MB/sec entries = 923537 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.33 avg-zval = 32.70 usrkeys = 923537 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.33 avg-zval = 32.70 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 923537 bytes = 3232400 } seq expand size = 6464759 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0302 GB dict = 1.08 MB all = 0.0363 GB } UnZip/Zip{ index = 10.5131 value = 3.5883 dict = 1.00 all = 3.6999 } Zip/UnZip{ index = 0.0951 value = 0.2787 dict = 1.00 all = 0.2703 } ---------------------------- total value len = 0.905508 GB avg = 0.120 KB (by entry num) total key len = 0.211355 GB avg = 0.028 KB total ukey len = 0.150968 GB avg = 0.020 KB total ukey num = 0.007548381 Billion total entry num = 0.007548381 Billion write speed all = 0.026569164 MB/sec (with seq num) write speed all = 0.025132609 MB/sec (without seq num) 2024/11/22-20:32:59.161338 140025028785728 [compaction_job.cc:1948] [default] [JOB 10310] Generated table #226307: 923537 keys, 36275756 bytes, temperature: kWarm 2024/11/22-20:32:59.161397 140025028785728 EVENT_LOG_v1 {"time_micros": 1732278779161366, "cf_name": "default", "job": 10310, "event": "table_file_creation", "file_number": 226307, "file_size": 36275756, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3394785136, "largest_seqno": 3542445619, "table_properties": {"data_size": 30197744, "index_size": 1756928, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25859036, "raw_average_key_size": 28, "raw_value_size": 108358702, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 923537, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732278776, "oldest_key_time": 0, "file_creation_time": 1732278776, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 226307, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-20:32:59.195795 140025028785728 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10310/att-00/226308.sst) /dev/shm/ToplingTemp/Topling-280575-pY2S4Y 2024/11/22-20:33:00.107714 140025028785728 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10310/att-00/226308.sst): first pass time = 0.91's, 147.188'MB/sec 2024/11/22-20:33:01.474644 140025028785728 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10310/att-00/226308.sst): old prealloc_size = 147639500, real_size = 33845328 2024/11/22-20:33:01.475218 140025028785728 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10310/att-00/226308.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 928180 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0318 GB avg-val = 116.60 avg-zval = 34.31 2024/11/22-20:33:01.476002 140025028785728 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10310/att-00/226308.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-20:33:02.387902 140025028785728 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10310/att-00/226308.sst): second pass time = 1.37's, 79.216'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.91's, 41.679'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3211.639'MB/sec (index lex order gen) rebuild zvType time = 0.78's, 0.297'MB/sec write SST data time = 0.13's, 290.019'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 34866.324'MB/sec zip my value time = 1.37's, unzip length = 0.108'GB zip my value throughput = 79.216'MB/sec zip pipeline throughput = 79.216'MB/sec entries = 928180 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.60 avg-zval = 34.31 usrkeys = 928180 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.60 avg-zval = 34.31 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 928180 bytes = 3364672 } seq expand size = 6497260 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0318 GB dict = 1.08 MB all = 0.0381 GB } UnZip/Zip{ index = 10.5116 value = 3.3984 dict = 1.00 all = 3.5262 } Zip/UnZip{ index = 0.0951 value = 0.2943 dict = 1.00 all = 0.2836 } ---------------------------- total value len = 1.020234 GB avg = 0.120 KB (by entry num) total key len = 0.237344 GB avg = 0.028 KB total ukey len = 0.169531 GB avg = 0.020 KB total ukey num = 0.008476561 Billion total entry num = 0.008476561 Billion write speed all = 0.029914330 MB/sec (with seq num) write speed all = 0.028301256 MB/sec (without seq num) 2024/11/22-20:33:02.422629 140025028785728 [compaction_job.cc:1948] [default] [JOB 10310] Generated table #226308: 928180 keys, 38063390 bytes, temperature: kWarm 2024/11/22-20:33:02.422695 140025028785728 EVENT_LOG_v1 {"time_micros": 1732278782422658, "cf_name": "default", "job": 10310, "event": "table_file_creation", "file_number": 226308, "file_size": 38063390, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3273701103, "largest_seqno": 3542445966, "table_properties": {"data_size": 31847104, "index_size": 1766016, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25989040, "raw_average_key_size": 28, "raw_value_size": 108228700, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 928180, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732278779, "oldest_key_time": 0, "file_creation_time": 1732278779, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 226308, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-20:33:02.457041 140025028785728 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10310/att-00/226309.sst) /dev/shm/ToplingTemp/Topling-280575-k1L2PZ 2024/11/22-20:33:03.307544 140025028785728 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10310/att-00/226309.sst): first pass time = 0.85's, 157.817'MB/sec 2024/11/22-20:33:04.640964 140025028785728 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10310/att-00/226309.sst): old prealloc_size = 147639500, real_size = 33582192 2024/11/22-20:33:04.641494 140025028785728 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10310/att-00/226309.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 928531 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.93 raw-val = 0.1082 GB zip-val = 0.0316 GB avg-val = 116.55 avg-zval = 33.99 2024/11/22-20:33:04.643571 140025028785728 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10310/att-00/226309.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-20:33:05.569839 140025028785728 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10310/att-00/226309.sst): second pass time = 1.33's, 81.196'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.93's, 40.572'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3573.616'MB/sec (index lex order gen) rebuild zvType time = 0.80's, 0.291'MB/sec write SST data time = 0.13's, 289.100'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 28575.663'MB/sec zip my value time = 1.33's, unzip length = 0.108'GB zip my value throughput = 81.196'MB/sec zip pipeline throughput = 81.196'MB/sec entries = 928531 avg-key = 28.00 avg-zkey = 1.93 avg-val = 116.55 avg-zval = 33.99 usrkeys = 928531 avg-key = 20.00 avg-zkey = 1.93 avg-val = 123.55 avg-zval = 33.99 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 928531 bytes = 3249872 } seq expand size = 6499717 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0316 GB dict = 1.08 MB all = 0.0377 GB } UnZip/Zip{ index = 10.3760 value = 3.4290 dict = 1.00 all = 3.5615 } Zip/UnZip{ index = 0.0964 value = 0.2916 dict = 1.00 all = 0.2808 } ---------------------------- total value len = 1.134952 GB avg = 0.121 KB (by entry num) total key len = 0.263343 GB avg = 0.028 KB total ukey len = 0.188102 GB avg = 0.020 KB total ukey num = 0.009405092 Billion total entry num = 0.009405092 Billion write speed all = 0.033259098 MB/sec (with seq num) write speed all = 0.031469462 MB/sec (without seq num) 2024/11/22-20:33:05.603406 140025028785728 [compaction_job.cc:1948] [default] [JOB 10310] Generated table #226309: 928531 keys, 37685344 bytes, temperature: kWarm 2024/11/22-20:33:05.603467 140025028785728 EVENT_LOG_v1 {"time_micros": 1732278785603437, "cf_name": "default", "job": 10310, "event": "table_file_creation", "file_number": 226309, "file_size": 37685344, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3326330223, "largest_seqno": 3542446324, "table_properties": {"data_size": 31560096, "index_size": 1789760, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25998868, "raw_average_key_size": 28, "raw_value_size": 108218942, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 928531, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732278782, "oldest_key_time": 0, "file_creation_time": 1732278782, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 226309, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-20:33:05.640293 140025028785728 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10310/att-00/226310.sst) /dev/shm/ToplingTemp/Topling-280575-ONJgZX 2024/11/22-20:33:06.565286 140025028785728 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10310/att-00/226310.sst): first pass time = 0.92's, 145.108'MB/sec 2024/11/22-20:33:07.922804 140025028785728 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10310/att-00/226310.sst): old prealloc_size = 147639500, real_size = 33866512 2024/11/22-20:33:07.923312 140025028785728 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10310/att-00/226310.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 923911 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0319 GB avg-val = 117.27 avg-zval = 34.50 2024/11/22-20:33:07.924239 140025028785728 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10310/att-00/226310.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-20:33:08.858256 140025028785728 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10310/att-00/226310.sst): second pass time = 1.36's, 79.872'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.94's, 40.700'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3640.315'MB/sec (index lex order gen) rebuild zvType time = 0.81's, 0.287'MB/sec write SST data time = 0.13's, 294.481'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.082'MB, throughput = 34195.564'MB/sec zip my value time = 1.36's, unzip length = 0.108'GB zip my value throughput = 79.872'MB/sec zip pipeline throughput = 79.872'MB/sec entries = 923911 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.27 avg-zval = 34.50 usrkeys = 923911 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.27 avg-zval = 34.50 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 923911 bytes = 3349200 } seq expand size = 6467377 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0319 GB dict = 1.08 MB all = 0.0381 GB } UnZip/Zip{ index = 10.5139 value = 3.3989 dict = 1.00 all = 3.5253 } Zip/UnZip{ index = 0.0951 value = 0.2942 dict = 1.00 all = 0.2837 } ---------------------------- total value len = 1.249768 GB avg = 0.121 KB (by entry num) total key len = 0.289212 GB avg = 0.028 KB total ukey len = 0.206580 GB avg = 0.020 KB total ukey num = 0.010329003 Billion total entry num = 0.010329003 Billion write speed all = 0.036602498 MB/sec (with seq num) write speed all = 0.034637210 MB/sec (without seq num) 2024/11/22-20:33:08.892953 140025028785728 [compaction_job.cc:1948] [default] [JOB 10310] Generated table #226310: 923911 keys, 38072902 bytes, temperature: kWarm 2024/11/22-20:33:08.893016 140025028785728 EVENT_LOG_v1 {"time_micros": 1732278788892984, "cf_name": "default", "job": 10310, "event": "table_file_creation", "file_number": 226310, "file_size": 38072902, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3273701165, "largest_seqno": 3542446205, "table_properties": {"data_size": 31877824, "index_size": 1757504, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25869508, "raw_average_key_size": 28, "raw_value_size": 108348262, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 923911, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732278785, "oldest_key_time": 0, "file_creation_time": 1732278785, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 226310, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-20:33:08.928842 140025028785728 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10310/att-00/226311.sst) /dev/shm/ToplingTemp/Topling-280575-DHNJAX 2024/11/22-20:33:09.796850 140025028785728 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10310/att-00/226311.sst): first pass time = 0.87's, 154.634'MB/sec 2024/11/22-20:33:11.142748 140025028785728 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10310/att-00/226311.sst): old prealloc_size = 147639500, real_size = 33703056 2024/11/22-20:33:11.143313 140025028785728 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10310/att-00/226311.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 923909 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0317 GB avg-val = 117.27 avg-zval = 34.33 2024/11/22-20:33:11.144101 140025028785728 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10310/att-00/226311.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-20:33:12.081424 140025028785728 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10310/att-00/226311.sst): second pass time = 1.34's, 80.573'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.94's, 40.264'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3288.724'MB/sec (index lex order gen) rebuild zvType time = 0.81's, 0.286'MB/sec write SST data time = 0.13's, 291.569'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.083'MB, throughput = 35269.866'MB/sec zip my value time = 1.34's, unzip length = 0.108'GB zip my value throughput = 80.573'MB/sec zip pipeline throughput = 80.573'MB/sec entries = 923909 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.27 avg-zval = 34.33 usrkeys = 923909 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.27 avg-zval = 34.33 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 923909 bytes = 3233696 } seq expand size = 6467363 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0317 GB dict = 1.08 MB all = 0.0378 GB } UnZip/Zip{ index = 10.5131 value = 3.4164 dict = 1.00 all = 3.5513 } Zip/UnZip{ index = 0.0951 value = 0.2927 dict = 1.00 all = 0.2816 } ---------------------------- total value len = 1.364584 GB avg = 0.121 KB (by entry num) total key len = 0.315082 GB avg = 0.028 KB total ukey len = 0.225058 GB avg = 0.020 KB total ukey num = 0.011252912 Billion total entry num = 0.011252912 Billion write speed all = 0.039945438 MB/sec (with seq num) write speed all = 0.037804523 MB/sec (without seq num) 2024/11/22-20:33:12.114965 140025028785728 [compaction_job.cc:1948] [default] [JOB 10310] Generated table #226311: 923909 keys, 37794106 bytes, temperature: kWarm 2024/11/22-20:33:12.115027 140025028785728 EVENT_LOG_v1 {"time_micros": 1732278792114995, "cf_name": "default", "job": 10310, "event": "table_file_creation", "file_number": 226311, "file_size": 37794106, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3388810268, "largest_seqno": 3542446114, "table_properties": {"data_size": 31714240, "index_size": 1757632, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25869452, "raw_average_key_size": 28, "raw_value_size": 108348386, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 923909, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732278788, "oldest_key_time": 0, "file_creation_time": 1732278788, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 226311, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-20:33:12.153117 140025028785728 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10310/att-00/226312.sst) /dev/shm/ToplingTemp/Topling-280575-LlRJKV 2024/11/22-20:33:13.083175 140025028785728 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10310/att-00/226312.sst): first pass time = 0.93's, 144.318'MB/sec 2024/11/22-20:33:14.431930 140025028785728 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10310/att-00/226312.sst): old prealloc_size = 147639500, real_size = 33925392 2024/11/22-20:33:14.432497 140025028785728 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10310/att-00/226312.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 929726 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.89 raw-val = 0.1082 GB zip-val = 0.0319 GB avg-val = 116.36 avg-zval = 34.35 2024/11/22-20:33:14.433163 140025028785728 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10310/att-00/226312.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/22-20:33:15.323673 140025028785728 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10310/att-00/226312.sst): second pass time = 1.35's, 80.278'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.89's, 42.137'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3221.774'MB/sec (index lex order gen) rebuild zvType time = 0.76's, 0.306'MB/sec write SST data time = 0.13's, 283.721'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 34652.541'MB/sec zip my value time = 1.35's, unzip length = 0.108'GB zip my value throughput = 80.278'MB/sec zip pipeline throughput = 80.278'MB/sec entries = 929726 avg-key = 28.00 avg-zkey = 1.89 avg-val = 116.36 avg-zval = 34.35 usrkeys = 929726 avg-key = 20.00 avg-zkey = 1.89 avg-val = 122.06 avg-zval = 34.35 TagRS{ kinds = RS_Key0_TagN bytes = 145360 } TagArray{ size = 756428 bytes = 2647520 } seq expand size = 5294996 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0319 GB dict = 1.08 MB all = 0.0376 GB } UnZip/Zip{ index = 10.5824 value = 3.3876 dict = 1.00 all = 3.5720 } Zip/UnZip{ index = 0.0945 value = 0.2952 dict = 1.00 all = 0.2800 } ---------------------------- total value len = 1.478064 GB avg = 0.121 KB (by entry num) total key len = 0.341114 GB avg = 0.028 KB total ukey len = 0.243653 GB avg = 0.020 KB total ukey num = 0.012182638 Billion total entry num = 0.012182638 Billion write speed all = 0.043259965 MB/sec (with seq num) write speed all = 0.040942344 MB/sec (without seq num) 2024/11/22-20:33:15.357874 140025028785728 [compaction_job.cc:1948] [default] [JOB 10310] Generated table #226312: 929726 keys, 37574768 bytes, temperature: kWarm 2024/11/22-20:33:15.357935 140025028785728 EVENT_LOG_v1 {"time_micros": 1732278795357904, "cf_name": "default", "job": 10310, "event": "table_file_creation", "file_number": 226312, "file_size": 37574768, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3542444878, "table_properties": {"data_size": 31935680, "index_size": 1757120, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26032328, "raw_average_key_size": 28, "raw_value_size": 108185432, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 929726, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732278792, "oldest_key_time": 0, "file_creation_time": 1732278792, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 226312, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-20:33:15.396070 140025028785728 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10310/att-00/226313.sst) /dev/shm/ToplingTemp/Topling-280575-Hq6PdZ 2024/11/22-20:33:15.556050 140025028785728 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10310/att-00/226313.sst): first pass time = 0.16's, 268.701'MB/sec 2024/11/22-20:33:15.920202 140025028785728 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10310/att-00/226313.sst): old prealloc_size = 147639500, real_size = 11814848 2024/11/22-20:33:15.920433 140025028785728 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10310/att-00/226313.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 296823 prefix = 4 raw-key = 0.0047 GB zip-key = 0.0006 GB avg-key = 16.00 avg-zkey = 1.89 raw-val = 0.0347 GB zip-val = 0.0112 GB avg-val = 116.78 avg-zval = 37.66 2024/11/22-20:33:15.920482 140025028785728 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10310/att-00/226313.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0007 GB, waited 0.000 sec, Key+Value = 0.043 GB 2024/11/22-20:33:16.121054 140025028785728 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10310/att-00/226313.sst): second pass time = 0.36's, 95.340'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.20's, 60.239'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2683.698'MB/sec (index lex order gen) rebuild zvType time = 0.16's, 0.466'MB/sec write SST data time = 0.04's, 291.574'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.353'MB, throughput = 12079.008'MB/sec zip my value time = 0.36's, unzip length = 0.035'GB zip my value throughput = 95.340'MB/sec zip pipeline throughput = 95.340'MB/sec entries = 296823 avg-key = 28.00 avg-zkey = 1.89 avg-val = 116.78 avg-zval = 37.66 usrkeys = 296823 avg-key = 20.00 avg-zkey = 1.89 avg-val = 116.78 avg-zval = 37.66 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0059 GB value = 0.0347 GB dict = 0.35 MB all = 0.0430 GB } __ZipSize{ index = 0.0006 GB value = 0.0112 GB dict = 0.35 MB all = 0.0121 GB } UnZip/Zip{ index = 10.5586 value = 3.1011 dict = 1.00 all = 3.5523 } Zip/UnZip{ index = 0.0947 value = 0.3225 dict = 1.00 all = 0.2815 } ---------------------------- total value len = 1.512728 GB avg = 0.121 KB (by entry num) total key len = 0.349425 GB avg = 0.028 KB total ukey len = 0.249589 GB avg = 0.020 KB total ukey num = 0.012479461 Billion total entry num = 0.012479461 Billion write speed all = 0.044281077 MB/sec (with seq num) write speed all = 0.041907034 MB/sec (without seq num) 2024/11/22-20:33:16.135762 140025028785728 [compaction_job.cc:1948] [default] [JOB 10310] Generated table #226313: 296823 keys, 12097918 bytes, temperature: kWarm 2024/11/22-20:33:16.135831 140025028785728 EVENT_LOG_v1 {"time_micros": 1732278796135797, "cf_name": "default", "job": 10310, "event": "table_file_creation", "file_number": 226313, "file_size": 12097918, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 11178224, "index_size": 562240, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 8311044, "raw_average_key_size": 28, "raw_value_size": 34664318, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 296823, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732278795, "oldest_key_time": 0, "file_creation_time": 1732278795, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 226313, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/22-20:33:16.149352 140025028785728 [compaction_job.cc:703] job-10310: subcompact[0], size: 0.497049 G, files: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-10310/att-00 [226300,226301,226302,226303,226304,226305,226306,226307,226308,226309,226310,226311,226312,226313] 2024/11/22-20:33:16.242729 140025028785728 (Original Log Time 2024/11/22-20:32:33.118208) EVENT_LOG_v1 {"time_micros": 1732278753118160, "job": 10310, "event": "compaction_started", "compaction_reason": "FilesMarkedForCompaction", "files_L2": [226250], "files_L3": [226219, 226220, 226172, 226173, 226174, 226175, 226176, 226177, 226178, 226197, 226198, 226199, 226200, 226289], "score": 0.995903, "input_data_size": 521701850, "oldest_snapshot_seqno": 3542809156} 2024/11/22-20:33:16.242732 140025028785728 (Original Log Time 2024/11/22-20:33:16.241976) [compaction_job.cc:2022] [default] [JOB 10310] Compacted 1@2 + 14@3 files to L3 => 497048756 bytes 2024/11/22-20:33:16.242733 140025028785728 (Original Log Time 2024/11/22-20:33:16.242663) [compaction_job.cc:1224] [default] compacted to: files[0 0 0 14 0 0 0] max score 0.02, MB/sec: 12.1 rd, 11.6 wr, level 3, files in(1, 14) out(14 +0 blob) MB in(27.2, 470.3 +0.0 blob) out(474.0 +0.0 blob), read-write-amplify(35.7) write-amplify(17.4) OK, records in: 12568489, records dropped: 89028 output_compression: Snappy 2024/11/22-20:33:16.242739 140025028785728 (Original Log Time 2024/11/22-20:33:16.242708) EVENT_LOG_v1 {"time_micros": 1732278796242687, "cf": "default", "job": 10310, "event": "compaction_finished", "compaction_time_micros": 43031153, "compaction_time_cpu_micros": 19225111, "output_level": 3, "num_output_files": 14, "total_output_size": 497048756, "num_input_records": 12568489, "num_output_records": 12479461, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "file_write_nanos": 304297703, "file_range_sync_nanos": 0, "file_fsync_nanos": 12773, "file_prepare_write_nanos": 27418, "lsm_state": [0, 0, 0, 14, 0, 0, 0]} 2024/11/22-20:33:16.374785 140025028785728 DEBG dcompact_worker.cpp:240: HttpPost: 200 OK: url = http://nlb-7zny4kaa1poal01o64.cn-shenzhen.nlb.aliyuncs.com:8443, body = {"instanceId":"nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137","labourId":"","dbId":"d89b4006-2803-486e-b7a2-759bcf348921","dbStarts":1732256054,"starts":1732278752,"executesMs":43268,"compactionJobId":10310,"attempt":0,"compactionInputRawBytes":1800448655,"compactionInputZipBytes":521701850,"compactionOutputRawBytes":0,"compactionOutputZipBytes":497048756,"headers":{"Accept":"*/*","Connection":"close","Host":"aliyun-topling-saas.topling.cn:18443","RemoteIp":"120.24.192.169","X-Forwarded-For":"120.24.192.169","region":"cn-shenzhen","token":"e6474c481bd4415abc537135cc03626b","instance-token":"e6474c481bd4415abc537135cc03626b","provider":"aliyun","CloudMarketInstanceId":"si-59c0ae5c955845588903","MeteringAssit":"","Transfer-Encoding":"chunked","traceparent":"00-17f5372b66686ff9661eabab2737794b-70abb4558767d1ea-00"}}, response = 2024/11/22-20:33:16.374854 140025028785728 INFO dcompact_worker.cpp:1459: finish /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-10310/att-00: olev 3, work 43.269 s, result 6.343 ms, install 0.782 ms, input{raw 1.677 GiB zip 497.534 MiB}