2024/11/23-06:36:32.819804 140024953251392 DEBG dcompact_worker.cpp:2214: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21157/att-00: fork to child time = 0.009016 sec 2024/11/23-06:36:32.820560 140024953251392 DEBG dcompact_worker.cpp:1013: Beg SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21157/att-00 2024/11/23-06:36:32.828044 140024953251392 DEBG dcompact_worker.cpp:1033: End SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21157/att-00 2024/11/23-06:36:32.829187 140024953251392 TRAC dcompact_worker.cpp:1083: INFO_LOG_LEVEL: rpc = INFO_LEVEL, env_var = undefined 2024/11/23-06:36:32.829499 140024953251392 [WARN] [column_family.cc:386] multiple cf_paths/db_paths and level_compaction_dynamic_level_bytes can't be used together 2024/11/23-06:36:32.881472 140024953251392 [version_set.cc:6208] Recovering from manifest file: /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-21157/att-00/MANIFEST-206347 2024/11/23-06:36:32.910655 140024953251392 [version_set.cc:6251] Recovered from manifest file:/worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-21157/att-00/MANIFEST-206347 succeeded,manifest_file_number is 206347, next_file_number is 248864, last_sequence is 3839389186, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 248739 2024/11/23-06:36:32.910661 140024953251392 [version_set.cc:6266] Column family [default] (ID 0), log number is 0 2024/11/23-06:36:32.910762 140024953251392 [version_set.cc:5721] Creating manifest 248864 2024/11/23-06:36:32.948544 140024953251392 DEBG dcompact_worker.cpp:1218: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21157/att-00: bottommost_level: fake = 1, rpc = 0 2024/11/23-06:36:32.968653 140024953251392 [compaction_job.cc:2437] [default] [JOB 21157] Compacting 1@2 + 15@3 files to L3, score 0.99, subcompactions 1 : 1 2024/11/23-06:36:32.968671 140024953251392 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 15840 Base level 2, inputs: [248803(26MB)], [248861(35MB) 248862(6482KB) 248757(6792KB) 248703(33MB) 248758(37MB) 248759(34MB) 248760(36MB) 248761(36MB) 248762(35MB) 248763(35MB) 248764(34MB) 248765(34MB) 248766(35MB) 248767(35MB) 248834(36MB)] 2024/11/23-06:36:32.974538 140024953251392 [top_zip_table.cc:59] core git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-06:36:32.974566 140024953251392 [top_zip_table.cc:60] fsa git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-06:36:32.974584 140024953251392 [top_zip_table.cc:61] zbs git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-06:36:32.974589 140024953251392 [top_zip_table.cc:62] topling-zip_table_reader: git_version_hash_info_is: commit a4a382006cb82713acf5b3425835f22711877681 Author: leipeng Date: 2024-04-11 19:44:14 +0800 fixed_len_hole_index.cc: Add env bool FixedLenHoleIndexUseAVX512 for ut & debug 1. FixedLenHoleIndexUseAVX512 is only in unit tests or debug 2. In release mode, use avx512 by compile options(-march=) g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/23-06:36:32.974599 140024953251392 [top_zip_table.cc:64] topling-rocks git_version_hash_info_is: commit feab587e468621ba0204d47b4ffacc52e7c4290d Author: leipeng Date: 2024-03-22 13:35:06 +0800 ToplingZipTableBuilder::Add: immediately return after error This function returns void, and caller does not check builder->status() after calling this function and graceful abandon. So immediately return after error, and return error status in Finish(). g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/23-06:36:33.413692 140024953251392 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21157/att-00/248865.sst) /dev/shm/ToplingTemp/Topling-436412-imeS6D 2024/11/23-06:36:33.964852 140024953251392 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21157/att-00/248865.sst): first pass time = 0.55's, 243.538'MB/sec 2024/11/23-06:36:35.583116 140024953251392 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21157/att-00/248865.sst): old prealloc_size = 147639500, real_size = 33081536 2024/11/23-06:36:35.583835 140024953251392 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21157/att-00/248865.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 930032 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0311 GB avg-val = 116.32 avg-zval = 33.42 2024/11/23-06:36:35.584696 140024953251392 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21157/att-00/248865.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-06:36:36.984203 140024953251392 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21157/att-00/248865.sst): second pass time = 1.60's, 67.803'MB/sec, value only(80.6% of KV) wait indexing time = 0.02's, remap KeyValue time = 1.40's, 26.543'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2541.291'MB/sec (index lex order gen) rebuild zvType time = 1.14's, 0.204'MB/sec write SST data time = 0.26's, 141.819'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 40158.506'MB/sec zip my value time = 1.60's, unzip length = 0.108'GB zip my value throughput = 67.803'MB/sec zip pipeline throughput = 67.803'MB/sec entries = 930032 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.32 avg-zval = 33.42 usrkeys = 930032 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.32 avg-zval = 33.42 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 930032 bytes = 3255120 } seq expand size = 6510224 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0311 GB dict = 1.08 MB all = 0.0372 GB } UnZip/Zip{ index = 10.5135 value = 3.4806 dict = 1.00 all = 3.6090 } Zip/UnZip{ index = 0.0951 value = 0.2873 dict = 1.00 all = 0.2771 } ---------------------------- total value len = 0.114687 GB avg = 0.123 KB (by entry num) total key len = 0.026041 GB avg = 0.028 KB total ukey len = 0.018601 GB avg = 0.020 KB total ukey num = 0.000930032 Billion total entry num = 0.000930032 Billion write speed all = 0.001798352 MB/sec (with seq num) write speed all = 0.001703273 MB/sec (without seq num) 2024/11/23-06:36:37.020568 140024953251392 [compaction_job.cc:1948] [default] [JOB 21157] Generated table #248865: 930032 keys, 37189268 bytes, temperature: kWarm 2024/11/23-06:36:37.020660 140024953251392 EVENT_LOG_v1 {"time_micros": 1732314997020605, "cf_name": "default", "job": 21157, "event": "table_file_creation", "file_number": 248865, "file_size": 37189268, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3621075956, "largest_seqno": 3838883110, "table_properties": {"data_size": 31079600, "index_size": 1769216, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26040896, "raw_average_key_size": 28, "raw_value_size": 108176908, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 930032, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732314993, "oldest_key_time": 0, "file_creation_time": 1732314993, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 248865, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-06:36:37.056875 140024953251392 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21157/att-00/248866.sst) /dev/shm/ToplingTemp/Topling-436412-1vLqEC 2024/11/23-06:36:38.128418 140024953251392 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21157/att-00/248866.sst): first pass time = 1.07's, 125.261'MB/sec 2024/11/23-06:36:39.520538 140024953251392 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21157/att-00/248866.sst): old prealloc_size = 147639500, real_size = 33116576 2024/11/23-06:36:39.521125 140024953251392 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21157/att-00/248866.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927315 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1083 GB zip-val = 0.0311 GB avg-val = 116.74 avg-zval = 33.55 2024/11/23-06:36:39.521945 140024953251392 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21157/att-00/248866.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-06:36:40.499180 140024953251392 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21157/att-00/248866.sst): second pass time = 1.39's, 77.845'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.98's, 38.148'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3166.020'MB/sec (index lex order gen) rebuild zvType time = 0.84's, 0.275'MB/sec write SST data time = 0.14's, 273.790'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 34560.084'MB/sec zip my value time = 1.39's, unzip length = 0.108'GB zip my value throughput = 77.845'MB/sec zip pipeline throughput = 77.845'MB/sec entries = 927315 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.74 avg-zval = 33.55 usrkeys = 927315 avg-key = 20.00 avg-zkey = 1.91 avg-val = 123.74 avg-zval = 33.55 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 927315 bytes = 3361536 } seq expand size = 6491205 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0311 GB dict = 1.08 MB all = 0.0373 GB } UnZip/Zip{ index = 10.4457 value = 3.4798 dict = 1.00 all = 3.5952 } Zip/UnZip{ index = 0.0957 value = 0.2874 dict = 1.00 all = 0.2781 } ---------------------------- total value len = 0.229431 GB avg = 0.124 KB (by entry num) total key len = 0.052006 GB avg = 0.028 KB total ukey len = 0.037147 GB avg = 0.020 KB total ukey num = 0.001857347 Billion total entry num = 0.001857347 Billion write speed all = 0.003596298 MB/sec (with seq num) write speed all = 0.003406428 MB/sec (without seq num) 2024/11/23-06:36:40.533692 140024953251392 [compaction_job.cc:1948] [default] [JOB 21157] Generated table #248866: 927315 keys, 37332322 bytes, temperature: kWarm 2024/11/23-06:36:40.533757 140024953251392 EVENT_LOG_v1 {"time_micros": 1732315000533722, "cf_name": "default", "job": 21157, "event": "table_file_creation", "file_number": 248866, "file_size": 37332322, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3376774746, "largest_seqno": 3838879505, "table_properties": {"data_size": 31109072, "index_size": 1775488, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25964820, "raw_average_key_size": 28, "raw_value_size": 108252910, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927315, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732314997, "oldest_key_time": 0, "file_creation_time": 1732314997, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 248866, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-06:36:40.575450 140024953251392 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21157/att-00/248867.sst) /dev/shm/ToplingTemp/Topling-436412-by8YRE 2024/11/23-06:36:41.592533 140024953251392 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21157/att-00/248867.sst): first pass time = 1.02's, 131.969'MB/sec 2024/11/23-06:36:43.034897 140024953251392 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21157/att-00/248867.sst): old prealloc_size = 147639500, real_size = 34046848 2024/11/23-06:36:43.035540 140024953251392 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21157/att-00/248867.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 932589 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1081 GB zip-val = 0.0320 GB avg-val = 115.92 avg-zval = 34.36 2024/11/23-06:36:43.036408 140024953251392 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21157/att-00/248867.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-06:36:44.122384 140024953251392 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21157/att-00/248867.sst): second pass time = 1.44's, 75.035'MB/sec, value only(80.5% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.09's, 35.199'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2870.153'MB/sec (index lex order gen) rebuild zvType time = 0.93's, 0.251'MB/sec write SST data time = 0.16's, 241.330'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 33697.652'MB/sec zip my value time = 1.44's, unzip length = 0.108'GB zip my value throughput = 75.035'MB/sec zip pipeline throughput = 75.035'MB/sec entries = 932589 avg-key = 28.00 avg-zkey = 1.90 avg-val = 115.92 avg-zval = 34.36 usrkeys = 932589 avg-key = 20.00 avg-zkey = 1.90 avg-val = 122.92 avg-zval = 34.36 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 932589 bytes = 3380656 } seq expand size = 6528123 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0187 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0320 GB dict = 1.08 MB all = 0.0383 GB } UnZip/Zip{ index = 10.5127 value = 3.3741 dict = 1.00 all = 3.5064 } Zip/UnZip{ index = 0.0951 value = 0.2964 dict = 1.00 all = 0.2852 } ---------------------------- total value len = 0.344065 GB avg = 0.123 KB (by entry num) total key len = 0.078118 GB avg = 0.028 KB total ukey len = 0.055799 GB avg = 0.020 KB total ukey num = 0.002789936 Billion total entry num = 0.002789936 Billion write speed all = 0.005394549 MB/sec (with seq num) write speed all = 0.005109356 MB/sec (without seq num) 2024/11/23-06:36:44.156688 140024953251392 [compaction_job.cc:1948] [default] [JOB 21157] Generated table #248867: 932589 keys, 38277896 bytes, temperature: kWarm 2024/11/23-06:36:44.156750 140024953251392 EVENT_LOG_v1 {"time_micros": 1732315004156719, "cf_name": "default", "job": 21157, "event": "table_file_creation", "file_number": 248867, "file_size": 38277896, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3563652023, "largest_seqno": 3838883466, "table_properties": {"data_size": 32039280, "index_size": 1774208, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26112492, "raw_average_key_size": 28, "raw_value_size": 108105334, "raw_average_value_size": 115, "num_data_blocks": 1, "num_entries": 932589, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732315000, "oldest_key_time": 0, "file_creation_time": 1732315000, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 248867, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-06:36:44.194180 140024953251392 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21157/att-00/248868.sst) /dev/shm/ToplingTemp/Topling-436412-2bvbsB 2024/11/23-06:36:45.130608 140024953251392 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21157/att-00/248868.sst): first pass time = 0.94's, 143.335'MB/sec 2024/11/23-06:36:46.516452 140024953251392 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21157/att-00/248868.sst): old prealloc_size = 147639500, real_size = 34029760 2024/11/23-06:36:46.517042 140024953251392 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21157/att-00/248868.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 933141 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1081 GB zip-val = 0.0320 GB avg-val = 115.83 avg-zval = 34.32 2024/11/23-06:36:46.517580 140024953251392 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21157/att-00/248868.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-06:36:47.360901 140024953251392 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21157/att-00/248868.sst): second pass time = 1.39's, 78.029'MB/sec, value only(80.5% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.84's, 43.720'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3120.568'MB/sec (index lex order gen) rebuild zvType time = 0.71's, 0.327'MB/sec write SST data time = 0.13's, 284.697'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 35507.806'MB/sec zip my value time = 1.39's, unzip length = 0.108'GB zip my value throughput = 78.029'MB/sec zip pipeline throughput = 78.029'MB/sec entries = 933141 avg-key = 28.00 avg-zkey = 1.90 avg-val = 115.83 avg-zval = 34.32 usrkeys = 933141 avg-key = 20.00 avg-zkey = 1.90 avg-val = 120.19 avg-zval = 34.32 TagRS{ kinds = RS_Key0_TagN bytes = 145920 } TagArray{ size = 581130 bytes = 1888688 } seq expand size = 4067910 multi value expand size = 0 cnt WriteAppend = 15 UnZipSize{ index = 0.0187 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0320 GB dict = 1.08 MB all = 0.0369 GB } UnZip/Zip{ index = 10.5144 value = 3.3756 dict = 1.00 all = 3.6355 } Zip/UnZip{ index = 0.0951 value = 0.2962 dict = 1.00 all = 0.2751 } ---------------------------- total value len = 0.456223 GB avg = 0.123 KB (by entry num) total key len = 0.104246 GB avg = 0.028 KB total ukey len = 0.074462 GB avg = 0.020 KB total ukey num = 0.003723077 Billion total entry num = 0.003723077 Billion write speed all = 0.007161234 MB/sec (with seq num) write speed all = 0.006780669 MB/sec (without seq num) 2024/11/23-06:36:47.393489 140024953251392 [compaction_job.cc:1948] [default] [JOB 21157] Generated table #248868: 933141 keys, 36918679 bytes, temperature: kWarm 2024/11/23-06:36:47.393550 140024953251392 EVENT_LOG_v1 {"time_micros": 1732315007393519, "cf_name": "default", "job": 21157, "event": "table_file_creation", "file_number": 248868, "file_size": 36918679, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3838883270, "table_properties": {"data_size": 32021296, "index_size": 1774976, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26127948, "raw_average_key_size": 28, "raw_value_size": 108089922, "raw_average_value_size": 115, "num_data_blocks": 1, "num_entries": 933141, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732315004, "oldest_key_time": 0, "file_creation_time": 1732315004, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 248868, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-06:36:47.430803 140024953251392 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21157/att-00/248869.sst) /dev/shm/ToplingTemp/Topling-436412-jvOm9B 2024/11/23-06:36:48.363991 140024953251392 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21157/att-00/248869.sst): first pass time = 0.93's, 143.833'MB/sec 2024/11/23-06:36:49.781328 140024953251392 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21157/att-00/248869.sst): old prealloc_size = 147639500, real_size = 35282928 2024/11/23-06:36:49.782001 140024953251392 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21157/att-00/248869.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 1081160 prefix = 4 raw-key = 0.0173 GB zip-key = 0.0021 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1039 GB zip-val = 0.0329 GB avg-val = 96.14 avg-zval = 30.47 2024/11/23-06:36:49.782169 140024953251392 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21157/att-00/248869.sst: sumWaitingMem = 0.003 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0028 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-06:36:50.410655 140024953251392 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21157/att-00/248869.sst): second pass time = 1.42's, 73.371'MB/sec, value only(77.4% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.63's, 57.782'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3175.281'MB/sec (index lex order gen) rebuild zvType time = 0.49's, 0.555'MB/sec write SST data time = 0.14's, 256.092'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.036'MB, throughput = 32681.272'MB/sec zip my value time = 1.42's, unzip length = 0.104'GB zip my value throughput = 73.371'MB/sec zip pipeline throughput = 73.371'MB/sec entries = 1081160 avg-key = 28.00 avg-zkey = 1.91 avg-val = 96.14 avg-zval = 30.47 usrkeys = 1081160 avg-key = 20.00 avg-zkey = 1.91 avg-val = 96.43 avg-zval = 30.47 TagRS{ kinds = RS_Key0_TagN bytes = 169040 } TagArray{ size = 44768 bytes = 134320 } seq expand size = 313376 multi value expand size = 0 cnt WriteAppend = 16 UnZipSize{ index = 0.0216 GB value = 0.1039 GB dict = 1.04 MB all = 0.1342 GB } __ZipSize{ index = 0.0021 GB value = 0.0329 GB dict = 1.04 MB all = 0.0364 GB } UnZip/Zip{ index = 10.4475 value = 3.1553 dict = 1.00 all = 3.6911 } Zip/UnZip{ index = 0.0957 value = 0.3169 dict = 1.00 all = 0.2709 } ---------------------------- total value len = 0.560481 GB avg = 0.117 KB (by entry num) total key len = 0.134519 GB avg = 0.028 KB total ukey len = 0.096085 GB avg = 0.020 KB total ukey num = 0.004804237 Billion total entry num = 0.004804237 Billion write speed all = 0.008879822 MB/sec (with seq num) write speed all = 0.008388763 MB/sec (without seq num) 2024/11/23-06:36:50.443491 140024953251392 [compaction_job.cc:1948] [default] [JOB 21157] Generated table #248869: 1081160 keys, 36363020 bytes, temperature: kWarm 2024/11/23-06:36:50.443554 140024953251392 EVENT_LOG_v1 {"time_micros": 1732315010443522, "cf_name": "default", "job": 21157, "event": "table_file_creation", "file_number": 248869, "file_size": 36363020, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3282147038, "table_properties": {"data_size": 32942752, "index_size": 2069696, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 30272480, "raw_average_key_size": 28, "raw_value_size": 103945297, "raw_average_value_size": 96, "num_data_blocks": 1, "num_entries": 1081160, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732315007, "oldest_key_time": 0, "file_creation_time": 1732315007, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 248869, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-06:36:50.478735 140024953251392 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21157/att-00/248870.sst) /dev/shm/ToplingTemp/Topling-436412-HDI5LA 2024/11/23-06:36:51.378515 140024953251392 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21157/att-00/248870.sst): first pass time = 0.90's, 149.174'MB/sec 2024/11/23-06:36:52.718411 140024953251392 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21157/att-00/248870.sst): old prealloc_size = 147639500, real_size = 32727168 2024/11/23-06:36:52.718963 140024953251392 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21157/att-00/248870.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 926005 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0307 GB avg-val = 116.94 avg-zval = 33.19 2024/11/23-06:36:52.719795 140024953251392 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21157/att-00/248870.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-06:36:53.630471 140024953251392 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21157/att-00/248870.sst): second pass time = 1.34's, 80.864'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.91's, 40.628'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3329.927'MB/sec (index lex order gen) rebuild zvType time = 0.78's, 0.296'MB/sec write SST data time = 0.13's, 283.709'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 31048.249'MB/sec zip my value time = 1.34's, unzip length = 0.108'GB zip my value throughput = 80.864'MB/sec zip pipeline throughput = 80.864'MB/sec entries = 926005 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.94 avg-zval = 33.19 usrkeys = 926005 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.94 avg-zval = 33.19 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 926005 bytes = 3472528 } seq expand size = 6482035 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0307 GB dict = 1.08 MB all = 0.0371 GB } UnZip/Zip{ index = 10.5125 value = 3.5235 dict = 1.00 all = 3.6222 } Zip/UnZip{ index = 0.0951 value = 0.2838 dict = 1.00 all = 0.2761 } ---------------------------- total value len = 0.675253 GB avg = 0.118 KB (by entry num) total key len = 0.160447 GB avg = 0.028 KB total ukey len = 0.114605 GB avg = 0.020 KB total ukey num = 0.005730242 Billion total entry num = 0.005730242 Billion write speed all = 0.010677065 MB/sec (with seq num) write speed all = 0.010091380 MB/sec (without seq num) 2024/11/23-06:36:53.664428 140024953251392 [compaction_job.cc:1948] [default] [JOB 21157] Generated table #248870: 926005 keys, 37054480 bytes, temperature: kWarm 2024/11/23-06:36:53.664491 140024953251392 EVENT_LOG_v1 {"time_micros": 1732315013664459, "cf_name": "default", "job": 21157, "event": "table_file_creation", "file_number": 248870, "file_size": 37054480, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3282147039, "largest_seqno": 3838881514, "table_properties": {"data_size": 30733744, "index_size": 1761728, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25928140, "raw_average_key_size": 28, "raw_value_size": 108289602, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 926005, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732315010, "oldest_key_time": 0, "file_creation_time": 1732315010, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 248870, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-06:36:53.700869 140024953251392 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21157/att-00/248871.sst) /dev/shm/ToplingTemp/Topling-436412-wfCU4B 2024/11/23-06:36:54.552025 140024953251392 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21157/att-00/248871.sst): first pass time = 0.85's, 157.696'MB/sec 2024/11/23-06:36:55.891677 140024953251392 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21157/att-00/248871.sst): old prealloc_size = 147639500, real_size = 33730256 2024/11/23-06:36:55.892253 140024953251392 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21157/att-00/248871.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 933479 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1081 GB zip-val = 0.0317 GB avg-val = 115.78 avg-zval = 33.98 2024/11/23-06:36:55.893083 140024953251392 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21157/att-00/248871.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-06:36:56.807491 140024953251392 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21157/att-00/248871.sst): second pass time = 1.34's, 80.719'MB/sec, value only(80.5% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.92's, 41.582'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3202.394'MB/sec (index lex order gen) rebuild zvType time = 0.79's, 0.297'MB/sec write SST data time = 0.13's, 292.527'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 33505.548'MB/sec zip my value time = 1.34's, unzip length = 0.108'GB zip my value throughput = 80.719'MB/sec zip pipeline throughput = 80.719'MB/sec entries = 933479 avg-key = 28.00 avg-zkey = 1.90 avg-val = 115.78 avg-zval = 33.98 usrkeys = 933479 avg-key = 20.00 avg-zkey = 1.90 avg-val = 122.78 avg-zval = 33.98 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 933479 bytes = 3500560 } seq expand size = 6534353 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0187 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0317 GB dict = 1.08 MB all = 0.0381 GB } UnZip/Zip{ index = 10.5110 value = 3.4073 dict = 1.00 all = 3.5245 } Zip/UnZip{ index = 0.0951 value = 0.2935 dict = 1.00 all = 0.2837 } ---------------------------- total value len = 0.789868 GB avg = 0.119 KB (by entry num) total key len = 0.186584 GB avg = 0.028 KB total ukey len = 0.133274 GB avg = 0.020 KB total ukey num = 0.006663721 Billion total entry num = 0.006663721 Billion write speed all = 0.012474836 MB/sec (with seq num) write speed all = 0.011793768 MB/sec (without seq num) 2024/11/23-06:36:56.841399 140024953251392 [compaction_job.cc:1948] [default] [JOB 21157] Generated table #248871: 933479 keys, 38081318 bytes, temperature: kWarm 2024/11/23-06:36:56.841464 140024953251392 EVENT_LOG_v1 {"time_micros": 1732315016841431, "cf_name": "default", "job": 21157, "event": "table_file_creation", "file_number": 248871, "file_size": 38081318, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3273701103, "largest_seqno": 3838882701, "table_properties": {"data_size": 31720512, "index_size": 1776192, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26137412, "raw_average_key_size": 28, "raw_value_size": 108080354, "raw_average_value_size": 115, "num_data_blocks": 1, "num_entries": 933479, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732315013, "oldest_key_time": 0, "file_creation_time": 1732315013, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 248871, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-06:36:56.879813 140024953251392 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21157/att-00/248872.sst) /dev/shm/ToplingTemp/Topling-436412-IRUFkC 2024/11/23-06:36:57.726040 140024953251392 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21157/att-00/248872.sst): first pass time = 0.85's, 158.614'MB/sec 2024/11/23-06:36:59.120049 140024953251392 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21157/att-00/248872.sst): old prealloc_size = 147639500, real_size = 34709504 2024/11/23-06:36:59.120623 140024953251392 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21157/att-00/248872.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927981 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0327 GB avg-val = 116.63 avg-zval = 35.25 2024/11/23-06:36:59.121442 140024953251392 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21157/att-00/248872.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-06:37:00.029841 140024953251392 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21157/att-00/248872.sst): second pass time = 1.39's, 77.680'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.91's, 42.787'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3272.859'MB/sec (index lex order gen) rebuild zvType time = 0.78's, 0.298'MB/sec write SST data time = 0.13's, 299.911'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 30549.539'MB/sec zip my value time = 1.39's, unzip length = 0.108'GB zip my value throughput = 77.680'MB/sec zip pipeline throughput = 77.680'MB/sec entries = 927981 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.63 avg-zval = 35.25 usrkeys = 927981 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.63 avg-zval = 35.25 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 927981 bytes = 3363952 } seq expand size = 6495867 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0327 GB dict = 1.08 MB all = 0.0389 GB } UnZip/Zip{ index = 10.5116 value = 3.3087 dict = 1.00 all = 3.4479 } Zip/UnZip{ index = 0.0951 value = 0.3022 dict = 1.00 all = 0.2900 } ---------------------------- total value len = 0.904598 GB avg = 0.119 KB (by entry num) total key len = 0.212568 GB avg = 0.028 KB total ukey len = 0.151834 GB avg = 0.020 KB total ukey num = 0.007591702 Billion total entry num = 0.007591702 Billion write speed all = 0.014271961 MB/sec (with seq num) write speed all = 0.013496080 MB/sec (without seq num) 2024/11/23-06:37:00.065795 140024953251392 [compaction_job.cc:1948] [default] [JOB 21157] Generated table #248872: 927981 keys, 38927052 bytes, temperature: kWarm 2024/11/23-06:37:00.065861 140024953251392 EVENT_LOG_v1 {"time_micros": 1732315020065827, "cf_name": "default", "job": 21157, "event": "table_file_creation", "file_number": 248872, "file_size": 38927052, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3369194706, "largest_seqno": 3838882842, "table_properties": {"data_size": 32711664, "index_size": 1765632, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25983468, "raw_average_key_size": 28, "raw_value_size": 108234262, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927981, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732315016, "oldest_key_time": 0, "file_creation_time": 1732315016, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 248872, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-06:37:00.106423 140024953251392 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21157/att-00/248873.sst) /dev/shm/ToplingTemp/Topling-436412-YwJE6E 2024/11/23-06:37:00.979759 140024953251392 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21157/att-00/248873.sst): first pass time = 0.87's, 153.691'MB/sec 2024/11/23-06:37:02.317420 140024953251392 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21157/att-00/248873.sst): old prealloc_size = 147639500, real_size = 33224480 2024/11/23-06:37:02.317997 140024953251392 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21157/att-00/248873.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927260 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0312 GB avg-val = 116.75 avg-zval = 33.68 2024/11/23-06:37:02.318811 140024953251392 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21157/att-00/248873.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-06:37:03.247412 140024953251392 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21157/att-00/248873.sst): second pass time = 1.34's, 80.973'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.93's, 40.260'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3187.385'MB/sec (index lex order gen) rebuild zvType time = 0.80's, 0.290'MB/sec write SST data time = 0.13's, 288.224'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 35028.331'MB/sec zip my value time = 1.34's, unzip length = 0.108'GB zip my value throughput = 80.973'MB/sec zip pipeline throughput = 80.973'MB/sec entries = 927260 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.75 avg-zval = 33.68 usrkeys = 927260 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.75 avg-zval = 33.68 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 927260 bytes = 3361328 } seq expand size = 6490820 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0312 GB dict = 1.08 MB all = 0.0374 GB } UnZip/Zip{ index = 10.5118 value = 3.4666 dict = 1.00 all = 3.5848 } Zip/UnZip{ index = 0.0951 value = 0.2885 dict = 1.00 all = 0.2790 } ---------------------------- total value len = 1.019343 GB avg = 0.120 KB (by entry num) total key len = 0.238531 GB avg = 0.028 KB total ukey len = 0.170379 GB avg = 0.020 KB total ukey num = 0.008518962 Billion total entry num = 0.008518962 Billion write speed all = 0.016068875 MB/sec (with seq num) write speed all = 0.015198262 MB/sec (without seq num) 2024/11/23-06:37:03.280381 140024953251392 [compaction_job.cc:1948] [default] [JOB 21157] Generated table #248873: 927260 keys, 37440384 bytes, temperature: kWarm 2024/11/23-06:37:03.280448 140024953251392 EVENT_LOG_v1 {"time_micros": 1732315023280414, "cf_name": "default", "job": 21157, "event": "table_file_creation", "file_number": 248873, "file_size": 37440384, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3514720078, "largest_seqno": 3838881967, "table_properties": {"data_size": 31228240, "index_size": 1764224, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25963280, "raw_average_key_size": 28, "raw_value_size": 108254516, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927260, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732315020, "oldest_key_time": 0, "file_creation_time": 1732315020, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 248873, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-06:37:03.316353 140024953251392 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21157/att-00/248874.sst) /dev/shm/ToplingTemp/Topling-436412-7mV8lC 2024/11/23-06:37:04.121799 140024953251392 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21157/att-00/248874.sst): first pass time = 0.81's, 166.645'MB/sec 2024/11/23-06:37:05.467438 140024953251392 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21157/att-00/248874.sst): old prealloc_size = 147639500, real_size = 33188592 2024/11/23-06:37:05.468029 140024953251392 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21157/att-00/248874.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 928396 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0312 GB avg-val = 116.57 avg-zval = 33.60 2024/11/23-06:37:05.468804 140024953251392 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21157/att-00/248874.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-06:37:06.411737 140024953251392 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21157/att-00/248874.sst): second pass time = 1.34's, 80.496'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.94's, 39.492'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3096.363'MB/sec (index lex order gen) rebuild zvType time = 0.81's, 0.286'MB/sec write SST data time = 0.13's, 281.987'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 25352.918'MB/sec zip my value time = 1.34's, unzip length = 0.108'GB zip my value throughput = 80.496'MB/sec zip pipeline throughput = 80.496'MB/sec entries = 928396 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.57 avg-zval = 33.60 usrkeys = 928396 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.57 avg-zval = 33.60 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 928396 bytes = 3249408 } seq expand size = 6498772 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0312 GB dict = 1.08 MB all = 0.0373 GB } UnZip/Zip{ index = 10.5133 value = 3.4698 dict = 1.00 all = 3.5992 } Zip/UnZip{ index = 0.0951 value = 0.2882 dict = 1.00 all = 0.2778 } ---------------------------- total value len = 1.134065 GB avg = 0.120 KB (by entry num) total key len = 0.264526 GB avg = 0.028 KB total ukey len = 0.188947 GB avg = 0.020 KB total ukey num = 0.009447358 Billion total entry num = 0.009447358 Billion write speed all = 0.017865756 MB/sec (with seq num) write speed all = 0.016900303 MB/sec (without seq num) 2024/11/23-06:37:06.459352 140024953251392 [compaction_job.cc:1948] [default] [JOB 21157] Generated table #248874: 928396 keys, 37291446 bytes, temperature: kWarm 2024/11/23-06:37:06.459414 140024953251392 EVENT_LOG_v1 {"time_micros": 1732315026459383, "cf_name": "default", "job": 21157, "event": "table_file_creation", "file_number": 248874, "file_size": 37291446, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3610601794, "largest_seqno": 3838882818, "table_properties": {"data_size": 31190176, "index_size": 1766144, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25995088, "raw_average_key_size": 28, "raw_value_size": 108222776, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 928396, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732315023, "oldest_key_time": 0, "file_creation_time": 1732315023, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 248874, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-06:37:06.494326 140024953251392 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21157/att-00/248875.sst) /dev/shm/ToplingTemp/Topling-436412-MfomuB 2024/11/23-06:37:07.321354 140024953251392 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21157/att-00/248875.sst): first pass time = 0.83's, 162.296'MB/sec 2024/11/23-06:37:08.696690 140024953251392 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21157/att-00/248875.sst): old prealloc_size = 147639500, real_size = 32874240 2024/11/23-06:37:08.697253 140024953251392 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21157/att-00/248875.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 928566 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0309 GB avg-val = 116.54 avg-zval = 33.25 2024/11/23-06:37:08.698062 140024953251392 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21157/att-00/248875.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-06:37:09.627902 140024953251392 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21157/att-00/248875.sst): second pass time = 1.37's, 78.729'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.93's, 39.834'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3259.615'MB/sec (index lex order gen) rebuild zvType time = 0.80's, 0.290'MB/sec write SST data time = 0.13's, 285.242'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 30439.401'MB/sec zip my value time = 1.37's, unzip length = 0.108'GB zip my value throughput = 78.729'MB/sec zip pipeline throughput = 78.729'MB/sec entries = 928566 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.54 avg-zval = 33.25 usrkeys = 928566 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.54 avg-zval = 33.25 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 928566 bytes = 3366064 } seq expand size = 6499962 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0309 GB dict = 1.08 MB all = 0.0371 GB } UnZip/Zip{ index = 10.5121 value = 3.5050 dict = 1.00 all = 3.6183 } Zip/UnZip{ index = 0.0951 value = 0.2853 dict = 1.00 all = 0.2764 } ---------------------------- total value len = 1.248782 GB avg = 0.120 KB (by entry num) total key len = 0.290526 GB avg = 0.028 KB total ukey len = 0.207518 GB avg = 0.020 KB total ukey num = 0.010375924 Billion total entry num = 0.010375924 Billion write speed all = 0.019662492 MB/sec (with seq num) write speed all = 0.018602190 MB/sec (without seq num) 2024/11/23-06:37:09.660048 140024953251392 [compaction_job.cc:1948] [default] [JOB 21157] Generated table #248875: 928566 keys, 37093684 bytes, temperature: kWarm 2024/11/23-06:37:09.660114 140024953251392 EVENT_LOG_v1 {"time_micros": 1732315029660081, "cf_name": "default", "job": 21157, "event": "table_file_creation", "file_number": 248875, "file_size": 37093684, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3516470397, "largest_seqno": 3838882725, "table_properties": {"data_size": 30875248, "index_size": 1766656, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25999848, "raw_average_key_size": 28, "raw_value_size": 108217936, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 928566, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732315026, "oldest_key_time": 0, "file_creation_time": 1732315026, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 248875, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-06:37:09.695069 140024953251392 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21157/att-00/248876.sst) /dev/shm/ToplingTemp/Topling-436412-bw4UfC 2024/11/23-06:37:10.607583 140024953251392 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21157/att-00/248876.sst): first pass time = 0.91's, 147.092'MB/sec 2024/11/23-06:37:11.951017 140024953251392 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21157/att-00/248876.sst): old prealloc_size = 147639500, real_size = 32370224 2024/11/23-06:37:11.951567 140024953251392 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21157/att-00/248876.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 928645 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0304 GB avg-val = 116.53 avg-zval = 32.70 2024/11/23-06:37:11.952381 140024953251392 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21157/att-00/248876.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-06:37:12.865896 140024953251392 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21157/att-00/248876.sst): second pass time = 1.34's, 80.591'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.91's, 39.995'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3348.114'MB/sec (index lex order gen) rebuild zvType time = 0.78's, 0.296'MB/sec write SST data time = 0.13's, 282.910'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 33025.503'MB/sec zip my value time = 1.34's, unzip length = 0.108'GB zip my value throughput = 80.591'MB/sec zip pipeline throughput = 80.591'MB/sec entries = 928645 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.53 avg-zval = 32.70 usrkeys = 928645 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.53 avg-zval = 32.70 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 928645 bytes = 3366352 } seq expand size = 6500515 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0304 GB dict = 1.08 MB all = 0.0366 GB } UnZip/Zip{ index = 10.5130 value = 3.5631 dict = 1.00 all = 3.6681 } Zip/UnZip{ index = 0.0951 value = 0.2807 dict = 1.00 all = 0.2726 } ---------------------------- total value len = 1.363499 GB avg = 0.121 KB (by entry num) total key len = 0.316528 GB avg = 0.028 KB total ukey len = 0.226091 GB avg = 0.020 KB total ukey num = 0.011304569 Billion total entry num = 0.011304569 Billion write speed all = 0.021459082 MB/sec (with seq num) write speed all = 0.020303930 MB/sec (without seq num) 2024/11/23-06:37:12.896700 140024953251392 [compaction_job.cc:1948] [default] [JOB 21157] Generated table #248876: 928645 keys, 36590288 bytes, temperature: kWarm 2024/11/23-06:37:12.896763 140024953251392 EVENT_LOG_v1 {"time_micros": 1732315032896731, "cf_name": "default", "job": 21157, "event": "table_file_creation", "file_number": 248876, "file_size": 36590288, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3369353416, "largest_seqno": 3838880648, "table_properties": {"data_size": 30371232, "index_size": 1766656, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26002060, "raw_average_key_size": 28, "raw_value_size": 108215678, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 928645, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732315029, "oldest_key_time": 0, "file_creation_time": 1732315029, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 248876, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-06:37:12.935865 140024953251392 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21157/att-00/248877.sst) /dev/shm/ToplingTemp/Topling-436412-drSsxC 2024/11/23-06:37:13.767616 140024953251392 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21157/att-00/248877.sst): first pass time = 0.83's, 161.375'MB/sec 2024/11/23-06:37:15.087733 140024953251392 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21157/att-00/248877.sst): old prealloc_size = 147639500, real_size = 30553744 2024/11/23-06:37:15.088290 140024953251392 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21157/att-00/248877.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927312 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1083 GB zip-val = 0.0285 GB avg-val = 116.74 avg-zval = 30.78 2024/11/23-06:37:15.089072 140024953251392 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21157/att-00/248877.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-06:37:15.931915 140024953251392 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21157/att-00/248877.sst): second pass time = 1.32's, 82.044'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.84's, 41.049'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3311.040'MB/sec (index lex order gen) rebuild zvType time = 0.72's, 0.324'MB/sec write SST data time = 0.13's, 270.036'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 35723.155'MB/sec zip my value time = 1.32's, unzip length = 0.108'GB zip my value throughput = 82.044'MB/sec zip pipeline throughput = 82.044'MB/sec entries = 927312 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.74 avg-zval = 30.78 usrkeys = 927312 avg-key = 20.00 avg-zkey = 1.91 avg-val = 123.74 avg-zval = 30.78 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 927312 bytes = 3245600 } seq expand size = 6491184 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0285 GB dict = 1.08 MB all = 0.0347 GB } UnZip/Zip{ index = 10.4465 value = 3.7922 dict = 1.00 all = 3.8733 } Zip/UnZip{ index = 0.0957 value = 0.2637 dict = 1.00 all = 0.2582 } ---------------------------- total value len = 1.478243 GB avg = 0.121 KB (by entry num) total key len = 0.342493 GB avg = 0.028 KB total ukey len = 0.244638 GB avg = 0.020 KB total ukey num = 0.012231881 Billion total entry num = 0.012231881 Billion write speed all = 0.023255455 MB/sec (with seq num) write speed all = 0.022005596 MB/sec (without seq num) 2024/11/23-06:37:15.963278 140024953251392 [compaction_job.cc:1948] [default] [JOB 21157] Generated table #248877: 927312 keys, 34652026 bytes, temperature: kWarm 2024/11/23-06:37:15.963344 140024953251392 EVENT_LOG_v1 {"time_micros": 1732315035963310, "cf_name": "default", "job": 21157, "event": "table_file_creation", "file_number": 248877, "file_size": 34652026, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3704404854, "largest_seqno": 3838877141, "table_properties": {"data_size": 28546368, "index_size": 1775360, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25964736, "raw_average_key_size": 28, "raw_value_size": 108253024, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927312, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732315032, "oldest_key_time": 0, "file_creation_time": 1732315032, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 248877, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-06:37:15.998276 140024953251392 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21157/att-00/248878.sst) /dev/shm/ToplingTemp/Topling-436412-Q5ztWD 2024/11/23-06:37:16.265291 140024953251392 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21157/att-00/248878.sst): first pass time = 0.27's, 258.849'MB/sec 2024/11/23-06:37:16.905361 140024953251392 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21157/att-00/248878.sst): old prealloc_size = 147639500, real_size = 19452672 2024/11/23-06:37:16.905677 140024953251392 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21157/att-00/248878.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 476496 prefix = 4 raw-key = 0.0076 GB zip-key = 0.0009 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.0558 GB zip-val = 0.0184 GB avg-val = 117.03 avg-zval = 38.66 2024/11/23-06:37:16.906020 140024953251392 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21157/att-00/248878.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0011 GB, waited 0.000 sec, Key+Value = 0.069 GB 2024/11/23-06:37:17.301352 140024953251392 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21157/att-00/248878.sst): second pass time = 0.64's, 87.208'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.40's, 53.217'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3115.437'MB/sec (index lex order gen) rebuild zvType time = 0.33's, 0.362'MB/sec write SST data time = 0.07's, 314.276'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.558'MB, throughput = 17087.714'MB/sec zip my value time = 0.64's, unzip length = 0.056'GB zip my value throughput = 87.208'MB/sec zip pipeline throughput = 87.208'MB/sec entries = 476496 avg-key = 28.00 avg-zkey = 1.92 avg-val = 117.03 avg-zval = 38.66 usrkeys = 476496 avg-key = 20.00 avg-zkey = 1.92 avg-val = 121.34 avg-zval = 38.66 TagRS{ kinds = RS_Key0_TagN bytes = 74560 } TagArray{ size = 293499 bytes = 1100640 } seq expand size = 2054493 multi value expand size = 0 cnt WriteAppend = 17 UnZipSize{ index = 0.0095 GB value = 0.0558 GB dict = 0.56 MB all = 0.0691 GB } __ZipSize{ index = 0.0009 GB value = 0.0184 GB dict = 0.56 MB all = 0.0211 GB } UnZip/Zip{ index = 10.4385 value = 3.0274 dict = 1.00 all = 3.2795 } Zip/UnZip{ index = 0.0958 value = 0.3303 dict = 1.00 all = 0.3049 } ---------------------------- total value len = 1.536063 GB avg = 0.121 KB (by entry num) total key len = 0.355835 GB avg = 0.028 KB total ukey len = 0.254168 GB avg = 0.020 KB total ukey num = 0.012708377 Billion total entry num = 0.012708377 Billion write speed all = 0.024163950 MB/sec (with seq num) write speed all = 0.022865425 MB/sec (without seq num) 2024/11/23-06:37:17.325886 140024953251392 [compaction_job.cc:1948] [default] [JOB 21157] Generated table #248878: 476496 keys, 21072455 bytes, temperature: kWarm 2024/11/23-06:37:17.325950 140024953251392 EVENT_LOG_v1 {"time_micros": 1732315037325917, "cf_name": "default", "job": 21157, "event": "table_file_creation", "file_number": 248878, "file_size": 21072455, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3838882320, "table_properties": {"data_size": 18420400, "index_size": 912960, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 13341888, "raw_average_key_size": 28, "raw_value_size": 55765348, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 476496, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732315035, "oldest_key_time": 0, "file_creation_time": 1732315035, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 248878, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-06:37:17.343653 140024953251392 [compaction_job.cc:703] job-21157: subcompact[0], size: 0.504284 G, files: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-21157/att-00 [248865,248866,248867,248868,248869,248870,248871,248872,248873,248874,248875,248876,248877,248878] 2024/11/23-06:37:17.433566 140024953251392 (Original Log Time 2024/11/23-06:36:32.968714) EVENT_LOG_v1 {"time_micros": 1732314992968681, "job": 21157, "event": "compaction_started", "compaction_reason": "FilesMarkedForCompaction", "files_L2": [248803], "files_L3": [248861, 248862, 248757, 248703, 248758, 248759, 248760, 248761, 248762, 248763, 248764, 248765, 248766, 248767, 248834], "score": 0.988637, "input_data_size": 524797745, "oldest_snapshot_seqno": 3839389137} 2024/11/23-06:37:17.433570 140024953251392 (Original Log Time 2024/11/23-06:37:17.432840) [compaction_job.cc:2022] [default] [JOB 21157] Compacted 1@2 + 15@3 files to L3 => 504284318 bytes 2024/11/23-06:37:17.433572 140024953251392 (Original Log Time 2024/11/23-06:37:17.433502) [compaction_job.cc:1224] [default] compacted to: files[0 0 0 14 0 0 0] max score 0.02, MB/sec: 11.8 rd, 11.4 wr, level 3, files in(1, 15) out(14 +0 blob) MB in(26.3, 474.2 +0.0 blob) out(480.9 +0.0 blob), read-write-amplify(37.3) write-amplify(18.3) OK, records in: 12763779, records dropped: 55402 output_compression: Snappy 2024/11/23-06:37:17.433578 140024953251392 (Original Log Time 2024/11/23-06:37:17.433546) EVENT_LOG_v1 {"time_micros": 1732315037433526, "cf": "default", "job": 21157, "event": "compaction_finished", "compaction_time_micros": 44374946, "compaction_time_cpu_micros": 20160751, "output_level": 3, "num_output_files": 14, "total_output_size": 504284318, "num_input_records": 12763779, "num_output_records": 12708377, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "file_write_nanos": 335570524, "file_range_sync_nanos": 0, "file_fsync_nanos": 14496, "file_prepare_write_nanos": 32237, "lsm_state": [0, 0, 0, 14, 0, 0, 0]} 2024/11/23-06:37:17.577669 140024953251392 DEBG dcompact_worker.cpp:240: HttpPost: 200 OK: url = http://nlb-7zny4kaa1poal01o64.cn-shenzhen.nlb.aliyuncs.com:8443, body = {"instanceId":"nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137","labourId":"","dbId":"d89b4006-2803-486e-b7a2-759bcf348921","dbStarts":1732256054,"starts":1732314992,"executesMs":44607,"compactionJobId":21157,"attempt":0,"compactionInputRawBytes":1821805507,"compactionInputZipBytes":524797745,"compactionOutputRawBytes":0,"compactionOutputZipBytes":504284318,"headers":{"Accept":"*/*","Connection":"close","Host":"aliyun-topling-saas.topling.cn:18443","RemoteIp":"120.24.192.169","X-Forwarded-For":"120.24.192.169","region":"cn-shenzhen","token":"e6474c481bd4415abc537135cc03626b","instance-token":"e6474c481bd4415abc537135cc03626b","provider":"aliyun","CloudMarketInstanceId":"si-59c0ae5c955845588903","MeteringAssit":"","Transfer-Encoding":"chunked","traceparent":"00-dcd0ac6f9e93a9d7895e8c5edb18a75b-6cc0f8d41288db2d-00"}}, response = 2024/11/23-06:37:17.577743 140024953251392 INFO dcompact_worker.cpp:1459: finish /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-21157/att-00: olev 3, work 44.608 s, result 4.938 ms, install 0.754 ms, input{raw 1.697 GiB zip 500.486 MiB}