2024/11/23-00:02:07.676399 140024970036800 DEBG dcompact_worker.cpp:2214: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14683/att-00: fork to child time = 0.009270 sec 2024/11/23-00:02:07.677219 140024970036800 DEBG dcompact_worker.cpp:1013: Beg SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14683/att-00 2024/11/23-00:02:07.684705 140024970036800 DEBG dcompact_worker.cpp:1033: End SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14683/att-00 2024/11/23-00:02:07.685809 140024970036800 TRAC dcompact_worker.cpp:1083: INFO_LOG_LEVEL: rpc = INFO_LEVEL, env_var = undefined 2024/11/23-00:02:07.686075 140024970036800 [WARN] [column_family.cc:386] multiple cf_paths/db_paths and level_compaction_dynamic_level_bytes can't be used together 2024/11/23-00:02:07.741427 140024970036800 [version_set.cc:6208] Recovering from manifest file: /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-14683/att-00/MANIFEST-206347 2024/11/23-00:02:07.773396 140024970036800 [version_set.cc:6251] Recovered from manifest file:/worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-14683/att-00/MANIFEST-206347 succeeded,manifest_file_number is 206347, next_file_number is 235258, last_sequence is 3661375488, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 235108 2024/11/23-00:02:07.773404 140024970036800 [version_set.cc:6266] Column family [default] (ID 0), log number is 0 2024/11/23-00:02:07.773505 140024970036800 [version_set.cc:5721] Creating manifest 235258 2024/11/23-00:02:07.810600 140024970036800 DEBG dcompact_worker.cpp:1218: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14683/att-00: bottommost_level: fake = 1, rpc = 0 2024/11/23-00:02:07.834394 140024970036800 [compaction_job.cc:2437] [default] [JOB 14683] Compacting 1@2 + 14@3 files to L3, score 1.00, subcompactions 1 : 1 2024/11/23-00:02:07.834412 140024970036800 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 11006 Base level 2, inputs: [235253(27MB)], [235189(33MB) 235190(35MB) 235191(35MB) 235192(34MB) 235193(35MB) 235194(35MB) 235195(38MB) 235196(36MB) 235197(35MB) 235198(36MB) 235199(35MB) 235200(36MB) 235201(35MB) 235202(12MB)] 2024/11/23-00:02:07.840760 140024970036800 [top_zip_table.cc:59] core git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-00:02:07.840795 140024970036800 [top_zip_table.cc:60] fsa git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-00:02:07.840814 140024970036800 [top_zip_table.cc:61] zbs git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-00:02:07.840819 140024970036800 [top_zip_table.cc:62] topling-zip_table_reader: git_version_hash_info_is: commit a4a382006cb82713acf5b3425835f22711877681 Author: leipeng Date: 2024-04-11 19:44:14 +0800 fixed_len_hole_index.cc: Add env bool FixedLenHoleIndexUseAVX512 for ut & debug 1. FixedLenHoleIndexUseAVX512 is only in unit tests or debug 2. In release mode, use avx512 by compile options(-march=) g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/23-00:02:07.840830 140024970036800 [top_zip_table.cc:64] topling-rocks git_version_hash_info_is: commit feab587e468621ba0204d47b4ffacc52e7c4290d Author: leipeng Date: 2024-03-22 13:35:06 +0800 ToplingZipTableBuilder::Add: immediately return after error This function returns void, and caller does not check builder->status() after calling this function and graceful abandon. So immediately return after error, and return error status in Finish(). g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/23-00:02:08.302867 140024970036800 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14683/att-00/235259.sst) /dev/shm/ToplingTemp/Topling-342762-pNrlOh 2024/11/23-00:02:08.868945 140024970036800 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14683/att-00/235259.sst): first pass time = 0.57's, 237.117'MB/sec 2024/11/23-00:02:10.500297 140024970036800 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14683/att-00/235259.sst): old prealloc_size = 147639500, real_size = 31218640 2024/11/23-00:02:10.500852 140024970036800 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14683/att-00/235259.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 924634 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1083 GB zip-val = 0.0292 GB avg-val = 117.16 avg-zval = 31.60 2024/11/23-00:02:10.501668 140024970036800 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14683/att-00/235259.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-00:02:12.280829 140024970036800 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14683/att-00/235259.sst): second pass time = 1.63's, 66.433'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.78's, 19.832'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3303.532'MB/sec (index lex order gen) rebuild zvType time = 1.48's, 0.157'MB/sec write SST data time = 0.30's, 116.401'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.082'MB, throughput = 31023.234'MB/sec zip my value time = 1.63's, unzip length = 0.108'GB zip my value throughput = 66.433'MB/sec zip pipeline throughput = 101.300'MB/sec entries = 924634 avg-key = 28.00 avg-zkey = 1.91 avg-val = 117.16 avg-zval = 31.60 usrkeys = 924634 avg-key = 20.00 avg-zkey = 1.91 avg-val = 124.16 avg-zval = 31.60 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 924634 bytes = 3236240 } seq expand size = 6472438 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0292 GB dict = 1.08 MB all = 0.0353 GB } UnZip/Zip{ index = 10.4442 value = 3.7077 dict = 1.00 all = 3.8010 } Zip/UnZip{ index = 0.0957 value = 0.2697 dict = 1.00 all = 0.2631 } ---------------------------- total value len = 0.114800 GB avg = 0.124 KB (by entry num) total key len = 0.025890 GB avg = 0.028 KB total ukey len = 0.018493 GB avg = 0.020 KB total ukey num = 0.000924634 Billion total entry num = 0.000924634 Billion write speed all = 0.002577255 MB/sec (with seq num) write speed all = 0.002441751 MB/sec (without seq num) 2024/11/23-00:02:12.317323 140024970036800 [compaction_job.cc:1948] [default] [JOB 14683] Generated table #235259: 924634 keys, 35310988 bytes, temperature: kWarm 2024/11/23-00:02:12.317435 140024970036800 EVENT_LOG_v1 {"time_micros": 1732291332317364, "cf_name": "default", "job": 14683, "event": "table_file_creation", "file_number": 235259, "file_size": 35310988, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3513012344, "largest_seqno": 3661355650, "table_properties": {"data_size": 29216704, "index_size": 1770624, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25889752, "raw_average_key_size": 28, "raw_value_size": 108328060, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 924634, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732291328, "oldest_key_time": 0, "file_creation_time": 1732291328, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 235259, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-00:02:12.397931 140024970036800 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14683/att-00/235260.sst) /dev/shm/ToplingTemp/Topling-342762-N7T0pg 2024/11/23-00:02:13.364991 140024970036800 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14683/att-00/235260.sst): first pass time = 0.97's, 138.796'MB/sec 2024/11/23-00:02:15.413760 140024970036800 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14683/att-00/235260.sst): old prealloc_size = 147639500, real_size = 33565168 2024/11/23-00:02:15.414458 140024970036800 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14683/att-00/235260.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 926010 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0316 GB avg-val = 116.94 avg-zval = 34.09 2024/11/23-00:02:15.415286 140024970036800 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14683/att-00/235260.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-00:02:16.779202 140024970036800 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14683/att-00/235260.sst): second pass time = 2.05's, 52.874'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.37's, 27.582'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2639.416'MB/sec (index lex order gen) rebuild zvType time = 1.20's, 0.193'MB/sec write SST data time = 0.16's, 231.311'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 26859.117'MB/sec zip my value time = 2.05's, unzip length = 0.108'GB zip my value throughput = 52.874'MB/sec zip pipeline throughput = 56.903'MB/sec entries = 926010 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.94 avg-zval = 34.09 usrkeys = 926010 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.94 avg-zval = 34.09 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 926010 bytes = 3241056 } seq expand size = 6482070 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0316 GB dict = 1.08 MB all = 0.0377 GB } UnZip/Zip{ index = 10.5156 value = 3.4299 dict = 1.00 all = 3.5638 } Zip/UnZip{ index = 0.0951 value = 0.2916 dict = 1.00 all = 0.2806 } ---------------------------- total value len = 0.229572 GB avg = 0.124 KB (by entry num) total key len = 0.051818 GB avg = 0.028 KB total ukey len = 0.037013 GB avg = 0.020 KB total ukey num = 0.001850644 Billion total entry num = 0.001850644 Billion write speed all = 0.005154262 MB/sec (with seq num) write speed all = 0.004883074 MB/sec (without seq num) 2024/11/23-00:02:16.830821 140024970036800 [compaction_job.cc:1948] [default] [JOB 14683] Generated table #235260: 926010 keys, 37661344 bytes, temperature: kWarm 2024/11/23-00:02:16.830883 140024970036800 EVENT_LOG_v1 {"time_micros": 1732291336830852, "cf_name": "default", "job": 14683, "event": "table_file_creation", "file_number": 235260, "file_size": 37661344, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3434038037, "largest_seqno": 3661355823, "table_properties": {"data_size": 31572256, "index_size": 1761216, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25928280, "raw_average_key_size": 28, "raw_value_size": 108289520, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 926010, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732291332, "oldest_key_time": 0, "file_creation_time": 1732291332, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 235260, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-00:02:16.944721 140024970036800 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14683/att-00/235261.sst) /dev/shm/ToplingTemp/Topling-342762-Hgff5e 2024/11/23-00:02:17.947260 140024970036800 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14683/att-00/235261.sst): first pass time = 1.00's, 133.883'MB/sec 2024/11/23-00:02:20.170305 140024970036800 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14683/att-00/235261.sst): old prealloc_size = 147639500, real_size = 33645360 2024/11/23-00:02:20.170976 140024970036800 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14683/att-00/235261.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 925651 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0317 GB avg-val = 117.00 avg-zval = 34.19 2024/11/23-00:02:20.171774 140024970036800 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14683/att-00/235261.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-00:02:21.309166 140024970036800 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14683/att-00/235261.sst): second pass time = 2.22's, 48.747'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.14's, 33.139'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2711.487'MB/sec (index lex order gen) rebuild zvType time = 0.98's, 0.235'MB/sec write SST data time = 0.15's, 243.496'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 36356.814'MB/sec zip my value time = 2.22's, unzip length = 0.108'GB zip my value throughput = 48.747'MB/sec zip pipeline throughput = 98.113'MB/sec entries = 925651 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.00 avg-zval = 34.19 usrkeys = 925651 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.00 avg-zval = 34.19 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 925651 bytes = 3239792 } seq expand size = 6479557 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0317 GB dict = 1.08 MB all = 0.0377 GB } UnZip/Zip{ index = 10.5088 value = 3.4216 dict = 1.00 all = 3.5564 } Zip/UnZip{ index = 0.0952 value = 0.2923 dict = 1.00 all = 0.2812 } ---------------------------- total value len = 0.344351 GB avg = 0.124 KB (by entry num) total key len = 0.077736 GB avg = 0.028 KB total ukey len = 0.055526 GB avg = 0.020 KB total ukey num = 0.002776295 Billion total entry num = 0.002776295 Billion write speed all = 0.007730794 MB/sec (with seq num) write speed all = 0.007323998 MB/sec (without seq num) 2024/11/23-00:02:21.342215 140024970036800 [compaction_job.cc:1948] [default] [JOB 14683] Generated table #235261: 925651 keys, 37739870 bytes, temperature: kWarm 2024/11/23-00:02:21.342275 140024970036800 EVENT_LOG_v1 {"time_micros": 1732291341342245, "cf_name": "default", "job": 14683, "event": "table_file_creation", "file_number": 235261, "file_size": 37739870, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3434038075, "largest_seqno": 3661356311, "table_properties": {"data_size": 31652128, "index_size": 1761664, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25918228, "raw_average_key_size": 28, "raw_value_size": 108299642, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 925651, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732291336, "oldest_key_time": 0, "file_creation_time": 1732291336, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 235261, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-00:02:21.378710 140024970036800 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14683/att-00/235262.sst) /dev/shm/ToplingTemp/Topling-342762-0n5Ucf 2024/11/23-00:02:22.459242 140024970036800 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14683/att-00/235262.sst): first pass time = 1.08's, 124.219'MB/sec 2024/11/23-00:02:24.055243 140024970036800 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14683/att-00/235262.sst): old prealloc_size = 147639500, real_size = 32922528 2024/11/23-00:02:24.055830 140024970036800 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14683/att-00/235262.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 925228 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0309 GB avg-val = 117.06 avg-zval = 33.43 2024/11/23-00:02:24.056601 140024970036800 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14683/att-00/235262.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-00:02:25.155204 140024970036800 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14683/att-00/235262.sst): second pass time = 1.59's, 67.922'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.10's, 33.652'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3102.310'MB/sec (index lex order gen) rebuild zvType time = 0.97's, 0.239'MB/sec write SST data time = 0.13's, 283.699'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 35365.782'MB/sec zip my value time = 1.59's, unzip length = 0.108'GB zip my value throughput = 67.922'MB/sec zip pipeline throughput = 67.922'MB/sec entries = 925228 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.06 avg-zval = 33.43 usrkeys = 925228 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.06 avg-zval = 33.43 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 925228 bytes = 3238320 } seq expand size = 6476596 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0309 GB dict = 1.08 MB all = 0.0370 GB } UnZip/Zip{ index = 10.5117 value = 3.5018 dict = 1.00 all = 3.6260 } Zip/UnZip{ index = 0.0951 value = 0.2856 dict = 1.00 all = 0.2758 } ---------------------------- total value len = 0.459139 GB avg = 0.124 KB (by entry num) total key len = 0.103643 GB avg = 0.028 KB total ukey len = 0.074030 GB avg = 0.020 KB total ukey num = 0.003701523 Billion total entry num = 0.003701523 Billion write speed all = 0.010306972 MB/sec (with seq num) write speed all = 0.009764645 MB/sec (without seq num) 2024/11/23-00:02:25.188518 140024970036800 [compaction_job.cc:1948] [default] [JOB 14683] Generated table #235262: 925228 keys, 37015772 bytes, temperature: kWarm 2024/11/23-00:02:25.188599 140024970036800 EVENT_LOG_v1 {"time_micros": 1732291345188548, "cf_name": "default", "job": 14683, "event": "table_file_creation", "file_number": 235262, "file_size": 37015772, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3434038106, "largest_seqno": 3661355976, "table_properties": {"data_size": 30930640, "index_size": 1760384, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25906384, "raw_average_key_size": 28, "raw_value_size": 108311384, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 925228, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732291341, "oldest_key_time": 0, "file_creation_time": 1732291341, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 235262, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-00:02:25.234118 140024970036800 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14683/att-00/235263.sst) /dev/shm/ToplingTemp/Topling-342762-KKNGbe 2024/11/23-00:02:26.431745 140024970036800 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14683/att-00/235263.sst): first pass time = 1.20's, 112.074'MB/sec 2024/11/23-00:02:27.963387 140024970036800 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14683/att-00/235263.sst): old prealloc_size = 147639500, real_size = 33577056 2024/11/23-00:02:27.963998 140024970036800 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14683/att-00/235263.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 925351 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0316 GB avg-val = 117.05 avg-zval = 34.13 2024/11/23-00:02:27.964812 140024970036800 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14683/att-00/235263.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-00:02:28.994801 140024970036800 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14683/att-00/235263.sst): second pass time = 1.53's, 70.751'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.03's, 36.524'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2982.535'MB/sec (index lex order gen) rebuild zvType time = 0.88's, 0.264'MB/sec write SST data time = 0.16's, 242.216'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 33169.383'MB/sec zip my value time = 1.53's, unzip length = 0.108'GB zip my value throughput = 70.751'MB/sec zip pipeline throughput = 70.751'MB/sec entries = 925351 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.05 avg-zval = 34.13 usrkeys = 925351 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.05 avg-zval = 34.13 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 925351 bytes = 3238736 } seq expand size = 6477457 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0316 GB dict = 1.08 MB all = 0.0377 GB } UnZip/Zip{ index = 10.5146 value = 3.4290 dict = 1.00 all = 3.5629 } Zip/UnZip{ index = 0.0951 value = 0.2916 dict = 1.00 all = 0.2807 } ---------------------------- total value len = 0.573925 GB avg = 0.124 KB (by entry num) total key len = 0.129552 GB avg = 0.028 KB total ukey len = 0.092537 GB avg = 0.020 KB total ukey num = 0.004626874 Billion total entry num = 0.004626874 Billion write speed all = 0.012882805 MB/sec (with seq num) write speed all = 0.012204948 MB/sec (without seq num) 2024/11/23-00:02:29.030519 140024970036800 [compaction_job.cc:1948] [default] [JOB 14683] Generated table #235263: 925351 keys, 37671046 bytes, temperature: kWarm 2024/11/23-00:02:29.030583 140024970036800 EVENT_LOG_v1 {"time_micros": 1732291349030551, "cf_name": "default", "job": 14683, "event": "table_file_creation", "file_number": 235263, "file_size": 37671046, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3522904895, "largest_seqno": 3661355472, "table_properties": {"data_size": 31585424, "index_size": 1760128, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25909828, "raw_average_key_size": 28, "raw_value_size": 108307974, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 925351, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732291345, "oldest_key_time": 0, "file_creation_time": 1732291345, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 235263, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-00:02:29.067732 140024970036800 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14683/att-00/235264.sst) /dev/shm/ToplingTemp/Topling-342762-KI8aQg 2024/11/23-00:02:30.224734 140024970036800 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14683/att-00/235264.sst): first pass time = 1.16's, 116.009'MB/sec 2024/11/23-00:02:31.635614 140024970036800 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14683/att-00/235264.sst): old prealloc_size = 147639500, real_size = 33532032 2024/11/23-00:02:31.636190 140024970036800 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14683/att-00/235264.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 925689 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0315 GB avg-val = 116.99 avg-zval = 34.07 2024/11/23-00:02:31.636956 140024970036800 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14683/att-00/235264.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-00:02:32.588997 140024970036800 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14683/att-00/235264.sst): second pass time = 1.41's, 76.793'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.95's, 39.468'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3165.745'MB/sec (index lex order gen) rebuild zvType time = 0.83's, 0.280'MB/sec write SST data time = 0.13's, 295.227'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 32777.104'MB/sec zip my value time = 1.41's, unzip length = 0.108'GB zip my value throughput = 76.793'MB/sec zip pipeline throughput = 76.793'MB/sec entries = 925689 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.99 avg-zval = 34.07 usrkeys = 925689 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.99 avg-zval = 34.07 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 925689 bytes = 3239920 } seq expand size = 6479823 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0315 GB dict = 1.08 MB all = 0.0376 GB } UnZip/Zip{ index = 10.5127 value = 3.4338 dict = 1.00 all = 3.5671 } Zip/UnZip{ index = 0.0951 value = 0.2912 dict = 1.00 all = 0.2803 } ---------------------------- total value len = 0.688703 GB avg = 0.124 KB (by entry num) total key len = 0.155472 GB avg = 0.028 KB total ukey len = 0.111051 GB avg = 0.020 KB total ukey num = 0.005552563 Billion total entry num = 0.005552563 Billion write speed all = 0.015458390 MB/sec (with seq num) write speed all = 0.014644969 MB/sec (without seq num) 2024/11/23-00:02:32.623644 140024970036800 [compaction_job.cc:1948] [default] [JOB 14683] Generated table #235264: 925689 keys, 37626850 bytes, temperature: kWarm 2024/11/23-00:02:32.623710 140024970036800 EVENT_LOG_v1 {"time_micros": 1732291352623678, "cf_name": "default", "job": 14683, "event": "table_file_creation", "file_number": 235264, "file_size": 37626850, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3434038136, "largest_seqno": 3661356048, "table_properties": {"data_size": 31539312, "index_size": 1761088, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25919292, "raw_average_key_size": 28, "raw_value_size": 108298562, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 925689, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732291349, "oldest_key_time": 0, "file_creation_time": 1732291349, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 235264, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-00:02:32.661848 140024970036800 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14683/att-00/235265.sst) /dev/shm/ToplingTemp/Topling-342762-tzGF4g 2024/11/23-00:02:33.615521 140024970036800 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14683/att-00/235265.sst): first pass time = 0.95's, 140.743'MB/sec 2024/11/23-00:02:35.271386 140024970036800 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14683/att-00/235265.sst): old prealloc_size = 147639500, real_size = 35134304 2024/11/23-00:02:35.271948 140024970036800 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14683/att-00/235265.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927130 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.89 raw-val = 0.1083 GB zip-val = 0.0331 GB avg-val = 116.77 avg-zval = 35.76 2024/11/23-00:02:35.272756 140024970036800 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14683/att-00/235265.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-00:02:36.394304 140024970036800 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14683/att-00/235265.sst): second pass time = 1.66's, 65.406'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.12's, 35.046'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3240.133'MB/sec (index lex order gen) rebuild zvType time = 1.00's, 0.233'MB/sec write SST data time = 0.13's, 312.737'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 32806.182'MB/sec zip my value time = 1.66's, unzip length = 0.108'GB zip my value throughput = 65.406'MB/sec zip pipeline throughput = 83.023'MB/sec entries = 927130 avg-key = 28.00 avg-zkey = 1.89 avg-val = 116.77 avg-zval = 35.76 usrkeys = 927130 avg-key = 20.00 avg-zkey = 1.89 avg-val = 123.77 avg-zval = 35.76 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 927130 bytes = 3360864 } seq expand size = 6489910 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0331 GB dict = 1.08 MB all = 0.0394 GB } UnZip/Zip{ index = 10.5814 value = 3.2657 dict = 1.00 all = 3.4106 } Zip/UnZip{ index = 0.0945 value = 0.3062 dict = 1.00 all = 0.2932 } ---------------------------- total value len = 0.803451 GB avg = 0.124 KB (by entry num) total key len = 0.181431 GB avg = 0.028 KB total ukey len = 0.129594 GB avg = 0.020 KB total ukey num = 0.006479693 Billion total entry num = 0.006479693 Billion write speed all = 0.018033750 MB/sec (with seq num) write speed all = 0.017084576 MB/sec (without seq num) 2024/11/23-00:02:36.429493 140024970036800 [compaction_job.cc:1948] [default] [JOB 14683] Generated table #235265: 927130 keys, 39353318 bytes, temperature: kWarm 2024/11/23-00:02:36.429556 140024970036800 EVENT_LOG_v1 {"time_micros": 1732291356429522, "cf_name": "default", "job": 14683, "event": "table_file_creation", "file_number": 235265, "file_size": 39353318, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3237868609, "largest_seqno": 3661356219, "table_properties": {"data_size": 33149968, "index_size": 1752384, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25959640, "raw_average_key_size": 28, "raw_value_size": 108258176, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927130, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732291352, "oldest_key_time": 0, "file_creation_time": 1732291352, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 235265, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-00:02:36.468033 140024970036800 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14683/att-00/235266.sst) /dev/shm/ToplingTemp/Topling-342762-bl0nAg 2024/11/23-00:02:37.376457 140024970036800 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14683/att-00/235266.sst): first pass time = 0.91's, 147.754'MB/sec 2024/11/23-00:02:38.909533 140024970036800 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14683/att-00/235266.sst): old prealloc_size = 147639500, real_size = 36953984 2024/11/23-00:02:38.910124 140024970036800 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14683/att-00/235266.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 925990 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0350 GB avg-val = 116.95 avg-zval = 37.76 2024/11/23-00:02:38.910384 140024970036800 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14683/att-00/235266.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-00:02:39.911405 140024970036800 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14683/att-00/235266.sst): second pass time = 1.53's, 70.694'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.00's, 38.509'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3083.448'MB/sec (index lex order gen) rebuild zvType time = 0.68's, 0.340'MB/sec write SST data time = 0.32's, 120.164'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 28750.352'MB/sec zip my value time = 1.53's, unzip length = 0.108'GB zip my value throughput = 70.694'MB/sec zip pipeline throughput = 70.694'MB/sec entries = 925990 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.95 avg-zval = 37.76 usrkeys = 925990 avg-key = 20.00 avg-zkey = 1.90 avg-val = 118.39 avg-zval = 37.76 TagRS{ kinds = RS_Key0_TagN bytes = 144800 } TagArray{ size = 191641 bytes = 622848 } seq expand size = 1341487 multi value expand size = 0 cnt WriteAppend = 15 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0350 GB dict = 1.08 MB all = 0.0386 GB } UnZip/Zip{ index = 10.5138 value = 3.0975 dict = 1.00 all = 3.4789 } Zip/UnZip{ index = 0.0951 value = 0.3228 dict = 1.00 all = 0.2874 } ---------------------------- total value len = 0.913083 GB avg = 0.123 KB (by entry num) total key len = 0.207359 GB avg = 0.028 KB total ukey len = 0.148114 GB avg = 0.020 KB total ukey num = 0.007405683 Billion total entry num = 0.007405683 Billion write speed all = 0.020514596 MB/sec (with seq num) write speed all = 0.019429849 MB/sec (without seq num) 2024/11/23-00:02:39.947121 140024970036800 [compaction_job.cc:1948] [default] [JOB 14683] Generated table #235266: 925990 keys, 38580475 bytes, temperature: kWarm 2024/11/23-00:02:39.947185 140024970036800 EVENT_LOG_v1 {"time_micros": 1732291359947155, "cf_name": "default", "job": 14683, "event": "table_file_creation", "file_number": 235266, "file_size": 38580475, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3273700833, "table_properties": {"data_size": 34960816, "index_size": 1761472, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25927720, "raw_average_key_size": 28, "raw_value_size": 108290136, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 925990, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732291356, "oldest_key_time": 0, "file_creation_time": 1732291356, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 235266, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-00:02:39.984978 140024970036800 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14683/att-00/235267.sst) /dev/shm/ToplingTemp/Topling-342762-xkyJce 2024/11/23-00:02:40.906508 140024970036800 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14683/att-00/235267.sst): first pass time = 0.92's, 145.654'MB/sec 2024/11/23-00:02:42.684126 140024970036800 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14683/att-00/235267.sst): old prealloc_size = 147639500, real_size = 36462016 2024/11/23-00:02:42.684813 140024970036800 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14683/att-00/235267.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927078 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.89 raw-val = 0.1083 GB zip-val = 0.0345 GB avg-val = 116.78 avg-zval = 37.19 2024/11/23-00:02:42.684883 140024970036800 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14683/att-00/235267.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-00:02:43.593592 140024970036800 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14683/att-00/235267.sst): second pass time = 1.78's, 60.928'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.91's, 41.036'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2578.865'MB/sec (index lex order gen) rebuild zvType time = 0.76's, 0.306'MB/sec write SST data time = 0.15's, 246.693'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 39956.139'MB/sec zip my value time = 1.78's, unzip length = 0.108'GB zip my value throughput = 60.928'MB/sec zip pipeline throughput = 60.928'MB/sec entries = 927078 avg-key = 28.00 avg-zkey = 1.89 avg-val = 116.78 avg-zval = 37.19 usrkeys = 927078 avg-key = 20.00 avg-zkey = 1.89 avg-val = 116.78 avg-zval = 37.19 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 9 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0345 GB dict = 1.08 MB all = 0.0373 GB } UnZip/Zip{ index = 10.5815 value = 3.1400 dict = 1.00 all = 3.5964 } Zip/UnZip{ index = 0.0945 value = 0.3185 dict = 1.00 all = 0.2781 } ---------------------------- total value len = 1.021342 GB avg = 0.123 KB (by entry num) total key len = 0.233317 GB avg = 0.028 KB total ukey len = 0.166655 GB avg = 0.020 KB total ukey num = 0.008332761 Billion total entry num = 0.008332761 Billion write speed all = 0.022970494 MB/sec (with seq num) write speed all = 0.021750034 MB/sec (without seq num) 2024/11/23-00:02:43.629305 140024970036800 [compaction_job.cc:1948] [default] [JOB 14683] Generated table #235267: 927078 keys, 37320160 bytes, temperature: kWarm 2024/11/23-00:02:43.629373 140024970036800 EVENT_LOG_v1 {"time_micros": 1732291363629340, "cf_name": "default", "job": 14683, "event": "table_file_creation", "file_number": 235267, "file_size": 37320160, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 34477808, "index_size": 1752256, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25958184, "raw_average_key_size": 28, "raw_value_size": 108259684, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927078, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732291359, "oldest_key_time": 0, "file_creation_time": 1732291359, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 235267, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-00:02:43.665928 140024970036800 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14683/att-00/235268.sst) /dev/shm/ToplingTemp/Topling-342762-Who6We 2024/11/23-00:02:44.713987 140024970036800 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14683/att-00/235268.sst): first pass time = 1.05's, 128.068'MB/sec 2024/11/23-00:02:46.290836 140024970036800 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14683/att-00/235268.sst): old prealloc_size = 147639500, real_size = 35943232 2024/11/23-00:02:46.291386 140024970036800 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14683/att-00/235268.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 923647 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1084 GB zip-val = 0.0340 GB avg-val = 117.31 avg-zval = 36.76 2024/11/23-00:02:46.291827 140024970036800 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14683/att-00/235268.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-00:02:47.110917 140024970036800 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14683/att-00/235268.sst): second pass time = 1.58's, 68.745'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.82's, 46.733'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3327.462'MB/sec (index lex order gen) rebuild zvType time = 0.64's, 0.358'MB/sec write SST data time = 0.18's, 218.945'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.083'MB, throughput = 22522.445'MB/sec zip my value time = 1.58's, unzip length = 0.108'GB zip my value throughput = 68.745'MB/sec zip pipeline throughput = 68.745'MB/sec entries = 923647 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.31 avg-zval = 36.76 usrkeys = 923647 avg-key = 20.00 avg-zkey = 1.90 avg-val = 120.40 avg-zval = 36.76 TagRS{ kinds = RS_Key0_TagN bytes = 144400 } TagArray{ size = 407303 bytes = 1374656 } seq expand size = 2851121 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0185 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0340 GB dict = 1.08 MB all = 0.0383 GB } UnZip/Zip{ index = 10.5117 value = 3.1912 dict = 1.00 all = 3.5022 } Zip/UnZip{ index = 0.0951 value = 0.3134 dict = 1.00 all = 0.2855 } ---------------------------- total value len = 1.132549 GB avg = 0.122 KB (by entry num) total key len = 0.259179 GB avg = 0.028 KB total ukey len = 0.185128 GB avg = 0.020 KB total ukey num = 0.009256408 Billion total entry num = 0.009256408 Billion write speed all = 0.025478331 MB/sec (with seq num) write speed all = 0.024122677 MB/sec (without seq num) 2024/11/23-00:02:47.145925 140024970036800 [compaction_job.cc:1948] [default] [JOB 14683] Generated table #235268: 923647 keys, 38323655 bytes, temperature: kWarm 2024/11/23-00:02:47.145991 140024970036800 EVENT_LOG_v1 {"time_micros": 1732291367145958, "cf_name": "default", "job": 14683, "event": "table_file_creation", "file_number": 235268, "file_size": 38323655, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3389001257, "table_properties": {"data_size": 33954736, "index_size": 1757376, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25862116, "raw_average_key_size": 28, "raw_value_size": 108355714, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 923647, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732291363, "oldest_key_time": 0, "file_creation_time": 1732291363, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 235268, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-00:02:47.185621 140024970036800 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14683/att-00/235269.sst) /dev/shm/ToplingTemp/Topling-342762-cNAFJg 2024/11/23-00:02:48.198713 140024970036800 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14683/att-00/235269.sst): first pass time = 1.01's, 132.489'MB/sec 2024/11/23-00:02:49.552191 140024970036800 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14683/att-00/235269.sst): old prealloc_size = 147639500, real_size = 32433328 2024/11/23-00:02:49.552718 140024970036800 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14683/att-00/235269.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 925774 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1083 GB zip-val = 0.0304 GB avg-val = 116.98 avg-zval = 32.87 2024/11/23-00:02:49.555282 140024970036800 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14683/att-00/235269.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-00:02:50.448573 140024970036800 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14683/att-00/235269.sst): second pass time = 1.35's, 80.081'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.90's, 40.881'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3513.057'MB/sec (index lex order gen) rebuild zvType time = 0.77's, 0.302'MB/sec write SST data time = 0.13's, 280.631'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 21268.826'MB/sec zip my value time = 1.35's, unzip length = 0.108'GB zip my value throughput = 80.081'MB/sec zip pipeline throughput = 80.081'MB/sec entries = 925774 avg-key = 28.00 avg-zkey = 1.92 avg-val = 116.98 avg-zval = 32.87 usrkeys = 925774 avg-key = 20.00 avg-zkey = 1.92 avg-val = 123.98 avg-zval = 32.87 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 925774 bytes = 3355952 } seq expand size = 6480418 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0304 GB dict = 1.08 MB all = 0.0366 GB } UnZip/Zip{ index = 10.4438 value = 3.5590 dict = 1.00 all = 3.6627 } Zip/UnZip{ index = 0.0958 value = 0.2810 dict = 1.00 all = 0.2730 } ---------------------------- total value len = 1.247326 GB avg = 0.123 KB (by entry num) total key len = 0.285101 GB avg = 0.028 KB total ukey len = 0.203644 GB avg = 0.020 KB total ukey num = 0.010182182 Billion total entry num = 0.010182182 Billion write speed all = 0.028052375 MB/sec (with seq num) write speed all = 0.026561227 MB/sec (without seq num) 2024/11/23-00:02:50.479941 140024970036800 [compaction_job.cc:1948] [default] [JOB 14683] Generated table #235269: 925774 keys, 36644014 bytes, temperature: kWarm 2024/11/23-00:02:50.480007 140024970036800 EVENT_LOG_v1 {"time_micros": 1732291370479973, "cf_name": "default", "job": 14683, "event": "table_file_creation", "file_number": 235269, "file_size": 36644014, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3389001258, "largest_seqno": 3661355706, "table_properties": {"data_size": 30428832, "index_size": 1772864, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25921672, "raw_average_key_size": 28, "raw_value_size": 108296144, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 925774, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732291367, "oldest_key_time": 0, "file_creation_time": 1732291367, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 235269, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-00:02:50.515209 140024970036800 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14683/att-00/235270.sst) /dev/shm/ToplingTemp/Topling-342762-CMoF3d 2024/11/23-00:02:51.543012 140024970036800 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14683/att-00/235270.sst): first pass time = 1.03's, 130.592'MB/sec 2024/11/23-00:02:52.874922 140024970036800 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14683/att-00/235270.sst): old prealloc_size = 147639500, real_size = 34379696 2024/11/23-00:02:52.875483 140024970036800 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14683/att-00/235270.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 930133 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0324 GB avg-val = 116.30 avg-zval = 34.81 2024/11/23-00:02:52.877158 140024970036800 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14683/att-00/235270.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-00:02:53.794212 140024970036800 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14683/att-00/235270.sst): second pass time = 1.33's, 81.286'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.92's, 41.994'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3272.223'MB/sec (index lex order gen) rebuild zvType time = 0.79's, 0.295'MB/sec write SST data time = 0.13's, 296.806'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 34423.891'MB/sec zip my value time = 1.33's, unzip length = 0.108'GB zip my value throughput = 81.286'MB/sec zip pipeline throughput = 81.286'MB/sec entries = 930133 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.30 avg-zval = 34.81 usrkeys = 930133 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.30 avg-zval = 34.81 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 930133 bytes = 3371744 } seq expand size = 6510931 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0324 GB dict = 1.08 MB all = 0.0386 GB } UnZip/Zip{ index = 10.5120 value = 3.3410 dict = 1.00 all = 3.4768 } Zip/UnZip{ index = 0.0951 value = 0.2993 dict = 1.00 all = 0.2876 } ---------------------------- total value len = 1.362011 GB avg = 0.123 KB (by entry num) total key len = 0.311145 GB avg = 0.028 KB total ukey len = 0.222246 GB avg = 0.020 KB total ukey num = 0.011112315 Billion total entry num = 0.011112315 Billion write speed all = 0.030626659 MB/sec (with seq num) write speed all = 0.028999396 MB/sec (without seq num) 2024/11/23-00:02:53.828810 140024970036800 [compaction_job.cc:1948] [default] [JOB 14683] Generated table #235270: 930133 keys, 38603700 bytes, temperature: kWarm 2024/11/23-00:02:53.828875 140024970036800 EVENT_LOG_v1 {"time_micros": 1732291373828844, "cf_name": "default", "job": 14683, "event": "table_file_creation", "file_number": 235270, "file_size": 38603700, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3273701386, "largest_seqno": 3661355451, "table_properties": {"data_size": 32377312, "index_size": 1769664, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26043724, "raw_average_key_size": 28, "raw_value_size": 108174146, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 930133, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732291370, "oldest_key_time": 0, "file_creation_time": 1732291370, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 235270, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-00:02:53.866183 140024970036800 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14683/att-00/235271.sst) /dev/shm/ToplingTemp/Topling-342762-fYvOif 2024/11/23-00:02:54.847464 140024970036800 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14683/att-00/235271.sst): first pass time = 0.98's, 136.784'MB/sec 2024/11/23-00:02:56.211346 140024970036800 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14683/att-00/235271.sst): old prealloc_size = 147639500, real_size = 32998112 2024/11/23-00:02:56.211956 140024970036800 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14683/att-00/235271.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 930199 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1082 GB zip-val = 0.0310 GB avg-val = 116.29 avg-zval = 33.31 2024/11/23-00:02:56.212688 140024970036800 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14683/att-00/235271.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-00:02:57.168187 140024970036800 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14683/att-00/235271.sst): second pass time = 1.36's, 79.352'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.96's, 38.659'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3040.155'MB/sec (index lex order gen) rebuild zvType time = 0.83's, 0.281'MB/sec write SST data time = 0.13's, 290.306'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 35523.969'MB/sec zip my value time = 1.36's, unzip length = 0.108'GB zip my value throughput = 79.352'MB/sec zip pipeline throughput = 79.352'MB/sec entries = 930199 avg-key = 28.00 avg-zkey = 1.92 avg-val = 116.29 avg-zval = 33.31 usrkeys = 930199 avg-key = 20.00 avg-zkey = 1.92 avg-val = 123.29 avg-zval = 33.31 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 930199 bytes = 3139440 } seq expand size = 6511393 multi value expand size = 0 cnt WriteAppend = 15 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0310 GB dict = 1.08 MB all = 0.0370 GB } UnZip/Zip{ index = 10.4436 value = 3.4912 dict = 1.00 all = 3.6285 } Zip/UnZip{ index = 0.0958 value = 0.2864 dict = 1.00 all = 0.2756 } ---------------------------- total value len = 1.476695 GB avg = 0.123 KB (by entry num) total key len = 0.337190 GB avg = 0.028 KB total ukey len = 0.240850 GB avg = 0.020 KB total ukey num = 0.012042514 Billion total entry num = 0.012042514 Billion write speed all = 0.033200617 MB/sec (with seq num) write speed all = 0.031437246 MB/sec (without seq num) 2024/11/23-00:02:57.209454 140024970036800 [compaction_job.cc:1948] [default] [JOB 14683] Generated table #235271: 930199 keys, 36989798 bytes, temperature: kWarm 2024/11/23-00:02:57.209520 140024970036800 EVENT_LOG_v1 {"time_micros": 1732291377209488, "cf_name": "default", "job": 14683, "event": "table_file_creation", "file_number": 235271, "file_size": 36989798, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3583362754, "largest_seqno": 3661355626, "table_properties": {"data_size": 30984016, "index_size": 1781376, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26045572, "raw_average_key_size": 28, "raw_value_size": 108172162, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 930199, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732291373, "oldest_key_time": 0, "file_creation_time": 1732291373, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 235271, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-00:02:57.246748 140024970036800 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14683/att-00/235272.sst) /dev/shm/ToplingTemp/Topling-342762-PKcGRe 2024/11/23-00:02:57.634190 140024970036800 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14683/att-00/235272.sst): first pass time = 0.39's, 179.297'MB/sec 2024/11/23-00:02:58.475084 140024970036800 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14683/att-00/235272.sst): old prealloc_size = 147639500, real_size = 17627152 2024/11/23-00:02:58.475415 140024970036800 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14683/att-00/235272.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 483601 prefix = 4 raw-key = 0.0077 GB zip-key = 0.0009 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.0559 GB zip-val = 0.0166 GB avg-val = 115.63 avg-zval = 34.30 2024/11/23-00:02:58.475850 140024970036800 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14683/att-00/235272.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0011 GB, waited 0.000 sec, Key+Value = 0.069 GB 2024/11/23-00:02:58.969727 140024970036800 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14683/att-00/235272.sst): second pass time = 0.84's, 66.551'MB/sec, value only(80.5% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.49's, 39.710'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3016.417'MB/sec (index lex order gen) rebuild zvType time = 0.43's, 0.284'MB/sec write SST data time = 0.07's, 288.430'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.560'MB, throughput = 18005.080'MB/sec zip my value time = 0.84's, unzip length = 0.056'GB zip my value throughput = 66.551'MB/sec zip pipeline throughput = 109.768'MB/sec entries = 483601 avg-key = 28.00 avg-zkey = 1.90 avg-val = 115.63 avg-zval = 34.30 usrkeys = 483601 avg-key = 20.00 avg-zkey = 1.90 avg-val = 122.63 avg-zval = 34.30 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 483601 bytes = 1571712 } seq expand size = 3385207 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0097 GB value = 0.0559 GB dict = 0.56 MB all = 0.0695 GB } __ZipSize{ index = 0.0009 GB value = 0.0166 GB dict = 0.56 MB all = 0.0196 GB } UnZip/Zip{ index = 10.5050 value = 3.3715 dict = 1.00 all = 3.5363 } Zip/UnZip{ index = 0.0952 value = 0.2966 dict = 1.00 all = 0.2828 } ---------------------------- total value len = 1.535997 GB avg = 0.123 KB (by entry num) total key len = 0.350731 GB avg = 0.028 KB total ukey len = 0.250522 GB avg = 0.020 KB total ukey num = 0.012526115 Billion total entry num = 0.012526115 Billion write speed all = 0.034532777 MB/sec (with seq num) write speed all = 0.032698654 MB/sec (without seq num) 2024/11/23-00:02:58.993011 140024970036800 [compaction_job.cc:1948] [default] [JOB 14683] Generated table #235272: 483601 keys, 19641563 bytes, temperature: kWarm 2024/11/23-00:02:58.993081 140024970036800 EVENT_LOG_v1 {"time_micros": 1732291378993048, "cf_name": "default", "job": 14683, "event": "table_file_creation", "file_number": 235272, "file_size": 19641563, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3618072141, "largest_seqno": 3661355241, "table_properties": {"data_size": 16585344, "index_size": 920704, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 13540828, "raw_average_key_size": 28, "raw_value_size": 55917506, "raw_average_value_size": 115, "num_data_blocks": 1, "num_entries": 483601, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732291377, "oldest_key_time": 0, "file_creation_time": 1732291377, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 235272, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-00:02:59.010386 140024970036800 [compaction_job.cc:703] job-14683: subcompact[0], size: 0.508483 G, files: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-14683/att-00 [235259,235260,235261,235262,235263,235264,235265,235266,235267,235268,235269,235270,235271,235272] 2024/11/23-00:02:59.117849 140024970036800 (Original Log Time 2024/11/23-00:02:07.834468) EVENT_LOG_v1 {"time_micros": 1732291327834427, "job": 14683, "event": "compaction_started", "compaction_reason": "FilesMarkedForCompaction", "files_L2": [235253], "files_L3": [235189, 235190, 235191, 235192, 235193, 235194, 235195, 235196, 235197, 235198, 235199, 235200, 235201, 235202], "score": 0.999559, "input_data_size": 528659619, "oldest_snapshot_seqno": 3661375488} 2024/11/23-00:02:59.117853 140024970036800 (Original Log Time 2024/11/23-00:02:59.117083) [compaction_job.cc:2022] [default] [JOB 14683] Compacted 1@2 + 14@3 files to L3 => 508482553 bytes 2024/11/23-00:02:59.117854 140024970036800 (Original Log Time 2024/11/23-00:02:59.117766) [compaction_job.cc:1224] [default] compacted to: files[0 0 0 14 0 0 0] max score 0.02, MB/sec: 10.3 rd, 9.9 wr, level 3, files in(1, 14) out(14 +0 blob) MB in(27.1, 477.1 +0.0 blob) out(484.9 +0.0 blob), read-write-amplify(36.5) write-amplify(17.9) OK, records in: 12586900, records dropped: 60785 output_compression: Snappy 2024/11/23-00:02:59.117861 140024970036800 (Original Log Time 2024/11/23-00:02:59.117827) EVENT_LOG_v1 {"time_micros": 1732291379117806, "cf": "default", "job": 14683, "event": "compaction_finished", "compaction_time_micros": 51175929, "compaction_time_cpu_micros": 22872925, "output_level": 3, "num_output_files": 14, "total_output_size": 508482553, "num_input_records": 12586900, "num_output_records": 12526115, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "file_write_nanos": 397977986, "file_range_sync_nanos": 0, "file_fsync_nanos": 12699, "file_prepare_write_nanos": 32669, "lsm_state": [0, 0, 0, 14, 0, 0, 0]} 2024/11/23-00:02:59.249474 140024970036800 DEBG dcompact_worker.cpp:240: HttpPost: 200 OK: url = http://nlb-7zny4kaa1poal01o64.cn-shenzhen.nlb.aliyuncs.com:8443, body = {"instanceId":"nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137","labourId":"","dbId":"d89b4006-2803-486e-b7a2-759bcf348921","dbStarts":1732256054,"starts":1732291327,"executesMs":51435,"compactionJobId":14683,"attempt":0,"compactionInputRawBytes":1822921500,"compactionInputZipBytes":528659619,"compactionOutputRawBytes":0,"compactionOutputZipBytes":508482553,"headers":{"Accept":"*/*","Connection":"close","Host":"aliyun-topling-saas.topling.cn:18443","RemoteIp":"120.24.192.169","X-Forwarded-For":"120.24.192.169","region":"cn-shenzhen","token":"e6474c481bd4415abc537135cc03626b","instance-token":"e6474c481bd4415abc537135cc03626b","provider":"aliyun","CloudMarketInstanceId":"si-59c0ae5c955845588903","MeteringAssit":"","Transfer-Encoding":"chunked","traceparent":"00-0c82304e858c9f7ce49b880a3b238d7a-5e51ba8023858b36-00"}}, response = 2024/11/23-00:02:59.249568 140024970036800 INFO dcompact_worker.cpp:1459: finish /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-14683/att-00: olev 3, work 51.435 s, result 4.989 ms, install 0.800 ms, input{raw 1.698 GiB zip 504.169 MiB}