2024/11/20-18:52:22.962086 140008156956224 DEBG dcompact_worker.cpp:2219: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00: fork to child time = 0.009728 sec 2024/11/20-18:52:22.962605 140008156956224 DEBG dcompact_worker.cpp:1013: Beg SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00 2024/11/20-18:52:22.969180 140008156956224 DEBG dcompact_worker.cpp:1033: End SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00 2024/11/20-18:52:22.970877 140008156956224 TRAC dcompact_worker.cpp:1083: INFO_LOG_LEVEL: rpc = INFO_LEVEL, env_var = undefined 2024/11/20-18:52:22.971091 140008156956224 [WARN] [column_family.cc:386] multiple cf_paths/db_paths and level_compaction_dynamic_level_bytes can't be used together 2024/11/20-18:52:23.012784 140008156956224 [version_set.cc:6211] Recovering from manifest file: /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-20T17.53.03/.rocksdb/job-06941/att-00/MANIFEST-049091 2024/11/20-18:52:23.028791 140008156956224 [version_set.cc:6254] Recovered from manifest file:/worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-20T17.53.03/.rocksdb/job-06941/att-00/MANIFEST-049091 succeeded,manifest_file_number is 49091, next_file_number is 59486, last_sequence is 992763372, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 59317 2024/11/20-18:52:23.028797 140008156956224 [version_set.cc:6269] Column family [default] (ID 0), log number is 0 2024/11/20-18:52:23.028896 140008156956224 [version_set.cc:5724] Creating manifest 59486 2024/11/20-18:52:23.057300 140008156956224 DEBG dcompact_worker.cpp:1225: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00: bottommost_level: fake = 1, rpc = 0 2024/11/20-18:52:23.076245 140008156956224 [compaction_job.cc:2437] [default] [JOB 6941] Compacting 1@2 + 22@3 files to L3, score 0.78, subcompactions 1 : 1 2024/11/20-18:52:23.076259 140008156956224 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 6315 Base level 2, inputs: [59484(12MB)], [59405(40MB) 59406(39MB) 59431(39MB) 59429(39MB) 59430(39MB) 59432(39MB) 59428(39MB) 59427(39MB) 59433(39MB) 59434(39MB) 59435(39MB) 59437(39MB) 59439(39MB) 59438(39MB) 59440(39MB) 59436(39MB) 59441(39MB) 59443(39MB) 59444(39MB) 59445(39MB) 59446(39MB) 59442(5682KB)] 2024/11/20-18:52:23.081188 140008156956224 [top_zip_table.cc:59] core git_version_hash_info_is:commit 81964c21ebbcc178d8e99dae0fbf61bded2729cc Author: rockeet Date: Mon Nov 11 21:28:46 2024 +0800 Makefile: fix gen git-version-*.cpp GIT_PATH_ARG = :!src/terark/fsa :!tools/fsa :!src/terark/zbs :!tools/zbs g++ (GCC) 12.2.1 20221121 (Red Hat 12.2.1-7) Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/zstd -Iboost-include DEFS = -DTOPLING_IO_WITH_URING=1 -DDIVSUFSORT_API= CXXFLAGS = -fPIC -time -fdiagnostics-color -mcx16 -fno-stack-protector WARNINGS = -Wno-class-memaccess -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -Wno-deprecated-declarations -Wstrict-aliasing=3 RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 LDFLAGS = -fPIC -rdynamic 2024/11/20-18:52:23.081218 140008156956224 [top_zip_table.cc:60] fsa git_version_hash_info_is:commit 5dfecb7d107196f044ff5bf78dc39d2e725b9d9b Author: leipeng Date: Thu Nov 7 15:22:45 2024 +0800 Makefile: fix for x86_64 CPU older than haswell GIT_PATH_ARG = src/terark/fsa tools/fsa g++ (GCC) 12.2.1 20221121 (Red Hat 12.2.1-7) Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/zstd -Iboost-include DEFS = -DTOPLING_IO_WITH_URING=1 -DDIVSUFSORT_API= CXXFLAGS = -fPIC -time -fdiagnostics-color -mcx16 -fno-stack-protector WARNINGS = -Wno-class-memaccess -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -Wno-deprecated-declarations -Wstrict-aliasing=3 RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 LDFLAGS = -fPIC -rdynamic 2024/11/20-18:52:23.081237 140008156956224 [top_zip_table.cc:61] zbs git_version_hash_info_is:commit d44dd5ff72707128fe3c916077b43d2093c01f7c Author: leipeng Date: Sun Oct 27 23:38:26 2024 +0800 Fix for msvc, when toplingdb on msvc GIT_PATH_ARG = src/terark/zbs tools/zbs g++ (GCC) 12.2.1 20221121 (Red Hat 12.2.1-7) Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/zstd -Iboost-include DEFS = -DTOPLING_IO_WITH_URING=1 -DDIVSUFSORT_API= CXXFLAGS = -fPIC -time -fdiagnostics-color -mcx16 -fno-stack-protector WARNINGS = -Wno-class-memaccess -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -Wno-deprecated-declarations -Wstrict-aliasing=3 RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 LDFLAGS = -fPIC -rdynamic 2024/11/20-18:52:23.081245 140008156956224 [top_zip_table.cc:62] topling-zip_table_reader: git_version_hash_info_is: commit 79614a7e7dc27362fc5151b0797eb7d83c674c7b Author: rockeet Date: Sun Nov 10 15:02:21 2024 +0800 cpu_has_bmi2.sh: detect by compile c++ code check __BMI2__ g++ (GCC) 12.2.1 20221121 (Red Hat 12.2.1-7) Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/20-18:52:23.081255 140008156956224 [top_zip_table.cc:64] topling-rocks git_version_hash_info_is: commit c46b65a52d9c74aa8b87aeb8438620ff2dbc669c Author: rockeet Date: Sun Nov 10 15:02:42 2024 +0800 cpu_has_bmi2.sh: detect by compile c++ code check __BMI2__ g++ (GCC) 12.2.1 20221121 (Red Hat 12.2.1-7) Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/20-18:52:23.549853 140008156956224 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059487.sst) /dev/shm/ToplingTemp/Topling-856414-WYwgac 2024/11/20-18:52:23.784229 140008156956224 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059487.sst): first pass time = 0.23's, 572.754'MB/sec 2024/11/20-18:52:25.167396 140008156956224 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059487.sst): old prealloc_size = 147639500, real_size = 40646384 2024/11/20-18:52:25.167521 140008156956224 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059487.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129430 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.71 raw-val = 0.1316 GB zip-val = 0.0404 GB avg-val =1016.99 avg-zval = 312.08 2024/11/20-18:52:25.167636 140008156956224 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059487.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-18:52:25.342058 140008156956224 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059487.sst): second pass time = 1.38's, 95.216'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.17's, 241.638'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2154.125'MB/sec (index lex order gen) rebuild zvType time = 0.13's, 0.256'MB/sec write SST data time = 0.05's, 877.050'MB/sec dict compress time = 3467835928.77's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 20823.941'MB/sec zip my value time = 1.38's, unzip length = 0.132'GB zip my value throughput = 95.216'MB/sec zip pipeline throughput = 263.917'MB/sec entries = 129430 avg-key = 20.00 avg-zkey = 1.71 avg-val = 1016.99 avg-zval = 312.08 usrkeys = 129430 avg-key = 12.00 avg-zkey = 1.71 avg-val = 1020.34 avg-zval = 312.08 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 61988 bytes = 185984 } seq expand size = 433916 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0404 GB dict = 1.38 MB all = 0.0422 GB } UnZip/Zip{ index = 7.0200 value = 3.2587 dict = 1.00 all = 3.1805 } Zip/UnZip{ index = 0.1425 value = 0.3069 dict = 1.00 all = 0.3144 } ---------------------------- total value len = 0.132063 GB avg = 1.020 KB (by entry num) total key len = 0.002589 GB avg = 0.020 KB total ukey len = 0.001553 GB avg = 0.012 KB total ukey num = 0.000129430 Billion total entry num = 0.000129430 Billion write speed all = 0.003711102 MB/sec (with seq num) write speed all = 0.003682564 MB/sec (without seq num) 2024/11/20-18:52:25.420724 140008156956224 [compaction_job.cc:1948] [default] [JOB 6941] Generated table #59487: 129430 keys, 42200020 bytes, temperature: kWarm 2024/11/20-18:52:25.420817 140008156956224 EVENT_LOG_v1 {"time_micros": 1732099945420775, "cf_name": "default", "job": 6941, "event": "table_file_creation", "file_number": 59487, "file_size": 42200020, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 992718201, "table_properties": {"data_size": 40392608, "index_size": 221248, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588600, "raw_average_key_size": 20, "raw_value_size": 131629263, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129430, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732099943, "oldest_key_time": 0, "file_creation_time": 1732099943, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "6MZ3RU376XPAYLWHL32R", "orig_file_number": 59487, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-18:52:25.457262 140008156956224 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059488.sst) /dev/shm/ToplingTemp/Topling-856414-KtFhZc 2024/11/20-18:52:25.953308 140008156956224 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059488.sst): first pass time = 0.49's, 273.119'MB/sec 2024/11/20-18:52:26.614969 140008156956224 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059488.sst): old prealloc_size = 147639500, real_size = 40363232 2024/11/20-18:52:26.615104 140008156956224 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059488.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129429 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.71 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1017.00 avg-zval = 309.89 2024/11/20-18:52:26.615159 140008156956224 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059488.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-18:52:26.775081 140008156956224 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059488.sst): second pass time = 0.66's, 199.150'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 260.720'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1942.850'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.274'MB/sec write SST data time = 0.04's, 997.623'MB/sec dict compress time = -180443551.36's, -0.000'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 41529.254'MB/sec zip my value time = 0.66's, unzip length = 0.132'GB zip my value throughput = 199.150'MB/sec zip pipeline throughput = 247.620'MB/sec entries = 129429 avg-key = 20.00 avg-zkey = 1.71 avg-val = 1017.00 avg-zval = 309.89 usrkeys = 129429 avg-key = 12.00 avg-zkey = 1.71 avg-val = 1017.11 avg-zval = 309.89 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 1957 bytes = 5888 } seq expand size = 13699 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0179 value = 3.2818 dict = 1.00 all = 3.2158 } Zip/UnZip{ index = 0.1425 value = 0.3047 dict = 1.00 all = 0.3110 } ---------------------------- total value len = 0.263706 GB avg = 1.019 KB (by entry num) total key len = 0.005177 GB avg = 0.020 KB total ukey len = 0.003106 GB avg = 0.012 KB total ukey num = 0.000258859 Billion total entry num = 0.000258859 Billion write speed all = 0.007410331 MB/sec (with seq num) write speed all = 0.007353258 MB/sec (without seq num) 2024/11/20-18:52:26.824494 140008156956224 [compaction_job.cc:1948] [default] [JOB 6941] Generated table #59488: 129429 keys, 41736644 bytes, temperature: kWarm 2024/11/20-18:52:26.824563 140008156956224 EVENT_LOG_v1 {"time_micros": 1732099946824531, "cf_name": "default", "job": 6941, "event": "table_file_creation", "file_number": 59488, "file_size": 41736644, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 992714248, "table_properties": {"data_size": 40109392, "index_size": 221312, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588580, "raw_average_key_size": 20, "raw_value_size": 131629322, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129429, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732099945, "oldest_key_time": 0, "file_creation_time": 1732099945, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "6MZ3RU376XPAYLWHL32R", "orig_file_number": 59488, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-18:52:26.880699 140008156956224 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059489.sst) /dev/shm/ToplingTemp/Topling-856414-WEmUyd 2024/11/20-18:52:27.452363 140008156956224 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059489.sst): first pass time = 0.57's, 234.804'MB/sec 2024/11/20-18:52:28.297259 140008156956224 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059489.sst): old prealloc_size = 147639500, real_size = 40348768 2024/11/20-18:52:28.297427 140008156956224 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059489.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129432 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1016.98 avg-zval = 309.80 2024/11/20-18:52:28.297510 140008156956224 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059489.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-18:52:28.647143 140008156956224 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059489.sst): second pass time = 0.84's, 155.965'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.35's, 119.229'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1761.095'MB/sec (index lex order gen) rebuild zvType time = 0.29's, 0.113'MB/sec write SST data time = 0.06's, 651.619'MB/sec dict compress time = 0.00's, 1318594.258'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 18591.797'MB/sec zip my value time = 0.84's, unzip length = 0.132'GB zip my value throughput = 155.965'MB/sec zip pipeline throughput = 279.410'MB/sec entries = 129432 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1016.98 avg-zval = 309.80 usrkeys = 129432 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1016.98 avg-zval = 309.80 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 12 bytes = 48 } seq expand size = 84 multi value expand size = 0 cnt WriteAppend = 11 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0981 value = 3.2827 dict = 1.00 all = 3.2174 } Zip/UnZip{ index = 0.1409 value = 0.3046 dict = 1.00 all = 0.3108 } ---------------------------- total value len = 0.395336 GB avg = 1.018 KB (by entry num) total key len = 0.007766 GB avg = 0.020 KB total ukey len = 0.004659 GB avg = 0.012 KB total ukey num = 0.000388291 Billion total entry num = 0.000388291 Billion write speed all = 0.011108760 MB/sec (with seq num) write speed all = 0.011023155 MB/sec (without seq num) 2024/11/20-18:52:28.711030 140008156956224 [compaction_job.cc:1948] [default] [JOB 6941] Generated table #59489: 129432 keys, 41716426 bytes, temperature: kWarm 2024/11/20-18:52:28.711129 140008156956224 EVENT_LOG_v1 {"time_micros": 1732099948711083, "cf_name": "default", "job": 6941, "event": "table_file_creation", "file_number": 59489, "file_size": 41716426, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 992473024, "table_properties": {"data_size": 40097424, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588640, "raw_average_key_size": 20, "raw_value_size": 131629349, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129432, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732099946, "oldest_key_time": 0, "file_creation_time": 1732099946, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "6MZ3RU376XPAYLWHL32R", "orig_file_number": 59489, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-18:52:28.759702 140008156956224 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059490.sst) /dev/shm/ToplingTemp/Topling-856414-IUkivc 2024/11/20-18:52:29.255812 140008156956224 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059490.sst): first pass time = 0.50's, 270.567'MB/sec 2024/11/20-18:52:30.003150 140008156956224 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059490.sst): old prealloc_size = 147639500, real_size = 40353904 2024/11/20-18:52:30.003276 140008156956224 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059490.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129429 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1017.00 avg-zval = 309.84 2024/11/20-18:52:30.003325 140008156956224 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059490.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-18:52:30.166521 140008156956224 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059490.sst): second pass time = 0.75's, 176.293'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 255.410'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2044.111'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.275'MB/sec write SST data time = 0.05's, 913.276'MB/sec dict compress time = 0.00's, 1318556.938'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 17952.055'MB/sec zip my value time = 0.75's, unzip length = 0.132'GB zip my value throughput = 176.293'MB/sec zip pipeline throughput = 352.586'MB/sec entries = 129429 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1017.00 avg-zval = 309.84 usrkeys = 129429 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1017.00 avg-zval = 309.84 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 14 bytes = 48 } seq expand size = 98 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0980 value = 3.2823 dict = 1.00 all = 3.2170 } Zip/UnZip{ index = 0.1409 value = 0.3047 dict = 1.00 all = 0.3108 } ---------------------------- total value len = 0.526965 GB avg = 1.018 KB (by entry num) total key len = 0.010354 GB avg = 0.020 KB total ukey len = 0.006213 GB avg = 0.012 KB total ukey num = 0.000517720 Billion total entry num = 0.000517720 Billion write speed all = 0.014806954 MB/sec (with seq num) write speed all = 0.014692819 MB/sec (without seq num) 2024/11/20-18:52:30.217061 140008156956224 [compaction_job.cc:1948] [default] [JOB 6941] Generated table #59490: 129429 keys, 41721571 bytes, temperature: kWarm 2024/11/20-18:52:30.217123 140008156956224 EVENT_LOG_v1 {"time_micros": 1732099950217091, "cf_name": "default", "job": 6941, "event": "table_file_creation", "file_number": 59490, "file_size": 41721571, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 992717308, "table_properties": {"data_size": 40102560, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588580, "raw_average_key_size": 20, "raw_value_size": 131629456, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129429, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732099948, "oldest_key_time": 0, "file_creation_time": 1732099948, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "6MZ3RU376XPAYLWHL32R", "orig_file_number": 59490, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-18:52:30.257381 140008156956224 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059491.sst) /dev/shm/ToplingTemp/Topling-856414-OGheEb 2024/11/20-18:52:30.763944 140008156956224 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059491.sst): first pass time = 0.51's, 264.982'MB/sec 2024/11/20-18:52:31.465643 140008156956224 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059491.sst): old prealloc_size = 147639500, real_size = 40354272 2024/11/20-18:52:31.465795 140008156956224 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059491.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129429 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1017.00 avg-zval = 309.84 2024/11/20-18:52:31.465859 140008156956224 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059491.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-18:52:31.762240 140008156956224 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059491.sst): second pass time = 0.70's, 187.835'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.30's, 140.684'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1888.624'MB/sec (index lex order gen) rebuild zvType time = 0.21's, 0.152'MB/sec write SST data time = 0.08's, 502.507'MB/sec dict compress time = 0.00's, 1318403.828'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 38991.679'MB/sec zip my value time = 0.70's, unzip length = 0.132'GB zip my value throughput = 187.835'MB/sec zip pipeline throughput = 283.346'MB/sec entries = 129429 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1017.00 avg-zval = 309.84 usrkeys = 129429 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1017.00 avg-zval = 309.84 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 16 bytes = 64 } seq expand size = 112 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0980 value = 3.2823 dict = 1.00 all = 3.2170 } Zip/UnZip{ index = 0.1409 value = 0.3047 dict = 1.00 all = 0.3109 } ---------------------------- total value len = 0.658595 GB avg = 1.018 KB (by entry num) total key len = 0.012943 GB avg = 0.020 KB total ukey len = 0.007766 GB avg = 0.012 KB total ukey num = 0.000647149 Billion total entry num = 0.000647149 Billion write speed all = 0.018504802 MB/sec (with seq num) write speed all = 0.018362140 MB/sec (without seq num) 2024/11/20-18:52:31.815278 140008156956224 [compaction_job.cc:1948] [default] [JOB 6941] Generated table #59491: 129429 keys, 41721731 bytes, temperature: kWarm 2024/11/20-18:52:31.815369 140008156956224 EVENT_LOG_v1 {"time_micros": 1732099951815323, "cf_name": "default", "job": 6941, "event": "table_file_creation", "file_number": 59491, "file_size": 41721731, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 992421775, "table_properties": {"data_size": 40102928, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588580, "raw_average_key_size": 20, "raw_value_size": 131629560, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129429, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732099950, "oldest_key_time": 0, "file_creation_time": 1732099950, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "6MZ3RU376XPAYLWHL32R", "orig_file_number": 59491, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-18:52:31.883935 140008156956224 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059492.sst) /dev/shm/ToplingTemp/Topling-856414-twGjxd 2024/11/20-18:52:32.417898 140008156956224 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059492.sst): first pass time = 0.53's, 251.393'MB/sec 2024/11/20-18:52:32.983168 140008156956224 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059492.sst): old prealloc_size = 147639500, real_size = 40358272 2024/11/20-18:52:32.983295 140008156956224 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059492.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129429 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1017.01 avg-zval = 309.88 2024/11/20-18:52:32.983349 140008156956224 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059492.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-18:52:33.143360 140008156956224 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059492.sst): second pass time = 0.56's, 233.201'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 260.500'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2073.240'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.272'MB/sec write SST data time = 0.04's, 1017.427'MB/sec dict compress time = 0.00's, 1318292.823'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 45500.413'MB/sec zip my value time = 0.56's, unzip length = 0.132'GB zip my value throughput = 233.201'MB/sec zip pipeline throughput = 233.201'MB/sec entries = 129429 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1017.01 avg-zval = 309.88 usrkeys = 129429 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1017.01 avg-zval = 309.88 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 17 bytes = 64 } seq expand size = 119 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0980 value = 3.2820 dict = 1.00 all = 3.2167 } Zip/UnZip{ index = 0.1409 value = 0.3047 dict = 1.00 all = 0.3109 } ---------------------------- total value len = 0.790225 GB avg = 1.018 KB (by entry num) total key len = 0.015532 GB avg = 0.020 KB total ukey len = 0.009319 GB avg = 0.012 KB total ukey num = 0.000776578 Billion total entry num = 0.000776578 Billion write speed all = 0.022202472 MB/sec (with seq num) write speed all = 0.022031284 MB/sec (without seq num) 2024/11/20-18:52:33.193935 140008156956224 [compaction_job.cc:1948] [default] [JOB 6941] Generated table #59492: 129429 keys, 41725647 bytes, temperature: kWarm 2024/11/20-18:52:33.193999 140008156956224 EVENT_LOG_v1 {"time_micros": 1732099953193969, "cf_name": "default", "job": 6941, "event": "table_file_creation", "file_number": 59492, "file_size": 41725647, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 992504680, "table_properties": {"data_size": 40106928, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588580, "raw_average_key_size": 20, "raw_value_size": 131630129, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129429, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732099951, "oldest_key_time": 0, "file_creation_time": 1732099951, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "6MZ3RU376XPAYLWHL32R", "orig_file_number": 59492, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-18:52:33.236637 140008156956224 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059493.sst) /dev/shm/ToplingTemp/Topling-856414-3sk3af 2024/11/20-18:52:33.773158 140008156956224 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059493.sst): first pass time = 0.54's, 250.181'MB/sec 2024/11/20-18:52:34.311361 140008156956224 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059493.sst): old prealloc_size = 147639500, real_size = 40354752 2024/11/20-18:52:34.311484 140008156956224 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059493.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129429 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1017.00 avg-zval = 309.85 2024/11/20-18:52:34.311538 140008156956224 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059493.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-18:52:34.471187 140008156956224 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059493.sst): second pass time = 0.54's, 244.947'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 261.077'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2306.483'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.281'MB/sec write SST data time = 0.04's, 933.347'MB/sec dict compress time = 0.00's, 1318901.435'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 26001.811'MB/sec zip my value time = 0.54's, unzip length = 0.132'GB zip my value throughput = 244.947'MB/sec zip pipeline throughput = 244.947'MB/sec entries = 129429 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1017.00 avg-zval = 309.85 usrkeys = 129429 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1017.01 avg-zval = 309.85 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 13 bytes = 48 } seq expand size = 91 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0980 value = 3.2823 dict = 1.00 all = 3.2169 } Zip/UnZip{ index = 0.1409 value = 0.3047 dict = 1.00 all = 0.3109 } ---------------------------- total value len = 0.921855 GB avg = 1.017 KB (by entry num) total key len = 0.018120 GB avg = 0.020 KB total ukey len = 0.010872 GB avg = 0.012 KB total ukey num = 0.000906007 Billion total entry num = 0.000906007 Billion write speed all = 0.025899892 MB/sec (with seq num) write speed all = 0.025700181 MB/sec (without seq num) 2024/11/20-18:52:34.524600 140008156956224 [compaction_job.cc:1948] [default] [JOB 6941] Generated table #59493: 129429 keys, 41722763 bytes, temperature: kWarm 2024/11/20-18:52:34.524670 140008156956224 EVENT_LOG_v1 {"time_micros": 1732099954524638, "cf_name": "default", "job": 6941, "event": "table_file_creation", "file_number": 59493, "file_size": 41722763, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 992614040, "table_properties": {"data_size": 40103408, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588580, "raw_average_key_size": 20, "raw_value_size": 131629928, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129429, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732099953, "oldest_key_time": 0, "file_creation_time": 1732099953, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "6MZ3RU376XPAYLWHL32R", "orig_file_number": 59493, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-18:52:34.562286 140008156956224 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059494.sst) /dev/shm/ToplingTemp/Topling-856414-wkWqHc 2024/11/20-18:52:35.463240 140008156956224 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059494.sst): first pass time = 0.90's, 148.982'MB/sec 2024/11/20-18:52:36.039373 140008156956224 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059494.sst): old prealloc_size = 147639500, real_size = 40351632 2024/11/20-18:52:36.039659 140008156956224 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059494.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129428 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1017.01 avg-zval = 309.83 2024/11/20-18:52:36.039761 140008156956224 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059494.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-18:52:36.202728 140008156956224 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059494.sst): second pass time = 0.58's, 228.784'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 255.425'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 853.323'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.272'MB/sec write SST data time = 0.04's, 947.726'MB/sec dict compress time = 0.00's, 1318922.488'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 40070.764'MB/sec zip my value time = 0.58's, unzip length = 0.132'GB zip my value throughput = 228.784'MB/sec zip pipeline throughput = 228.784'MB/sec entries = 129428 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1017.01 avg-zval = 309.83 usrkeys = 129428 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1017.01 avg-zval = 309.83 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 13 bytes = 48 } seq expand size = 91 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0979 value = 3.2825 dict = 1.00 all = 3.2171 } Zip/UnZip{ index = 0.1409 value = 0.3046 dict = 1.00 all = 0.3108 } ---------------------------- total value len = 1.053485 GB avg = 1.017 KB (by entry num) total key len = 0.020709 GB avg = 0.020 KB total ukey len = 0.012425 GB avg = 0.012 KB total ukey num = 0.001035435 Billion total entry num = 0.001035435 Billion write speed all = 0.029596696 MB/sec (with seq num) write speed all = 0.029368466 MB/sec (without seq num) 2024/11/20-18:52:36.258308 140008156956224 [compaction_job.cc:1948] [default] [JOB 6941] Generated table #59494: 129428 keys, 41719649 bytes, temperature: kWarm 2024/11/20-18:52:36.258398 140008156956224 EVENT_LOG_v1 {"time_micros": 1732099956258352, "cf_name": "default", "job": 6941, "event": "table_file_creation", "file_number": 59494, "file_size": 41719649, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 992624530, "table_properties": {"data_size": 40100288, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588560, "raw_average_key_size": 20, "raw_value_size": 131629361, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129428, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732099954, "oldest_key_time": 0, "file_creation_time": 1732099954, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "6MZ3RU376XPAYLWHL32R", "orig_file_number": 59494, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-18:52:36.321569 140008156956224 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059495.sst) /dev/shm/ToplingTemp/Topling-856414-RAuKJe 2024/11/20-18:52:36.863669 140008156956224 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059495.sst): first pass time = 0.54's, 247.616'MB/sec 2024/11/20-18:52:37.579148 140008156956224 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059495.sst): old prealloc_size = 147639500, real_size = 40353232 2024/11/20-18:52:37.579323 140008156956224 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059495.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129428 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1017.01 avg-zval = 309.84 2024/11/20-18:52:37.579400 140008156956224 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059495.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-18:52:37.760178 140008156956224 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059495.sst): second pass time = 0.71's, 184.228'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.18's, 230.483'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1472.190'MB/sec (index lex order gen) rebuild zvType time = 0.14's, 0.235'MB/sec write SST data time = 0.04's, 962.363'MB/sec dict compress time = 0.00's, 1318877.512'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 23220.848'MB/sec zip my value time = 0.71's, unzip length = 0.132'GB zip my value throughput = 184.228'MB/sec zip pipeline throughput = 208.977'MB/sec entries = 129428 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1017.01 avg-zval = 309.84 usrkeys = 129428 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1017.01 avg-zval = 309.84 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 14 bytes = 48 } seq expand size = 98 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0979 value = 3.2824 dict = 1.00 all = 3.2170 } Zip/UnZip{ index = 0.1409 value = 0.3047 dict = 1.00 all = 0.3108 } ---------------------------- total value len = 1.185114 GB avg = 1.017 KB (by entry num) total key len = 0.023297 GB avg = 0.020 KB total ukey len = 0.013978 GB avg = 0.012 KB total ukey num = 0.001164863 Billion total entry num = 0.001164863 Billion write speed all = 0.033293313 MB/sec (with seq num) write speed all = 0.033036565 MB/sec (without seq num) 2024/11/20-18:52:37.815154 140008156956224 [compaction_job.cc:1948] [default] [JOB 6941] Generated table #59495: 129428 keys, 41721202 bytes, temperature: kWarm 2024/11/20-18:52:37.815234 140008156956224 EVENT_LOG_v1 {"time_micros": 1732099957815193, "cf_name": "default", "job": 6941, "event": "table_file_creation", "file_number": 59495, "file_size": 41721202, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 992718202, "table_properties": {"data_size": 40101888, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588560, "raw_average_key_size": 20, "raw_value_size": 131629526, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129428, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732099956, "oldest_key_time": 0, "file_creation_time": 1732099956, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "6MZ3RU376XPAYLWHL32R", "orig_file_number": 59495, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-18:52:37.859169 140008156956224 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059496.sst) /dev/shm/ToplingTemp/Topling-856414-gT519e 2024/11/20-18:52:38.670470 140008156956224 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059496.sst): first pass time = 0.81's, 165.450'MB/sec 2024/11/20-18:52:39.229549 140008156956224 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059496.sst): old prealloc_size = 147639500, real_size = 40356144 2024/11/20-18:52:39.229730 140008156956224 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059496.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129428 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1017.01 avg-zval = 309.86 2024/11/20-18:52:39.229822 140008156956224 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059496.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-18:52:39.394822 140008156956224 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059496.sst): second pass time = 0.56's, 235.841'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.17's, 252.451'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1387.731'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.261'MB/sec write SST data time = 0.04's, 1009.506'MB/sec dict compress time = 0.00's, 1318193.301'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 46217.480'MB/sec zip my value time = 0.56's, unzip length = 0.132'GB zip my value throughput = 235.841'MB/sec zip pipeline throughput = 248.110'MB/sec entries = 129428 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1017.01 avg-zval = 309.86 usrkeys = 129428 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1017.02 avg-zval = 309.86 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 21 bytes = 64 } seq expand size = 147 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0979 value = 3.2822 dict = 1.00 all = 3.2169 } Zip/UnZip{ index = 0.1409 value = 0.3047 dict = 1.00 all = 0.3109 } ---------------------------- total value len = 1.316744 GB avg = 1.017 KB (by entry num) total key len = 0.025886 GB avg = 0.020 KB total ukey len = 0.015531 GB avg = 0.012 KB total ukey num = 0.001294291 Billion total entry num = 0.001294291 Billion write speed all = 0.036989550 MB/sec (with seq num) write speed all = 0.036704287 MB/sec (without seq num) 2024/11/20-18:52:39.446176 140008156956224 [compaction_job.cc:1948] [default] [JOB 6941] Generated table #59496: 129428 keys, 41723431 bytes, temperature: kWarm 2024/11/20-18:52:39.446243 140008156956224 EVENT_LOG_v1 {"time_micros": 1732099959446212, "cf_name": "default", "job": 6941, "event": "table_file_creation", "file_number": 59496, "file_size": 41723431, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 992634211, "table_properties": {"data_size": 40104800, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588560, "raw_average_key_size": 20, "raw_value_size": 131630099, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129428, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732099957, "oldest_key_time": 0, "file_creation_time": 1732099957, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "6MZ3RU376XPAYLWHL32R", "orig_file_number": 59496, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-18:52:39.482792 140008156956224 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059497.sst) /dev/shm/ToplingTemp/Topling-856414-pF3pKd 2024/11/20-18:52:39.979754 140008156956224 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059497.sst): first pass time = 0.50's, 270.096'MB/sec 2024/11/20-18:52:40.562657 140008156956224 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059497.sst): old prealloc_size = 147639500, real_size = 40353280 2024/11/20-18:52:40.562764 140008156956224 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059497.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129429 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1017.00 avg-zval = 309.84 2024/11/20-18:52:40.562809 140008156956224 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059497.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-18:52:40.724654 140008156956224 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059497.sst): second pass time = 0.58's, 226.043'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 257.562'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2481.020'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.267'MB/sec write SST data time = 0.04's, 1029.136'MB/sec dict compress time = 0.00's, 1318608.612'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 46689.459'MB/sec zip my value time = 0.58's, unzip length = 0.132'GB zip my value throughput = 226.043'MB/sec zip pipeline throughput = 226.043'MB/sec entries = 129429 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1017.00 avg-zval = 309.84 usrkeys = 129429 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1017.00 avg-zval = 309.84 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 11 bytes = 48 } seq expand size = 77 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0980 value = 3.2824 dict = 1.00 all = 3.2170 } Zip/UnZip{ index = 0.1409 value = 0.3047 dict = 1.00 all = 0.3108 } ---------------------------- total value len = 1.448374 GB avg = 1.017 KB (by entry num) total key len = 0.028474 GB avg = 0.020 KB total ukey len = 0.017085 GB avg = 0.012 KB total ukey num = 0.001423720 Billion total entry num = 0.001423720 Billion write speed all = 0.040685776 MB/sec (with seq num) write speed all = 0.040371999 MB/sec (without seq num) 2024/11/20-18:52:40.773550 140008156956224 [compaction_job.cc:1948] [default] [JOB 6941] Generated table #59497: 129429 keys, 41720985 bytes, temperature: kWarm 2024/11/20-18:52:40.773607 140008156956224 EVENT_LOG_v1 {"time_micros": 1732099960773577, "cf_name": "default", "job": 6941, "event": "table_file_creation", "file_number": 59497, "file_size": 41720985, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 992679898, "table_properties": {"data_size": 40101936, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588580, "raw_average_key_size": 20, "raw_value_size": 131629438, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129429, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732099959, "oldest_key_time": 0, "file_creation_time": 1732099959, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "6MZ3RU376XPAYLWHL32R", "orig_file_number": 59497, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-18:52:40.818477 140008156956224 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059498.sst) /dev/shm/ToplingTemp/Topling-856414-GopL0d 2024/11/20-18:52:41.477528 140008156956224 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059498.sst): first pass time = 0.66's, 203.671'MB/sec 2024/11/20-18:52:42.297730 140008156956224 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059498.sst): old prealloc_size = 147639500, real_size = 40353296 2024/11/20-18:52:42.297860 140008156956224 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059498.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129429 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1017.00 avg-zval = 309.84 2024/11/20-18:52:42.297918 140008156956224 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059498.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-18:52:42.464915 140008156956224 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059498.sst): second pass time = 0.82's, 160.676'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.17's, 249.578'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2164.117'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.267'MB/sec write SST data time = 0.05's, 913.606'MB/sec dict compress time = 0.00's, 1318585.646'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 28331.901'MB/sec zip my value time = 0.82's, unzip length = 0.132'GB zip my value throughput = 160.676'MB/sec zip pipeline throughput = 252.163'MB/sec entries = 129429 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1017.00 avg-zval = 309.84 usrkeys = 129429 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1017.01 avg-zval = 309.84 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 16 bytes = 64 } seq expand size = 112 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0980 value = 3.2824 dict = 1.00 all = 3.2171 } Zip/UnZip{ index = 0.1409 value = 0.3047 dict = 1.00 all = 0.3108 } ---------------------------- total value len = 1.580004 GB avg = 1.017 KB (by entry num) total key len = 0.031063 GB avg = 0.020 KB total ukey len = 0.018638 GB avg = 0.012 KB total ukey num = 0.001553149 Billion total entry num = 0.001553149 Billion write speed all = 0.044381243 MB/sec (with seq num) write speed all = 0.044038957 MB/sec (without seq num) 2024/11/20-18:52:42.561951 140008156956224 [compaction_job.cc:1948] [default] [JOB 6941] Generated table #59498: 129429 keys, 41720961 bytes, temperature: kWarm 2024/11/20-18:52:42.562022 140008156956224 EVENT_LOG_v1 {"time_micros": 1732099962561989, "cf_name": "default", "job": 6941, "event": "table_file_creation", "file_number": 59498, "file_size": 41720961, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 992640610, "table_properties": {"data_size": 40101952, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588580, "raw_average_key_size": 20, "raw_value_size": 131629875, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129429, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732099960, "oldest_key_time": 0, "file_creation_time": 1732099960, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "6MZ3RU376XPAYLWHL32R", "orig_file_number": 59498, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-18:52:42.600343 140008156956224 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059499.sst) /dev/shm/ToplingTemp/Topling-856414-SzL6ve 2024/11/20-18:52:43.124516 140008156956224 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059499.sst): first pass time = 0.52's, 256.078'MB/sec 2024/11/20-18:52:43.630711 140008156956224 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059499.sst): old prealloc_size = 147639500, real_size = 40351520 2024/11/20-18:52:43.630833 140008156956224 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059499.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129430 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1017.00 avg-zval = 309.82 2024/11/20-18:52:43.630890 140008156956224 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059499.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-18:52:43.794377 140008156956224 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059499.sst): second pass time = 0.51's, 260.433'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 254.931'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2232.042'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.273'MB/sec write SST data time = 0.04's, 927.801'MB/sec dict compress time = 0.00's, 1318372.249'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 43970.988'MB/sec zip my value time = 0.51's, unzip length = 0.132'GB zip my value throughput = 260.433'MB/sec zip pipeline throughput = 260.433'MB/sec entries = 129430 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1017.00 avg-zval = 309.82 usrkeys = 129430 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1017.00 avg-zval = 309.82 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 18 bytes = 64 } seq expand size = 126 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0980 value = 3.2825 dict = 1.00 all = 3.2172 } Zip/UnZip{ index = 0.1409 value = 0.3046 dict = 1.00 all = 0.3108 } ---------------------------- total value len = 1.711634 GB avg = 1.017 KB (by entry num) total key len = 0.033652 GB avg = 0.020 KB total ukey len = 0.020191 GB avg = 0.012 KB total ukey num = 0.001682579 Billion total entry num = 0.001682579 Billion write speed all = 0.048076898 MB/sec (with seq num) write speed all = 0.047706101 MB/sec (without seq num) 2024/11/20-18:52:43.845672 140008156956224 [compaction_job.cc:1948] [default] [JOB 6941] Generated table #59499: 129430 keys, 41718946 bytes, temperature: kWarm 2024/11/20-18:52:43.845744 140008156956224 EVENT_LOG_v1 {"time_micros": 1732099963845711, "cf_name": "default", "job": 6941, "event": "table_file_creation", "file_number": 59499, "file_size": 41718946, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 992611101, "table_properties": {"data_size": 40100176, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588600, "raw_average_key_size": 20, "raw_value_size": 131629753, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129430, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732099962, "oldest_key_time": 0, "file_creation_time": 1732099962, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "6MZ3RU376XPAYLWHL32R", "orig_file_number": 59499, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-18:52:43.883294 140008156956224 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059500.sst) /dev/shm/ToplingTemp/Topling-856414-vsYk6b 2024/11/20-18:52:44.495567 140008156956224 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059500.sst): first pass time = 0.61's, 219.228'MB/sec 2024/11/20-18:52:45.370149 140008156956224 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059500.sst): old prealloc_size = 147639500, real_size = 40350544 2024/11/20-18:52:45.370288 140008156956224 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059500.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129431 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1016.98 avg-zval = 309.81 2024/11/20-18:52:45.370351 140008156956224 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059500.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-18:52:45.532091 140008156956224 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059500.sst): second pass time = 0.87's, 150.622'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 257.657'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1905.001'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.273'MB/sec write SST data time = 0.04's, 967.671'MB/sec dict compress time = 0.00's, 1318582.775'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 36115.613'MB/sec zip my value time = 0.87's, unzip length = 0.132'GB zip my value throughput = 150.622'MB/sec zip pipeline throughput = 245.053'MB/sec entries = 129431 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1016.98 avg-zval = 309.81 usrkeys = 129431 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1016.98 avg-zval = 309.81 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 11 bytes = 48 } seq expand size = 77 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0981 value = 3.2826 dict = 1.00 all = 3.2172 } Zip/UnZip{ index = 0.1409 value = 0.3046 dict = 1.00 all = 0.3108 } ---------------------------- total value len = 1.843263 GB avg = 1.017 KB (by entry num) total key len = 0.036240 GB avg = 0.020 KB total ukey len = 0.021744 GB avg = 0.012 KB total ukey num = 0.001812010 Billion total entry num = 0.001812010 Billion write speed all = 0.051771683 MB/sec (with seq num) write speed all = 0.051372382 MB/sec (without seq num) 2024/11/20-18:52:45.632033 140008156956224 [compaction_job.cc:1948] [default] [JOB 6941] Generated table #59500: 129431 keys, 41718206 bytes, temperature: kWarm 2024/11/20-18:52:45.632113 140008156956224 EVENT_LOG_v1 {"time_micros": 1732099965632081, "cf_name": "default", "job": 6941, "event": "table_file_creation", "file_number": 59500, "file_size": 41718206, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 992668107, "table_properties": {"data_size": 40099200, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588620, "raw_average_key_size": 20, "raw_value_size": 131629193, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129431, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732099963, "oldest_key_time": 0, "file_creation_time": 1732099963, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "6MZ3RU376XPAYLWHL32R", "orig_file_number": 59500, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-18:52:45.666541 140008156956224 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059501.sst) /dev/shm/ToplingTemp/Topling-856414-1tAPSe 2024/11/20-18:52:46.197011 140008156956224 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059501.sst): first pass time = 0.53's, 253.037'MB/sec 2024/11/20-18:52:46.761654 140008156956224 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059501.sst): old prealloc_size = 147639500, real_size = 40353296 2024/11/20-18:52:46.761783 140008156956224 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059501.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129429 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1017.00 avg-zval = 309.84 2024/11/20-18:52:46.761837 140008156956224 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059501.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-18:52:46.919386 140008156956224 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059501.sst): second pass time = 0.56's, 233.465'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 264.534'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2130.197'MB/sec (index lex order gen) rebuild zvType time = 0.11's, 0.282'MB/sec write SST data time = 0.04's, 970.674'MB/sec dict compress time = 0.00's, 1318740.670'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 26097.604'MB/sec zip my value time = 0.56's, unzip length = 0.132'GB zip my value throughput = 233.465'MB/sec zip pipeline throughput = 233.465'MB/sec entries = 129429 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1017.00 avg-zval = 309.84 usrkeys = 129429 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1017.01 avg-zval = 309.84 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 16 bytes = 64 } seq expand size = 112 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0980 value = 3.2824 dict = 1.00 all = 3.2170 } Zip/UnZip{ index = 0.1409 value = 0.3047 dict = 1.00 all = 0.3108 } ---------------------------- total value len = 1.974893 GB avg = 1.017 KB (by entry num) total key len = 0.038829 GB avg = 0.020 KB total ukey len = 0.023297 GB avg = 0.012 KB total ukey num = 0.001941439 Billion total entry num = 0.001941439 Billion write speed all = 0.055466667 MB/sec (with seq num) write speed all = 0.055038862 MB/sec (without seq num) 2024/11/20-18:52:46.971239 140008156956224 [compaction_job.cc:1948] [default] [JOB 6941] Generated table #59501: 129429 keys, 41721123 bytes, temperature: kWarm 2024/11/20-18:52:46.971304 140008156956224 EVENT_LOG_v1 {"time_micros": 1732099966971273, "cf_name": "default", "job": 6941, "event": "table_file_creation", "file_number": 59501, "file_size": 41721123, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 992502725, "table_properties": {"data_size": 40101952, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588580, "raw_average_key_size": 20, "raw_value_size": 131629847, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129429, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732099965, "oldest_key_time": 0, "file_creation_time": 1732099965, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "6MZ3RU376XPAYLWHL32R", "orig_file_number": 59501, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-18:52:47.006868 140008156956224 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059502.sst) /dev/shm/ToplingTemp/Topling-856414-xO1bSe 2024/11/20-18:52:47.743674 140008156956224 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059502.sst): first pass time = 0.74's, 182.173'MB/sec 2024/11/20-18:52:48.445663 140008156956224 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059502.sst): old prealloc_size = 147639500, real_size = 40353056 2024/11/20-18:52:48.445788 140008156956224 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059502.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129427 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1017.02 avg-zval = 309.84 2024/11/20-18:52:48.445843 140008156956224 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059502.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-18:52:48.608007 140008156956224 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059502.sst): second pass time = 0.70's, 187.748'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 257.023'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2335.457'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.268'MB/sec write SST data time = 0.04's, 1009.850'MB/sec dict compress time = 0.00's, 1319155.024'MB/sec z-dict build time = 0.00's, sample length = 1.379'MB, throughput = 37774.834'MB/sec zip my value time = 0.70's, unzip length = 0.132'GB zip my value throughput = 187.748'MB/sec zip pipeline throughput = 187.748'MB/sec entries = 129427 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1017.02 avg-zval = 309.84 usrkeys = 129427 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1017.02 avg-zval = 309.84 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 15 bytes = 48 } seq expand size = 105 multi value expand size = 0 cnt WriteAppend = 11 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0979 value = 3.2824 dict = 1.00 all = 3.2170 } Zip/UnZip{ index = 0.1409 value = 0.3047 dict = 1.00 all = 0.3108 } ---------------------------- total value len = 2.106523 GB avg = 1.017 KB (by entry num) total key len = 0.041417 GB avg = 0.020 KB total ukey len = 0.024850 GB avg = 0.012 KB total ukey num = 0.002070866 Billion total entry num = 0.002070866 Billion write speed all = 0.059160863 MB/sec (with seq num) write speed all = 0.058704559 MB/sec (without seq num) 2024/11/20-18:52:48.657145 140008156956224 [compaction_job.cc:1948] [default] [JOB 6941] Generated table #59502: 129427 keys, 41721300 bytes, temperature: kWarm 2024/11/20-18:52:48.657207 140008156956224 EVENT_LOG_v1 {"time_micros": 1732099968657172, "cf_name": "default", "job": 6941, "event": "table_file_creation", "file_number": 59502, "file_size": 41721300, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 992628128, "table_properties": {"data_size": 40101712, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588540, "raw_average_key_size": 20, "raw_value_size": 131629344, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129427, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732099966, "oldest_key_time": 0, "file_creation_time": 1732099966, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "6MZ3RU376XPAYLWHL32R", "orig_file_number": 59502, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-18:52:48.699552 140008156956224 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059503.sst) /dev/shm/ToplingTemp/Topling-856414-dJDZ5d 2024/11/20-18:52:49.280632 140008156956224 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059503.sst): first pass time = 0.58's, 230.994'MB/sec 2024/11/20-18:52:49.885694 140008156956224 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059503.sst): old prealloc_size = 147639500, real_size = 40351728 2024/11/20-18:52:49.885808 140008156956224 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059503.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129429 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1017.00 avg-zval = 309.83 2024/11/20-18:52:49.885857 140008156956224 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059503.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-18:52:50.043787 140008156956224 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059503.sst): second pass time = 0.60's, 217.755'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 263.926'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2335.806'MB/sec (index lex order gen) rebuild zvType time = 0.11's, 0.283'MB/sec write SST data time = 0.04's, 954.983'MB/sec dict compress time = 0.00's, 1318935.885'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 39197.111'MB/sec zip my value time = 0.60's, unzip length = 0.132'GB zip my value throughput = 217.755'MB/sec zip pipeline throughput = 217.755'MB/sec entries = 129429 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1017.00 avg-zval = 309.83 usrkeys = 129429 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1017.00 avg-zval = 309.83 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 13 bytes = 48 } seq expand size = 91 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0980 value = 3.2825 dict = 1.00 all = 3.2171 } Zip/UnZip{ index = 0.1409 value = 0.3046 dict = 1.00 all = 0.3108 } ---------------------------- total value len = 2.238152 GB avg = 1.017 KB (by entry num) total key len = 0.044006 GB avg = 0.020 KB total ukey len = 0.026404 GB avg = 0.012 KB total ukey num = 0.002200295 Billion total entry num = 0.002200295 Billion write speed all = 0.062855161 MB/sec (with seq num) write speed all = 0.062370357 MB/sec (without seq num) 2024/11/20-18:52:50.093286 140008156956224 [compaction_job.cc:1948] [default] [JOB 6941] Generated table #59503: 129429 keys, 41719791 bytes, temperature: kWarm 2024/11/20-18:52:50.093342 140008156956224 EVENT_LOG_v1 {"time_micros": 1732099970093312, "cf_name": "default", "job": 6941, "event": "table_file_creation", "file_number": 59503, "file_size": 41719791, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 992626014, "table_properties": {"data_size": 40100384, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588580, "raw_average_key_size": 20, "raw_value_size": 131629578, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129429, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732099968, "oldest_key_time": 0, "file_creation_time": 1732099968, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "6MZ3RU376XPAYLWHL32R", "orig_file_number": 59503, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-18:52:50.131673 140008156956224 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059504.sst) /dev/shm/ToplingTemp/Topling-856414-2IDvOa 2024/11/20-18:52:51.026625 140008156956224 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059504.sst): first pass time = 0.89's, 149.977'MB/sec 2024/11/20-18:52:51.602912 140008156956224 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059504.sst): old prealloc_size = 147639500, real_size = 40351920 2024/11/20-18:52:51.603026 140008156956224 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059504.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129432 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1016.98 avg-zval = 309.82 2024/11/20-18:52:51.603088 140008156956224 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059504.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-18:52:51.762142 140008156956224 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059504.sst): second pass time = 0.58's, 228.643'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 262.040'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2274.736'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.281'MB/sec write SST data time = 0.04's, 949.630'MB/sec dict compress time = 0.00's, 1318595.215'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 26789.774'MB/sec zip my value time = 0.58's, unzip length = 0.132'GB zip my value throughput = 228.643'MB/sec zip pipeline throughput = 228.643'MB/sec entries = 129432 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1016.98 avg-zval = 309.82 usrkeys = 129432 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1016.98 avg-zval = 309.82 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 15 bytes = 48 } seq expand size = 105 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0981 value = 3.2825 dict = 1.00 all = 3.2171 } Zip/UnZip{ index = 0.1409 value = 0.3046 dict = 1.00 all = 0.3108 } ---------------------------- total value len = 2.369782 GB avg = 1.017 KB (by entry num) total key len = 0.046595 GB avg = 0.020 KB total ukey len = 0.027957 GB avg = 0.012 KB total ukey num = 0.002329727 Billion total entry num = 0.002329727 Billion write speed all = 0.066548642 MB/sec (with seq num) write speed all = 0.066035344 MB/sec (without seq num) 2024/11/20-18:52:51.812647 140008156956224 [compaction_job.cc:1948] [default] [JOB 6941] Generated table #59504: 129432 keys, 41719627 bytes, temperature: kWarm 2024/11/20-18:52:51.812715 140008156956224 EVENT_LOG_v1 {"time_micros": 1732099971812684, "cf_name": "default", "job": 6941, "event": "table_file_creation", "file_number": 59504, "file_size": 41719627, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 992615494, "table_properties": {"data_size": 40100576, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588640, "raw_average_key_size": 20, "raw_value_size": 131629277, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129432, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732099970, "oldest_key_time": 0, "file_creation_time": 1732099970, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "6MZ3RU376XPAYLWHL32R", "orig_file_number": 59504, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-18:52:51.848688 140008156956224 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059505.sst) /dev/shm/ToplingTemp/Topling-856414-K3gVUb 2024/11/20-18:52:52.352100 140008156956224 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059505.sst): first pass time = 0.50's, 266.637'MB/sec 2024/11/20-18:52:52.980985 140008156956224 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059505.sst): old prealloc_size = 147639500, real_size = 40353136 2024/11/20-18:52:52.981147 140008156956224 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059505.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129428 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1017.01 avg-zval = 309.84 2024/11/20-18:52:52.981230 140008156956224 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059505.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-18:52:53.165231 140008156956224 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059505.sst): second pass time = 0.63's, 209.604'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.18's, 226.467'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1583.592'MB/sec (index lex order gen) rebuild zvType time = 0.14's, 0.229'MB/sec write SST data time = 0.04's, 968.774'MB/sec dict compress time = 0.00's, 1318763.636'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 35206.111'MB/sec zip my value time = 0.63's, unzip length = 0.132'GB zip my value throughput = 209.604'MB/sec zip pipeline throughput = 226.561'MB/sec entries = 129428 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1017.01 avg-zval = 309.84 usrkeys = 129428 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1017.01 avg-zval = 309.84 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 10 bytes = 32 } seq expand size = 70 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0979 value = 3.2824 dict = 1.00 all = 3.2171 } Zip/UnZip{ index = 0.1409 value = 0.3047 dict = 1.00 all = 0.3108 } ---------------------------- total value len = 2.501412 GB avg = 1.017 KB (by entry num) total key len = 0.049183 GB avg = 0.020 KB total ukey len = 0.029510 GB avg = 0.012 KB total ukey num = 0.002459155 Billion total entry num = 0.002459155 Billion write speed all = 0.070242403 MB/sec (with seq num) write speed all = 0.069700610 MB/sec (without seq num) 2024/11/20-18:52:53.218015 140008156956224 [compaction_job.cc:1948] [default] [JOB 6941] Generated table #59505: 129428 keys, 41721019 bytes, temperature: kWarm 2024/11/20-18:52:53.218107 140008156956224 EVENT_LOG_v1 {"time_micros": 1732099973218060, "cf_name": "default", "job": 6941, "event": "table_file_creation", "file_number": 59505, "file_size": 41721019, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 992695142, "table_properties": {"data_size": 40101792, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588560, "raw_average_key_size": 20, "raw_value_size": 131630119, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 129428, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732099971, "oldest_key_time": 0, "file_creation_time": 1732099971, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "6MZ3RU376XPAYLWHL32R", "orig_file_number": 59505, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-18:52:53.277490 140008156956224 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059506.sst) /dev/shm/ToplingTemp/Topling-856414-b5xuXd 2024/11/20-18:52:53.931997 140008156956224 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059506.sst): first pass time = 0.65's, 205.086'MB/sec 2024/11/20-18:52:54.476423 140008156956224 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059506.sst): old prealloc_size = 147639500, real_size = 40352912 2024/11/20-18:52:54.476547 140008156956224 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059506.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129431 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1016.99 avg-zval = 309.83 2024/11/20-18:52:54.476609 140008156956224 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059506.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-18:52:54.644219 140008156956224 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059506.sst): second pass time = 0.54's, 242.135'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.17's, 248.655'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2287.315'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.259'MB/sec write SST data time = 0.04's, 971.978'MB/sec dict compress time = 0.00's, 1318614.354'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 29005.241'MB/sec zip my value time = 0.54's, unzip length = 0.132'GB zip my value throughput = 242.135'MB/sec zip pipeline throughput = 242.135'MB/sec entries = 129431 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1016.99 avg-zval = 309.83 usrkeys = 129431 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1016.99 avg-zval = 309.83 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 14 bytes = 48 } seq expand size = 98 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0981 value = 3.2824 dict = 1.00 all = 3.2171 } Zip/UnZip{ index = 0.1409 value = 0.3047 dict = 1.00 all = 0.3108 } ---------------------------- total value len = 2.633042 GB avg = 1.017 KB (by entry num) total key len = 0.051772 GB avg = 0.020 KB total ukey len = 0.031063 GB avg = 0.012 KB total ukey num = 0.002588586 Billion total entry num = 0.002588586 Billion write speed all = 0.073935726 MB/sec (with seq num) write speed all = 0.073365440 MB/sec (without seq num) 2024/11/20-18:52:54.697022 140008156956224 [compaction_job.cc:1948] [default] [JOB 6941] Generated table #59506: 129431 keys, 41720607 bytes, temperature: kWarm 2024/11/20-18:52:54.697093 140008156956224 EVENT_LOG_v1 {"time_micros": 1732099974697063, "cf_name": "default", "job": 6941, "event": "table_file_creation", "file_number": 59506, "file_size": 41720607, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 992636967, "table_properties": {"data_size": 40101568, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588620, "raw_average_key_size": 20, "raw_value_size": 131630093, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129431, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732099973, "oldest_key_time": 0, "file_creation_time": 1732099973, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "6MZ3RU376XPAYLWHL32R", "orig_file_number": 59506, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-18:52:54.732090 140008156956224 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059507.sst) /dev/shm/ToplingTemp/Topling-856414-Xp6ORd 2024/11/20-18:52:55.285743 140008156956224 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059507.sst): first pass time = 0.55's, 242.439'MB/sec 2024/11/20-18:52:55.818574 140008156956224 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059507.sst): old prealloc_size = 147639500, real_size = 40353504 2024/11/20-18:52:55.818688 140008156956224 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059507.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 129431 prefix = 4 raw-key = 0.0010 GB zip-key = 0.0002 GB avg-key = 8.00 avg-zkey = 1.69 raw-val = 0.1316 GB zip-val = 0.0401 GB avg-val =1016.99 avg-zval = 309.83 2024/11/20-18:52:55.818734 140008156956224 [top_zip_table_builder.cc:1325] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059507.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/20-18:52:55.976480 140008156956224 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059507.sst): second pass time = 0.53's, 247.373'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.16's, 264.243'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2423.104'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.279'MB/sec write SST data time = 0.04's, 997.311'MB/sec dict compress time = 0.00's, 1318369.378'MB/sec z-dict build time = 0.00's, sample length = 1.378'MB, throughput = 41105.621'MB/sec zip my value time = 0.53's, unzip length = 0.132'GB zip my value throughput = 247.373'MB/sec zip pipeline throughput = 247.373'MB/sec entries = 129431 avg-key = 20.00 avg-zkey = 1.69 avg-val = 1016.99 avg-zval = 309.83 usrkeys = 129431 avg-key = 12.00 avg-zkey = 1.69 avg-val = 1016.99 avg-zval = 309.83 TagRS{ kinds = RS_Key0_TagN bytes = 20320 } TagArray{ size = 13 bytes = 48 } seq expand size = 91 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0016 GB value = 0.1316 GB dict = 1.38 MB all = 0.1342 GB } __ZipSize{ index = 0.0002 GB value = 0.0401 GB dict = 1.38 MB all = 0.0417 GB } UnZip/Zip{ index = 7.0981 value = 3.2824 dict = 1.00 all = 3.2171 } Zip/UnZip{ index = 0.1409 value = 0.3047 dict = 1.00 all = 0.3108 } ---------------------------- total value len = 2.764672 GB avg = 1.017 KB (by entry num) total key len = 0.054360 GB avg = 0.020 KB total ukey len = 0.032616 GB avg = 0.012 KB total ukey num = 0.002718017 Billion total entry num = 0.002718017 Billion write speed all = 0.077629059 MB/sec (with seq num) write speed all = 0.077030280 MB/sec (without seq num) 2024/11/20-18:52:56.025980 140008156956224 [compaction_job.cc:1948] [default] [JOB 6941] Generated table #59507: 129431 keys, 41720927 bytes, temperature: kWarm 2024/11/20-18:52:56.026054 140008156956224 EVENT_LOG_v1 {"time_micros": 1732099976026014, "cf_name": "default", "job": 6941, "event": "table_file_creation", "file_number": 59507, "file_size": 41720927, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 992565308, "table_properties": {"data_size": 40102160, "index_size": 218816, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2588620, "raw_average_key_size": 20, "raw_value_size": 131629984, "raw_average_value_size": 1016, "num_data_blocks": 1, "num_entries": 129431, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732099974, "oldest_key_time": 0, "file_creation_time": 1732099974, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "6MZ3RU376XPAYLWHL32R", "orig_file_number": 59507, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-18:52:56.060595 140008156956224 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059508.sst) /dev/shm/ToplingTemp/Topling-856414-wPRpRe 2024/11/20-18:52:56.156223 140008156956224 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059508.sst): first pass time = 0.10's, 206.915'MB/sec 2024/11/20-18:52:56.379705 140008156956224 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059508.sst): old prealloc_size = 147639500, real_size = 6024600 2024/11/20-18:52:56.379766 140008156956224 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059508.sst): index type = UintIndex_AllOne , store type = DictZipBlobStore usrkeys = 19074 prefix = 4 raw-key = 0.0002 GB zip-key = 0.0000 GB avg-key = 8.00 avg-zkey = 0.01 raw-val = 0.0194 GB zip-val = 0.0060 GB avg-val =1017.01 avg-zval = 315.59 2024/11/20-18:52:56.405187 140008156956224 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00/059508.sst): second pass time = 0.22's, 87.189'MB/sec, value only(98.1% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.03's, 243.947'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 7.262'MB/sec (index lex order gen) rebuild zvType time = 0.02's, 0.252'MB/sec write SST data time = 0.01's, 956.617'MB/sec dict compress time = 0.00's, 182865.072'MB/sec z-dict build time = 0.00's, sample length = 0.191'MB, throughput = 3569.582'MB/sec zip my value time = 0.22's, unzip length = 0.019'GB zip my value throughput = 87.189'MB/sec zip pipeline throughput = 87.189'MB/sec entries = 19074 avg-key = 20.00 avg-zkey = 0.01 avg-val = 1017.01 avg-zval = 315.59 usrkeys = 19074 avg-key = 12.00 avg-zkey = 0.01 avg-val = 1017.01 avg-zval = 315.59 TagRS{ kinds = RS_Key0_TagN bytes = 3080 } TagArray{ size = 2 bytes = 16 } seq expand size = 14 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0002 GB value = 0.0194 GB dict = 0.19 MB all = 0.0198 GB } __ZipSize{ index = 0.0000 GB value = 0.0060 GB dict = 0.19 MB all = 0.0062 GB } UnZip/Zip{ index =1192.1250 value = 3.2226 dict = 1.00 all = 3.1825 } Zip/UnZip{ index = 0.0008 value = 0.3103 dict = 1.00 all = 0.3142 } ---------------------------- total value len = 2.784070 GB avg = 1.017 KB (by entry num) total key len = 0.054742 GB avg = 0.020 KB total ukey len = 0.032845 GB avg = 0.012 KB total ukey num = 0.002737091 Billion total entry num = 0.002737091 Billion write speed all = 0.078172823 MB/sec (with seq num) write speed all = 0.077569850 MB/sec (without seq num) 2024/11/20-18:52:56.422034 140008156956224 [compaction_job.cc:1948] [default] [JOB 6941] Generated table #59508: 19074 keys, 6215097 bytes, temperature: kWarm 2024/11/20-18:52:56.422137 140008156956224 EVENT_LOG_v1 {"time_micros": 1732099976422090, "cf_name": "default", "job": 6941, "event": "table_file_creation", "file_number": 59508, "file_size": 6215097, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 991990097, "table_properties": {"data_size": 6019488, "index_size": 192, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 381480, "raw_average_key_size": 20, "raw_value_size": 19398356, "raw_average_value_size": 1017, "num_data_blocks": 1, "num_entries": 19074, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-UintIndex_AllOne-DictZipBlobStore", "creation_time": 1732099976, "oldest_key_time": 0, "file_creation_time": 1732099976, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "6MZ3RU376XPAYLWHL32R", "orig_file_number": 59508, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/20-18:52:56.435668 140008156956224 [compaction_job.cc:703] job-06941: subcompact[0], size: 0.882848 G, files: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-06941/att-00 [059487,059488,059489,059490,059491,059492,059493,059494,059495,059496,059497,059498,059499,059500,059501,059502,059503,059504,059505,059506,059507,059508] 2024/11/20-18:52:56.642410 140008156956224 (Original Log Time 2024/11/20-18:52:23.076324) EVENT_LOG_v1 {"time_micros": 1732099943076272, "job": 6941, "event": "compaction_started", "compaction_reason": "FilesMarkedForCompaction", "files_L2": [59484], "files_L3": [59405, 59406, 59431, 59429, 59430, 59432, 59428, 59427, 59433, 59434, 59435, 59437, 59439, 59438, 59440, 59436, 59441, 59443, 59444, 59445, 59446, 59442], "score": 0.783013, "input_data_size": 895069246, "oldest_snapshot_seqno": 992763197} 2024/11/20-18:52:56.642413 140008156956224 (Original Log Time 2024/11/20-18:52:56.640585) [compaction_job.cc:2022] [default] [JOB 6941] Compacted 1@2 + 22@3 files to L3 => 882847673 bytes 2024/11/20-18:52:56.642414 140008156956224 (Original Log Time 2024/11/20-18:52:56.642317) [compaction_job.cc:1224] [default] compacted to: files[0 0 0 22 0 0 0] max score 0.03, MB/sec: 26.8 rd, 26.5 wr, level 3, files in(1, 22) out(22 +0 blob) MB in(12.4, 841.2 +0.0 blob) out(841.9 +0.0 blob), read-write-amplify(136.5) write-amplify(67.8) OK, records in: 2748568, records dropped: 11477 output_compression: Snappy 2024/11/20-18:52:56.642417 140008156956224 (Original Log Time 2024/11/20-18:52:56.642381) EVENT_LOG_v1 {"time_micros": 1732099976642341, "cf": "default", "job": 6941, "event": "compaction_finished", "compaction_time_micros": 33359357, "compaction_time_cpu_micros": 8223069, "output_level": 3, "num_output_files": 22, "total_output_size": 882847673, "num_input_records": 2748568, "num_output_records": 2737091, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "file_write_nanos": 703177665, "file_range_sync_nanos": 0, "file_fsync_nanos": 19601, "file_prepare_write_nanos": 49169, "lsm_state": [0, 0, 0, 22, 0, 0, 0]} 2024/11/20-18:52:56.771482 140008156956224 DEBG dcompact_worker.cpp:240: HttpPost: 200 OK: url = http://nlb-7zny4kaa1poal01o64.cn-shenzhen.nlb.aliyuncs.com:8443, body = {"instanceId":"nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137","labourId":"","dbId":"d89b4006-2803-486e-b7a2-759bcf348921","dbStarts":1732096383,"starts":1732099942,"executesMs":33670,"compactionJobId":6941,"attempt":0,"compactionInputRawBytes":2850264422,"compactionInputZipBytes":895069246,"compactionOutputRawBytes":0,"compactionOutputZipBytes":882847673,"headers":{"Accept":"*/*","Connection":"close","Host":"aliyun-topling-saas.topling.cn:18443","RemoteIp":"120.24.192.169","X-Forwarded-For":"120.24.192.169","region":"cn-shenzhen","token":"e6474c481bd4415abc537135cc03626b","instance-token":"e6474c481bd4415abc537135cc03626b","provider":"aliyun","CloudMarketInstanceId":"si-59c0ae5c955845588903","MeteringAssit":"","Transfer-Encoding":"chunked","traceparent":"00-04fbddefbbe5207c9d25e45e885efefe-f735e507215b2ff6-00"}}, response = 2024/11/20-18:52:56.771536 140008156956224 INFO dcompact_worker.cpp:1464: finish /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-20T17.53.03/.rocksdb/job-06941/att-00: olev 3, work 33.671 s, result 7.787 ms, install 1.848 ms, input{raw 2.655 GiB zip 853.605 MiB}