2024/11/23-04:22:49.210962 140024768611904 DEBG dcompact_worker.cpp:2214: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19210/att-00: fork to child time = 0.009098 sec 2024/11/23-04:22:49.211742 140024768611904 DEBG dcompact_worker.cpp:1013: Beg SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19210/att-00 2024/11/23-04:22:49.219301 140024768611904 DEBG dcompact_worker.cpp:1033: End SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19210/att-00 2024/11/23-04:22:49.220831 140024768611904 TRAC dcompact_worker.cpp:1083: INFO_LOG_LEVEL: rpc = INFO_LEVEL, env_var = undefined 2024/11/23-04:22:49.221108 140024768611904 [WARN] [column_family.cc:386] multiple cf_paths/db_paths and level_compaction_dynamic_level_bytes can't be used together 2024/11/23-04:22:49.298460 140024768611904 [version_set.cc:6208] Recovering from manifest file: /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-19210/att-00/MANIFEST-206347 2024/11/23-04:22:49.326956 140024768611904 [version_set.cc:6251] Recovered from manifest file:/worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-19210/att-00/MANIFEST-206347 succeeded,manifest_file_number is 206347, next_file_number is 244535, last_sequence is 3783492420, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 244323 2024/11/23-04:22:49.326962 140024768611904 [version_set.cc:6266] Column family [default] (ID 0), log number is 0 2024/11/23-04:22:49.327060 140024768611904 [version_set.cc:5721] Creating manifest 244535 2024/11/23-04:22:49.372381 140024768611904 DEBG dcompact_worker.cpp:1218: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19210/att-00: bottommost_level: fake = 1, rpc = 0 2024/11/23-04:22:49.395824 140024768611904 [compaction_job.cc:2437] [default] [JOB 19210] Compacting 1@2 + 15@3 files to L3, score 1.00, subcompactions 1 : 1 2024/11/23-04:22:49.395838 140024768611904 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 14359 Base level 2, inputs: [244472(27MB)], [244533(7695KB) 244427(34MB) 244428(34MB) 244429(35MB) 244430(35MB) 244431(34MB) 244432(34MB) 244433(35MB) 244434(35MB) 244435(35MB) 244436(35MB) 244437(11MB) 244410(35MB) 244411(35MB) 244511(35MB)] 2024/11/23-04:22:49.401655 140024768611904 [top_zip_table.cc:59] core git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-04:22:49.401686 140024768611904 [top_zip_table.cc:60] fsa git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-04:22:49.401707 140024768611904 [top_zip_table.cc:61] zbs git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-04:22:49.401712 140024768611904 [top_zip_table.cc:62] topling-zip_table_reader: git_version_hash_info_is: commit a4a382006cb82713acf5b3425835f22711877681 Author: leipeng Date: 2024-04-11 19:44:14 +0800 fixed_len_hole_index.cc: Add env bool FixedLenHoleIndexUseAVX512 for ut & debug 1. FixedLenHoleIndexUseAVX512 is only in unit tests or debug 2. In release mode, use avx512 by compile options(-march=) g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/23-04:22:49.401723 140024768611904 [top_zip_table.cc:64] topling-rocks git_version_hash_info_is: commit feab587e468621ba0204d47b4ffacc52e7c4290d Author: leipeng Date: 2024-03-22 13:35:06 +0800 ToplingZipTableBuilder::Add: immediately return after error This function returns void, and caller does not check builder->status() after calling this function and graceful abandon. So immediately return after error, and return error status in Finish(). g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/23-04:22:49.772744 140024768611904 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19210/att-00/244536.sst) /dev/shm/ToplingTemp/Topling-407478-NPSTAN 2024/11/23-04:22:50.663929 140024768611904 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19210/att-00/244536.sst): first pass time = 0.89's, 150.614'MB/sec 2024/11/23-04:22:51.982905 140024768611904 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19210/att-00/244536.sst): old prealloc_size = 147639500, real_size = 33020432 2024/11/23-04:22:51.983456 140024768611904 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19210/att-00/244536.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 932326 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1081 GB zip-val = 0.0310 GB avg-val = 115.96 avg-zval = 33.25 2024/11/23-04:22:51.984414 140024768611904 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19210/att-00/244536.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-04:22:52.914086 140024768611904 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19210/att-00/244536.sst): second pass time = 1.32's, 82.017'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.93's, 39.879'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3371.309'MB/sec (index lex order gen) rebuild zvType time = 0.80's, 0.290'MB/sec write SST data time = 0.13's, 294.542'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 23991.633'MB/sec zip my value time = 1.32's, unzip length = 0.108'GB zip my value throughput = 82.017'MB/sec zip pipeline throughput = 82.017'MB/sec entries = 932326 avg-key = 28.00 avg-zkey = 1.91 avg-val = 115.96 avg-zval = 33.25 usrkeys = 932326 avg-key = 20.00 avg-zkey = 1.91 avg-val = 122.96 avg-zval = 33.25 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 932326 bytes = 3263152 } seq expand size = 6526282 multi value expand size = 0 cnt WriteAppend = 15 UnZipSize{ index = 0.0186 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0310 GB dict = 1.08 MB all = 0.0371 GB } UnZip/Zip{ index = 10.4442 value = 3.4873 dict = 1.00 all = 3.6144 } Zip/UnZip{ index = 0.0957 value = 0.2868 dict = 1.00 all = 0.2767 } ---------------------------- total value len = 0.114639 GB avg = 0.123 KB (by entry num) total key len = 0.026105 GB avg = 0.028 KB total ukey len = 0.018647 GB avg = 0.020 KB total ukey num = 0.000932326 Billion total entry num = 0.000932326 Billion write speed all = 0.002004051 MB/sec (with seq num) write speed all = 0.001897848 MB/sec (without seq num) 2024/11/23-04:22:52.945772 140024768611904 [compaction_job.cc:1948] [default] [JOB 19210] Generated table #244536: 932326 keys, 37134408 bytes, temperature: kWarm 2024/11/23-04:22:52.945866 140024768611904 EVENT_LOG_v1 {"time_micros": 1732306972945813, "cf_name": "default", "job": 19210, "event": "table_file_creation", "file_number": 244536, "file_size": 37134408, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3583362754, "largest_seqno": 3783134072, "table_properties": {"data_size": 31001792, "index_size": 1785344, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26105128, "raw_average_key_size": 28, "raw_value_size": 108112712, "raw_average_value_size": 115, "num_data_blocks": 1, "num_entries": 932326, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732306969, "oldest_key_time": 0, "file_creation_time": 1732306969, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 244536, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-04:22:52.988314 140024768611904 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19210/att-00/244537.sst) /dev/shm/ToplingTemp/Topling-407478-FKKl1K 2024/11/23-04:22:53.873838 140024768611904 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19210/att-00/244537.sst): first pass time = 0.89's, 151.574'MB/sec 2024/11/23-04:22:55.199320 140024768611904 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19210/att-00/244537.sst): old prealloc_size = 147639500, real_size = 34038848 2024/11/23-04:22:55.199911 140024768611904 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19210/att-00/244537.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 930984 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1082 GB zip-val = 0.0320 GB avg-val = 116.17 avg-zval = 34.40 2024/11/23-04:22:55.200729 140024768611904 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19210/att-00/244537.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-04:22:56.114285 140024768611904 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19210/att-00/244537.sst): second pass time = 1.32's, 81.663'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.91's, 41.822'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3131.807'MB/sec (index lex order gen) rebuild zvType time = 0.79's, 0.296'MB/sec write SST data time = 0.13's, 301.565'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 30357.386'MB/sec zip my value time = 1.32's, unzip length = 0.108'GB zip my value throughput = 81.663'MB/sec zip pipeline throughput = 81.663'MB/sec entries = 930984 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.17 avg-zval = 34.40 usrkeys = 930984 avg-key = 20.00 avg-zkey = 1.91 avg-val = 123.17 avg-zval = 34.40 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 930984 bytes = 3374832 } seq expand size = 6516888 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0320 GB dict = 1.08 MB all = 0.0383 GB } UnZip/Zip{ index = 10.4449 value = 3.3772 dict = 1.00 all = 3.5076 } Zip/UnZip{ index = 0.0957 value = 0.2961 dict = 1.00 all = 0.2851 } ---------------------------- total value len = 0.229306 GB avg = 0.123 KB (by entry num) total key len = 0.052173 GB avg = 0.028 KB total ukey len = 0.037266 GB avg = 0.020 KB total ukey num = 0.001863310 Billion total entry num = 0.001863310 Billion write speed all = 0.004007784 MB/sec (with seq num) write speed all = 0.003795541 MB/sec (without seq num) 2024/11/23-04:22:56.149787 140024768611904 [compaction_job.cc:1948] [default] [JOB 19210] Generated table #244537: 930984 keys, 38265096 bytes, temperature: kWarm 2024/11/23-04:22:56.149851 140024768611904 EVENT_LOG_v1 {"time_micros": 1732306976149819, "cf_name": "default", "job": 19210, "event": "table_file_creation", "file_number": 244537, "file_size": 38265096, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3376774746, "largest_seqno": 3783134969, "table_properties": {"data_size": 32023280, "index_size": 1782656, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26067552, "raw_average_key_size": 28, "raw_value_size": 108150184, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 930984, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732306972, "oldest_key_time": 0, "file_creation_time": 1732306972, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 244537, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-04:22:56.193751 140024768611904 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19210/att-00/244538.sst) /dev/shm/ToplingTemp/Topling-407478-GgmM6K 2024/11/23-04:22:57.020276 140024768611904 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19210/att-00/244538.sst): first pass time = 0.83's, 162.396'MB/sec 2024/11/23-04:22:58.356699 140024768611904 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19210/att-00/244538.sst): old prealloc_size = 147639500, real_size = 32855824 2024/11/23-04:22:58.357291 140024768611904 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19210/att-00/244538.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 934354 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1081 GB zip-val = 0.0308 GB avg-val = 115.65 avg-zval = 33.01 2024/11/23-04:22:58.358116 140024768611904 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19210/att-00/244538.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-04:22:59.279145 140024768611904 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19210/att-00/244538.sst): second pass time = 1.34's, 80.927'MB/sec, value only(80.5% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.92's, 40.213'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3105.964'MB/sec (index lex order gen) rebuild zvType time = 0.79's, 0.294'MB/sec write SST data time = 0.13's, 290.959'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 26148.170'MB/sec zip my value time = 1.34's, unzip length = 0.108'GB zip my value throughput = 80.927'MB/sec zip pipeline throughput = 80.927'MB/sec entries = 934354 avg-key = 28.00 avg-zkey = 1.90 avg-val = 115.65 avg-zval = 33.01 usrkeys = 934354 avg-key = 20.00 avg-zkey = 1.90 avg-val = 122.65 avg-zval = 33.01 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 934354 bytes = 3387056 } seq expand size = 6540478 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0187 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0308 GB dict = 1.08 MB all = 0.0371 GB } UnZip/Zip{ index = 10.5133 value = 3.5032 dict = 1.00 all = 3.6184 } Zip/UnZip{ index = 0.0951 value = 0.2855 dict = 1.00 all = 0.2764 } ---------------------------- total value len = 0.343902 GB avg = 0.123 KB (by entry num) total key len = 0.078335 GB avg = 0.028 KB total ukey len = 0.055953 GB avg = 0.020 KB total ukey num = 0.002797664 Billion total entry num = 0.002797664 Billion write speed all = 0.006011673 MB/sec (with seq num) write speed all = 0.005693015 MB/sec (without seq num) 2024/11/23-04:22:59.311424 140024768611904 [compaction_job.cc:1948] [default] [JOB 19210] Generated table #244538: 934354 keys, 37093090 bytes, temperature: kWarm 2024/11/23-04:22:59.311486 140024768611904 EVENT_LOG_v1 {"time_micros": 1732306979311455, "cf_name": "default", "job": 19210, "event": "table_file_creation", "file_number": 244538, "file_size": 37093090, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3504428200, "largest_seqno": 3783134873, "table_properties": {"data_size": 30844608, "index_size": 1777472, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26161912, "raw_average_key_size": 28, "raw_value_size": 108055824, "raw_average_value_size": 115, "num_data_blocks": 1, "num_entries": 934354, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732306976, "oldest_key_time": 0, "file_creation_time": 1732306976, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 244538, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-04:22:59.350090 140024768611904 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19210/att-00/244539.sst) /dev/shm/ToplingTemp/Topling-407478-Cq0M9N 2024/11/23-04:23:00.157614 140024768611904 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19210/att-00/244539.sst): first pass time = 0.81's, 166.215'MB/sec 2024/11/23-04:23:01.508505 140024768611904 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19210/att-00/244539.sst): old prealloc_size = 147639500, real_size = 33084544 2024/11/23-04:23:01.509056 140024768611904 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19210/att-00/244539.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 929376 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0311 GB avg-val = 116.42 avg-zval = 33.45 2024/11/23-04:23:01.509829 140024768611904 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19210/att-00/244539.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-04:23:02.455119 140024768611904 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19210/att-00/244539.sst): second pass time = 1.35's, 80.177'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.95's, 39.288'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3322.387'MB/sec (index lex order gen) rebuild zvType time = 0.82's, 0.284'MB/sec write SST data time = 0.13's, 291.130'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 28076.273'MB/sec zip my value time = 1.35's, unzip length = 0.108'GB zip my value throughput = 80.177'MB/sec zip pipeline throughput = 80.177'MB/sec entries = 929376 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.42 avg-zval = 33.45 usrkeys = 929376 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.42 avg-zval = 33.45 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 929376 bytes = 3252832 } seq expand size = 6505632 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0311 GB dict = 1.08 MB all = 0.0372 GB } UnZip/Zip{ index = 10.5141 value = 3.4807 dict = 1.00 all = 3.6090 } Zip/UnZip{ index = 0.0951 value = 0.2873 dict = 1.00 all = 0.2771 } ---------------------------- total value len = 0.458603 GB avg = 0.123 KB (by entry num) total key len = 0.104357 GB avg = 0.028 KB total ukey len = 0.074541 GB avg = 0.020 KB total ukey num = 0.003727040 Billion total entry num = 0.003727040 Billion write speed all = 0.008014885 MB/sec (with seq num) write speed all = 0.007590389 MB/sec (without seq num) 2024/11/23-04:23:02.491865 140024768611904 [compaction_job.cc:1948] [default] [JOB 19210] Generated table #244539: 929376 keys, 37190144 bytes, temperature: kWarm 2024/11/23-04:23:02.491937 140024768611904 EVENT_LOG_v1 {"time_micros": 1732306982491898, "cf_name": "default", "job": 19210, "event": "table_file_creation", "file_number": 244539, "file_size": 37190144, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3587898319, "largest_seqno": 3783134155, "table_properties": {"data_size": 31084144, "index_size": 1767872, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26022528, "raw_average_key_size": 28, "raw_value_size": 108195264, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 929376, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732306979, "oldest_key_time": 0, "file_creation_time": 1732306979, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 244539, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-04:23:02.528554 140024768611904 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19210/att-00/244540.sst) /dev/shm/ToplingTemp/Topling-407478-2lYbxL 2024/11/23-04:23:03.321812 140024768611904 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19210/att-00/244540.sst): first pass time = 0.79's, 169.206'MB/sec 2024/11/23-04:23:04.716141 140024768611904 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19210/att-00/244540.sst): old prealloc_size = 147639500, real_size = 35151584 2024/11/23-04:23:04.716738 140024768611904 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19210/att-00/244540.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 1082735 prefix = 4 raw-key = 0.0173 GB zip-key = 0.0021 GB avg-key = 16.00 avg-zkey = 1.93 raw-val = 0.1039 GB zip-val = 0.0328 GB avg-val = 95.96 avg-zval = 30.29 2024/11/23-04:23:04.716961 140024768611904 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19210/att-00/244540.sst: sumWaitingMem = 0.003 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0028 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-04:23:05.345183 140024768611904 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19210/att-00/244540.sst): second pass time = 1.39's, 74.552'MB/sec, value only(77.4% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.63's, 57.674'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3630.758'MB/sec (index lex order gen) rebuild zvType time = 0.49's, 0.552'MB/sec write SST data time = 0.14's, 263.184'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.033'MB, throughput = 29940.546'MB/sec zip my value time = 1.39's, unzip length = 0.104'GB zip my value throughput = 74.552'MB/sec zip pipeline throughput = 74.552'MB/sec entries = 1082735 avg-key = 28.00 avg-zkey = 1.93 avg-val = 95.96 avg-zval = 30.29 usrkeys = 1082735 avg-key = 20.00 avg-zkey = 1.93 avg-val = 96.36 avg-zval = 30.29 TagRS{ kinds = RS_Key0_TagN bytes = 169280 } TagArray{ size = 61246 bytes = 183760 } seq expand size = 428722 multi value expand size = 0 cnt WriteAppend = 16 UnZipSize{ index = 0.0217 GB value = 0.1039 GB dict = 1.03 MB all = 0.1342 GB } __ZipSize{ index = 0.0021 GB value = 0.0328 GB dict = 1.03 MB all = 0.0363 GB } UnZip/Zip{ index = 10.3799 value = 3.1682 dict = 1.00 all = 3.6997 } Zip/UnZip{ index = 0.0963 value = 0.3156 dict = 1.00 all = 0.2703 } ---------------------------- total value len = 0.562933 GB avg = 0.117 KB (by entry num) total key len = 0.134674 GB avg = 0.028 KB total ukey len = 0.096196 GB avg = 0.020 KB total ukey num = 0.004809775 Billion total entry num = 0.004809775 Billion write speed all = 0.009931442 MB/sec (with seq num) write speed all = 0.009383649 MB/sec (without seq num) 2024/11/23-04:23:05.379707 140024768611904 [compaction_job.cc:1948] [default] [JOB 19210] Generated table #244540: 1082735 keys, 36278311 bytes, temperature: kWarm 2024/11/23-04:23:05.379770 140024768611904 EVENT_LOG_v1 {"time_micros": 1732306985379738, "cf_name": "default", "job": 19210, "event": "table_file_creation", "file_number": 244540, "file_size": 36278311, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3783130692, "table_properties": {"data_size": 32794512, "index_size": 2086208, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 30316580, "raw_average_key_size": 28, "raw_value_size": 103901151, "raw_average_value_size": 95, "num_data_blocks": 1, "num_entries": 1082735, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732306982, "oldest_key_time": 0, "file_creation_time": 1732306982, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 244540, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-04:23:05.426700 140024768611904 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19210/att-00/244541.sst) /dev/shm/ToplingTemp/Topling-407478-9kgNCM 2024/11/23-04:23:06.293458 140024768611904 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19210/att-00/244541.sst): first pass time = 0.87's, 154.856'MB/sec 2024/11/23-04:23:07.654443 140024768611904 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19210/att-00/244541.sst): old prealloc_size = 147639500, real_size = 34960288 2024/11/23-04:23:07.655000 140024768611904 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19210/att-00/244541.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 922364 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1084 GB zip-val = 0.0330 GB avg-val = 117.52 avg-zval = 35.74 2024/11/23-04:23:07.655545 140024768611904 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19210/att-00/244541.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-04:23:08.487708 140024768611904 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19210/att-00/244541.sst): second pass time = 1.36's, 79.682'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.83's, 45.581'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3317.252'MB/sec (index lex order gen) rebuild zvType time = 0.70's, 0.327'MB/sec write SST data time = 0.13's, 297.353'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.083'MB, throughput = 31367.388'MB/sec zip my value time = 1.36's, unzip length = 0.108'GB zip my value throughput = 79.682'MB/sec zip pipeline throughput = 79.682'MB/sec entries = 922364 avg-key = 28.00 avg-zkey = 1.91 avg-val = 117.52 avg-zval = 35.74 usrkeys = 922364 avg-key = 20.00 avg-zkey = 1.91 avg-val = 121.73 avg-zval = 35.74 TagRS{ kinds = RS_Key0_TagN bytes = 144200 } TagArray{ size = 555450 bytes = 2013520 } seq expand size = 3888150 multi value expand size = 0 cnt WriteAppend = 16 UnZipSize{ index = 0.0184 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0330 GB dict = 1.08 MB all = 0.0380 GB } UnZip/Zip{ index = 10.4446 value = 3.2883 dict = 1.00 all = 3.5339 } Zip/UnZip{ index = 0.0957 value = 0.3041 dict = 1.00 all = 0.2830 } ---------------------------- total value len = 0.675213 GB avg = 0.118 KB (by entry num) total key len = 0.160500 GB avg = 0.028 KB total ukey len = 0.114643 GB avg = 0.020 KB total ukey num = 0.005732139 Billion total entry num = 0.005732139 Billion write speed all = 0.011897049 MB/sec (with seq num) write speed all = 0.011244236 MB/sec (without seq num) 2024/11/23-04:23:08.523438 140024768611904 [compaction_job.cc:1948] [default] [JOB 19210] Generated table #244541: 922364 keys, 37979930 bytes, temperature: kWarm 2024/11/23-04:23:08.523503 140024768611904 EVENT_LOG_v1 {"time_micros": 1732306988523469, "cf_name": "default", "job": 19210, "event": "table_file_creation", "file_number": 244541, "file_size": 37979930, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3717490122, "table_properties": {"data_size": 32963280, "index_size": 1766208, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25826192, "raw_average_key_size": 28, "raw_value_size": 108391664, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 922364, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732306985, "oldest_key_time": 0, "file_creation_time": 1732306985, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 244541, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-04:23:08.561917 140024768611904 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19210/att-00/244542.sst) /dev/shm/ToplingTemp/Topling-407478-oVwrDM 2024/11/23-04:23:09.366162 140024768611904 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19210/att-00/244542.sst): first pass time = 0.80's, 166.894'MB/sec 2024/11/23-04:23:10.705587 140024768611904 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19210/att-00/244542.sst): old prealloc_size = 147639500, real_size = 33027296 2024/11/23-04:23:10.706140 140024768611904 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19210/att-00/244542.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927588 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0310 GB avg-val = 116.70 avg-zval = 33.45 2024/11/23-04:23:10.706961 140024768611904 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19210/att-00/244542.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-04:23:11.635503 140024768611904 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19210/att-00/244542.sst): second pass time = 1.34's, 80.854'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.93's, 40.052'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3338.970'MB/sec (index lex order gen) rebuild zvType time = 0.80's, 0.289'MB/sec write SST data time = 0.13's, 290.445'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 33223.432'MB/sec zip my value time = 1.34's, unzip length = 0.108'GB zip my value throughput = 80.854'MB/sec zip pipeline throughput = 80.854'MB/sec entries = 927588 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.70 avg-zval = 33.45 usrkeys = 927588 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.70 avg-zval = 33.45 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 927588 bytes = 3362528 } seq expand size = 6493116 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0310 GB dict = 1.08 MB all = 0.0372 GB } UnZip/Zip{ index = 10.5125 value = 3.4884 dict = 1.00 all = 3.6037 } Zip/UnZip{ index = 0.0951 value = 0.2867 dict = 1.00 all = 0.2775 } ---------------------------- total value len = 0.789951 GB avg = 0.119 KB (by entry num) total key len = 0.186472 GB avg = 0.028 KB total ukey len = 0.133195 GB avg = 0.020 KB total ukey num = 0.006659727 Billion total entry num = 0.006659727 Billion write speed all = 0.013899559 MB/sec (with seq num) write speed all = 0.013141140 MB/sec (without seq num) 2024/11/23-04:23:11.667031 140024768611904 [compaction_job.cc:1948] [default] [JOB 19210] Generated table #244542: 927588 keys, 37244154 bytes, temperature: kWarm 2024/11/23-04:23:11.667096 140024768611904 EVENT_LOG_v1 {"time_micros": 1732306991667062, "cf_name": "default", "job": 19210, "event": "table_file_creation", "file_number": 244542, "file_size": 37244154, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3487497056, "largest_seqno": 3783132757, "table_properties": {"data_size": 31030480, "index_size": 1764736, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25972464, "raw_average_key_size": 28, "raw_value_size": 108245264, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927588, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732306988, "oldest_key_time": 0, "file_creation_time": 1732306988, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 244542, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-04:23:11.704413 140024768611904 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19210/att-00/244543.sst) /dev/shm/ToplingTemp/Topling-407478-47NBvL 2024/11/23-04:23:12.533125 140024768611904 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19210/att-00/244543.sst): first pass time = 0.83's, 161.966'MB/sec 2024/11/23-04:23:13.857284 140024768611904 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19210/att-00/244543.sst): old prealloc_size = 147639500, real_size = 31081376 2024/11/23-04:23:13.857865 140024768611904 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19210/att-00/244543.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927649 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0291 GB avg-val = 116.69 avg-zval = 31.35 2024/11/23-04:23:13.858638 140024768611904 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19210/att-00/244543.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-04:23:14.721464 140024768611904 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19210/att-00/244543.sst): second pass time = 1.32's, 81.791'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.86's, 40.847'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3165.870'MB/sec (index lex order gen) rebuild zvType time = 0.73's, 0.316'MB/sec write SST data time = 0.13's, 274.279'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 31766.322'MB/sec zip my value time = 1.32's, unzip length = 0.108'GB zip my value throughput = 81.791'MB/sec zip pipeline throughput = 81.791'MB/sec entries = 927649 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.69 avg-zval = 31.35 usrkeys = 927649 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.69 avg-zval = 31.35 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 927649 bytes = 3362736 } seq expand size = 6493543 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0291 GB dict = 1.08 MB all = 0.0353 GB } UnZip/Zip{ index = 10.5120 value = 3.7217 dict = 1.00 all = 3.8024 } Zip/UnZip{ index = 0.0951 value = 0.2687 dict = 1.00 all = 0.2630 } ---------------------------- total value len = 0.904688 GB avg = 0.119 KB (by entry num) total key len = 0.212447 GB avg = 0.028 KB total ukey len = 0.151748 GB avg = 0.020 KB total ukey num = 0.007587376 Billion total entry num = 0.007587376 Billion write speed all = 0.015901910 MB/sec (with seq num) write speed all = 0.015037887 MB/sec (without seq num) 2024/11/23-04:23:14.752352 140024768611904 [compaction_job.cc:1948] [default] [JOB 19210] Generated table #244543: 927649 keys, 35298182 bytes, temperature: kWarm 2024/11/23-04:23:14.752418 140024768611904 EVENT_LOG_v1 {"time_micros": 1732306994752385, "cf_name": "default", "job": 19210, "event": "table_file_creation", "file_number": 244543, "file_size": 35298182, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3375334738, "largest_seqno": 3783134294, "table_properties": {"data_size": 29084368, "index_size": 1764928, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25974172, "raw_average_key_size": 28, "raw_value_size": 108243602, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927649, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732306991, "oldest_key_time": 0, "file_creation_time": 1732306991, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 244543, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-04:23:14.788246 140024768611904 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19210/att-00/244544.sst) /dev/shm/ToplingTemp/Topling-407478-rZR9pO 2024/11/23-04:23:15.602604 140024768611904 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19210/att-00/244544.sst): first pass time = 0.81's, 164.822'MB/sec 2024/11/23-04:23:16.924078 140024768611904 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19210/att-00/244544.sst): old prealloc_size = 147639500, real_size = 32714208 2024/11/23-04:23:16.924607 140024768611904 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19210/att-00/244544.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927624 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0307 GB avg-val = 116.69 avg-zval = 33.11 2024/11/23-04:23:16.925681 140024768611904 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19210/att-00/244544.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-04:23:17.836268 140024768611904 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19210/att-00/244544.sst): second pass time = 1.32's, 81.960'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.91's, 40.487'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3513.706'MB/sec (index lex order gen) rebuild zvType time = 0.78's, 0.296'MB/sec write SST data time = 0.13's, 285.368'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 32064.999'MB/sec zip my value time = 1.32's, unzip length = 0.108'GB zip my value throughput = 81.960'MB/sec zip pipeline throughput = 81.960'MB/sec entries = 927624 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.69 avg-zval = 33.11 usrkeys = 927624 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.69 avg-zval = 33.11 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 927624 bytes = 3362656 } seq expand size = 6493368 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0307 GB dict = 1.08 MB all = 0.0369 GB } UnZip/Zip{ index = 10.5121 value = 3.5239 dict = 1.00 all = 3.6343 } Zip/UnZip{ index = 0.0951 value = 0.2838 dict = 1.00 all = 0.2752 } ---------------------------- total value len = 1.019426 GB avg = 0.120 KB (by entry num) total key len = 0.238420 GB avg = 0.028 KB total ukey len = 0.170300 GB avg = 0.020 KB total ukey num = 0.008515000 Billion total entry num = 0.008515000 Billion write speed all = 0.017904075 MB/sec (with seq num) write speed all = 0.016934460 MB/sec (without seq num) 2024/11/23-04:23:17.867591 140024768611904 [compaction_job.cc:1948] [default] [JOB 19210] Generated table #244544: 927624 keys, 36931134 bytes, temperature: kWarm 2024/11/23-04:23:17.867654 140024768611904 EVENT_LOG_v1 {"time_micros": 1732306997867622, "cf_name": "default", "job": 19210, "event": "table_file_creation", "file_number": 244544, "file_size": 36931134, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3273701103, "largest_seqno": 3783133245, "table_properties": {"data_size": 30717264, "index_size": 1764864, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25973472, "raw_average_key_size": 28, "raw_value_size": 108244272, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927624, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732306994, "oldest_key_time": 0, "file_creation_time": 1732306994, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 244544, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-04:23:17.911169 140024768611904 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19210/att-00/244545.sst) /dev/shm/ToplingTemp/Topling-407478-GMrCIM 2024/11/23-04:23:18.711205 140024768611904 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19210/att-00/244545.sst): first pass time = 0.80's, 167.772'MB/sec 2024/11/23-04:23:20.033138 140024768611904 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19210/att-00/244545.sst): old prealloc_size = 147639500, real_size = 30949216 2024/11/23-04:23:20.033676 140024768611904 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19210/att-00/244545.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927983 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.93 raw-val = 0.1082 GB zip-val = 0.0289 GB avg-val = 116.63 avg-zval = 31.17 2024/11/23-04:23:20.034486 140024768611904 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19210/att-00/244545.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-04:23:20.885008 140024768611904 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19210/att-00/244545.sst): second pass time = 1.32's, 81.919'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.85's, 41.147'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3477.758'MB/sec (index lex order gen) rebuild zvType time = 0.72's, 0.321'MB/sec write SST data time = 0.13's, 274.678'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 29536.349'MB/sec zip my value time = 1.32's, unzip length = 0.108'GB zip my value throughput = 81.919'MB/sec zip pipeline throughput = 81.919'MB/sec entries = 927983 avg-key = 28.00 avg-zkey = 1.93 avg-val = 116.63 avg-zval = 31.17 usrkeys = 927983 avg-key = 20.00 avg-zkey = 1.93 avg-val = 123.63 avg-zval = 31.17 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 927983 bytes = 3247952 } seq expand size = 6495881 multi value expand size = 0 cnt WriteAppend = 16 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0289 GB dict = 1.08 MB all = 0.0351 GB } UnZip/Zip{ index = 10.3759 value = 3.7415 dict = 1.00 all = 3.8292 } Zip/UnZip{ index = 0.0964 value = 0.2673 dict = 1.00 all = 0.2611 } ---------------------------- total value len = 1.134156 GB avg = 0.120 KB (by entry num) total key len = 0.264404 GB avg = 0.028 KB total ukey len = 0.188860 GB avg = 0.020 KB total ukey num = 0.009442983 Billion total entry num = 0.009442983 Billion write speed all = 0.019906117 MB/sec (with seq num) write speed all = 0.018830878 MB/sec (without seq num) 2024/11/23-04:23:20.915958 140024768611904 [compaction_job.cc:1948] [default] [JOB 19210] Generated table #244545: 927983 keys, 35050932 bytes, temperature: kWarm 2024/11/23-04:23:20.916020 140024768611904 EVENT_LOG_v1 {"time_micros": 1732307000915988, "cf_name": "default", "job": 19210, "event": "table_file_creation", "file_number": 244545, "file_size": 35050932, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3633974283, "largest_seqno": 3783134377, "table_properties": {"data_size": 28928272, "index_size": 1788736, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25983524, "raw_average_key_size": 28, "raw_value_size": 108234222, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927983, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732306997, "oldest_key_time": 0, "file_creation_time": 1732306997, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 244545, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-04:23:20.965705 140024768611904 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19210/att-00/244546.sst) /dev/shm/ToplingTemp/Topling-407478-qefOuM 2024/11/23-04:23:21.837853 140024768611904 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19210/att-00/244546.sst): first pass time = 0.87's, 153.901'MB/sec 2024/11/23-04:23:23.131208 140024768611904 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19210/att-00/244546.sst): old prealloc_size = 147639500, real_size = 32105232 2024/11/23-04:23:23.131813 140024768611904 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19210/att-00/244546.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927781 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0301 GB avg-val = 116.67 avg-zval = 32.45 2024/11/23-04:23:23.132619 140024768611904 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19210/att-00/244546.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-04:23:24.021587 140024768611904 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19210/att-00/244546.sst): second pass time = 1.29's, 83.734'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.89's, 40.795'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3035.168'MB/sec (index lex order gen) rebuild zvType time = 0.76's, 0.305'MB/sec write SST data time = 0.13's, 279.674'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 29406.300'MB/sec zip my value time = 1.29's, unzip length = 0.108'GB zip my value throughput = 83.734'MB/sec zip pipeline throughput = 83.734'MB/sec entries = 927781 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.67 avg-zval = 32.45 usrkeys = 927781 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.67 avg-zval = 32.45 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 927781 bytes = 3363216 } seq expand size = 6494467 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0301 GB dict = 1.08 MB all = 0.0363 GB } UnZip/Zip{ index = 10.5124 value = 3.5951 dict = 1.00 all = 3.6952 } Zip/UnZip{ index = 0.0951 value = 0.2782 dict = 1.00 all = 0.2706 } ---------------------------- total value len = 1.248891 GB avg = 0.120 KB (by entry num) total key len = 0.290381 GB avg = 0.028 KB total ukey len = 0.207415 GB avg = 0.020 KB total ukey num = 0.010370764 Billion total entry num = 0.010370764 Billion write speed all = 0.021907938 MB/sec (with seq num) write speed all = 0.020727109 MB/sec (without seq num) 2024/11/23-04:23:24.055593 140024768611904 [compaction_job.cc:1948] [default] [JOB 19210] Generated table #244546: 927781 keys, 36322384 bytes, temperature: kWarm 2024/11/23-04:23:24.055655 140024768611904 EVENT_LOG_v1 {"time_micros": 1732307004055624, "cf_name": "default", "job": 19210, "event": "table_file_creation", "file_number": 244546, "file_size": 36322384, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3369194706, "largest_seqno": 3783134646, "table_properties": {"data_size": 30107968, "index_size": 1765120, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25977868, "raw_average_key_size": 28, "raw_value_size": 108239914, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927781, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732307000, "oldest_key_time": 0, "file_creation_time": 1732307000, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 244546, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-04:23:24.096903 140024768611904 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19210/att-00/244547.sst) /dev/shm/ToplingTemp/Topling-407478-JF9xnK 2024/11/23-04:23:24.903059 140024768611904 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19210/att-00/244547.sst): first pass time = 0.81's, 166.498'MB/sec 2024/11/23-04:23:26.200615 140024768611904 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19210/att-00/244547.sst): old prealloc_size = 147639500, real_size = 30746256 2024/11/23-04:23:26.201216 140024768611904 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19210/att-00/244547.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 925695 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1083 GB zip-val = 0.0287 GB avg-val = 116.99 avg-zval = 31.05 2024/11/23-04:23:26.202012 140024768611904 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19210/att-00/244547.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-04:23:27.044250 140024768611904 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19210/att-00/244547.sst): second pass time = 1.30's, 83.509'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.84's, 41.298'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3082.752'MB/sec (index lex order gen) rebuild zvType time = 0.71's, 0.324'MB/sec write SST data time = 0.13's, 271.839'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 33881.353'MB/sec zip my value time = 1.30's, unzip length = 0.108'GB zip my value throughput = 83.509'MB/sec zip pipeline throughput = 83.509'MB/sec entries = 925695 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.99 avg-zval = 31.05 usrkeys = 925695 avg-key = 20.00 avg-zkey = 1.91 avg-val = 123.99 avg-zval = 31.05 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 925695 bytes = 3239952 } seq expand size = 6479865 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0287 GB dict = 1.08 MB all = 0.0348 GB } UnZip/Zip{ index = 10.4456 value = 3.7679 dict = 1.00 all = 3.8525 } Zip/UnZip{ index = 0.0957 value = 0.2654 dict = 1.00 all = 0.2596 } ---------------------------- total value len = 1.363669 GB avg = 0.121 KB (by entry num) total key len = 0.316301 GB avg = 0.028 KB total ukey len = 0.225929 GB avg = 0.020 KB total ukey num = 0.011296459 Billion total entry num = 0.011296459 Billion write speed all = 0.023909411 MB/sec (with seq num) write speed all = 0.022623237 MB/sec (without seq num) 2024/11/23-04:23:27.076615 140024768611904 [compaction_job.cc:1948] [default] [JOB 19210] Generated table #244547: 925695 keys, 34839314 bytes, temperature: kWarm 2024/11/23-04:23:27.076691 140024768611904 EVENT_LOG_v1 {"time_micros": 1732307007076650, "cf_name": "default", "job": 19210, "event": "table_file_creation", "file_number": 244547, "file_size": 34839314, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3636152882, "largest_seqno": 3783132831, "table_properties": {"data_size": 28742208, "index_size": 1772416, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25919460, "raw_average_key_size": 28, "raw_value_size": 108298306, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 925695, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732307004, "oldest_key_time": 0, "file_creation_time": 1732307004, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 244547, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-04:23:27.115890 140024768611904 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19210/att-00/244548.sst) /dev/shm/ToplingTemp/Topling-407478-cXoNHL 2024/11/23-04:23:27.997417 140024768611904 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19210/att-00/244548.sst): first pass time = 0.88's, 152.262'MB/sec 2024/11/23-04:23:29.332463 140024768611904 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19210/att-00/244548.sst): old prealloc_size = 147639500, real_size = 32792784 2024/11/23-04:23:29.333049 140024768611904 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19210/att-00/244548.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 929604 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.93 raw-val = 0.1082 GB zip-val = 0.0308 GB avg-val = 116.38 avg-zval = 33.10 2024/11/23-04:23:29.333888 140024768611904 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19210/att-00/244548.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-04:23:30.249652 140024768611904 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19210/att-00/244548.sst): second pass time = 1.33's, 81.079'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.92's, 40.358'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3162.796'MB/sec (index lex order gen) rebuild zvType time = 0.79's, 0.296'MB/sec write SST data time = 0.13's, 282.371'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 30835.248'MB/sec zip my value time = 1.33's, unzip length = 0.108'GB zip my value throughput = 81.079'MB/sec zip pipeline throughput = 81.079'MB/sec entries = 929604 avg-key = 28.00 avg-zkey = 1.93 avg-val = 116.38 avg-zval = 33.10 usrkeys = 929604 avg-key = 20.00 avg-zkey = 1.93 avg-val = 123.38 avg-zval = 33.10 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 929604 bytes = 3369824 } seq expand size = 6507228 multi value expand size = 0 cnt WriteAppend = 16 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0308 GB dict = 1.08 MB all = 0.0370 GB } UnZip/Zip{ index = 10.3754 value = 3.5162 dict = 1.00 all = 3.6260 } Zip/UnZip{ index = 0.0964 value = 0.2844 dict = 1.00 all = 0.2758 } ---------------------------- total value len = 1.478365 GB avg = 0.121 KB (by entry num) total key len = 0.342330 GB avg = 0.028 KB total ukey len = 0.244521 GB avg = 0.020 KB total ukey num = 0.012226063 Billion total entry num = 0.012226063 Billion write speed all = 0.025911034 MB/sec (with seq num) write speed all = 0.024519082 MB/sec (without seq num) 2024/11/23-04:23:30.284197 140024768611904 [compaction_job.cc:1948] [default] [JOB 19210] Generated table #244548: 929604 keys, 37015188 bytes, temperature: kWarm 2024/11/23-04:23:30.284261 140024768611904 EVENT_LOG_v1 {"time_micros": 1732307010284227, "cf_name": "default", "job": 19210, "event": "table_file_creation", "file_number": 244548, "file_size": 37015188, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3339428666, "largest_seqno": 3783134573, "table_properties": {"data_size": 30768256, "index_size": 1791936, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26028912, "raw_average_key_size": 28, "raw_value_size": 108188848, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 929604, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732307007, "oldest_key_time": 0, "file_creation_time": 1732307007, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 244548, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-04:23:30.324895 140024768611904 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19210/att-00/244549.sst) /dev/shm/ToplingTemp/Topling-407478-whMxFK 2024/11/23-04:23:30.682246 140024768611904 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19210/att-00/244549.sst): first pass time = 0.36's, 244.602'MB/sec 2024/11/23-04:23:31.566687 140024768611904 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19210/att-00/244549.sst): old prealloc_size = 147639500, real_size = 21859824 2024/11/23-04:23:31.567080 140024768611904 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19210/att-00/244549.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 607074 prefix = 4 raw-key = 0.0097 GB zip-key = 0.0012 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.0704 GB zip-val = 0.0206 GB avg-val = 115.97 avg-zval = 33.85 2024/11/23-04:23:31.567623 140024768611904 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19210/att-00/244549.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0015 GB, waited 0.000 sec, Key+Value = 0.087 GB 2024/11/23-04:23:32.184857 140024768611904 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19210/att-00/244549.sst): second pass time = 0.88's, 79.661'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.62's, 39.703'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3127.773'MB/sec (index lex order gen) rebuild zvType time = 0.53's, 0.284'MB/sec write SST data time = 0.08's, 291.672'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.705'MB, throughput = 22674.767'MB/sec zip my value time = 0.88's, unzip length = 0.070'GB zip my value throughput = 79.661'MB/sec zip pipeline throughput = 79.661'MB/sec entries = 607074 avg-key = 28.00 avg-zkey = 1.90 avg-val = 115.97 avg-zval = 33.85 usrkeys = 607074 avg-key = 20.00 avg-zkey = 1.90 avg-val = 122.97 avg-zval = 33.85 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 607074 bytes = 2124768 } seq expand size = 4249518 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0121 GB value = 0.0704 GB dict = 0.71 MB all = 0.0874 GB } __ZipSize{ index = 0.0012 GB value = 0.0206 GB dict = 0.71 MB all = 0.0245 GB } UnZip/Zip{ index = 10.5068 value = 3.4255 dict = 1.00 all = 3.5612 } Zip/UnZip{ index = 0.0952 value = 0.2919 dict = 1.00 all = 0.2808 } ---------------------------- total value len = 1.553016 GB avg = 0.121 KB (by entry num) total key len = 0.359328 GB avg = 0.028 KB total ukey len = 0.256663 GB avg = 0.020 KB total ukey num = 0.012833137 Billion total entry num = 0.012833137 Billion write speed all = 0.027214585 MB/sec (with seq num) write speed all = 0.025753557 MB/sec (without seq num) 2024/11/23-04:23:32.209791 140024768611904 [compaction_job.cc:1948] [default] [JOB 19210] Generated table #244549: 607074 keys, 24542484 bytes, temperature: kWarm 2024/11/23-04:23:32.209850 140024768611904 EVENT_LOG_v1 {"time_micros": 1732307012209820, "cf_name": "default", "job": 19210, "event": "table_file_creation", "file_number": 244549, "file_size": 24542484, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3516470397, "largest_seqno": 3783133738, "table_properties": {"data_size": 20552288, "index_size": 1155584, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 16998072, "raw_average_key_size": 28, "raw_value_size": 70401884, "raw_average_value_size": 115, "num_data_blocks": 1, "num_entries": 607074, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732307010, "oldest_key_time": 0, "file_creation_time": 1732307010, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 244549, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-04:23:32.235197 140024768611904 [compaction_job.cc:703] job-19210: subcompact[0], size: 0.501185 G, files: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-19210/att-00 [244536,244537,244538,244539,244540,244541,244542,244543,244544,244545,244546,244547,244548,244549] 2024/11/23-04:23:32.321720 140024768611904 (Original Log Time 2024/11/23-04:22:49.395892) EVENT_LOG_v1 {"time_micros": 1732306969395850, "job": 19210, "event": "compaction_started", "compaction_reason": "FilesMarkedForCompaction", "files_L2": [244472], "files_L3": [244533, 244427, 244428, 244429, 244430, 244431, 244432, 244433, 244434, 244435, 244436, 244437, 244410, 244411, 244511], "score": 0.998662, "input_data_size": 529397875, "oldest_snapshot_seqno": 3783492420} 2024/11/23-04:23:32.321724 140024768611904 (Original Log Time 2024/11/23-04:23:32.319985) [compaction_job.cc:2022] [default] [JOB 19210] Compacted 1@2 + 15@3 files to L3 => 501184751 bytes 2024/11/23-04:23:32.321725 140024768611904 (Original Log Time 2024/11/23-04:23:32.321655) [compaction_job.cc:1224] [default] compacted to: files[0 0 0 14 0 0 0] max score 0.02, MB/sec: 12.4 rd, 11.7 wr, level 3, files in(1, 15) out(14 +0 blob) MB in(27.1, 477.8 +0.0 blob) out(478.0 +0.0 blob), read-write-amplify(36.3) write-amplify(17.6) OK, records in: 12915518, records dropped: 82381 output_compression: Snappy 2024/11/23-04:23:32.321731 140024768611904 (Original Log Time 2024/11/23-04:23:32.321700) EVENT_LOG_v1 {"time_micros": 1732307012321679, "cf": "default", "job": 19210, "event": "compaction_finished", "compaction_time_micros": 42839312, "compaction_time_cpu_micros": 19458351, "output_level": 3, "num_output_files": 14, "total_output_size": 501184751, "num_input_records": 12915518, "num_output_records": 12833137, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "file_write_nanos": 314341190, "file_range_sync_nanos": 0, "file_fsync_nanos": 13285, "file_prepare_write_nanos": 31200, "lsm_state": [0, 0, 0, 14, 0, 0, 0]} 2024/11/23-04:23:32.455281 140024768611904 DEBG dcompact_worker.cpp:240: HttpPost: 200 OK: url = http://nlb-7zny4kaa1poal01o64.cn-shenzhen.nlb.aliyuncs.com:8443, body = {"instanceId":"nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137","labourId":"","dbId":"d89b4006-2803-486e-b7a2-759bcf348921","dbStarts":1732256054,"starts":1732306969,"executesMs":43102,"compactionJobId":19210,"attempt":0,"compactionInputRawBytes":1843929049,"compactionInputZipBytes":529397875,"compactionOutputRawBytes":0,"compactionOutputZipBytes":501184751,"headers":{"Accept":"*/*","Connection":"close","Host":"aliyun-topling-saas.topling.cn:18443","RemoteIp":"120.24.192.169","X-Forwarded-For":"120.24.192.169","region":"cn-shenzhen","token":"e6474c481bd4415abc537135cc03626b","instance-token":"e6474c481bd4415abc537135cc03626b","provider":"aliyun","CloudMarketInstanceId":"si-59c0ae5c955845588903","MeteringAssit":"","Transfer-Encoding":"chunked","traceparent":"00-617dcc4804e83945c296673ec658d7cf-ae118e9f90b7786d-00"}}, response = 2024/11/23-04:23:32.455341 140024768611904 INFO dcompact_worker.cpp:1459: finish /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-19210/att-00: olev 3, work 43.102 s, result 6.332 ms, install 1.770 ms, input{raw 1.717 GiB zip 504.873 MiB}