2024/11/24-04:55:09.595603 139957659977280 DEBG dcompact_worker.cpp:2214: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00: fork to child time = 0.007634 sec 2024/11/24-04:55:09.596373 139957659977280 DEBG dcompact_worker.cpp:1013: Beg SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00 2024/11/24-04:55:09.601827 139957659977280 DEBG dcompact_worker.cpp:1033: End SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00 2024/11/24-04:55:09.602708 139957659977280 TRAC dcompact_worker.cpp:1083: INFO_LOG_LEVEL: rpc = INFO_LEVEL, env_var = undefined 2024/11/24-04:55:09.602951 139957659977280 [WARN] [column_family.cc:386] multiple cf_paths/db_paths and level_compaction_dynamic_level_bytes can't be used together 2024/11/24-04:55:09.655849 139957659977280 [version_set.cc:6208] Recovering from manifest file: /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-41847/att-00/MANIFEST-206347 2024/11/24-04:55:09.681292 139957659977280 [version_set.cc:6251] Recovered from manifest file:/worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-41847/att-00/MANIFEST-206347 succeeded,manifest_file_number is 206347, next_file_number is 292683, last_sequence is 4448681773, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 292514 2024/11/24-04:55:09.681298 139957659977280 [version_set.cc:6266] Column family [default] (ID 0), log number is 0 2024/11/24-04:55:09.681412 139957659977280 [version_set.cc:5721] Creating manifest 292683 2024/11/24-04:55:09.712705 139957659977280 DEBG dcompact_worker.cpp:1218: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00: bottommost_level: fake = 1, rpc = 0 2024/11/24-04:55:09.749179 139957659977280 [compaction_job.cc:2437] [default] [JOB 41847] Compacting 1@2 + 21@3 files to L3, score 0.71, subcompactions 1 : 1 2024/11/24-04:55:09.749194 139957659977280 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 31369 Base level 2, inputs: [292661(27MB)], [292597(35MB) 292598(34MB) 292599(33MB) 292600(35MB) 292601(30MB) 292602(32MB) 292603(33MB) 292604(30MB) 292605(35MB) 292606(33MB) 292607(35MB) 292608(33MB) 292609(35MB) 292610(33MB) 292611(34MB) 292612(33MB) 292613(33MB) 292614(33MB) 292615(32MB) 292616(33MB) 292676(32MB)] 2024/11/24-04:55:09.755826 139957659977280 [top_zip_table.cc:59] core git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/24-04:55:09.755854 139957659977280 [top_zip_table.cc:60] fsa git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/24-04:55:09.755874 139957659977280 [top_zip_table.cc:61] zbs git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/24-04:55:09.755879 139957659977280 [top_zip_table.cc:62] topling-zip_table_reader: git_version_hash_info_is: commit a4a382006cb82713acf5b3425835f22711877681 Author: leipeng Date: 2024-04-11 19:44:14 +0800 fixed_len_hole_index.cc: Add env bool FixedLenHoleIndexUseAVX512 for ut & debug 1. FixedLenHoleIndexUseAVX512 is only in unit tests or debug 2. In release mode, use avx512 by compile options(-march=) g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/24-04:55:09.755890 139957659977280 [top_zip_table.cc:64] topling-rocks git_version_hash_info_is: commit feab587e468621ba0204d47b4ffacc52e7c4290d Author: leipeng Date: 2024-03-22 13:35:06 +0800 ToplingZipTableBuilder::Add: immediately return after error This function returns void, and caller does not check builder->status() after calling this function and graceful abandon. So immediately return after error, and return error status in Finish(). g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/24-04:55:10.417912 139957659977280 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292684.sst) /dev/shm/ToplingTemp/Topling-274520-vLjKu7 2024/11/24-04:55:10.974614 139957659977280 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292684.sst): first pass time = 0.56's, 241.114'MB/sec 2024/11/24-04:55:12.631454 139957659977280 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292684.sst): old prealloc_size = 147639500, real_size = 33276384 2024/11/24-04:55:12.631953 139957659977280 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292684.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927303 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0313 GB avg-val = 116.74 avg-zval = 33.73 2024/11/24-04:55:12.632758 139957659977280 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292684.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-04:55:13.494196 139957659977280 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292684.sst): second pass time = 1.66's, 65.371'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.86's, 43.323'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3672.244'MB/sec (index lex order gen) rebuild zvType time = 0.73's, 0.315'MB/sec write SST data time = 0.13's, 293.570'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 28023.817'MB/sec zip my value time = 1.66's, unzip length = 0.108'GB zip my value throughput = 65.371'MB/sec zip pipeline throughput = 127.450'MB/sec entries = 927303 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.74 avg-zval = 33.73 usrkeys = 927303 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.74 avg-zval = 33.73 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 927303 bytes = 3245568 } seq expand size = 6491121 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0313 GB dict = 1.08 MB all = 0.0374 GB } UnZip/Zip{ index = 10.5134 value = 3.4607 dict = 1.00 all = 3.5910 } Zip/UnZip{ index = 0.0951 value = 0.2890 dict = 1.00 all = 0.2785 } ---------------------------- total value len = 2251.440318 GB avg = 0.200 KB (by entry num) total key len = 306.908927 GB avg = 0.027 KB total ukey len = 237.373273 GB avg = 0.015 KB total ukey num = 15.739588466 Billion total entry num = 11.280902414 Billion write speed all = 35.531996939 MB/sec (with seq num) write speed all = 34.278585612 MB/sec (without seq num) 2024/11/24-04:55:13.539910 139957659977280 [compaction_job.cc:1948] [default] [JOB 41847] Generated table #292684: 927303 keys, 37376102 bytes, temperature: kWarm 2024/11/24-04:55:13.540019 139957659977280 EVENT_LOG_v1 {"time_micros": 1732395313539947, "cf_name": "default", "job": 41847, "event": "table_file_creation", "file_number": 292684, "file_size": 37376102, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4265680199, "largest_seqno": 4448532202, "table_properties": {"data_size": 31280336, "index_size": 1764032, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25964484, "raw_average_key_size": 28, "raw_value_size": 108253262, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927303, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732395310, "oldest_key_time": 0, "file_creation_time": 1732395310, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 292684, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-04:55:13.576748 139957659977280 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292685.sst) /dev/shm/ToplingTemp/Topling-274520-Dkw2Q5 2024/11/24-04:55:14.454048 139957659977280 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292685.sst): first pass time = 0.88's, 152.996'MB/sec 2024/11/24-04:55:16.017944 139957659977280 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292685.sst): old prealloc_size = 147639500, real_size = 32111792 2024/11/24-04:55:16.018494 139957659977280 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292685.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 926988 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0301 GB avg-val = 116.79 avg-zval = 32.49 2024/11/24-04:55:16.019295 139957659977280 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292685.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-04:55:16.861429 139957659977280 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292685.sst): second pass time = 1.56's, 69.276'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.84's, 42.931'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3427.783'MB/sec (index lex order gen) rebuild zvType time = 0.71's, 0.325'MB/sec write SST data time = 0.13's, 279.273'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 27761.758'MB/sec zip my value time = 1.56's, unzip length = 0.108'GB zip my value throughput = 69.276'MB/sec zip pipeline throughput = 116.024'MB/sec entries = 926988 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.79 avg-zval = 32.49 usrkeys = 926988 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.79 avg-zval = 32.49 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 926988 bytes = 3244480 } seq expand size = 6488916 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0301 GB dict = 1.08 MB all = 0.0362 GB } UnZip/Zip{ index = 10.5160 value = 3.5947 dict = 1.00 all = 3.7066 } Zip/UnZip{ index = 0.0951 value = 0.2782 dict = 1.00 all = 0.2698 } ---------------------------- total value len = 2251.555069 GB avg = 0.200 KB (by entry num) total key len = 306.934883 GB avg = 0.027 KB total ukey len = 237.391813 GB avg = 0.015 KB total ukey num = 15.740515454 Billion total entry num = 11.281829402 Billion write speed all = 35.532289454 MB/sec (with seq num) write speed all = 34.278833750 MB/sec (without seq num) 2024/11/24-04:55:16.911862 139957659977280 [compaction_job.cc:1948] [default] [JOB 41847] Generated table #292685: 926988 keys, 36210594 bytes, temperature: kWarm 2024/11/24-04:55:16.911928 139957659977280 EVENT_LOG_v1 {"time_micros": 1732395316911893, "cf_name": "default", "job": 41847, "event": "table_file_creation", "file_number": 292685, "file_size": 36210594, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4265680212, "largest_seqno": 4448532218, "table_properties": {"data_size": 30116832, "index_size": 1763008, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25955664, "raw_average_key_size": 28, "raw_value_size": 108262164, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 926988, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732395313, "oldest_key_time": 0, "file_creation_time": 1732395313, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 292685, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-04:55:16.950009 139957659977280 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292686.sst) /dev/shm/ToplingTemp/Topling-274520-itFss8 2024/11/24-04:55:17.812561 139957659977280 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292686.sst): first pass time = 0.86's, 155.612'MB/sec 2024/11/24-04:55:19.345736 139957659977280 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292686.sst): old prealloc_size = 147639500, real_size = 31504832 2024/11/24-04:55:19.346333 139957659977280 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292686.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 919300 prefix = 4 raw-key = 0.0147 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1085 GB zip-val = 0.0295 GB avg-val = 118.00 avg-zval = 32.11 2024/11/24-04:55:19.347078 139957659977280 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292686.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-04:55:20.157599 139957659977280 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292686.sst): second pass time = 1.53's, 70.793'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.81's, 43.829'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3052.127'MB/sec (index lex order gen) rebuild zvType time = 0.69's, 0.335'MB/sec write SST data time = 0.12's, 285.173'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.085'MB, throughput = 33864.232'MB/sec zip my value time = 1.53's, unzip length = 0.108'GB zip my value throughput = 70.793'MB/sec zip pipeline throughput = 111.430'MB/sec entries = 919300 avg-key = 28.00 avg-zkey = 1.91 avg-val = 118.00 avg-zval = 32.11 usrkeys = 919300 avg-key = 20.00 avg-zkey = 1.91 avg-val = 125.00 avg-zval = 32.11 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 919300 bytes = 3217568 } seq expand size = 6435100 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0184 GB value = 0.1085 GB dict = 1.09 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0295 GB dict = 1.09 MB all = 0.0356 GB } UnZip/Zip{ index = 10.4455 value = 3.6754 dict = 1.00 all = 3.7721 } Zip/UnZip{ index = 0.0957 value = 0.2721 dict = 1.00 all = 0.2651 } ---------------------------- total value len = 2251.669981 GB avg = 0.200 KB (by entry num) total key len = 306.960623 GB avg = 0.027 KB total ukey len = 237.410199 GB avg = 0.015 KB total ukey num = 15.741434754 Billion total entry num = 11.282748702 Billion write speed all = 35.532616258 MB/sec (with seq num) write speed all = 34.279115798 MB/sec (without seq num) 2024/11/24-04:55:20.219246 139957659977280 [compaction_job.cc:1948] [default] [JOB 41847] Generated table #292686: 919300 keys, 35581554 bytes, temperature: kWarm 2024/11/24-04:55:20.219309 139957659977280 EVENT_LOG_v1 {"time_micros": 1732395320219275, "cf_name": "default", "job": 41847, "event": "table_file_creation", "file_number": 292686, "file_size": 35581554, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4287562852, "largest_seqno": 4439619791, "table_properties": {"data_size": 29514608, "index_size": 1760192, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25740400, "raw_average_key_size": 28, "raw_value_size": 108477400, "raw_average_value_size": 118, "num_data_blocks": 1, "num_entries": 919300, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 118, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732395316, "oldest_key_time": 0, "file_creation_time": 1732395316, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 292686, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-04:55:20.255113 139957659977280 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292687.sst) /dev/shm/ToplingTemp/Topling-274520-xBPy16 2024/11/24-04:55:21.148284 139957659977280 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292687.sst): first pass time = 0.89's, 150.277'MB/sec 2024/11/24-04:55:22.777190 139957659977280 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292687.sst): old prealloc_size = 147639500, real_size = 33502112 2024/11/24-04:55:22.777708 139957659977280 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292687.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927402 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1083 GB zip-val = 0.0315 GB avg-val = 116.72 avg-zval = 33.96 2024/11/24-04:55:22.778495 139957659977280 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292687.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-04:55:23.630525 139957659977280 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292687.sst): second pass time = 1.63's, 66.507'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.85's, 44.070'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3551.559'MB/sec (index lex order gen) rebuild zvType time = 0.73's, 0.320'MB/sec write SST data time = 0.13's, 295.584'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 28429.628'MB/sec zip my value time = 1.63's, unzip length = 0.108'GB zip my value throughput = 66.507'MB/sec zip pipeline throughput = 123.167'MB/sec entries = 927402 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.72 avg-zval = 33.96 usrkeys = 927402 avg-key = 20.00 avg-zkey = 1.91 avg-val = 123.72 avg-zval = 33.96 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 927402 bytes = 3245920 } seq expand size = 6491814 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0315 GB dict = 1.08 MB all = 0.0376 GB } UnZip/Zip{ index = 10.4452 value = 3.4371 dict = 1.00 all = 3.5691 } Zip/UnZip{ index = 0.0957 value = 0.2909 dict = 1.00 all = 0.2802 } ---------------------------- total value len = 2251.784723 GB avg = 0.200 KB (by entry num) total key len = 306.986590 GB avg = 0.027 KB total ukey len = 237.428747 GB avg = 0.015 KB total ukey num = 15.742362156 Billion total entry num = 11.283676104 Billion write speed all = 35.532856597 MB/sec (with seq num) write speed all = 34.279313561 MB/sec (without seq num) 2024/11/24-04:55:23.679155 139957659977280 [compaction_job.cc:1948] [default] [JOB 41847] Generated table #292687: 927402 keys, 37605782 bytes, temperature: kWarm 2024/11/24-04:55:23.679211 139957659977280 EVENT_LOG_v1 {"time_micros": 1732395323679180, "cf_name": "default", "job": 41847, "event": "table_file_creation", "file_number": 292687, "file_size": 37605782, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4265679834, "largest_seqno": 4448532401, "table_properties": {"data_size": 31494352, "index_size": 1775744, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25967256, "raw_average_key_size": 28, "raw_value_size": 108250496, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927402, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732395320, "oldest_key_time": 0, "file_creation_time": 1732395320, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 292687, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-04:55:23.715708 139957659977280 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292688.sst) /dev/shm/ToplingTemp/Topling-274520-FcAZw8 2024/11/24-04:55:24.547428 139957659977280 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292688.sst): first pass time = 0.83's, 161.380'MB/sec 2024/11/24-04:55:26.091500 139957659977280 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292688.sst): old prealloc_size = 147639500, real_size = 28360112 2024/11/24-04:55:26.092023 139957659977280 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292688.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 942320 prefix = 4 raw-key = 0.0151 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.93 raw-val = 0.1078 GB zip-val = 0.0263 GB avg-val = 114.43 avg-zval = 27.92 2024/11/24-04:55:26.092773 139957659977280 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292688.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0024 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-04:55:26.924074 139957659977280 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292688.sst): second pass time = 1.54's, 69.868'MB/sec, value only(80.3% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.83's, 39.040'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3600.889'MB/sec (index lex order gen) rebuild zvType time = 0.70's, 0.335'MB/sec write SST data time = 0.13's, 254.332'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.076'MB, throughput = 28674.024'MB/sec zip my value time = 1.54's, unzip length = 0.108'GB zip my value throughput = 69.868'MB/sec zip pipeline throughput = 138.637'MB/sec entries = 942320 avg-key = 28.00 avg-zkey = 1.93 avg-val = 114.43 avg-zval = 27.92 usrkeys = 942320 avg-key = 20.00 avg-zkey = 1.93 avg-val = 121.43 avg-zval = 27.92 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 942320 bytes = 3298128 } seq expand size = 6596240 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0188 GB value = 0.1078 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0263 GB dict = 1.08 MB all = 0.0325 GB } UnZip/Zip{ index = 10.3765 value = 4.0988 dict = 1.00 all = 4.1295 } Zip/UnZip{ index = 0.0964 value = 0.2440 dict = 1.00 all = 0.2422 } ---------------------------- total value len = 2251.899153 GB avg = 0.200 KB (by entry num) total key len = 307.012975 GB avg = 0.027 KB total ukey len = 237.447594 GB avg = 0.015 KB total ukey num = 15.743304476 Billion total entry num = 11.284618424 Billion write speed all = 35.533186879 MB/sec (with seq num) write speed all = 34.279596493 MB/sec (without seq num) 2024/11/24-04:55:26.972423 139957659977280 [compaction_job.cc:1948] [default] [JOB 41847] Generated table #292688: 942320 keys, 32502346 bytes, temperature: kWarm 2024/11/24-04:55:26.972481 139957659977280 EVENT_LOG_v1 {"time_micros": 1732395326972448, "cf_name": "default", "job": 41847, "event": "table_file_creation", "file_number": 292688, "file_size": 32502346, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4265680463, "largest_seqno": 4448531668, "table_properties": {"data_size": 26308064, "index_size": 1816256, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26384960, "raw_average_key_size": 28, "raw_value_size": 107832788, "raw_average_value_size": 114, "num_data_blocks": 1, "num_entries": 942320, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732395323, "oldest_key_time": 0, "file_creation_time": 1732395323, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 292688, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-04:55:27.006652 139957659977280 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292689.sst) /dev/shm/ToplingTemp/Topling-274520-ZI6XV4 2024/11/24-04:55:27.844265 139957659977280 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292689.sst): first pass time = 0.84's, 160.245'MB/sec 2024/11/24-04:55:29.407259 139957659977280 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292689.sst): old prealloc_size = 147639500, real_size = 29216704 2024/11/24-04:55:29.407795 139957659977280 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292689.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 942965 prefix = 4 raw-key = 0.0151 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1078 GB zip-val = 0.0272 GB avg-val = 114.34 avg-zval = 28.83 2024/11/24-04:55:29.408607 139957659977280 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292689.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0024 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-04:55:30.249650 139957659977280 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292689.sst): second pass time = 1.56's, 69.017'MB/sec, value only(80.3% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.84's, 39.605'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3491.835'MB/sec (index lex order gen) rebuild zvType time = 0.71's, 0.330'MB/sec write SST data time = 0.13's, 261.663'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.075'MB, throughput = 28897.930'MB/sec zip my value time = 1.56's, unzip length = 0.108'GB zip my value throughput = 69.017'MB/sec zip pipeline throughput = 122.740'MB/sec entries = 942965 avg-key = 28.00 avg-zkey = 1.90 avg-val = 114.34 avg-zval = 28.83 usrkeys = 942965 avg-key = 20.00 avg-zkey = 1.90 avg-val = 121.34 avg-zval = 28.83 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 942965 bytes = 3300400 } seq expand size = 6600755 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0189 GB value = 0.1078 GB dict = 1.07 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0272 GB dict = 1.07 MB all = 0.0334 GB } UnZip/Zip{ index = 10.5129 value = 3.9657 dict = 1.00 all = 4.0231 } Zip/UnZip{ index = 0.0951 value = 0.2522 dict = 1.00 all = 0.2486 } ---------------------------- total value len = 2252.013568 GB avg = 0.200 KB (by entry num) total key len = 307.039378 GB avg = 0.027 KB total ukey len = 237.466453 GB avg = 0.015 KB total ukey num = 15.744247441 Billion total entry num = 11.285561389 Billion write speed all = 35.533501386 MB/sec (with seq num) write speed all = 34.279864139 MB/sec (without seq num) 2024/11/24-04:55:30.291921 139957659977280 [compaction_job.cc:1948] [default] [JOB 41847] Generated table #292689: 942965 keys, 33361962 bytes, temperature: kWarm 2024/11/24-04:55:30.292003 139957659977280 EVENT_LOG_v1 {"time_micros": 1732395330291955, "cf_name": "default", "job": 41847, "event": "table_file_creation", "file_number": 292689, "file_size": 33361962, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4265679848, "largest_seqno": 4448530484, "table_properties": {"data_size": 27186864, "index_size": 1793920, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26403020, "raw_average_key_size": 28, "raw_value_size": 107814770, "raw_average_value_size": 114, "num_data_blocks": 1, "num_entries": 942965, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732395326, "oldest_key_time": 0, "file_creation_time": 1732395326, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 292689, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-04:55:30.330786 139957659977280 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292690.sst) /dev/shm/ToplingTemp/Topling-274520-SYQEN7 2024/11/24-04:55:31.175625 139957659977280 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292690.sst): first pass time = 0.84's, 158.875'MB/sec 2024/11/24-04:55:32.677456 139957659977280 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292690.sst): old prealloc_size = 147639500, real_size = 31515440 2024/11/24-04:55:32.678013 139957659977280 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292690.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 919300 prefix = 4 raw-key = 0.0147 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1085 GB zip-val = 0.0295 GB avg-val = 118.00 avg-zval = 32.12 2024/11/24-04:55:32.678762 139957659977280 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292690.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-04:55:33.501281 139957659977280 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292690.sst): second pass time = 1.50's, 72.274'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.82's, 43.205'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3309.590'MB/sec (index lex order gen) rebuild zvType time = 0.70's, 0.330'MB/sec write SST data time = 0.13's, 282.803'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.085'MB, throughput = 34411.989'MB/sec zip my value time = 1.50's, unzip length = 0.108'GB zip my value throughput = 72.274'MB/sec zip pipeline throughput = 98.196'MB/sec entries = 919300 avg-key = 28.00 avg-zkey = 1.91 avg-val = 118.00 avg-zval = 32.12 usrkeys = 919300 avg-key = 20.00 avg-zkey = 1.91 avg-val = 125.00 avg-zval = 32.12 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 919300 bytes = 3217568 } seq expand size = 6435100 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0184 GB value = 0.1085 GB dict = 1.09 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0295 GB dict = 1.09 MB all = 0.0356 GB } UnZip/Zip{ index = 10.4443 value = 3.6741 dict = 1.00 all = 3.7710 } Zip/UnZip{ index = 0.0957 value = 0.2722 dict = 1.00 all = 0.2652 } ---------------------------- total value len = 2252.128481 GB avg = 0.200 KB (by entry num) total key len = 307.065119 GB avg = 0.027 KB total ukey len = 237.484839 GB avg = 0.015 KB total ukey num = 15.745166741 Billion total entry num = 11.286480689 Billion write speed all = 35.533850050 MB/sec (with seq num) write speed all = 34.280167289 MB/sec (without seq num) 2024/11/24-04:55:33.546150 139957659977280 [compaction_job.cc:1948] [default] [JOB 41847] Generated table #292690: 919300 keys, 35592178 bytes, temperature: kWarm 2024/11/24-04:55:33.546216 139957659977280 EVENT_LOG_v1 {"time_micros": 1732395333546184, "cf_name": "default", "job": 41847, "event": "table_file_creation", "file_number": 292690, "file_size": 35592178, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4276737465, "largest_seqno": 4421680988, "table_properties": {"data_size": 29525024, "index_size": 1760384, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25740400, "raw_average_key_size": 28, "raw_value_size": 108477400, "raw_average_value_size": 118, "num_data_blocks": 1, "num_entries": 919300, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 118, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732395330, "oldest_key_time": 0, "file_creation_time": 1732395330, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 292690, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-04:55:33.581406 139957659977280 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292691.sst) /dev/shm/ToplingTemp/Topling-274520-ZzRiW6 2024/11/24-04:55:34.489727 139957659977280 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292691.sst): first pass time = 0.91's, 147.771'MB/sec 2024/11/24-04:55:35.973479 139957659977280 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292691.sst): old prealloc_size = 147639500, real_size = 28659200 2024/11/24-04:55:35.974032 139957659977280 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292691.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 940614 prefix = 4 raw-key = 0.0150 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.93 raw-val = 0.1079 GB zip-val = 0.0266 GB avg-val = 114.69 avg-zval = 28.29 2024/11/24-04:55:35.974774 139957659977280 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292691.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0024 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-04:55:36.805022 139957659977280 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292691.sst): second pass time = 1.48's, 72.747'MB/sec, value only(80.4% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.83's, 39.302'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3415.790'MB/sec (index lex order gen) rebuild zvType time = 0.70's, 0.334'MB/sec write SST data time = 0.13's, 255.877'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.076'MB, throughput = 37132.735'MB/sec zip my value time = 1.48's, unzip length = 0.108'GB zip my value throughput = 72.747'MB/sec zip pipeline throughput = 88.139'MB/sec entries = 940614 avg-key = 28.00 avg-zkey = 1.93 avg-val = 114.69 avg-zval = 28.29 usrkeys = 940614 avg-key = 20.00 avg-zkey = 1.93 avg-val = 121.69 avg-zval = 28.29 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 940614 bytes = 3174592 } seq expand size = 6584298 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0188 GB value = 0.1079 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0266 GB dict = 1.08 MB all = 0.0327 GB } UnZip/Zip{ index = 10.3749 value = 4.0540 dict = 1.00 all = 4.1071 } Zip/UnZip{ index = 0.0964 value = 0.2467 dict = 1.00 all = 0.2435 } ---------------------------- total value len = 2252.242945 GB avg = 0.200 KB (by entry num) total key len = 307.091456 GB avg = 0.027 KB total ukey len = 237.503651 GB avg = 0.015 KB total ukey num = 15.746107355 Billion total entry num = 11.287421303 Billion write speed all = 35.534175051 MB/sec (with seq num) write speed all = 34.280445318 MB/sec (without seq num) 2024/11/24-04:55:36.847550 139957659977280 [compaction_job.cc:1948] [default] [JOB 41847] Generated table #292691: 940614 keys, 32679182 bytes, temperature: kWarm 2024/11/24-04:55:36.847620 139957659977280 EVENT_LOG_v1 {"time_micros": 1732395336847584, "cf_name": "default", "job": 41847, "event": "table_file_creation", "file_number": 292691, "file_size": 32679182, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4329977204, "largest_seqno": 4448531682, "table_properties": {"data_size": 26610608, "index_size": 1813248, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26337192, "raw_average_key_size": 28, "raw_value_size": 107880596, "raw_average_value_size": 114, "num_data_blocks": 1, "num_entries": 940614, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732395333, "oldest_key_time": 0, "file_creation_time": 1732395333, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 292691, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-04:55:36.884852 139957659977280 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292692.sst) /dev/shm/ToplingTemp/Topling-274520-1VdhE8 2024/11/24-04:55:37.810678 139957659977280 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292692.sst): first pass time = 0.93's, 144.978'MB/sec 2024/11/24-04:55:39.466017 139957659977280 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292692.sst): old prealloc_size = 147639500, real_size = 32988816 2024/11/24-04:55:39.466597 139957659977280 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292692.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927870 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1082 GB zip-val = 0.0310 GB avg-val = 116.65 avg-zval = 33.39 2024/11/24-04:55:39.468418 139957659977280 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292692.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-04:55:40.326767 139957659977280 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292692.sst): second pass time = 1.65's, 65.422'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.86's, 43.091'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3237.665'MB/sec (index lex order gen) rebuild zvType time = 0.73's, 0.317'MB/sec write SST data time = 0.13's, 289.536'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 31620.208'MB/sec zip my value time = 1.65's, unzip length = 0.108'GB zip my value throughput = 65.422'MB/sec zip pipeline throughput = 121.623'MB/sec entries = 927870 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.65 avg-zval = 33.39 usrkeys = 927870 avg-key = 20.00 avg-zkey = 1.91 avg-val = 123.65 avg-zval = 33.39 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 927870 bytes = 3247552 } seq expand size = 6495090 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0310 GB dict = 1.08 MB all = 0.0371 GB } UnZip/Zip{ index = 10.4467 value = 3.4938 dict = 1.00 all = 3.6187 } Zip/UnZip{ index = 0.0957 value = 0.2862 dict = 1.00 all = 0.2763 } ---------------------------- total value len = 2252.357678 GB avg = 0.200 KB (by entry num) total key len = 307.117436 GB avg = 0.027 KB total ukey len = 237.522209 GB avg = 0.015 KB total ukey num = 15.747035225 Billion total entry num = 11.288349173 Billion write speed all = 35.534391216 MB/sec (with seq num) write speed all = 34.280619726 MB/sec (without seq num) 2024/11/24-04:55:40.384835 139957659977280 [compaction_job.cc:1948] [default] [JOB 41847] Generated table #292692: 927870 keys, 37089864 bytes, temperature: kWarm 2024/11/24-04:55:40.384939 139957659977280 EVENT_LOG_v1 {"time_micros": 1732395340384886, "cf_name": "default", "job": 41847, "event": "table_file_creation", "file_number": 292692, "file_size": 37089864, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4265679865, "largest_seqno": 4448528839, "table_properties": {"data_size": 30980288, "index_size": 1776384, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25980360, "raw_average_key_size": 28, "raw_value_size": 108237492, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927870, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732395336, "oldest_key_time": 0, "file_creation_time": 1732395336, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 292692, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-04:55:40.428415 139957659977280 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292693.sst) /dev/shm/ToplingTemp/Topling-274520-gXwZW8 2024/11/24-04:55:41.342431 139957659977280 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292693.sst): first pass time = 0.91's, 146.851'MB/sec 2024/11/24-04:55:42.661756 139957659977280 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292693.sst): old prealloc_size = 147639500, real_size = 31197968 2024/11/24-04:55:42.662326 139957659977280 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292693.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 922191 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1084 GB zip-val = 0.0292 GB avg-val = 117.54 avg-zval = 31.67 2024/11/24-04:55:42.664120 139957659977280 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292693.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-04:55:43.476461 139957659977280 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292693.sst): second pass time = 1.32's, 82.212'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.81's, 43.167'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3237.279'MB/sec (index lex order gen) rebuild zvType time = 0.69's, 0.336'MB/sec write SST data time = 0.13's, 275.992'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.083'MB, throughput = 34178.170'MB/sec zip my value time = 1.32's, unzip length = 0.108'GB zip my value throughput = 82.212'MB/sec zip pipeline throughput = 82.212'MB/sec entries = 922191 avg-key = 28.00 avg-zkey = 1.91 avg-val = 117.54 avg-zval = 31.67 usrkeys = 922191 avg-key = 20.00 avg-zkey = 1.91 avg-val = 124.54 avg-zval = 31.67 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 922191 bytes = 3112416 } seq expand size = 6455337 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0184 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0292 GB dict = 1.08 MB all = 0.0352 GB } UnZip/Zip{ index = 10.4441 value = 3.7120 dict = 1.00 all = 3.8166 } Zip/UnZip{ index = 0.0957 value = 0.2694 dict = 1.00 all = 0.2620 } ---------------------------- total value len = 2252.472530 GB avg = 0.200 KB (by entry num) total key len = 307.143258 GB avg = 0.027 KB total ukey len = 237.540652 GB avg = 0.015 KB total ukey num = 15.747957416 Billion total entry num = 11.289271364 Billion write speed all = 35.534790358 MB/sec (with seq num) write speed all = 34.280971271 MB/sec (without seq num) 2024/11/24-04:55:43.520440 139957659977280 [compaction_job.cc:1948] [default] [JOB 41847] Generated table #292693: 922191 keys, 35167240 bytes, temperature: kWarm 2024/11/24-04:55:43.520509 139957659977280 EVENT_LOG_v1 {"time_micros": 1732395343520474, "cf_name": "default", "job": 41847, "event": "table_file_creation", "file_number": 292693, "file_size": 35167240, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4342093708, "largest_seqno": 4448531698, "table_properties": {"data_size": 29201280, "index_size": 1765952, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25821348, "raw_average_key_size": 28, "raw_value_size": 108396514, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 922191, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732395340, "oldest_key_time": 0, "file_creation_time": 1732395340, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 292693, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-04:55:43.558876 139957659977280 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292694.sst) /dev/shm/ToplingTemp/Topling-274520-ICzo08 2024/11/24-04:55:44.585842 139957659977280 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292694.sst): first pass time = 1.03's, 130.699'MB/sec 2024/11/24-04:55:45.923227 139957659977280 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292694.sst): old prealloc_size = 147639500, real_size = 32562880 2024/11/24-04:55:45.923783 139957659977280 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292694.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 933214 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1081 GB zip-val = 0.0306 GB avg-val = 115.82 avg-zval = 32.74 2024/11/24-04:55:45.924595 139957659977280 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292694.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-04:55:46.792384 139957659977280 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292694.sst): second pass time = 1.34's, 80.869'MB/sec, value only(80.5% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.87's, 42.202'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3407.481'MB/sec (index lex order gen) rebuild zvType time = 0.74's, 0.315'MB/sec write SST data time = 0.13's, 288.176'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 34974.039'MB/sec zip my value time = 1.34's, unzip length = 0.108'GB zip my value throughput = 80.869'MB/sec zip pipeline throughput = 80.869'MB/sec entries = 933214 avg-key = 28.00 avg-zkey = 1.90 avg-val = 115.82 avg-zval = 32.74 usrkeys = 933214 avg-key = 20.00 avg-zkey = 1.90 avg-val = 122.82 avg-zval = 32.74 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 933214 bytes = 3266256 } seq expand size = 6532498 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0187 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0306 GB dict = 1.08 MB all = 0.0367 GB } UnZip/Zip{ index = 10.5107 value = 3.5376 dict = 1.00 all = 3.6592 } Zip/UnZip{ index = 0.0951 value = 0.2827 dict = 1.00 all = 0.2733 } ---------------------------- total value len = 2252.587150 GB avg = 0.200 KB (by entry num) total key len = 307.169388 GB avg = 0.027 KB total ukey len = 237.559317 GB avg = 0.015 KB total ukey num = 15.748890630 Billion total entry num = 11.290204578 Billion write speed all = 35.535108532 MB/sec (with seq num) write speed all = 34.281243520 MB/sec (without seq num) 2024/11/24-04:55:46.837882 139957659977280 [compaction_job.cc:1948] [default] [JOB 41847] Generated table #292694: 933214 keys, 36679504 bytes, temperature: kWarm 2024/11/24-04:55:46.837958 139957659977280 EVENT_LOG_v1 {"time_micros": 1732395346837918, "cf_name": "default", "job": 41847, "event": "table_file_creation", "file_number": 292694, "file_size": 36679504, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4265679880, "largest_seqno": 4448531851, "table_properties": {"data_size": 30553648, "index_size": 1775744, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26129992, "raw_average_key_size": 28, "raw_value_size": 108087736, "raw_average_value_size": 115, "num_data_blocks": 1, "num_entries": 933214, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732395343, "oldest_key_time": 0, "file_creation_time": 1732395343, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 292694, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-04:55:46.884484 139957659977280 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292695.sst) /dev/shm/ToplingTemp/Topling-274520-o6E9w7 2024/11/24-04:55:47.828859 139957659977280 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292695.sst): first pass time = 0.94's, 142.129'MB/sec 2024/11/24-04:55:49.150475 139957659977280 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292695.sst): old prealloc_size = 147639500, real_size = 31359072 2024/11/24-04:55:49.151044 139957659977280 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292695.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 919300 prefix = 4 raw-key = 0.0147 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1085 GB zip-val = 0.0294 GB avg-val = 118.00 avg-zval = 31.95 2024/11/24-04:55:49.151791 139957659977280 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292695.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-04:55:49.958209 139957659977280 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292695.sst): second pass time = 1.32's, 82.134'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.81's, 43.730'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3216.595'MB/sec (index lex order gen) rebuild zvType time = 0.68's, 0.336'MB/sec write SST data time = 0.12's, 287.060'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.085'MB, throughput = 33375.681'MB/sec zip my value time = 1.32's, unzip length = 0.108'GB zip my value throughput = 82.134'MB/sec zip pipeline throughput = 82.134'MB/sec entries = 919300 avg-key = 28.00 avg-zkey = 1.91 avg-val = 118.00 avg-zval = 31.95 usrkeys = 919300 avg-key = 20.00 avg-zkey = 1.91 avg-val = 125.00 avg-zval = 31.95 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 919300 bytes = 3102656 } seq expand size = 6435100 multi value expand size = 0 cnt WriteAppend = 11 UnZipSize{ index = 0.0184 GB value = 0.1085 GB dict = 1.09 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0294 GB dict = 1.09 MB all = 0.0353 GB } UnZip/Zip{ index = 10.4447 value = 3.6936 dict = 1.00 all = 3.8000 } Zip/UnZip{ index = 0.0957 value = 0.2707 dict = 1.00 all = 0.2632 } ---------------------------- total value len = 2252.702063 GB avg = 0.200 KB (by entry num) total key len = 307.195128 GB avg = 0.027 KB total ukey len = 237.577703 GB avg = 0.015 KB total ukey num = 15.749809930 Billion total entry num = 11.291123878 Billion write speed all = 35.535499368 MB/sec (with seq num) write speed all = 34.281587369 MB/sec (without seq num) 2024/11/24-04:55:50.001342 139957659977280 [compaction_job.cc:1948] [default] [JOB 41847] Generated table #292695: 919300 keys, 35320882 bytes, temperature: kWarm 2024/11/24-04:55:50.001413 139957659977280 EVENT_LOG_v1 {"time_micros": 1732395350001378, "cf_name": "default", "job": 41847, "event": "table_file_creation", "file_number": 292695, "file_size": 35320882, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4315158107, "largest_seqno": 4426945415, "table_properties": {"data_size": 29368720, "index_size": 1760320, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25740400, "raw_average_key_size": 28, "raw_value_size": 108477400, "raw_average_value_size": 118, "num_data_blocks": 1, "num_entries": 919300, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 118, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732395346, "oldest_key_time": 0, "file_creation_time": 1732395346, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 292695, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-04:55:50.037098 139957659977280 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292696.sst) /dev/shm/ToplingTemp/Topling-274520-wCmNY6 2024/11/24-04:55:51.040894 139957659977280 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292696.sst): first pass time = 1.00's, 133.716'MB/sec 2024/11/24-04:55:52.377553 139957659977280 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292696.sst): old prealloc_size = 147639500, real_size = 32305184 2024/11/24-04:55:52.378156 139957659977280 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292696.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 932435 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1081 GB zip-val = 0.0303 GB avg-val = 115.94 avg-zval = 32.49 2024/11/24-04:55:52.378941 139957659977280 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292696.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-04:55:53.233429 139957659977280 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292696.sst): second pass time = 1.34's, 80.927'MB/sec, value only(80.5% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.86's, 42.554'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3064.145'MB/sec (index lex order gen) rebuild zvType time = 0.73's, 0.320'MB/sec write SST data time = 0.13's, 288.509'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 22198.332'MB/sec zip my value time = 1.34's, unzip length = 0.108'GB zip my value throughput = 80.927'MB/sec zip pipeline throughput = 80.927'MB/sec entries = 932435 avg-key = 28.00 avg-zkey = 1.90 avg-val = 115.94 avg-zval = 32.49 usrkeys = 932435 avg-key = 20.00 avg-zkey = 1.90 avg-val = 122.94 avg-zval = 32.49 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 932435 bytes = 3263536 } seq expand size = 6527045 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0186 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0303 GB dict = 1.08 MB all = 0.0364 GB } UnZip/Zip{ index = 10.5137 value = 3.5682 dict = 1.00 all = 3.6853 } Zip/UnZip{ index = 0.0951 value = 0.2803 dict = 1.00 all = 0.2713 } ---------------------------- total value len = 2252.816699 GB avg = 0.200 KB (by entry num) total key len = 307.221236 GB avg = 0.027 KB total ukey len = 237.596351 GB avg = 0.015 KB total ukey num = 15.750742365 Billion total entry num = 11.292056313 Billion write speed all = 35.535837485 MB/sec (with seq num) write speed all = 34.281878948 MB/sec (without seq num) 2024/11/24-04:55:53.277674 139957659977280 [compaction_job.cc:1948] [default] [JOB 41847] Generated table #292696: 932435 keys, 36419454 bytes, temperature: kWarm 2024/11/24-04:55:53.277744 139957659977280 EVENT_LOG_v1 {"time_micros": 1732395353277709, "cf_name": "default", "job": 41847, "event": "table_file_creation", "file_number": 292696, "file_size": 36419454, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4265679891, "largest_seqno": 4448531711, "table_properties": {"data_size": 30298128, "index_size": 1773760, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26108180, "raw_average_key_size": 28, "raw_value_size": 108109598, "raw_average_value_size": 115, "num_data_blocks": 1, "num_entries": 932435, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732395350, "oldest_key_time": 0, "file_creation_time": 1732395350, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 292696, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-04:55:53.316023 139957659977280 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292697.sst) /dev/shm/ToplingTemp/Topling-274520-QuzFc5 2024/11/24-04:55:54.277808 139957659977280 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292697.sst): first pass time = 0.96's, 139.558'MB/sec 2024/11/24-04:55:55.578549 139957659977280 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292697.sst): old prealloc_size = 147639500, real_size = 31382032 2024/11/24-04:55:55.579093 139957659977280 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292697.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 919300 prefix = 4 raw-key = 0.0147 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1085 GB zip-val = 0.0294 GB avg-val = 118.00 avg-zval = 31.97 2024/11/24-04:55:55.579866 139957659977280 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292697.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-04:55:56.386039 139957659977280 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292697.sst): second pass time = 1.30's, 83.451'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.81's, 43.772'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3371.505'MB/sec (index lex order gen) rebuild zvType time = 0.68's, 0.336'MB/sec write SST data time = 0.12's, 287.351'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.085'MB, throughput = 32897.035'MB/sec zip my value time = 1.30's, unzip length = 0.108'GB zip my value throughput = 83.451'MB/sec zip pipeline throughput = 83.451'MB/sec entries = 919300 avg-key = 28.00 avg-zkey = 1.91 avg-val = 118.00 avg-zval = 31.97 usrkeys = 919300 avg-key = 20.00 avg-zkey = 1.91 avg-val = 125.00 avg-zval = 31.97 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 919300 bytes = 3102656 } seq expand size = 6435100 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0184 GB value = 0.1085 GB dict = 1.09 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0294 GB dict = 1.09 MB all = 0.0353 GB } UnZip/Zip{ index = 10.4462 value = 3.6907 dict = 1.00 all = 3.7975 } Zip/UnZip{ index = 0.0957 value = 0.2709 dict = 1.00 all = 0.2633 } ---------------------------- total value len = 2252.931612 GB avg = 0.199 KB (by entry num) total key len = 307.246977 GB avg = 0.027 KB total ukey len = 237.614737 GB avg = 0.015 KB total ukey num = 15.751661665 Billion total entry num = 11.292975613 Billion write speed all = 35.536234781 MB/sec (with seq num) write speed all = 34.282229035 MB/sec (without seq num) 2024/11/24-04:55:56.429555 139957659977280 [compaction_job.cc:1948] [default] [JOB 41847] Generated table #292697: 919300 keys, 35343858 bytes, temperature: kWarm 2024/11/24-04:55:56.429626 139957659977280 EVENT_LOG_v1 {"time_micros": 1732395356429589, "cf_name": "default", "job": 41847, "event": "table_file_creation", "file_number": 292697, "file_size": 35343858, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4297259161, "largest_seqno": 4407227450, "table_properties": {"data_size": 29391936, "index_size": 1760064, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25740400, "raw_average_key_size": 28, "raw_value_size": 108477400, "raw_average_value_size": 118, "num_data_blocks": 1, "num_entries": 919300, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 118, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732395353, "oldest_key_time": 0, "file_creation_time": 1732395353, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 292697, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-04:55:56.464882 139957659977280 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292698.sst) /dev/shm/ToplingTemp/Topling-274520-xphPi6 2024/11/24-04:55:57.459612 139957659977280 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292698.sst): first pass time = 0.99's, 134.934'MB/sec 2024/11/24-04:55:58.784184 139957659977280 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292698.sst): old prealloc_size = 147639500, real_size = 31806560 2024/11/24-04:55:58.784746 139957659977280 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292698.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 931402 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1081 GB zip-val = 0.0298 GB avg-val = 116.10 avg-zval = 32.00 2024/11/24-04:55:58.785563 139957659977280 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292698.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-04:55:59.628307 139957659977280 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292698.sst): second pass time = 1.32's, 81.752'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.84's, 42.551'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3358.583'MB/sec (index lex order gen) rebuild zvType time = 0.72's, 0.325'MB/sec write SST data time = 0.13's, 284.963'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 33017.115'MB/sec zip my value time = 1.32's, unzip length = 0.108'GB zip my value throughput = 81.752'MB/sec zip pipeline throughput = 81.752'MB/sec entries = 931402 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.10 avg-zval = 32.00 usrkeys = 931402 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.10 avg-zval = 32.00 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 931402 bytes = 3259920 } seq expand size = 6519814 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0186 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0298 GB dict = 1.08 MB all = 0.0359 GB } UnZip/Zip{ index = 10.5126 value = 3.6286 dict = 1.00 all = 3.7368 } Zip/UnZip{ index = 0.0951 value = 0.2756 dict = 1.00 all = 0.2676 } ---------------------------- total value len = 2253.046270 GB avg = 0.199 KB (by entry num) total key len = 307.273056 GB avg = 0.027 KB total ukey len = 237.633365 GB avg = 0.015 KB total ukey num = 15.752593067 Billion total entry num = 11.293907015 Billion write speed all = 35.536588976 MB/sec (with seq num) write speed all = 34.282536241 MB/sec (without seq num) 2024/11/24-04:55:59.671759 139957659977280 [compaction_job.cc:1948] [default] [JOB 41847] Generated table #292698: 931402 keys, 35917812 bytes, temperature: kWarm 2024/11/24-04:55:59.671830 139957659977280 EVENT_LOG_v1 {"time_micros": 1732395359671795, "cf_name": "default", "job": 41847, "event": "table_file_creation", "file_number": 292698, "file_size": 35917812, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4265679902, "largest_seqno": 4448531722, "table_properties": {"data_size": 29801552, "index_size": 1771968, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26079256, "raw_average_key_size": 28, "raw_value_size": 108138528, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 931402, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732395356, "oldest_key_time": 0, "file_creation_time": 1732395356, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 292698, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-04:55:59.708475 139957659977280 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292699.sst) /dev/shm/ToplingTemp/Topling-274520-XDv2G8 2024/11/24-04:56:00.550985 139957659977280 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292699.sst): first pass time = 0.84's, 159.317'MB/sec 2024/11/24-04:56:01.848940 139957659977280 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292699.sst): old prealloc_size = 147639500, real_size = 31381360 2024/11/24-04:56:01.849494 139957659977280 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292699.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 919300 prefix = 4 raw-key = 0.0147 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1085 GB zip-val = 0.0294 GB avg-val = 118.00 avg-zval = 31.97 2024/11/24-04:56:01.852077 139957659977280 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292699.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-04:56:02.666358 139957659977280 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292699.sst): second pass time = 1.30's, 83.628'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.82's, 43.240'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3430.119'MB/sec (index lex order gen) rebuild zvType time = 0.69's, 0.334'MB/sec write SST data time = 0.13's, 274.531'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.085'MB, throughput = 31433.165'MB/sec zip my value time = 1.30's, unzip length = 0.108'GB zip my value throughput = 83.628'MB/sec zip pipeline throughput = 83.628'MB/sec entries = 919300 avg-key = 28.00 avg-zkey = 1.91 avg-val = 118.00 avg-zval = 31.97 usrkeys = 919300 avg-key = 20.00 avg-zkey = 1.91 avg-val = 125.00 avg-zval = 31.97 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 919300 bytes = 3102656 } seq expand size = 6435100 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0184 GB value = 0.1085 GB dict = 1.09 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0294 GB dict = 1.09 MB all = 0.0353 GB } UnZip/Zip{ index = 10.4458 value = 3.6908 dict = 1.00 all = 3.7976 } Zip/UnZip{ index = 0.0957 value = 0.2709 dict = 1.00 all = 0.2633 } ---------------------------- total value len = 2253.161183 GB avg = 0.199 KB (by entry num) total key len = 307.298796 GB avg = 0.027 KB total ukey len = 237.651751 GB avg = 0.015 KB total ukey num = 15.753512367 Billion total entry num = 11.294826315 Billion write speed all = 35.537042707 MB/sec (with seq num) write speed all = 34.282940777 MB/sec (without seq num) 2024/11/24-04:56:02.710507 139957659977280 [compaction_job.cc:1948] [default] [JOB 41847] Generated table #292699: 919300 keys, 35343218 bytes, temperature: kWarm 2024/11/24-04:56:02.710580 139957659977280 EVENT_LOG_v1 {"time_micros": 1732395362710543, "cf_name": "default", "job": 41847, "event": "table_file_creation", "file_number": 292699, "file_size": 35343218, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4282822056, "largest_seqno": 4391990709, "table_properties": {"data_size": 29391200, "index_size": 1760128, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25740400, "raw_average_key_size": 28, "raw_value_size": 108477400, "raw_average_value_size": 118, "num_data_blocks": 1, "num_entries": 919300, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 118, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732395359, "oldest_key_time": 0, "file_creation_time": 1732395359, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 292699, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-04:56:02.747551 139957659977280 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292700.sst) /dev/shm/ToplingTemp/Topling-274520-FAcfY5 2024/11/24-04:56:03.762285 139957659977280 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292700.sst): first pass time = 1.01's, 132.277'MB/sec 2024/11/24-04:56:05.054698 139957659977280 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292700.sst): old prealloc_size = 147639500, real_size = 30383360 2024/11/24-04:56:05.055323 139957659977280 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292700.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 931556 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1081 GB zip-val = 0.0284 GB avg-val = 116.08 avg-zval = 30.46 2024/11/24-04:56:05.057397 139957659977280 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292700.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-04:56:05.877247 139957659977280 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292700.sst): second pass time = 1.29's, 83.716'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.82's, 41.938'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2951.663'MB/sec (index lex order gen) rebuild zvType time = 0.70's, 0.335'MB/sec write SST data time = 0.13's, 273.384'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 32396.598'MB/sec zip my value time = 1.29's, unzip length = 0.108'GB zip my value throughput = 83.716'MB/sec zip pipeline throughput = 83.716'MB/sec entries = 931556 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.08 avg-zval = 30.46 usrkeys = 931556 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.08 avg-zval = 30.46 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 931556 bytes = 3260464 } seq expand size = 6520892 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0284 GB dict = 1.08 MB all = 0.0345 GB } UnZip/Zip{ index = 10.5136 value = 3.8105 dict = 1.00 all = 3.8910 } Zip/UnZip{ index = 0.0951 value = 0.2624 dict = 1.00 all = 0.2570 } ---------------------------- total value len = 2253.275838 GB avg = 0.199 KB (by entry num) total key len = 307.324880 GB avg = 0.027 KB total ukey len = 237.670383 GB avg = 0.015 KB total ukey num = 15.754443923 Billion total entry num = 11.295757871 Billion write speed all = 35.537412335 MB/sec (with seq num) write speed all = 34.283262862 MB/sec (without seq num) 2024/11/24-04:56:05.919278 139957659977280 [compaction_job.cc:1948] [default] [JOB 41847] Generated table #292700: 931556 keys, 34494814 bytes, temperature: kWarm 2024/11/24-04:56:05.919345 139957659977280 EVENT_LOG_v1 {"time_micros": 1732395365919310, "cf_name": "default", "job": 41847, "event": "table_file_creation", "file_number": 292700, "file_size": 34494814, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4265679921, "largest_seqno": 4448532056, "table_properties": {"data_size": 28378160, "index_size": 1772096, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26083568, "raw_average_key_size": 28, "raw_value_size": 108134248, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 931556, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732395362, "oldest_key_time": 0, "file_creation_time": 1732395362, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 292700, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-04:56:05.954461 139957659977280 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292701.sst) /dev/shm/ToplingTemp/Topling-274520-wZ4Ac5 2024/11/24-04:56:06.941411 139957659977280 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292701.sst): first pass time = 0.99's, 135.997'MB/sec 2024/11/24-04:56:08.251903 139957659977280 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292701.sst): old prealloc_size = 147639500, real_size = 31336400 2024/11/24-04:56:08.252522 139957659977280 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292701.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 919300 prefix = 4 raw-key = 0.0147 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1085 GB zip-val = 0.0293 GB avg-val = 118.00 avg-zval = 31.92 2024/11/24-04:56:08.253328 139957659977280 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292701.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-04:56:09.067406 139957659977280 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292701.sst): second pass time = 1.31's, 82.852'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.82's, 43.286'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2923.489'MB/sec (index lex order gen) rebuild zvType time = 0.69's, 0.333'MB/sec write SST data time = 0.12's, 283.029'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.085'MB, throughput = 36496.687'MB/sec zip my value time = 1.31's, unzip length = 0.108'GB zip my value throughput = 82.852'MB/sec zip pipeline throughput = 82.852'MB/sec entries = 919300 avg-key = 28.00 avg-zkey = 1.91 avg-val = 118.00 avg-zval = 31.92 usrkeys = 919300 avg-key = 20.00 avg-zkey = 1.91 avg-val = 125.00 avg-zval = 31.92 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 919300 bytes = 3102656 } seq expand size = 6435100 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0184 GB value = 0.1085 GB dict = 1.09 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0293 GB dict = 1.09 MB all = 0.0353 GB } UnZip/Zip{ index = 10.4455 value = 3.6965 dict = 1.00 all = 3.8024 } Zip/UnZip{ index = 0.0957 value = 0.2705 dict = 1.00 all = 0.2630 } ---------------------------- total value len = 2253.390750 GB avg = 0.199 KB (by entry num) total key len = 307.350620 GB avg = 0.027 KB total ukey len = 237.688769 GB avg = 0.015 KB total ukey num = 15.755363223 Billion total entry num = 11.296677171 Billion write speed all = 35.537790963 MB/sec (with seq num) write speed all = 34.283594951 MB/sec (without seq num) 2024/11/24-04:56:09.110380 139957659977280 [compaction_job.cc:1948] [default] [JOB 41847] Generated table #292701: 919300 keys, 35298226 bytes, temperature: kWarm 2024/11/24-04:56:09.110449 139957659977280 EVENT_LOG_v1 {"time_micros": 1732395369110415, "cf_name": "default", "job": 41847, "event": "table_file_creation", "file_number": 292701, "file_size": 35298226, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4268249628, "largest_seqno": 4376263175, "table_properties": {"data_size": 29346176, "index_size": 1760192, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25740400, "raw_average_key_size": 28, "raw_value_size": 108477400, "raw_average_value_size": 118, "num_data_blocks": 1, "num_entries": 919300, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 118, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732395365, "oldest_key_time": 0, "file_creation_time": 1732395365, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 292701, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-04:56:09.147013 139957659977280 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292702.sst) /dev/shm/ToplingTemp/Topling-274520-enFW64 2024/11/24-04:56:10.083046 139957659977280 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292702.sst): first pass time = 0.94's, 143.396'MB/sec 2024/11/24-04:56:11.376150 139957659977280 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292702.sst): old prealloc_size = 147639500, real_size = 30570080 2024/11/24-04:56:11.376731 139957659977280 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292702.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 928575 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1082 GB zip-val = 0.0286 GB avg-val = 116.54 avg-zval = 30.76 2024/11/24-04:56:11.378695 139957659977280 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292702.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-04:56:12.198217 139957659977280 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292702.sst): second pass time = 1.29's, 83.767'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.82's, 42.036'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3174.052'MB/sec (index lex order gen) rebuild zvType time = 0.69's, 0.335'MB/sec write SST data time = 0.13's, 269.691'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 31310.909'MB/sec zip my value time = 1.29's, unzip length = 0.108'GB zip my value throughput = 83.767'MB/sec zip pipeline throughput = 83.767'MB/sec entries = 928575 avg-key = 28.00 avg-zkey = 1.92 avg-val = 116.54 avg-zval = 30.76 usrkeys = 928575 avg-key = 20.00 avg-zkey = 1.92 avg-val = 123.54 avg-zval = 30.76 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 928575 bytes = 3133952 } seq expand size = 6500025 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0286 GB dict = 1.08 MB all = 0.0346 GB } UnZip/Zip{ index = 10.4434 value = 3.7892 dict = 1.00 all = 3.8841 } Zip/UnZip{ index = 0.0958 value = 0.2639 dict = 1.00 all = 0.2575 } ---------------------------- total value len = 2253.505468 GB avg = 0.199 KB (by entry num) total key len = 307.376620 GB avg = 0.027 KB total ukey len = 237.707340 GB avg = 0.015 KB total ukey num = 15.756291798 Billion total entry num = 11.297605746 Billion write speed all = 35.538199727 MB/sec (with seq num) write speed all = 34.283955117 MB/sec (without seq num) 2024/11/24-04:56:12.240265 139957659977280 [compaction_job.cc:1948] [default] [JOB 41847] Generated table #292702: 928575 keys, 34555644 bytes, temperature: kWarm 2024/11/24-04:56:12.240335 139957659977280 EVENT_LOG_v1 {"time_micros": 1732395372240300, "cf_name": "default", "job": 41847, "event": "table_file_creation", "file_number": 292702, "file_size": 34555644, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4376263176, "largest_seqno": 4448531751, "table_properties": {"data_size": 28559440, "index_size": 1778304, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26000100, "raw_average_key_size": 28, "raw_value_size": 108217670, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 928575, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732395369, "oldest_key_time": 0, "file_creation_time": 1732395369, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 292702, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-04:56:12.311656 139957659977280 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292703.sst) /dev/shm/ToplingTemp/Topling-274520-63pK28 2024/11/24-04:56:13.307863 139957659977280 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292703.sst): first pass time = 1.00's, 134.736'MB/sec 2024/11/24-04:56:14.627542 139957659977280 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292703.sst): old prealloc_size = 147639500, real_size = 32485888 2024/11/24-04:56:14.628089 139957659977280 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292703.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 922269 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1084 GB zip-val = 0.0305 GB avg-val = 117.53 avg-zval = 33.07 2024/11/24-04:56:14.629542 139957659977280 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292703.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-04:56:15.460777 139957659977280 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292703.sst): second pass time = 1.32's, 82.229'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.83's, 43.893'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3339.785'MB/sec (index lex order gen) rebuild zvType time = 0.71's, 0.326'MB/sec write SST data time = 0.13's, 289.997'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.083'MB, throughput = 35066.365'MB/sec zip my value time = 1.32's, unzip length = 0.108'GB zip my value throughput = 82.229'MB/sec zip pipeline throughput = 82.229'MB/sec entries = 922269 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.53 avg-zval = 33.07 usrkeys = 922269 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.53 avg-zval = 33.07 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 922269 bytes = 3227952 } seq expand size = 6455883 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0184 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0305 GB dict = 1.08 MB all = 0.0366 GB } UnZip/Zip{ index = 10.5132 value = 3.5538 dict = 1.00 all = 3.6699 } Zip/UnZip{ index = 0.0951 value = 0.2814 dict = 1.00 all = 0.2725 } ---------------------------- total value len = 2253.620318 GB avg = 0.199 KB (by entry num) total key len = 307.402444 GB avg = 0.027 KB total ukey len = 237.725785 GB avg = 0.015 KB total ukey num = 15.757214067 Billion total entry num = 11.298528015 Billion write speed all = 35.538542874 MB/sec (with seq num) write speed all = 34.284252664 MB/sec (without seq num) 2024/11/24-04:56:15.510945 139957659977280 [compaction_job.cc:1948] [default] [JOB 41847] Generated table #292703: 922269 keys, 36572304 bytes, temperature: kWarm 2024/11/24-04:56:15.511033 139957659977280 EVENT_LOG_v1 {"time_micros": 1732395375510994, "cf_name": "default", "job": 41847, "event": "table_file_creation", "file_number": 292703, "file_size": 36572304, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4265679941, "largest_seqno": 4448532000, "table_properties": {"data_size": 30500656, "index_size": 1754496, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25823532, "raw_average_key_size": 28, "raw_value_size": 108394290, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 922269, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732395372, "oldest_key_time": 0, "file_creation_time": 1732395372, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 292703, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-04:56:15.548402 139957659977280 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292704.sst) /dev/shm/ToplingTemp/Topling-274520-dkDAR8 2024/11/24-04:56:16.366609 139957659977280 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292704.sst): first pass time = 0.82's, 164.048'MB/sec 2024/11/24-04:56:17.678682 139957659977280 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292704.sst): old prealloc_size = 147639500, real_size = 30925680 2024/11/24-04:56:17.679285 139957659977280 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292704.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 924909 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1083 GB zip-val = 0.0289 GB avg-val = 117.11 avg-zval = 31.27 2024/11/24-04:56:17.680053 139957659977280 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292704.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-04:56:18.501663 139957659977280 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292704.sst): second pass time = 1.31's, 82.608'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.82's, 42.410'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3056.467'MB/sec (index lex order gen) rebuild zvType time = 0.70's, 0.333'MB/sec write SST data time = 0.13's, 274.365'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 35024.490'MB/sec zip my value time = 1.31's, unzip length = 0.108'GB zip my value throughput = 82.608'MB/sec zip pipeline throughput = 82.608'MB/sec entries = 924909 avg-key = 28.00 avg-zkey = 1.91 avg-val = 117.11 avg-zval = 31.27 usrkeys = 924909 avg-key = 20.00 avg-zkey = 1.91 avg-val = 124.11 avg-zval = 31.27 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 924909 bytes = 3121584 } seq expand size = 6474363 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0289 GB dict = 1.08 MB all = 0.0349 GB } UnZip/Zip{ index = 10.4469 value = 3.7451 dict = 1.00 all = 3.8456 } Zip/UnZip{ index = 0.0957 value = 0.2670 dict = 1.00 all = 0.2600 } ---------------------------- total value len = 2253.735113 GB avg = 0.199 KB (by entry num) total key len = 307.428341 GB avg = 0.027 KB total ukey len = 237.744284 GB avg = 0.015 KB total ukey num = 15.758138976 Billion total entry num = 11.299452924 Billion write speed all = 35.538995561 MB/sec (with seq num) write speed all = 34.284655603 MB/sec (without seq num) 2024/11/24-04:56:18.550001 139957659977280 [compaction_job.cc:1948] [default] [JOB 41847] Generated table #292704: 924909 keys, 34901190 bytes, temperature: kWarm 2024/11/24-04:56:18.550093 139957659977280 EVENT_LOG_v1 {"time_micros": 1732395378550043, "cf_name": "default", "job": 41847, "event": "table_file_creation", "file_number": 292704, "file_size": 34901190, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4360854893, "largest_seqno": 4448531765, "table_properties": {"data_size": 28923552, "index_size": 1770688, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25897452, "raw_average_key_size": 28, "raw_value_size": 108320298, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 924909, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732395375, "oldest_key_time": 0, "file_creation_time": 1732395375, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 292704, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-04:56:18.588394 139957659977280 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292705.sst) /dev/shm/ToplingTemp/Topling-274520-2kg0l5 2024/11/24-04:56:18.667624 139957659977280 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292705.sst): first pass time = 0.08's, 236.337'MB/sec 2024/11/24-04:56:18.844030 139957659977280 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292705.sst): old prealloc_size = 147639500, real_size = 5151856 2024/11/24-04:56:18.844167 139957659977280 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292705.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 131794 prefix = 4 raw-key = 0.0021 GB zip-key = 0.0003 GB avg-key = 16.00 avg-zkey = 1.93 raw-val = 0.0150 GB zip-val = 0.0049 GB avg-val = 114.00 avg-zval = 36.91 2024/11/24-04:56:18.844321 139957659977280 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292705.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.019 GB 2024/11/24-04:56:18.960056 139957659977280 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00/292705.sst): second pass time = 0.18's, 85.522'MB/sec, value only(80.3% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.12's, 48.883'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2278.858'MB/sec (index lex order gen) rebuild zvType time = 0.10's, 0.339'MB/sec write SST data time = 0.02's, 302.355'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.157'MB, throughput = 4394.463'MB/sec zip my value time = 0.18's, unzip length = 0.015'GB zip my value throughput = 85.522'MB/sec zip pipeline throughput = 85.522'MB/sec entries = 131794 avg-key = 28.00 avg-zkey = 1.93 avg-val = 114.00 avg-zval = 36.91 usrkeys = 131794 avg-key = 20.00 avg-zkey = 1.93 avg-val = 121.00 avg-zval = 36.91 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 131794 bytes = 395392 } seq expand size = 922558 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0026 GB value = 0.0150 GB dict = 0.16 MB all = 0.0187 GB } __ZipSize{ index = 0.0003 GB value = 0.0049 GB dict = 0.16 MB all = 0.0057 GB } UnZip/Zip{ index = 10.3873 value = 3.0883 dict = 1.00 all = 3.2993 } Zip/UnZip{ index = 0.0963 value = 0.3238 dict = 1.00 all = 0.3031 } ---------------------------- total value len = 2253.751060 GB avg = 0.199 KB (by entry num) total key len = 307.432031 GB avg = 0.027 KB total ukey len = 237.746919 GB avg = 0.015 KB total ukey num = 15.758270770 Billion total entry num = 11.299584718 Billion write speed all = 35.539041994 MB/sec (with seq num) write speed all = 34.284695384 MB/sec (without seq num) 2024/11/24-04:56:18.974006 139957659977280 [compaction_job.cc:1948] [default] [JOB 41847] Generated table #292705: 131794 keys, 5672393 bytes, temperature: kWarm 2024/11/24-04:56:18.974064 139957659977280 EVENT_LOG_v1 {"time_micros": 1732395378974035, "cf_name": "default", "job": 41847, "event": "table_file_creation", "file_number": 292705, "file_size": 5672393, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4421319361, "largest_seqno": 4435953710, "table_properties": {"data_size": 4864992, "index_size": 253760, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 3690232, "raw_average_key_size": 28, "raw_value_size": 15024516, "raw_average_value_size": 114, "num_data_blocks": 1, "num_entries": 131794, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 114, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732395378, "oldest_key_time": 0, "file_creation_time": 1732395378, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 292705, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-04:56:18.984972 139957659977280 [compaction_job.cc:703] job-41847: subcompact[0], size: 0.749686 G, files: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-41847/att-00 [292684,292685,292686,292687,292688,292689,292690,292691,292692,292693,292694,292695,292696,292697,292698,292699,292700,292701,292702,292703,292704,292705] 2024/11/24-04:56:19.107363 139957659977280 (Original Log Time 2024/11/24-04:55:09.749256) EVENT_LOG_v1 {"time_micros": 1732395309749209, "job": 41847, "event": "compaction_started", "compaction_reason": "FilesMarkedForCompaction", "files_L2": [292661], "files_L3": [292597, 292598, 292599, 292600, 292601, 292602, 292603, 292604, 292605, 292606, 292607, 292608, 292609, 292610, 292611, 292612, 292613, 292614, 292615, 292616, 292676], "score": 0.707329, "input_data_size": 772976378, "oldest_snapshot_seqno": 4448681626} 2024/11/24-04:56:19.107372 139957659977280 (Original Log Time 2024/11/24-04:56:19.105107) [compaction_job.cc:2022] [default] [JOB 41847] Compacted 1@2 + 21@3 files to L3 => 749686103 bytes 2024/11/24-04:56:19.107373 139957659977280 (Original Log Time 2024/11/24-04:56:19.107287) [compaction_job.cc:1224] [default] compacted to: files[0 0 0 22 0 0 0] max score 0.03, MB/sec: 11.2 rd, 10.8 wr, level 3, files in(1, 21) out(22 +0 blob) MB in(27.1, 710.1 +0.0 blob) out(715.0 +0.0 blob), read-write-amplify(53.6) write-amplify(26.4) OK, records in: 19713797, records dropped: 104190 output_compression: Snappy 2024/11/24-04:56:19.107377 139957659977280 (Original Log Time 2024/11/24-04:56:19.107335) EVENT_LOG_v1 {"time_micros": 1732395379107312, "cf": "default", "job": 41847, "event": "compaction_finished", "compaction_time_micros": 69235734, "compaction_time_cpu_micros": 29304027, "output_level": 3, "num_output_files": 22, "total_output_size": 749686103, "num_input_records": 19713797, "num_output_records": 19609607, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "file_write_nanos": 522484556, "file_range_sync_nanos": 0, "file_fsync_nanos": 15789, "file_prepare_write_nanos": 55855, "lsm_state": [0, 0, 0, 22, 0, 0, 0]} 2024/11/24-04:56:19.224019 139957659977280 DEBG dcompact_worker.cpp:240: HttpPost: 200 OK: url = http://nlb-7zny4kaa1poal01o64.cn-shenzhen.nlb.aliyuncs.com:8443, body = {"instanceId":"nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137","labourId":"","dbId":"d89b4006-2803-486e-b7a2-759bcf348921","dbStarts":1732256054,"starts":1732395309,"executesMs":69501,"compactionJobId":41847,"attempt":0,"compactionInputRawBytes":2852083342,"compactionInputZipBytes":772976378,"compactionOutputRawBytes":0,"compactionOutputZipBytes":749686103,"headers":{"Accept":"*/*","Connection":"close","Host":"aliyun-topling-saas.topling.cn:18443","RemoteIp":"120.24.192.169","X-Forwarded-For":"120.24.192.169","region":"cn-shenzhen","token":"e6474c481bd4415abc537135cc03626b","instance-token":"e6474c481bd4415abc537135cc03626b","provider":"aliyun","CloudMarketInstanceId":"si-59c0ae5c955845588903","MeteringAssit":"","Transfer-Encoding":"chunked","traceparent":"00-0f69fb5c2760dd1b75d56ce339d3010f-9a93b4e9d8b519f1-00"}}, response = 2024/11/24-04:56:19.224112 139957659977280 INFO dcompact_worker.cpp:1459: finish /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-41847/att-00: olev 3, work 69.502 s, result 7.746 ms, install 2.285 ms, input{raw 2.656 GiB zip 737.168 MiB}