2024/11/24-08:23:15.771048 139957534086720 DEBG dcompact_worker.cpp:2214: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00: fork to child time = 0.008662 sec 2024/11/24-08:23:15.771878 139957534086720 DEBG dcompact_worker.cpp:1013: Beg SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00 2024/11/24-08:23:15.778786 139957534086720 DEBG dcompact_worker.cpp:1033: End SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00 2024/11/24-08:23:15.779693 139957534086720 TRAC dcompact_worker.cpp:1083: INFO_LOG_LEVEL: rpc = INFO_LEVEL, env_var = undefined 2024/11/24-08:23:15.779961 139957534086720 [WARN] [column_family.cc:386] multiple cf_paths/db_paths and level_compaction_dynamic_level_bytes can't be used together 2024/11/24-08:23:15.835245 139957534086720 [version_set.cc:6208] Recovering from manifest file: /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-43915/att-00/MANIFEST-206347 2024/11/24-08:23:15.852480 139957534086720 [version_set.cc:6251] Recovered from manifest file:/worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-43915/att-00/MANIFEST-206347 succeeded,manifest_file_number is 206347, next_file_number is 297480, last_sequence is 4512929449, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 297341 2024/11/24-08:23:15.852487 139957534086720 [version_set.cc:6266] Column family [default] (ID 0), log number is 0 2024/11/24-08:23:15.852632 139957534086720 [version_set.cc:5721] Creating manifest 297480 2024/11/24-08:23:15.885538 139957534086720 DEBG dcompact_worker.cpp:1218: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00: bottommost_level: fake = 1, rpc = 0 2024/11/24-08:23:15.906247 139957534086720 [compaction_job.cc:2437] [default] [JOB 43915] Compacting 1@2 + 30@3 files to L3, score 0.78, subcompactions 1 : 1 2024/11/24-08:23:15.906269 139957534086720 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 32923 Base level 2, inputs: [297477(27MB)], [297427(35MB) 297428(31MB) 297429(30MB) 297430(34MB) 297431(33MB) 297432(31MB) 297433(34MB) 297434(33MB) 297435(32MB) 297436(35MB) 297437(33MB) 297438(32MB) 297439(35MB) 297440(33MB) 297441(32MB) 297442(33MB) 297443(33MB) 297444(34MB) 297445(33MB) 297446(33MB) 297447(22MB) 297398(33MB) 297399(33MB) 297400(34MB) 297401(33MB) 297402(33MB) 297403(35MB) 297404(33MB) 297405(32MB) 297406(3344KB)] 2024/11/24-08:23:15.913168 139957534086720 [top_zip_table.cc:59] core git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/24-08:23:15.913198 139957534086720 [top_zip_table.cc:60] fsa git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/24-08:23:15.913217 139957534086720 [top_zip_table.cc:61] zbs git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/24-08:23:15.913223 139957534086720 [top_zip_table.cc:62] topling-zip_table_reader: git_version_hash_info_is: commit a4a382006cb82713acf5b3425835f22711877681 Author: leipeng Date: 2024-04-11 19:44:14 +0800 fixed_len_hole_index.cc: Add env bool FixedLenHoleIndexUseAVX512 for ut & debug 1. FixedLenHoleIndexUseAVX512 is only in unit tests or debug 2. In release mode, use avx512 by compile options(-march=) g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/24-08:23:15.913234 139957534086720 [top_zip_table.cc:64] topling-rocks git_version_hash_info_is: commit feab587e468621ba0204d47b4ffacc52e7c4290d Author: leipeng Date: 2024-03-22 13:35:06 +0800 ToplingZipTableBuilder::Add: immediately return after error This function returns void, and caller does not check builder->status() after calling this function and graceful abandon. So immediately return after error, and return error status in Finish(). g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/24-08:23:16.484509 139957534086720 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297481.sst) /dev/shm/ToplingTemp/Topling-305069-mQVrE4 2024/11/24-08:23:17.064177 139957534086720 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297481.sst): first pass time = 0.58's, 231.559'MB/sec 2024/11/24-08:23:18.950682 139957534086720 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297481.sst): old prealloc_size = 147639500, real_size = 33256400 2024/11/24-08:23:18.951433 139957534086720 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297481.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 925589 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1083 GB zip-val = 0.0313 GB avg-val = 117.01 avg-zval = 33.77 2024/11/24-08:23:18.952345 139957534086720 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297481.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-08:23:19.813476 139957534086720 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297481.sst): second pass time = 1.89's, 57.448'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.86's, 43.295'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2412.745'MB/sec (index lex order gen) rebuild zvType time = 0.73's, 0.317'MB/sec write SST data time = 0.13's, 283.148'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 38361.861'MB/sec zip my value time = 1.89's, unzip length = 0.108'GB zip my value throughput = 57.448'MB/sec zip pipeline throughput = 58.172'MB/sec entries = 925589 avg-key = 28.00 avg-zkey = 1.91 avg-val = 117.01 avg-zval = 33.77 usrkeys = 925589 avg-key = 20.00 avg-zkey = 1.91 avg-val = 124.01 avg-zval = 33.77 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 925589 bytes = 3239584 } seq expand size = 6479123 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0313 GB dict = 1.08 MB all = 0.0374 GB } UnZip/Zip{ index = 10.4455 value = 3.4654 dict = 1.00 all = 3.5931 } Zip/UnZip{ index = 0.0957 value = 0.2886 dict = 1.00 all = 0.2783 } ---------------------------- total value len = 2251.440354 GB avg = 0.200 KB (by entry num) total key len = 306.908879 GB avg = 0.027 KB total ukey len = 237.373239 GB avg = 0.015 KB total ukey num = 15.739586752 Billion total entry num = 11.280900700 Billion write speed all = 30.280766265 MB/sec (with seq num) write speed all = 29.212595234 MB/sec (without seq num) 2024/11/24-08:23:19.862623 139957534086720 [compaction_job.cc:1948] [default] [JOB 43915] Generated table #297481: 925589 keys, 37354398 bytes, temperature: kWarm 2024/11/24-08:23:19.862736 139957534086720 EVENT_LOG_v1 {"time_micros": 1732407799862656, "cf_name": "default", "job": 43915, "event": "table_file_creation", "file_number": 297481, "file_size": 37354398, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4265679834, "largest_seqno": 4512916859, "table_properties": {"data_size": 31252608, "index_size": 1772224, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25916492, "raw_average_key_size": 28, "raw_value_size": 108301250, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 925589, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732407796, "oldest_key_time": 0, "file_creation_time": 1732407796, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 297481, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-08:23:19.902514 139957534086720 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297482.sst) /dev/shm/ToplingTemp/Topling-305069-CHSz46 2024/11/24-08:23:20.827325 139957534086720 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297482.sst): first pass time = 0.92's, 145.136'MB/sec 2024/11/24-08:23:23.949033 139957534086720 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297482.sst): old prealloc_size = 147639500, real_size = 28725824 2024/11/24-08:23:23.949594 139957534086720 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297482.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 940223 prefix = 4 raw-key = 0.0150 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1079 GB zip-val = 0.0267 GB avg-val = 114.75 avg-zval = 28.39 2024/11/24-08:23:23.950458 139957534086720 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297482.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0024 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-08:23:25.030283 139957534086720 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297482.sst): second pass time = 3.12's, 34.572'MB/sec, value only(80.4% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.08's, 30.394'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3379.320'MB/sec (index lex order gen) rebuild zvType time = 0.85's, 0.278'MB/sec write SST data time = 0.23's, 140.534'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.077'MB, throughput = 36000.000'MB/sec zip my value time = 3.12's, unzip length = 0.108'GB zip my value throughput = 34.572'MB/sec zip pipeline throughput = 118.605'MB/sec entries = 940223 avg-key = 28.00 avg-zkey = 1.91 avg-val = 114.75 avg-zval = 28.39 usrkeys = 940223 avg-key = 20.00 avg-zkey = 1.91 avg-val = 121.75 avg-zval = 28.39 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 940223 bytes = 3290800 } seq expand size = 6581561 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0188 GB value = 0.1079 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0267 GB dict = 1.08 MB all = 0.0329 GB } UnZip/Zip{ index = 10.4440 value = 4.0424 dict = 1.00 all = 4.0842 } Zip/UnZip{ index = 0.0957 value = 0.2474 dict = 1.00 all = 0.2448 } ---------------------------- total value len = 2251.554827 GB avg = 0.200 KB (by entry num) total key len = 306.935205 GB avg = 0.027 KB total ukey len = 237.392044 GB avg = 0.015 KB total ukey num = 15.740526975 Billion total entry num = 11.281840923 Billion write speed all = 30.280563066 MB/sec (with seq num) write speed all = 29.212368963 MB/sec (without seq num) 2024/11/24-08:23:25.073875 139957534086720 [compaction_job.cc:1948] [default] [JOB 43915] Generated table #297482: 940223 keys, 32862376 bytes, temperature: kWarm 2024/11/24-08:23:25.073953 139957534086720 EVENT_LOG_v1 {"time_micros": 1732407805073909, "cf_name": "default", "job": 43915, "event": "table_file_creation", "file_number": 297482, "file_size": 32862376, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4265680463, "largest_seqno": 4512918269, "table_properties": {"data_size": 26690096, "index_size": 1800512, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26326244, "raw_average_key_size": 28, "raw_value_size": 107891574, "raw_average_value_size": 114, "num_data_blocks": 1, "num_entries": 940223, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732407799, "oldest_key_time": 0, "file_creation_time": 1732407799, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 297482, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-08:23:25.131190 139957534086720 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297483.sst) /dev/shm/ToplingTemp/Topling-305069-PRP883 2024/11/24-08:23:26.177933 139957534086720 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297483.sst): first pass time = 1.05's, 128.230'MB/sec 2024/11/24-08:23:29.079722 139957534086720 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297483.sst): old prealloc_size = 147639500, real_size = 27799616 2024/11/24-08:23:29.080322 139957534086720 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297483.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 945196 prefix = 4 raw-key = 0.0151 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1078 GB zip-val = 0.0258 GB avg-val = 114.00 avg-zval = 27.25 2024/11/24-08:23:29.081127 139957534086720 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297483.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0024 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-08:23:30.181404 139957534086720 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297483.sst): second pass time = 2.90's, 37.142'MB/sec, value only(80.3% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.10's, 28.894'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3141.693'MB/sec (index lex order gen) rebuild zvType time = 0.86's, 0.274'MB/sec write SST data time = 0.24's, 133.261'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.073'MB, throughput = 29665.709'MB/sec zip my value time = 2.90's, unzip length = 0.108'GB zip my value throughput = 37.142'MB/sec zip pipeline throughput = 125.638'MB/sec entries = 945196 avg-key = 28.00 avg-zkey = 1.91 avg-val = 114.00 avg-zval = 27.25 usrkeys = 945196 avg-key = 20.00 avg-zkey = 1.91 avg-val = 121.00 avg-zval = 27.25 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 945196 bytes = 3190048 } seq expand size = 6616372 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0189 GB value = 0.1078 GB dict = 1.07 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0258 GB dict = 1.07 MB all = 0.0318 GB } UnZip/Zip{ index = 10.4457 value = 4.1840 dict = 1.00 all = 4.2166 } Zip/UnZip{ index = 0.0957 value = 0.2390 dict = 1.00 all = 0.2372 } ---------------------------- total value len = 2251.669195 GB avg = 0.200 KB (by entry num) total key len = 306.961671 GB avg = 0.027 KB total ukey len = 237.410947 GB avg = 0.015 KB total ukey num = 15.741472171 Billion total entry num = 11.282786119 Billion write speed all = 30.280383835 MB/sec (with seq num) write speed all = 29.212165363 MB/sec (without seq num) 2024/11/24-08:23:30.225040 139957534086720 [compaction_job.cc:1948] [default] [JOB 43915] Generated table #297483: 945196 keys, 31830832 bytes, temperature: kWarm 2024/11/24-08:23:30.225130 139957534086720 EVENT_LOG_v1 {"time_micros": 1732407810225081, "cf_name": "default", "job": 43915, "event": "table_file_creation", "file_number": 297483, "file_size": 31830832, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4346219190, "largest_seqno": 4449080381, "table_properties": {"data_size": 25753392, "index_size": 1809728, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26465488, "raw_average_key_size": 28, "raw_value_size": 107752344, "raw_average_value_size": 114, "num_data_blocks": 1, "num_entries": 945196, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 114, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732407805, "oldest_key_time": 0, "file_creation_time": 1732407805, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 297483, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-08:23:30.263307 139957534086720 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297484.sst) /dev/shm/ToplingTemp/Topling-305069-wwtzF6 2024/11/24-08:23:31.201379 139957534086720 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297484.sst): first pass time = 0.94's, 143.084'MB/sec 2024/11/24-08:23:32.781550 139957534086720 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297484.sst): old prealloc_size = 147639500, real_size = 32270848 2024/11/24-08:23:32.782165 139957534086720 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297484.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 934899 prefix = 4 raw-key = 0.0150 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1080 GB zip-val = 0.0303 GB avg-val = 115.56 avg-zval = 32.37 2024/11/24-08:23:32.782986 139957534086720 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297484.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-08:23:33.927267 139957534086720 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297484.sst): second pass time = 1.58's, 68.406'MB/sec, value only(80.5% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.15's, 31.765'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3014.710'MB/sec (index lex order gen) rebuild zvType time = 1.01's, 0.232'MB/sec write SST data time = 0.14's, 264.105'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 35302.853'MB/sec zip my value time = 1.58's, unzip length = 0.108'GB zip my value throughput = 68.406'MB/sec zip pipeline throughput = 96.492'MB/sec entries = 934899 avg-key = 28.00 avg-zkey = 1.90 avg-val = 115.56 avg-zval = 32.37 usrkeys = 934899 avg-key = 20.00 avg-zkey = 1.90 avg-val = 122.56 avg-zval = 32.37 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 934899 bytes = 3272160 } seq expand size = 6544293 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0187 GB value = 0.1080 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0303 GB dict = 1.08 MB all = 0.0364 GB } UnZip/Zip{ index = 10.5122 value = 3.5706 dict = 1.00 all = 3.6880 } Zip/UnZip{ index = 0.0951 value = 0.2801 dict = 1.00 all = 0.2711 } ---------------------------- total value len = 2251.783780 GB avg = 0.200 KB (by entry num) total key len = 306.987848 GB avg = 0.027 KB total ukey len = 237.429645 GB avg = 0.015 KB total ukey num = 15.742407070 Billion total entry num = 11.283721018 Billion write speed all = 30.280707324 MB/sec (with seq num) write speed all = 29.212447695 MB/sec (without seq num) 2024/11/24-08:23:33.989145 139957534086720 [compaction_job.cc:1948] [default] [JOB 43915] Generated table #297484: 934899 keys, 36393054 bytes, temperature: kWarm 2024/11/24-08:23:33.989235 139957534086720 EVENT_LOG_v1 {"time_micros": 1732407813989182, "cf_name": "default", "job": 43915, "event": "table_file_creation", "file_number": 297484, "file_size": 36393054, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4265679848, "largest_seqno": 4512918552, "table_properties": {"data_size": 30258224, "index_size": 1778688, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26177172, "raw_average_key_size": 28, "raw_value_size": 108040606, "raw_average_value_size": 115, "num_data_blocks": 1, "num_entries": 934899, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732407810, "oldest_key_time": 0, "file_creation_time": 1732407810, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 297484, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-08:23:34.028352 139957534086720 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297485.sst) /dev/shm/ToplingTemp/Topling-305069-d7D5t6 2024/11/24-08:23:34.943292 139957534086720 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297485.sst): first pass time = 0.91's, 146.702'MB/sec 2024/11/24-08:23:36.804618 139957534086720 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297485.sst): old prealloc_size = 147639500, real_size = 31425632 2024/11/24-08:23:36.805317 139957534086720 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297485.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 919300 prefix = 4 raw-key = 0.0147 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1085 GB zip-val = 0.0294 GB avg-val = 118.00 avg-zval = 32.02 2024/11/24-08:23:36.806155 139957534086720 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297485.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-08:23:37.814554 139957534086720 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297485.sst): second pass time = 1.86's, 58.307'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.01's, 35.154'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2590.972'MB/sec (index lex order gen) rebuild zvType time = 0.85's, 0.269'MB/sec write SST data time = 0.16's, 228.372'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.085'MB, throughput = 30095.695'MB/sec zip my value time = 1.86's, unzip length = 0.108'GB zip my value throughput = 58.307'MB/sec zip pipeline throughput = 103.071'MB/sec entries = 919300 avg-key = 28.00 avg-zkey = 1.91 avg-val = 118.00 avg-zval = 32.02 usrkeys = 919300 avg-key = 20.00 avg-zkey = 1.91 avg-val = 125.00 avg-zval = 32.02 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 919300 bytes = 3217568 } seq expand size = 6435100 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0184 GB value = 0.1085 GB dict = 1.09 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0294 GB dict = 1.09 MB all = 0.0355 GB } UnZip/Zip{ index = 10.4443 value = 3.6853 dict = 1.00 all = 3.7805 } Zip/UnZip{ index = 0.0957 value = 0.2713 dict = 1.00 all = 0.2645 } ---------------------------- total value len = 2251.898693 GB avg = 0.200 KB (by entry num) total key len = 307.013588 GB avg = 0.027 KB total ukey len = 237.448031 GB avg = 0.015 KB total ukey num = 15.743326370 Billion total entry num = 11.284640318 Billion write speed all = 30.280978821 MB/sec (with seq num) write speed all = 29.212681304 MB/sec (without seq num) 2024/11/24-08:23:37.857826 139957534086720 [compaction_job.cc:1948] [default] [JOB 43915] Generated table #297485: 919300 keys, 35502322 bytes, temperature: kWarm 2024/11/24-08:23:37.857890 139957534086720 EVENT_LOG_v1 {"time_micros": 1732407817857858, "cf_name": "default", "job": 43915, "event": "table_file_creation", "file_number": 297485, "file_size": 35502322, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4320431171, "largest_seqno": 4469808461, "table_properties": {"data_size": 29435216, "index_size": 1760384, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25740400, "raw_average_key_size": 28, "raw_value_size": 108477400, "raw_average_value_size": 118, "num_data_blocks": 1, "num_entries": 919300, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 118, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732407814, "oldest_key_time": 0, "file_creation_time": 1732407814, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 297485, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-08:23:37.893817 139957534086720 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297486.sst) /dev/shm/ToplingTemp/Topling-305069-hYpJx4 2024/11/24-08:23:38.740892 139957534086720 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297486.sst): first pass time = 0.85's, 158.456'MB/sec 2024/11/24-08:23:40.331041 139957534086720 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297486.sst): old prealloc_size = 147639500, real_size = 29022176 2024/11/24-08:23:40.331607 139957534086720 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297486.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 938752 prefix = 4 raw-key = 0.0150 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1079 GB zip-val = 0.0270 GB avg-val = 114.97 avg-zval = 28.75 2024/11/24-08:23:40.332408 139957534086720 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297486.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-08:23:41.163499 139957534086720 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297486.sst): second pass time = 1.59's, 67.912'MB/sec, value only(80.4% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.83's, 39.828'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3309.191'MB/sec (index lex order gen) rebuild zvType time = 0.70's, 0.334'MB/sec write SST data time = 0.13's, 256.420'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.077'MB, throughput = 33357.346'MB/sec zip my value time = 1.59's, unzip length = 0.108'GB zip my value throughput = 67.912'MB/sec zip pipeline throughput = 131.590'MB/sec entries = 938752 avg-key = 28.00 avg-zkey = 1.91 avg-val = 114.97 avg-zval = 28.75 usrkeys = 938752 avg-key = 20.00 avg-zkey = 1.91 avg-val = 121.97 avg-zval = 28.75 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 938752 bytes = 3285648 } seq expand size = 6571264 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0188 GB value = 0.1079 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0270 GB dict = 1.08 MB all = 0.0332 GB } UnZip/Zip{ index = 10.4443 value = 3.9990 dict = 1.00 all = 4.0483 } Zip/UnZip{ index = 0.0957 value = 0.2501 dict = 1.00 all = 0.2470 } ---------------------------- total value len = 2252.013197 GB avg = 0.200 KB (by entry num) total key len = 307.039873 GB avg = 0.027 KB total ukey len = 237.466807 GB avg = 0.015 KB total ukey num = 15.744265122 Billion total entry num = 11.285579070 Billion write speed all = 30.281444808 MB/sec (with seq num) write speed all = 29.213100760 MB/sec (without seq num) 2024/11/24-08:23:41.207510 139957534086720 [compaction_job.cc:1948] [default] [JOB 43915] Generated table #297486: 938752 keys, 33154178 bytes, temperature: kWarm 2024/11/24-08:23:41.207575 139957534086720 EVENT_LOG_v1 {"time_micros": 1732407821207540, "cf_name": "default", "job": 43915, "event": "table_file_creation", "file_number": 297486, "file_size": 33154178, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4367808804, "largest_seqno": 4512918284, "table_properties": {"data_size": 26989648, "index_size": 1797632, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26285056, "raw_average_key_size": 28, "raw_value_size": 107932772, "raw_average_value_size": 114, "num_data_blocks": 1, "num_entries": 938752, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732407817, "oldest_key_time": 0, "file_creation_time": 1732407817, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 297486, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-08:23:41.242476 139957534086720 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297487.sst) /dev/shm/ToplingTemp/Topling-305069-rqc5V5 2024/11/24-08:23:42.137382 139957534086720 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297487.sst): first pass time = 0.89's, 149.985'MB/sec 2024/11/24-08:23:43.717391 139957534086720 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297487.sst): old prealloc_size = 147639500, real_size = 31969968 2024/11/24-08:23:43.717996 139957534086720 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297487.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 935953 prefix = 4 raw-key = 0.0150 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1080 GB zip-val = 0.0300 GB avg-val = 115.40 avg-zval = 32.01 2024/11/24-08:23:43.719467 139957534086720 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297487.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-08:23:44.577552 139957534086720 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297487.sst): second pass time = 1.58's, 68.398'MB/sec, value only(80.5% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.86's, 41.964'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3059.729'MB/sec (index lex order gen) rebuild zvType time = 0.73's, 0.320'MB/sec write SST data time = 0.13's, 279.261'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.077'MB, throughput = 31315.748'MB/sec zip my value time = 1.58's, unzip length = 0.108'GB zip my value throughput = 68.398'MB/sec zip pipeline throughput = 112.000'MB/sec entries = 935953 avg-key = 28.00 avg-zkey = 1.90 avg-val = 115.40 avg-zval = 32.01 usrkeys = 935953 avg-key = 20.00 avg-zkey = 1.90 avg-val = 122.40 avg-zval = 32.01 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 935953 bytes = 3275856 } seq expand size = 6551671 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0187 GB value = 0.1080 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0300 GB dict = 1.08 MB all = 0.0361 GB } UnZip/Zip{ index = 10.5146 value = 3.6057 dict = 1.00 all = 3.7185 } Zip/UnZip{ index = 0.0951 value = 0.2773 dict = 1.00 all = 0.2689 } ---------------------------- total value len = 2252.127760 GB avg = 0.200 KB (by entry num) total key len = 307.066080 GB avg = 0.027 KB total ukey len = 237.485526 GB avg = 0.015 KB total ukey num = 15.745201075 Billion total entry num = 11.286515023 Billion write speed all = 30.281887193 MB/sec (with seq num) write speed all = 29.213497704 MB/sec (without seq num) 2024/11/24-08:23:44.625049 139957534086720 [compaction_job.cc:1948] [default] [JOB 43915] Generated table #297487: 935953 keys, 36094536 bytes, temperature: kWarm 2024/11/24-08:23:44.625117 139957534086720 EVENT_LOG_v1 {"time_micros": 1732407824625082, "cf_name": "default", "job": 43915, "event": "table_file_creation", "file_number": 297487, "file_size": 36094536, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4265679865, "largest_seqno": 4512916712, "table_properties": {"data_size": 29955488, "index_size": 1780288, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26206684, "raw_average_key_size": 28, "raw_value_size": 108011098, "raw_average_value_size": 115, "num_data_blocks": 1, "num_entries": 935953, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732407821, "oldest_key_time": 0, "file_creation_time": 1732407821, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 297487, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-08:23:44.663917 139957534086720 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297488.sst) /dev/shm/ToplingTemp/Topling-305069-HzbIg6 2024/11/24-08:23:45.554900 139957534086720 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297488.sst): first pass time = 0.89's, 150.647'MB/sec 2024/11/24-08:23:47.129707 139957534086720 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297488.sst): old prealloc_size = 147639500, real_size = 31436336 2024/11/24-08:23:47.130325 139957534086720 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297488.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 919300 prefix = 4 raw-key = 0.0147 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1085 GB zip-val = 0.0294 GB avg-val = 118.00 avg-zval = 32.03 2024/11/24-08:23:47.131132 139957534086720 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297488.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-08:23:47.950045 139957534086720 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297488.sst): second pass time = 1.57's, 68.944'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.82's, 43.153'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2951.337'MB/sec (index lex order gen) rebuild zvType time = 0.69's, 0.332'MB/sec write SST data time = 0.13's, 276.838'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.085'MB, throughput = 35146.578'MB/sec zip my value time = 1.57's, unzip length = 0.108'GB zip my value throughput = 68.944'MB/sec zip pipeline throughput = 109.767'MB/sec entries = 919300 avg-key = 28.00 avg-zkey = 1.91 avg-val = 118.00 avg-zval = 32.03 usrkeys = 919300 avg-key = 20.00 avg-zkey = 1.91 avg-val = 125.00 avg-zval = 32.03 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 919300 bytes = 3102656 } seq expand size = 6435100 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0184 GB value = 0.1085 GB dict = 1.09 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0294 GB dict = 1.09 MB all = 0.0354 GB } UnZip/Zip{ index = 10.4455 value = 3.6839 dict = 1.00 all = 3.7917 } Zip/UnZip{ index = 0.0957 value = 0.2714 dict = 1.00 all = 0.2637 } ---------------------------- total value len = 2252.242672 GB avg = 0.200 KB (by entry num) total key len = 307.091820 GB avg = 0.027 KB total ukey len = 237.503912 GB avg = 0.015 KB total ukey num = 15.746120375 Billion total entry num = 11.287434323 Billion write speed all = 30.282343060 MB/sec (with seq num) write speed all = 29.213909185 MB/sec (without seq num) 2024/11/24-08:23:47.993414 139957534086720 [compaction_job.cc:1948] [default] [JOB 43915] Generated table #297488: 919300 keys, 35398194 bytes, temperature: kWarm 2024/11/24-08:23:47.993479 139957534086720 EVENT_LOG_v1 {"time_micros": 1732407827993446, "cf_name": "default", "job": 43915, "event": "table_file_creation", "file_number": 297488, "file_size": 35398194, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4305752579, "largest_seqno": 4424342802, "table_properties": {"data_size": 29446112, "index_size": 1760192, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25740400, "raw_average_key_size": 28, "raw_value_size": 108477400, "raw_average_value_size": 118, "num_data_blocks": 1, "num_entries": 919300, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 118, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732407824, "oldest_key_time": 0, "file_creation_time": 1732407824, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 297488, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-08:23:48.043236 139957534086720 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297489.sst) /dev/shm/ToplingTemp/Topling-305069-cmQ7L4 2024/11/24-08:23:48.919656 139957534086720 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297489.sst): first pass time = 0.88's, 153.152'MB/sec 2024/11/24-08:23:50.217006 139957534086720 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297489.sst): old prealloc_size = 147639500, real_size = 30721600 2024/11/24-08:23:50.217548 139957534086720 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297489.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927116 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1083 GB zip-val = 0.0287 GB avg-val = 116.77 avg-zval = 30.97 2024/11/24-08:23:50.218310 139957534086720 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297489.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-08:23:51.035451 139957534086720 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297489.sst): second pass time = 1.30's, 83.514'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.82's, 42.402'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3438.315'MB/sec (index lex order gen) rebuild zvType time = 0.69's, 0.336'MB/sec write SST data time = 0.13's, 269.323'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 32506.136'MB/sec zip my value time = 1.30's, unzip length = 0.108'GB zip my value throughput = 83.514'MB/sec zip pipeline throughput = 83.514'MB/sec entries = 927116 avg-key = 28.00 avg-zkey = 1.92 avg-val = 116.77 avg-zval = 30.97 usrkeys = 927116 avg-key = 20.00 avg-zkey = 1.92 avg-val = 123.77 avg-zval = 30.97 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 927116 bytes = 3129024 } seq expand size = 6489812 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0287 GB dict = 1.08 MB all = 0.0347 GB } UnZip/Zip{ index = 10.4424 value = 3.7702 dict = 1.00 all = 3.8676 } Zip/UnZip{ index = 0.0958 value = 0.2652 dict = 1.00 all = 0.2586 } ---------------------------- total value len = 2252.357420 GB avg = 0.200 KB (by entry num) total key len = 307.117780 GB avg = 0.027 KB total ukey len = 237.522454 GB avg = 0.015 KB total ukey num = 15.747047491 Billion total entry num = 11.288361439 Billion write speed all = 30.282902389 MB/sec (with seq num) write speed all = 29.214419764 MB/sec (without seq num) 2024/11/24-08:23:51.081481 139957534086720 [compaction_job.cc:1948] [default] [JOB 43915] Generated table #297489: 927116 keys, 34703498 bytes, temperature: kWarm 2024/11/24-08:23:51.081552 139957534086720 EVENT_LOG_v1 {"time_micros": 1732407831081514, "cf_name": "default", "job": 43915, "event": "table_file_creation", "file_number": 297489, "file_size": 34703498, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4424342803, "largest_seqno": 4512918302, "table_properties": {"data_size": 28713968, "index_size": 1775680, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25959248, "raw_average_key_size": 28, "raw_value_size": 108258516, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927116, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732407828, "oldest_key_time": 0, "file_creation_time": 1732407828, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 297489, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-08:23:51.120134 139957534086720 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297490.sst) /dev/shm/ToplingTemp/Topling-305069-uyDg44 2024/11/24-08:23:52.017491 139957534086720 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297490.sst): first pass time = 0.90's, 149.578'MB/sec 2024/11/24-08:23:53.360355 139957534086720 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297490.sst): old prealloc_size = 147639500, real_size = 32777216 2024/11/24-08:23:53.360878 139957534086720 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297490.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 931646 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1081 GB zip-val = 0.0308 GB avg-val = 116.07 avg-zval = 33.03 2024/11/24-08:23:53.362890 139957534086720 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297490.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-08:23:54.220618 139957534086720 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297490.sst): second pass time = 1.34's, 80.572'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.86's, 42.882'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3571.521'MB/sec (index lex order gen) rebuild zvType time = 0.73's, 0.318'MB/sec write SST data time = 0.13's, 289.628'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 34359.764'MB/sec zip my value time = 1.34's, unzip length = 0.108'GB zip my value throughput = 80.572'MB/sec zip pipeline throughput = 80.572'MB/sec entries = 931646 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.07 avg-zval = 33.03 usrkeys = 931646 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.07 avg-zval = 33.03 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 931646 bytes = 3260768 } seq expand size = 6521522 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0308 GB dict = 1.08 MB all = 0.0369 GB } UnZip/Zip{ index = 10.5142 value = 3.5140 dict = 1.00 all = 3.6385 } Zip/UnZip{ index = 0.0951 value = 0.2846 dict = 1.00 all = 0.2748 } ---------------------------- total value len = 2252.472074 GB avg = 0.200 KB (by entry num) total key len = 307.143866 GB avg = 0.027 KB total ukey len = 237.541087 GB avg = 0.015 KB total ukey num = 15.747979137 Billion total entry num = 11.289293085 Billion write speed all = 30.283426314 MB/sec (with seq num) write speed all = 29.214895774 MB/sec (without seq num) 2024/11/24-08:23:54.269405 139957534086720 [compaction_job.cc:1948] [default] [JOB 43915] Generated table #297490: 931646 keys, 36888590 bytes, temperature: kWarm 2024/11/24-08:23:54.269478 139957534086720 EVENT_LOG_v1 {"time_micros": 1732407834269441, "cf_name": "default", "job": 43915, "event": "table_file_creation", "file_number": 297490, "file_size": 36888590, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4265679880, "largest_seqno": 4512916833, "table_properties": {"data_size": 30771952, "index_size": 1772160, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26086088, "raw_average_key_size": 28, "raw_value_size": 108131676, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 931646, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732407831, "oldest_key_time": 0, "file_creation_time": 1732407831, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 297490, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-08:23:54.305177 139957534086720 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297491.sst) /dev/shm/ToplingTemp/Topling-305069-p387N3 2024/11/24-08:23:55.304822 139957534086720 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297491.sst): first pass time = 1.00's, 134.272'MB/sec 2024/11/24-08:23:56.596692 139957534086720 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297491.sst): old prealloc_size = 147639500, real_size = 31390192 2024/11/24-08:23:56.597286 139957534086720 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297491.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 919300 prefix = 4 raw-key = 0.0147 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1085 GB zip-val = 0.0294 GB avg-val = 118.00 avg-zval = 31.98 2024/11/24-08:23:56.599199 139957534086720 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297491.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-08:23:57.411676 139957534086720 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297491.sst): second pass time = 1.29's, 84.017'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.81's, 43.379'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3087.317'MB/sec (index lex order gen) rebuild zvType time = 0.68's, 0.336'MB/sec write SST data time = 0.13's, 270.930'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.085'MB, throughput = 34864.240'MB/sec zip my value time = 1.29's, unzip length = 0.108'GB zip my value throughput = 84.017'MB/sec zip pipeline throughput = 84.017'MB/sec entries = 919300 avg-key = 28.00 avg-zkey = 1.91 avg-val = 118.00 avg-zval = 31.98 usrkeys = 919300 avg-key = 20.00 avg-zkey = 1.91 avg-val = 125.00 avg-zval = 31.98 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 919300 bytes = 3102656 } seq expand size = 6435100 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0184 GB value = 0.1085 GB dict = 1.09 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0294 GB dict = 1.09 MB all = 0.0354 GB } UnZip/Zip{ index = 10.4447 value = 3.6897 dict = 1.00 all = 3.7966 } Zip/UnZip{ index = 0.0957 value = 0.2710 dict = 1.00 all = 0.2634 } ---------------------------- total value len = 2252.586986 GB avg = 0.200 KB (by entry num) total key len = 307.169606 GB avg = 0.027 KB total ukey len = 237.559473 GB avg = 0.015 KB total ukey num = 15.748898437 Billion total entry num = 11.290212385 Billion write speed all = 30.283947065 MB/sec (with seq num) write speed all = 29.215369857 MB/sec (without seq num) 2024/11/24-08:23:57.456817 139957534086720 [compaction_job.cc:1948] [default] [JOB 43915] Generated table #297491: 919300 keys, 35352050 bytes, temperature: kWarm 2024/11/24-08:23:57.456896 139957534086720 EVENT_LOG_v1 {"time_micros": 1732407837456859, "cf_name": "default", "job": 43915, "event": "table_file_creation", "file_number": 297491, "file_size": 35352050, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4321763956, "largest_seqno": 4433800264, "table_properties": {"data_size": 29399840, "index_size": 1760320, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25740400, "raw_average_key_size": 28, "raw_value_size": 108477400, "raw_average_value_size": 118, "num_data_blocks": 1, "num_entries": 919300, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 118, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732407834, "oldest_key_time": 0, "file_creation_time": 1732407834, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 297491, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-08:23:57.498903 139957534086720 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297492.sst) /dev/shm/ToplingTemp/Topling-305069-54wnu6 2024/11/24-08:23:58.379936 139957534086720 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297492.sst): first pass time = 0.88's, 152.349'MB/sec 2024/11/24-08:23:59.683012 139957534086720 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297492.sst): old prealloc_size = 147639500, real_size = 30692176 2024/11/24-08:23:59.683585 139957534086720 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297492.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927518 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1082 GB zip-val = 0.0287 GB avg-val = 116.71 avg-zval = 30.93 2024/11/24-08:23:59.685477 139957534086720 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297492.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-08:24:00.504773 139957534086720 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297492.sst): second pass time = 1.30's, 83.121'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.82's, 42.196'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3235.652'MB/sec (index lex order gen) rebuild zvType time = 0.69's, 0.334'MB/sec write SST data time = 0.13's, 272.452'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 30654.467'MB/sec zip my value time = 1.30's, unzip length = 0.108'GB zip my value throughput = 83.121'MB/sec zip pipeline throughput = 83.121'MB/sec entries = 927518 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.71 avg-zval = 30.93 usrkeys = 927518 avg-key = 20.00 avg-zkey = 1.91 avg-val = 123.71 avg-zval = 30.93 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 927518 bytes = 3130384 } seq expand size = 6492626 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0287 GB dict = 1.08 MB all = 0.0347 GB } UnZip/Zip{ index = 10.4439 value = 3.7738 dict = 1.00 all = 3.8707 } Zip/UnZip{ index = 0.0957 value = 0.2650 dict = 1.00 all = 0.2583 } ---------------------------- total value len = 2252.701726 GB avg = 0.200 KB (by entry num) total key len = 307.195577 GB avg = 0.027 KB total ukey len = 237.578023 GB avg = 0.015 KB total ukey num = 15.749825955 Billion total entry num = 11.291139903 Billion write speed all = 30.284503557 MB/sec (with seq num) write speed all = 29.215877667 MB/sec (without seq num) 2024/11/24-08:24:00.548760 139957534086720 [compaction_job.cc:1948] [default] [JOB 43915] Generated table #297492: 927518 keys, 34675118 bytes, temperature: kWarm 2024/11/24-08:24:00.548836 139957534086720 EVENT_LOG_v1 {"time_micros": 1732407840548797, "cf_name": "default", "job": 43915, "event": "table_file_creation", "file_number": 297492, "file_size": 34675118, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4433800265, "largest_seqno": 4512918318, "table_properties": {"data_size": 28683904, "index_size": 1776192, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25970504, "raw_average_key_size": 28, "raw_value_size": 108247292, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927518, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732407837, "oldest_key_time": 0, "file_creation_time": 1732407837, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 297492, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-08:24:00.591132 139957534086720 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297493.sst) /dev/shm/ToplingTemp/Topling-305069-vzruq6 2024/11/24-08:24:01.467650 139957534086720 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297493.sst): first pass time = 0.88's, 153.134'MB/sec 2024/11/24-08:24:02.804898 139957534086720 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297493.sst): old prealloc_size = 147639500, real_size = 32978224 2024/11/24-08:24:02.805499 139957534086720 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297493.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 926221 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0310 GB avg-val = 116.91 avg-zval = 33.45 2024/11/24-08:24:02.806364 139957534086720 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297493.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-08:24:03.657994 139957534086720 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297493.sst): second pass time = 1.34's, 81.032'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.85's, 43.461'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3007.464'MB/sec (index lex order gen) rebuild zvType time = 0.73's, 0.319'MB/sec write SST data time = 0.13's, 294.541'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 30838.520'MB/sec zip my value time = 1.34's, unzip length = 0.108'GB zip my value throughput = 81.032'MB/sec zip pipeline throughput = 81.032'MB/sec entries = 926221 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.91 avg-zval = 33.45 usrkeys = 926221 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.91 avg-zval = 33.45 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 926221 bytes = 3241792 } seq expand size = 6483547 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0310 GB dict = 1.08 MB all = 0.0371 GB } UnZip/Zip{ index = 10.5138 value = 3.4948 dict = 1.00 all = 3.6202 } Zip/UnZip{ index = 0.0951 value = 0.2861 dict = 1.00 all = 0.2762 } ---------------------------- total value len = 2252.816493 GB avg = 0.200 KB (by entry num) total key len = 307.221511 GB avg = 0.027 KB total ukey len = 237.596548 GB avg = 0.015 KB total ukey num = 15.750752176 Billion total entry num = 11.292066124 Billion write speed all = 30.285038364 MB/sec (with seq num) write speed all = 29.216364679 MB/sec (without seq num) 2024/11/24-08:24:03.705021 139957534086720 [compaction_job.cc:1948] [default] [JOB 43915] Generated table #297493: 926221 keys, 37074470 bytes, temperature: kWarm 2024/11/24-08:24:03.705093 139957534086720 EVENT_LOG_v1 {"time_micros": 1732407843705055, "cf_name": "default", "job": 43915, "event": "table_file_creation", "file_number": 297493, "file_size": 37074470, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4265679891, "largest_seqno": 4512917932, "table_properties": {"data_size": 30984544, "index_size": 1761920, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25934188, "raw_average_key_size": 28, "raw_value_size": 108283638, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 926221, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732407840, "oldest_key_time": 0, "file_creation_time": 1732407840, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 297493, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-08:24:03.744912 139957534086720 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297494.sst) /dev/shm/ToplingTemp/Topling-305069-GyRZt6 2024/11/24-08:24:04.759037 139957534086720 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297494.sst): first pass time = 1.01's, 132.353'MB/sec 2024/11/24-08:24:06.043350 139957534086720 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297494.sst): old prealloc_size = 147639500, real_size = 31292672 2024/11/24-08:24:06.043887 139957534086720 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297494.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 919300 prefix = 4 raw-key = 0.0147 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1085 GB zip-val = 0.0293 GB avg-val = 118.00 avg-zval = 31.87 2024/11/24-08:24:06.044841 139957534086720 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297494.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-08:24:06.858421 139957534086720 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297494.sst): second pass time = 1.28's, 84.541'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.82's, 43.255'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3440.065'MB/sec (index lex order gen) rebuild zvType time = 0.69's, 0.334'MB/sec write SST data time = 0.13's, 281.082'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.085'MB, throughput = 31853.037'MB/sec zip my value time = 1.28's, unzip length = 0.108'GB zip my value throughput = 84.541'MB/sec zip pipeline throughput = 84.541'MB/sec entries = 919300 avg-key = 28.00 avg-zkey = 1.91 avg-val = 118.00 avg-zval = 31.87 usrkeys = 919300 avg-key = 20.00 avg-zkey = 1.91 avg-val = 125.00 avg-zval = 31.87 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 919300 bytes = 3102656 } seq expand size = 6435100 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0184 GB value = 0.1085 GB dict = 1.09 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0293 GB dict = 1.09 MB all = 0.0353 GB } UnZip/Zip{ index = 10.4455 value = 3.7020 dict = 1.00 all = 3.8071 } Zip/UnZip{ index = 0.0957 value = 0.2701 dict = 1.00 all = 0.2627 } ---------------------------- total value len = 2252.931406 GB avg = 0.199 KB (by entry num) total key len = 307.247251 GB avg = 0.027 KB total ukey len = 237.614934 GB avg = 0.015 KB total ukey num = 15.751671476 Billion total entry num = 11.292985424 Billion write speed all = 30.285555636 MB/sec (with seq num) write speed all = 29.216835412 MB/sec (without seq num) 2024/11/24-08:24:06.901922 139957534086720 [compaction_job.cc:1948] [default] [JOB 43915] Generated table #297494: 919300 keys, 35254514 bytes, temperature: kWarm 2024/11/24-08:24:06.902011 139957534086720 EVENT_LOG_v1 {"time_micros": 1732407846901959, "cf_name": "default", "job": 43915, "event": "table_file_creation", "file_number": 297494, "file_size": 35254514, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4343887495, "largest_seqno": 4455906018, "table_properties": {"data_size": 29302448, "index_size": 1760192, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25740400, "raw_average_key_size": 28, "raw_value_size": 108477400, "raw_average_value_size": 118, "num_data_blocks": 1, "num_entries": 919300, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 118, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732407843, "oldest_key_time": 0, "file_creation_time": 1732407843, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 297494, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-08:24:06.942574 139957534086720 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297495.sst) /dev/shm/ToplingTemp/Topling-305069-VwhDy5 2024/11/24-08:24:07.906047 139957534086720 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297495.sst): first pass time = 0.96's, 139.311'MB/sec 2024/11/24-08:24:09.223205 139957534086720 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297495.sst): old prealloc_size = 147639500, real_size = 29941904 2024/11/24-08:24:09.223761 139957534086720 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297495.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 932291 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1081 GB zip-val = 0.0279 GB avg-val = 115.97 avg-zval = 29.95 2024/11/24-08:24:09.224530 139957534086720 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297495.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-08:24:10.039857 139957534086720 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297495.sst): second pass time = 1.32's, 82.159'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.82's, 41.416'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3349.774'MB/sec (index lex order gen) rebuild zvType time = 0.69's, 0.337'MB/sec write SST data time = 0.12's, 271.557'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 32525.732'MB/sec zip my value time = 1.32's, unzip length = 0.108'GB zip my value throughput = 82.159'MB/sec zip pipeline throughput = 82.159'MB/sec entries = 932291 avg-key = 28.00 avg-zkey = 1.91 avg-val = 115.97 avg-zval = 29.95 usrkeys = 932291 avg-key = 20.00 avg-zkey = 1.91 avg-val = 122.97 avg-zval = 29.95 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 932291 bytes = 3029968 } seq expand size = 6526037 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0279 GB dict = 1.08 MB all = 0.0338 GB } UnZip/Zip{ index = 10.4457 value = 3.8718 dict = 1.00 all = 3.9685 } Zip/UnZip{ index = 0.0957 value = 0.2583 dict = 1.00 all = 0.2520 } ---------------------------- total value len = 2253.046046 GB avg = 0.199 KB (by entry num) total key len = 307.273355 GB avg = 0.027 KB total ukey len = 237.633579 GB avg = 0.015 KB total ukey num = 15.752603767 Billion total entry num = 11.293917715 Billion write speed all = 30.286080757 MB/sec (with seq num) write speed all = 29.217312528 MB/sec (without seq num) 2024/11/24-08:24:10.082864 139957534086720 [compaction_job.cc:1948] [default] [JOB 43915] Generated table #297495: 932291 keys, 33821028 bytes, temperature: kWarm 2024/11/24-08:24:10.082935 139957534086720 EVENT_LOG_v1 {"time_micros": 1732407850082896, "cf_name": "default", "job": 43915, "event": "table_file_creation", "file_number": 297495, "file_size": 33821028, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4455906019, "largest_seqno": 4512918331, "table_properties": {"data_size": 27923648, "index_size": 1785024, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26104148, "raw_average_key_size": 28, "raw_value_size": 108113718, "raw_average_value_size": 115, "num_data_blocks": 1, "num_entries": 932291, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732407846, "oldest_key_time": 0, "file_creation_time": 1732407846, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 297495, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-08:24:10.121089 139957534086720 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297496.sst) /dev/shm/ToplingTemp/Topling-305069-n8IS74 2024/11/24-08:24:11.123782 139957534086720 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297496.sst): first pass time = 1.00's, 133.863'MB/sec 2024/11/24-08:24:12.422041 139957534086720 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297496.sst): old prealloc_size = 147639500, real_size = 31690208 2024/11/24-08:24:12.422569 139957534086720 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297496.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 920159 prefix = 4 raw-key = 0.0147 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1085 GB zip-val = 0.0297 GB avg-val = 117.86 avg-zval = 32.29 2024/11/24-08:24:12.423324 139957534086720 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297496.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-08:24:13.234673 139957534086720 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297496.sst): second pass time = 1.30's, 83.597'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.81's, 44.020'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3495.042'MB/sec (index lex order gen) rebuild zvType time = 0.69's, 0.334'MB/sec write SST data time = 0.12's, 290.082'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.084'MB, throughput = 35626.639'MB/sec zip my value time = 1.30's, unzip length = 0.108'GB zip my value throughput = 83.597'MB/sec zip pipeline throughput = 83.597'MB/sec entries = 920159 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.86 avg-zval = 32.29 usrkeys = 920159 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.86 avg-zval = 32.29 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 920159 bytes = 3220576 } seq expand size = 6441113 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0184 GB value = 0.1085 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0297 GB dict = 1.08 MB all = 0.0358 GB } UnZip/Zip{ index = 10.5133 value = 3.6505 dict = 1.00 all = 3.7522 } Zip/UnZip{ index = 0.0951 value = 0.2739 dict = 1.00 all = 0.2665 } ---------------------------- total value len = 2253.160940 GB avg = 0.199 KB (by entry num) total key len = 307.299120 GB avg = 0.027 KB total ukey len = 237.651983 GB avg = 0.015 KB total ukey num = 15.753523926 Billion total entry num = 11.294837874 Billion write speed all = 30.286600035 MB/sec (with seq num) write speed all = 29.217785122 MB/sec (without seq num) 2024/11/24-08:24:13.279264 139957534086720 [compaction_job.cc:1948] [default] [JOB 43915] Generated table #297496: 920159 keys, 35770912 bytes, temperature: kWarm 2024/11/24-08:24:13.279329 139957534086720 EVENT_LOG_v1 {"time_micros": 1732407853279293, "cf_name": "default", "job": 43915, "event": "table_file_creation", "file_number": 297496, "file_size": 35770912, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4265679902, "largest_seqno": 4512918568, "table_properties": {"data_size": 29709520, "index_size": 1750464, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25764452, "raw_average_key_size": 28, "raw_value_size": 108453398, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 920159, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732407850, "oldest_key_time": 0, "file_creation_time": 1732407850, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 297496, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-08:24:13.316744 139957534086720 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297497.sst) /dev/shm/ToplingTemp/Topling-305069-WnOv23 2024/11/24-08:24:14.320471 139957534086720 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297497.sst): first pass time = 1.00's, 133.724'MB/sec 2024/11/24-08:24:15.603349 139957534086720 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297497.sst): old prealloc_size = 147639500, real_size = 31312656 2024/11/24-08:24:15.603885 139957534086720 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297497.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 919300 prefix = 4 raw-key = 0.0147 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.93 raw-val = 0.1085 GB zip-val = 0.0293 GB avg-val = 118.00 avg-zval = 31.88 2024/11/24-08:24:15.604621 139957534086720 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297497.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-08:24:16.418228 139957534086720 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297497.sst): second pass time = 1.28's, 84.643'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.81's, 43.289'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3460.514'MB/sec (index lex order gen) rebuild zvType time = 0.69's, 0.334'MB/sec write SST data time = 0.13's, 280.023'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.085'MB, throughput = 33381.842'MB/sec zip my value time = 1.28's, unzip length = 0.108'GB zip my value throughput = 84.643'MB/sec zip pipeline throughput = 84.643'MB/sec entries = 919300 avg-key = 28.00 avg-zkey = 1.93 avg-val = 118.00 avg-zval = 31.88 usrkeys = 919300 avg-key = 20.00 avg-zkey = 1.93 avg-val = 125.00 avg-zval = 31.88 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 919300 bytes = 3102656 } seq expand size = 6435100 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0184 GB value = 0.1085 GB dict = 1.09 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0293 GB dict = 1.09 MB all = 0.0353 GB } UnZip/Zip{ index = 10.3779 value = 3.7009 dict = 1.00 all = 3.8050 } Zip/UnZip{ index = 0.0964 value = 0.2702 dict = 1.00 all = 0.2628 } ---------------------------- total value len = 2253.275853 GB avg = 0.199 KB (by entry num) total key len = 307.324860 GB avg = 0.027 KB total ukey len = 237.670369 GB avg = 0.015 KB total ukey num = 15.754443226 Billion total entry num = 11.295757174 Billion write speed all = 30.287123240 MB/sec (with seq num) write speed all = 29.218261584 MB/sec (without seq num) 2024/11/24-08:24:16.462060 139957534086720 [compaction_job.cc:1948] [default] [JOB 43915] Generated table #297497: 919300 keys, 35274482 bytes, temperature: kWarm 2024/11/24-08:24:16.462139 139957534086720 EVENT_LOG_v1 {"time_micros": 1732407856462096, "cf_name": "default", "job": 43915, "event": "table_file_creation", "file_number": 297497, "file_size": 35274482, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4369871641, "largest_seqno": 4482399338, "table_properties": {"data_size": 29310976, "index_size": 1771648, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25740400, "raw_average_key_size": 28, "raw_value_size": 108477400, "raw_average_value_size": 118, "num_data_blocks": 1, "num_entries": 919300, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 118, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732407853, "oldest_key_time": 0, "file_creation_time": 1732407853, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 297497, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-08:24:16.508941 139957534086720 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297498.sst) /dev/shm/ToplingTemp/Topling-305069-k9j305 2024/11/24-08:24:17.371374 139957534086720 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297498.sst): first pass time = 0.86's, 155.639'MB/sec 2024/11/24-08:24:18.708536 139957534086720 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297498.sst): old prealloc_size = 147639500, real_size = 31666240 2024/11/24-08:24:18.709112 139957534086720 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297498.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 933180 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1081 GB zip-val = 0.0297 GB avg-val = 115.83 avg-zval = 31.78 2024/11/24-08:24:18.709879 139957534086720 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297498.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-08:24:19.551744 139957534086720 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297498.sst): second pass time = 1.34's, 80.916'MB/sec, value only(80.5% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.84's, 42.438'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3195.898'MB/sec (index lex order gen) rebuild zvType time = 0.72's, 0.325'MB/sec write SST data time = 0.13's, 285.454'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 31879.820'MB/sec zip my value time = 1.34's, unzip length = 0.108'GB zip my value throughput = 80.916'MB/sec zip pipeline throughput = 80.916'MB/sec entries = 933180 avg-key = 28.00 avg-zkey = 1.90 avg-val = 115.83 avg-zval = 31.78 usrkeys = 933180 avg-key = 20.00 avg-zkey = 1.90 avg-val = 122.83 avg-zval = 31.78 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 933180 bytes = 3266144 } seq expand size = 6532260 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0187 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0297 GB dict = 1.08 MB all = 0.0358 GB } UnZip/Zip{ index = 10.5152 value = 3.6445 dict = 1.00 all = 3.7509 } Zip/UnZip{ index = 0.0951 value = 0.2744 dict = 1.00 all = 0.2666 } ---------------------------- total value len = 2253.390474 GB avg = 0.199 KB (by entry num) total key len = 307.350989 GB avg = 0.027 KB total ukey len = 237.689032 GB avg = 0.015 KB total ukey num = 15.755376406 Billion total entry num = 11.296690354 Billion write speed all = 30.287665480 MB/sec (with seq num) write speed all = 29.218755140 MB/sec (without seq num) 2024/11/24-08:24:19.597395 139957534086720 [compaction_job.cc:1948] [default] [JOB 43915] Generated table #297498: 933180 keys, 35783024 bytes, temperature: kWarm 2024/11/24-08:24:19.597463 139957534086720 EVENT_LOG_v1 {"time_micros": 1732407859597428, "cf_name": "default", "job": 43915, "event": "table_file_creation", "file_number": 297498, "file_size": 35783024, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4265679921, "largest_seqno": 4512918502, "table_properties": {"data_size": 29657840, "index_size": 1774912, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26129040, "raw_average_key_size": 28, "raw_value_size": 108088828, "raw_average_value_size": 115, "num_data_blocks": 1, "num_entries": 933180, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732407856, "oldest_key_time": 0, "file_creation_time": 1732407856, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 297498, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-08:24:19.640204 139957534086720 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297499.sst) /dev/shm/ToplingTemp/Topling-305069-F8WC06 2024/11/24-08:24:20.639279 139957534086720 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297499.sst): first pass time = 1.00's, 134.348'MB/sec 2024/11/24-08:24:21.934854 139957534086720 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297499.sst): old prealloc_size = 147639500, real_size = 31306192 2024/11/24-08:24:21.935424 139957534086720 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297499.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 919300 prefix = 4 raw-key = 0.0147 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1085 GB zip-val = 0.0293 GB avg-val = 118.00 avg-zval = 31.89 2024/11/24-08:24:21.936188 139957534086720 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297499.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-08:24:22.744028 139957534086720 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297499.sst): second pass time = 1.29's, 83.779'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.81's, 43.587'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3217.871'MB/sec (index lex order gen) rebuild zvType time = 0.68's, 0.337'MB/sec write SST data time = 0.13's, 279.615'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.085'MB, throughput = 27560.009'MB/sec zip my value time = 1.29's, unzip length = 0.108'GB zip my value throughput = 83.779'MB/sec zip pipeline throughput = 83.779'MB/sec entries = 919300 avg-key = 28.00 avg-zkey = 1.91 avg-val = 118.00 avg-zval = 31.89 usrkeys = 919300 avg-key = 20.00 avg-zkey = 1.91 avg-val = 125.00 avg-zval = 31.89 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 919300 bytes = 3102656 } seq expand size = 6435100 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0184 GB value = 0.1085 GB dict = 1.09 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0293 GB dict = 1.09 MB all = 0.0353 GB } UnZip/Zip{ index = 10.4447 value = 3.7003 dict = 1.00 all = 3.8057 } Zip/UnZip{ index = 0.0957 value = 0.2702 dict = 1.00 all = 0.2628 } ---------------------------- total value len = 2253.505386 GB avg = 0.199 KB (by entry num) total key len = 307.376730 GB avg = 0.027 KB total ukey len = 237.707418 GB avg = 0.015 KB total ukey num = 15.756295706 Billion total entry num = 11.297609654 Billion write speed all = 30.288185483 MB/sec (with seq num) write speed all = 29.219228518 MB/sec (without seq num) 2024/11/24-08:24:22.787677 139957534086720 [compaction_job.cc:1948] [default] [JOB 43915] Generated table #297499: 919300 keys, 35268018 bytes, temperature: kWarm 2024/11/24-08:24:22.787746 139957534086720 EVENT_LOG_v1 {"time_micros": 1732407862787710, "cf_name": "default", "job": 43915, "event": "table_file_creation", "file_number": 297499, "file_size": 35268018, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4286273933, "largest_seqno": 4395783122, "table_properties": {"data_size": 29315840, "index_size": 1760320, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25740400, "raw_average_key_size": 28, "raw_value_size": 108477400, "raw_average_value_size": 118, "num_data_blocks": 1, "num_entries": 919300, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 118, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732407859, "oldest_key_time": 0, "file_creation_time": 1732407859, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 297499, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-08:24:22.824261 139957534086720 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297500.sst) /dev/shm/ToplingTemp/Topling-305069-v2EBg7 2024/11/24-08:24:23.729156 139957534086720 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297500.sst): first pass time = 0.90's, 148.329'MB/sec 2024/11/24-08:24:25.043470 139957534086720 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297500.sst): old prealloc_size = 147639500, real_size = 31396592 2024/11/24-08:24:25.044085 139957534086720 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297500.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 919300 prefix = 4 raw-key = 0.0147 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.93 raw-val = 0.1085 GB zip-val = 0.0294 GB avg-val = 118.00 avg-zval = 31.98 2024/11/24-08:24:25.044826 139957534086720 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297500.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-08:24:25.863066 139957534086720 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297500.sst): second pass time = 1.31's, 82.585'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.82's, 43.143'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2991.611'MB/sec (index lex order gen) rebuild zvType time = 0.69's, 0.332'MB/sec write SST data time = 0.13's, 277.443'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.085'MB, throughput = 27420.708'MB/sec zip my value time = 1.31's, unzip length = 0.108'GB zip my value throughput = 82.585'MB/sec zip pipeline throughput = 82.585'MB/sec entries = 919300 avg-key = 28.00 avg-zkey = 1.93 avg-val = 118.00 avg-zval = 31.98 usrkeys = 919300 avg-key = 20.00 avg-zkey = 1.93 avg-val = 125.00 avg-zval = 31.98 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 919300 bytes = 3102656 } seq expand size = 6435100 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0184 GB value = 0.1085 GB dict = 1.09 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0294 GB dict = 1.09 MB all = 0.0354 GB } UnZip/Zip{ index = 10.3764 value = 3.6904 dict = 1.00 all = 3.7959 } Zip/UnZip{ index = 0.0964 value = 0.2710 dict = 1.00 all = 0.2634 } ---------------------------- total value len = 2253.620299 GB avg = 0.199 KB (by entry num) total key len = 307.402470 GB avg = 0.027 KB total ukey len = 237.725804 GB avg = 0.015 KB total ukey num = 15.757215006 Billion total entry num = 11.298528954 Billion write speed all = 30.288731675 MB/sec (with seq num) write speed all = 29.219727163 MB/sec (without seq num) 2024/11/24-08:24:25.906567 139957534086720 [compaction_job.cc:1948] [default] [JOB 43915] Generated table #297500: 919300 keys, 35358450 bytes, temperature: kWarm 2024/11/24-08:24:25.906638 139957534086720 EVENT_LOG_v1 {"time_micros": 1732407865906601, "cf_name": "default", "job": 43915, "event": "table_file_creation", "file_number": 297500, "file_size": 35358450, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4395783123, "largest_seqno": 4509360268, "table_properties": {"data_size": 29394656, "index_size": 1771904, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25740400, "raw_average_key_size": 28, "raw_value_size": 108477400, "raw_average_value_size": 118, "num_data_blocks": 1, "num_entries": 919300, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 118, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732407862, "oldest_key_time": 0, "file_creation_time": 1732407862, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 297500, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-08:24:25.944891 139957534086720 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297501.sst) /dev/shm/ToplingTemp/Topling-305069-gVWqh3 2024/11/24-08:24:27.211832 139957534086720 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297501.sst): first pass time = 1.27's, 105.942'MB/sec 2024/11/24-08:24:28.533146 139957534086720 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297501.sst): old prealloc_size = 147639500, real_size = 32537552 2024/11/24-08:24:28.533696 139957534086720 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297501.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 933158 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1081 GB zip-val = 0.0305 GB avg-val = 115.83 avg-zval = 32.72 2024/11/24-08:24:28.534508 139957534086720 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297501.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-08:24:29.389914 139957534086720 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297501.sst): second pass time = 1.32's, 81.856'MB/sec, value only(80.5% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.86's, 42.783'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3361.418'MB/sec (index lex order gen) rebuild zvType time = 0.73's, 0.319'MB/sec write SST data time = 0.12's, 294.906'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 31145.095'MB/sec zip my value time = 1.32's, unzip length = 0.108'GB zip my value throughput = 81.856'MB/sec zip pipeline throughput = 81.856'MB/sec entries = 933158 avg-key = 28.00 avg-zkey = 1.90 avg-val = 115.83 avg-zval = 32.72 usrkeys = 933158 avg-key = 20.00 avg-zkey = 1.90 avg-val = 122.83 avg-zval = 32.72 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 933158 bytes = 3266064 } seq expand size = 6532106 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0187 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0305 GB dict = 1.08 MB all = 0.0367 GB } UnZip/Zip{ index = 10.5131 value = 3.5406 dict = 1.00 all = 3.6618 } Zip/UnZip{ index = 0.0951 value = 0.2824 dict = 1.00 all = 0.2731 } ---------------------------- total value len = 2253.734920 GB avg = 0.199 KB (by entry num) total key len = 307.428599 GB avg = 0.027 KB total ukey len = 237.744467 GB avg = 0.015 KB total ukey num = 15.758148164 Billion total entry num = 11.299462112 Billion write speed all = 30.289132895 MB/sec (with seq num) write speed all = 29.220084685 MB/sec (without seq num) 2024/11/24-08:24:29.434794 139957534086720 [compaction_job.cc:1948] [default] [JOB 43915] Generated table #297501: 933158 keys, 36653984 bytes, temperature: kWarm 2024/11/24-08:24:29.434877 139957534086720 EVENT_LOG_v1 {"time_micros": 1732407869434834, "cf_name": "default", "job": 43915, "event": "table_file_creation", "file_number": 297501, "file_size": 36653984, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4265679941, "largest_seqno": 4512918360, "table_properties": {"data_size": 30528832, "index_size": 1775232, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26128424, "raw_average_key_size": 28, "raw_value_size": 108089440, "raw_average_value_size": 115, "num_data_blocks": 1, "num_entries": 933158, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732407865, "oldest_key_time": 0, "file_creation_time": 1732407865, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 297501, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-08:24:29.471611 139957534086720 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297502.sst) /dev/shm/ToplingTemp/Topling-305069-tXksr6 2024/11/24-08:24:30.474822 139957534086720 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297502.sst): first pass time = 1.00's, 133.793'MB/sec 2024/11/24-08:24:31.782683 139957534086720 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297502.sst): old prealloc_size = 147639500, real_size = 31411232 2024/11/24-08:24:31.783276 139957534086720 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297502.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 919300 prefix = 4 raw-key = 0.0147 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1085 GB zip-val = 0.0294 GB avg-val = 118.00 avg-zval = 32.00 2024/11/24-08:24:31.784032 139957534086720 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297502.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-08:24:32.594138 139957534086720 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297502.sst): second pass time = 1.31's, 82.991'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.81's, 43.594'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3093.362'MB/sec (index lex order gen) rebuild zvType time = 0.69's, 0.335'MB/sec write SST data time = 0.13's, 282.264'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.085'MB, throughput = 33512.787'MB/sec zip my value time = 1.31's, unzip length = 0.108'GB zip my value throughput = 82.991'MB/sec zip pipeline throughput = 82.991'MB/sec entries = 919300 avg-key = 28.00 avg-zkey = 1.91 avg-val = 118.00 avg-zval = 32.00 usrkeys = 919300 avg-key = 20.00 avg-zkey = 1.91 avg-val = 125.00 avg-zval = 32.00 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 919300 bytes = 3102656 } seq expand size = 6435100 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0184 GB value = 0.1085 GB dict = 1.09 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0294 GB dict = 1.09 MB all = 0.0354 GB } UnZip/Zip{ index = 10.4451 value = 3.6871 dict = 1.00 all = 3.7944 } Zip/UnZip{ index = 0.0957 value = 0.2712 dict = 1.00 all = 0.2635 } ---------------------------- total value len = 2253.849833 GB avg = 0.199 KB (by entry num) total key len = 307.454339 GB avg = 0.027 KB total ukey len = 237.762853 GB avg = 0.015 KB total ukey num = 15.759067464 Billion total entry num = 11.300381412 Billion write speed all = 30.289648500 MB/sec (with seq num) write speed all = 29.220553827 MB/sec (without seq num) 2024/11/24-08:24:32.639036 139957534086720 [compaction_job.cc:1948] [default] [JOB 43915] Generated table #297502: 919300 keys, 35373042 bytes, temperature: kWarm 2024/11/24-08:24:32.639111 139957534086720 EVENT_LOG_v1 {"time_micros": 1732407872639074, "cf_name": "default", "job": 43915, "event": "table_file_creation", "file_number": 297502, "file_size": 35373042, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4311518694, "largest_seqno": 4422307260, "table_properties": {"data_size": 29420944, "index_size": 1760256, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25740400, "raw_average_key_size": 28, "raw_value_size": 108477400, "raw_average_value_size": 118, "num_data_blocks": 1, "num_entries": 919300, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 118, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732407869, "oldest_key_time": 0, "file_creation_time": 1732407869, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 297502, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-08:24:32.685513 139957534086720 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297503.sst) /dev/shm/ToplingTemp/Topling-305069-pf2Np7 2024/11/24-08:24:33.720506 139957534086720 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297503.sst): first pass time = 1.03's, 129.685'MB/sec 2024/11/24-08:24:35.007226 139957534086720 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297503.sst): old prealloc_size = 147639500, real_size = 30992256 2024/11/24-08:24:35.007744 139957534086720 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297503.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 924522 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1083 GB zip-val = 0.0290 GB avg-val = 117.18 avg-zval = 31.36 2024/11/24-08:24:35.008859 139957534086720 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297503.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-08:24:35.823414 139957534086720 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297503.sst): second pass time = 1.29's, 84.247'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.82's, 42.843'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3597.996'MB/sec (index lex order gen) rebuild zvType time = 0.69's, 0.335'MB/sec write SST data time = 0.13's, 277.332'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.082'MB, throughput = 33640.955'MB/sec zip my value time = 1.29's, unzip length = 0.108'GB zip my value throughput = 84.247'MB/sec zip pipeline throughput = 84.247'MB/sec entries = 924522 avg-key = 28.00 avg-zkey = 1.91 avg-val = 117.18 avg-zval = 31.36 usrkeys = 924522 avg-key = 20.00 avg-zkey = 1.91 avg-val = 124.18 avg-zval = 31.36 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 924522 bytes = 3120272 } seq expand size = 6471654 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0290 GB dict = 1.08 MB all = 0.0350 GB } UnZip/Zip{ index = 10.4467 value = 3.7367 dict = 1.00 all = 3.8384 } Zip/UnZip{ index = 0.0957 value = 0.2676 dict = 1.00 all = 0.2605 } ---------------------------- total value len = 2253.964635 GB avg = 0.199 KB (by entry num) total key len = 307.480226 GB avg = 0.027 KB total ukey len = 237.781344 GB avg = 0.015 KB total ukey num = 15.759991986 Billion total entry num = 11.301305934 Billion write speed all = 30.290155525 MB/sec (with seq num) write speed all = 29.221014214 MB/sec (without seq num) 2024/11/24-08:24:35.867341 139957534086720 [compaction_job.cc:1948] [default] [JOB 43915] Generated table #297503: 924522 keys, 34967016 bytes, temperature: kWarm 2024/11/24-08:24:35.867414 139957534086720 EVENT_LOG_v1 {"time_micros": 1732407875867378, "cf_name": "default", "job": 43915, "event": "table_file_creation", "file_number": 297503, "file_size": 34967016, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4422307261, "largest_seqno": 4512918380, "table_properties": {"data_size": 28990960, "index_size": 1769984, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25886616, "raw_average_key_size": 28, "raw_value_size": 108331172, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 924522, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732407872, "oldest_key_time": 0, "file_creation_time": 1732407872, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 297503, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-08:24:35.904787 139957534086720 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297504.sst) /dev/shm/ToplingTemp/Topling-305069-R72Iw5 2024/11/24-08:24:36.913720 139957534086720 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297504.sst): first pass time = 1.01's, 133.035'MB/sec 2024/11/24-08:24:38.264535 139957534086720 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297504.sst): old prealloc_size = 147639500, real_size = 33119824 2024/11/24-08:24:38.265080 139957534086720 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297504.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 928060 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0311 GB avg-val = 116.62 avg-zval = 33.53 2024/11/24-08:24:38.266191 139957534086720 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297504.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-08:24:39.120267 139957534086720 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297504.sst): second pass time = 1.35's, 80.171'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.86's, 43.497'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3394.401'MB/sec (index lex order gen) rebuild zvType time = 0.73's, 0.319'MB/sec write SST data time = 0.13's, 291.682'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 24664.625'MB/sec zip my value time = 1.35's, unzip length = 0.108'GB zip my value throughput = 80.171'MB/sec zip pipeline throughput = 80.171'MB/sec entries = 928060 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.62 avg-zval = 33.53 usrkeys = 928060 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.62 avg-zval = 33.53 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 928060 bytes = 3248224 } seq expand size = 6496420 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0311 GB dict = 1.08 MB all = 0.0372 GB } UnZip/Zip{ index = 10.5121 value = 3.4777 dict = 1.00 all = 3.6060 } Zip/UnZip{ index = 0.0951 value = 0.2875 dict = 1.00 all = 0.2773 } ---------------------------- total value len = 2254.079364 GB avg = 0.199 KB (by entry num) total key len = 307.506211 GB avg = 0.027 KB total ukey len = 237.799905 GB avg = 0.015 KB total ukey num = 15.760920046 Billion total entry num = 11.302233994 Billion write speed all = 30.290638597 MB/sec (with seq num) write speed all = 29.221451173 MB/sec (without seq num) 2024/11/24-08:24:39.165228 139957534086720 [compaction_job.cc:1948] [default] [JOB 43915] Generated table #297504: 928060 keys, 37221164 bytes, temperature: kWarm 2024/11/24-08:24:39.165303 139957534086720 EVENT_LOG_v1 {"time_micros": 1732407879165266, "cf_name": "default", "job": 43915, "event": "table_file_creation", "file_number": 297504, "file_size": 37221164, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4265679961, "largest_seqno": 4512917868, "table_properties": {"data_size": 31121920, "index_size": 1765696, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25985680, "raw_average_key_size": 28, "raw_value_size": 108232152, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 928060, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732407875, "oldest_key_time": 0, "file_creation_time": 1732407875, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 297504, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-08:24:39.204166 139957534086720 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297505.sst) /dev/shm/ToplingTemp/Topling-305069-TKSAk6 2024/11/24-08:24:40.056230 139957534086720 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297505.sst): first pass time = 0.85's, 157.528'MB/sec 2024/11/24-08:24:41.356163 139957534086720 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297505.sst): old prealloc_size = 147639500, real_size = 31261904 2024/11/24-08:24:41.356676 139957534086720 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297505.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 919300 prefix = 4 raw-key = 0.0147 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1085 GB zip-val = 0.0293 GB avg-val = 118.00 avg-zval = 31.84 2024/11/24-08:24:41.358597 139957534086720 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297505.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-08:24:42.168949 139957534086720 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297505.sst): second pass time = 1.30's, 83.519'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.81's, 43.339'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3608.202'MB/sec (index lex order gen) rebuild zvType time = 0.68's, 0.337'MB/sec write SST data time = 0.13's, 269.901'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.085'MB, throughput = 33192.915'MB/sec zip my value time = 1.30's, unzip length = 0.108'GB zip my value throughput = 83.519'MB/sec zip pipeline throughput = 83.519'MB/sec entries = 919300 avg-key = 28.00 avg-zkey = 1.91 avg-val = 118.00 avg-zval = 31.84 usrkeys = 919300 avg-key = 20.00 avg-zkey = 1.91 avg-val = 125.00 avg-zval = 31.84 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 919300 bytes = 3102656 } seq expand size = 6435100 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0184 GB value = 0.1085 GB dict = 1.09 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0293 GB dict = 1.09 MB all = 0.0352 GB } UnZip/Zip{ index = 10.4443 value = 3.7059 dict = 1.00 all = 3.8104 } Zip/UnZip{ index = 0.0957 value = 0.2698 dict = 1.00 all = 0.2624 } ---------------------------- total value len = 2254.194277 GB avg = 0.199 KB (by entry num) total key len = 307.531952 GB avg = 0.027 KB total ukey len = 237.818291 GB avg = 0.015 KB total ukey num = 15.761839346 Billion total entry num = 11.303153294 Billion write speed all = 30.291209799 MB/sec (with seq num) write speed all = 29.221973957 MB/sec (without seq num) 2024/11/24-08:24:42.212560 139957534086720 [compaction_job.cc:1948] [default] [JOB 43915] Generated table #297505: 919300 keys, 35223730 bytes, temperature: kWarm 2024/11/24-08:24:42.212631 139957534086720 EVENT_LOG_v1 {"time_micros": 1732407882212595, "cf_name": "default", "job": 43915, "event": "table_file_creation", "file_number": 297505, "file_size": 35223730, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4336269270, "largest_seqno": 4447975541, "table_properties": {"data_size": 29271488, "index_size": 1760384, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25740400, "raw_average_key_size": 28, "raw_value_size": 108477400, "raw_average_value_size": 118, "num_data_blocks": 1, "num_entries": 919300, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 118, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732407879, "oldest_key_time": 0, "file_creation_time": 1732407879, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 297505, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-08:24:42.254059 139957534086720 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297506.sst) /dev/shm/ToplingTemp/Topling-305069-KjFIV5 2024/11/24-08:24:43.278912 139957534086720 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297506.sst): first pass time = 1.02's, 130.968'MB/sec 2024/11/24-08:24:44.572914 139957534086720 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297506.sst): old prealloc_size = 147639500, real_size = 30206960 2024/11/24-08:24:44.573483 139957534086720 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297506.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 930479 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1082 GB zip-val = 0.0282 GB avg-val = 116.25 avg-zval = 30.30 2024/11/24-08:24:44.574271 139957534086720 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297506.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-08:24:45.392853 139957534086720 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297506.sst): second pass time = 1.29's, 83.642'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.82's, 41.567'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3285.083'MB/sec (index lex order gen) rebuild zvType time = 0.69's, 0.336'MB/sec write SST data time = 0.13's, 267.193'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 31645.374'MB/sec zip my value time = 1.29's, unzip length = 0.108'GB zip my value throughput = 83.642'MB/sec zip pipeline throughput = 83.642'MB/sec entries = 930479 avg-key = 28.00 avg-zkey = 1.91 avg-val = 116.25 avg-zval = 30.30 usrkeys = 930479 avg-key = 20.00 avg-zkey = 1.91 avg-val = 123.25 avg-zval = 30.30 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 930479 bytes = 3024064 } seq expand size = 6513353 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0282 GB dict = 1.08 MB all = 0.0341 GB } UnZip/Zip{ index = 10.4452 value = 3.8366 dict = 1.00 all = 3.9382 } Zip/UnZip{ index = 0.0957 value = 0.2606 dict = 1.00 all = 0.2539 } ---------------------------- total value len = 2254.308954 GB avg = 0.199 KB (by entry num) total key len = 307.558005 GB avg = 0.027 KB total ukey len = 237.836901 GB avg = 0.015 KB total ukey num = 15.762769825 Billion total entry num = 11.304083773 Billion write speed all = 30.291719127 MB/sec (with seq num) write speed all = 29.222436026 MB/sec (without seq num) 2024/11/24-08:24:45.435387 139957534086720 [compaction_job.cc:1948] [default] [JOB 43915] Generated table #297506: 930479 keys, 34080954 bytes, temperature: kWarm 2024/11/24-08:24:45.435454 139957534086720 EVENT_LOG_v1 {"time_micros": 1732407885435419, "cf_name": "default", "job": 43915, "event": "table_file_creation", "file_number": 297506, "file_size": 34080954, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4447975542, "largest_seqno": 4512918396, "table_properties": {"data_size": 28192544, "index_size": 1781632, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26053412, "raw_average_key_size": 28, "raw_value_size": 108164430, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 930479, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732407882, "oldest_key_time": 0, "file_creation_time": 1732407882, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 297506, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-08:24:45.472129 139957534086720 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297507.sst) /dev/shm/ToplingTemp/Topling-305069-Masnn7 2024/11/24-08:24:46.469245 139957534086720 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297507.sst): first pass time = 1.00's, 134.611'MB/sec 2024/11/24-08:24:47.786442 139957534086720 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297507.sst): old prealloc_size = 147639500, real_size = 32415136 2024/11/24-08:24:47.787008 139957534086720 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297507.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 922135 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1084 GB zip-val = 0.0304 GB avg-val = 117.55 avg-zval = 33.00 2024/11/24-08:24:47.787775 139957534086720 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297507.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-08:24:48.622015 139957534086720 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297507.sst): second pass time = 1.32's, 82.372'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.84's, 43.686'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3220.551'MB/sec (index lex order gen) rebuild zvType time = 0.71's, 0.326'MB/sec write SST data time = 0.13's, 283.725'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.083'MB, throughput = 37373.422'MB/sec zip my value time = 1.32's, unzip length = 0.108'GB zip my value throughput = 82.372'MB/sec zip pipeline throughput = 82.372'MB/sec entries = 922135 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.55 avg-zval = 33.00 usrkeys = 922135 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.55 avg-zval = 33.00 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 922135 bytes = 3227488 } seq expand size = 6454945 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0184 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0304 GB dict = 1.08 MB all = 0.0365 GB } UnZip/Zip{ index = 10.5140 value = 3.5622 dict = 1.00 all = 3.6771 } Zip/UnZip{ index = 0.0951 value = 0.2807 dict = 1.00 all = 0.2720 } ---------------------------- total value len = 2254.423807 GB avg = 0.199 KB (by entry num) total key len = 307.583825 GB avg = 0.027 KB total ukey len = 237.855343 GB avg = 0.015 KB total ukey num = 15.763691960 Billion total entry num = 11.305005908 Billion write speed all = 30.292225840 MB/sec (with seq num) write speed all = 29.222896342 MB/sec (without seq num) 2024/11/24-08:24:48.667874 139957534086720 [compaction_job.cc:1948] [default] [JOB 43915] Generated table #297507: 922135 keys, 36501178 bytes, temperature: kWarm 2024/11/24-08:24:48.667944 139957534086720 EVENT_LOG_v1 {"time_micros": 1732407888667908, "cf_name": "default", "job": 43915, "event": "table_file_creation", "file_number": 297507, "file_size": 36501178, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4265679976, "largest_seqno": 4512917806, "table_properties": {"data_size": 30430288, "index_size": 1754112, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25819780, "raw_average_key_size": 28, "raw_value_size": 108397958, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 922135, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732407885, "oldest_key_time": 0, "file_creation_time": 1732407885, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 297507, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-08:24:48.706258 139957534086720 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297508.sst) /dev/shm/ToplingTemp/Topling-305069-ogblI3 2024/11/24-08:24:49.625306 139957534086720 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297508.sst): first pass time = 0.92's, 146.046'MB/sec 2024/11/24-08:24:50.947149 139957534086720 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297508.sst): old prealloc_size = 147639500, real_size = 31329152 2024/11/24-08:24:50.947710 139957534086720 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297508.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 919300 prefix = 4 raw-key = 0.0147 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1085 GB zip-val = 0.0293 GB avg-val = 118.00 avg-zval = 31.91 2024/11/24-08:24:50.948785 139957534086720 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297508.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/24-08:24:51.767021 139957534086720 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297508.sst): second pass time = 1.32's, 82.113'MB/sec, value only(80.8% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.82's, 43.047'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3291.421'MB/sec (index lex order gen) rebuild zvType time = 0.69's, 0.333'MB/sec write SST data time = 0.13's, 272.234'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.085'MB, throughput = 34279.350'MB/sec zip my value time = 1.32's, unzip length = 0.108'GB zip my value throughput = 82.113'MB/sec zip pipeline throughput = 82.113'MB/sec entries = 919300 avg-key = 28.00 avg-zkey = 1.92 avg-val = 118.00 avg-zval = 31.91 usrkeys = 919300 avg-key = 20.00 avg-zkey = 1.92 avg-val = 125.00 avg-zval = 31.91 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 919300 bytes = 3102656 } seq expand size = 6435100 multi value expand size = 0 cnt WriteAppend = 12 UnZipSize{ index = 0.0184 GB value = 0.1085 GB dict = 1.09 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0293 GB dict = 1.09 MB all = 0.0353 GB } UnZip/Zip{ index = 10.4436 value = 3.6974 dict = 1.00 all = 3.8032 } Zip/UnZip{ index = 0.0958 value = 0.2705 dict = 1.00 all = 0.2629 } ---------------------------- total value len = 2254.538720 GB avg = 0.199 KB (by entry num) total key len = 307.609565 GB avg = 0.027 KB total ukey len = 237.873729 GB avg = 0.015 KB total ukey num = 15.764611260 Billion total entry num = 11.305925208 Billion write speed all = 30.292762419 MB/sec (with seq num) write speed all = 29.223385730 MB/sec (without seq num) 2024/11/24-08:24:51.812342 139957534086720 [compaction_job.cc:1948] [default] [JOB 43915] Generated table #297508: 919300 keys, 35290994 bytes, temperature: kWarm 2024/11/24-08:24:51.812411 139957534086720 EVENT_LOG_v1 {"time_micros": 1732407891812376, "cf_name": "default", "job": 43915, "event": "table_file_creation", "file_number": 297508, "file_size": 35290994, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4361267854, "largest_seqno": 4473804136, "table_properties": {"data_size": 29338608, "index_size": 1760512, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25740400, "raw_average_key_size": 28, "raw_value_size": 108477400, "raw_average_value_size": 118, "num_data_blocks": 1, "num_entries": 919300, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 118, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732407888, "oldest_key_time": 0, "file_creation_time": 1732407888, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 297508, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-08:24:51.853853 139957534086720 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297509.sst) /dev/shm/ToplingTemp/Topling-305069-R0DiJ6 2024/11/24-08:24:52.365589 139957534086720 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297509.sst): first pass time = 0.51's, 225.014'MB/sec 2024/11/24-08:24:53.486105 139957534086720 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297509.sst): old prealloc_size = 147639500, real_size = 26101552 2024/11/24-08:24:53.486604 139957534086720 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297509.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 801992 prefix = 4 raw-key = 0.0128 GB zip-key = 0.0015 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.0927 GB zip-val = 0.0244 GB avg-val = 115.56 avg-zval = 30.38 2024/11/24-08:24:53.487270 139957534086720 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297509.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.006 GB, reorder workingMem = 0.0020 GB, waited 0.000 sec, Key+Value = 0.115 GB 2024/11/24-08:24:54.213903 139957534086720 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00/297509.sst): second pass time = 1.12's, 82.774'MB/sec, value only(80.5% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.73's, 40.449'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3227.694'MB/sec (index lex order gen) rebuild zvType time = 0.62's, 0.325'MB/sec write SST data time = 0.11's, 266.992'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.926'MB, throughput = 31478.500'MB/sec zip my value time = 1.12's, unzip length = 0.093'GB zip my value throughput = 82.774'MB/sec zip pipeline throughput = 82.774'MB/sec entries = 801992 avg-key = 28.00 avg-zkey = 1.91 avg-val = 115.56 avg-zval = 30.38 usrkeys = 801992 avg-key = 20.00 avg-zkey = 1.91 avg-val = 122.56 avg-zval = 30.38 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 801992 bytes = 2606496 } seq expand size = 5613944 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0160 GB value = 0.0927 GB dict = 0.93 MB all = 0.1151 GB } __ZipSize{ index = 0.0015 GB value = 0.0244 GB dict = 0.93 MB all = 0.0294 GB } UnZip/Zip{ index = 10.4439 value = 3.8039 dict = 1.00 all = 3.9113 } Zip/UnZip{ index = 0.0957 value = 0.2629 dict = 1.00 all = 0.2557 } ---------------------------- total value len = 2254.637015 GB avg = 0.199 KB (by entry num) total key len = 307.632021 GB avg = 0.027 KB total ukey len = 237.889769 GB avg = 0.015 KB total ukey num = 15.765413252 Billion total entry num = 11.306727200 Billion write speed all = 30.293313699 MB/sec (with seq num) write speed all = 29.223892092 MB/sec (without seq num) 2024/11/24-08:24:54.254661 139957534086720 [compaction_job.cc:1948] [default] [JOB 43915] Generated table #297509: 801992 keys, 29437250 bytes, temperature: kWarm 2024/11/24-08:24:54.254732 139957534086720 EVENT_LOG_v1 {"time_micros": 1732407894254696, "cf_name": "default", "job": 43915, "event": "table_file_creation", "file_number": 297509, "file_size": 29437250, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4457153551, "largest_seqno": 4512918409, "table_properties": {"data_size": 24365088, "index_size": 1535808, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 22455776, "raw_average_key_size": 28, "raw_value_size": 92681644, "raw_average_value_size": 115, "num_data_blocks": 1, "num_entries": 801992, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732407891, "oldest_key_time": 0, "file_creation_time": 1732407891, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 297509, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/24-08:24:54.280554 139957534086720 [compaction_job.cc:703] job-43915: subcompact[0], size: 1.018563 G, files: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-43915/att-00 [297481,297482,297483,297484,297485,297486,297487,297488,297489,297490,297491,297492,297493,297494,297495,297496,297497,297498,297499,297500,297501,297502,297503,297504,297505,297506,297507,297508,297509] 2024/11/24-08:24:54.495058 139957534086720 (Original Log Time 2024/11/24-08:23:15.906324) EVENT_LOG_v1 {"time_micros": 1732407795906284, "job": 43915, "event": "compaction_started", "compaction_reason": "FilesMarkedForCompaction", "files_L2": [297477], "files_L3": [297427, 297428, 297429, 297430, 297431, 297432, 297433, 297434, 297435, 297436, 297437, 297438, 297439, 297440, 297441, 297442, 297443, 297444, 297445, 297446, 297447, 297398, 297399, 297400, 297401, 297402, 297403, 297404, 297405, 297406], "score": 0.778448, "input_data_size": 1043635850, "oldest_snapshot_seqno": 4512929331} 2024/11/24-08:24:54.495062 139957534086720 (Original Log Time 2024/11/24-08:24:54.493403) [compaction_job.cc:2022] [default] [JOB 43915] Compacted 1@2 + 30@3 files to L3 => 1018563356 bytes 2024/11/24-08:24:54.495063 139957534086720 (Original Log Time 2024/11/24-08:24:54.494965) [compaction_job.cc:1224] [default] compacted to: files[0 0 0 29 0 0 0] max score 0.04, MB/sec: 10.6 rd, 10.4 wr, level 3, files in(1, 30) out(29 +0 blob) MB in(27.1, 968.2 +0.0 blob) out(971.4 +0.0 blob), read-write-amplify(72.6) write-amplify(35.8) OK, records in: 26855715, records dropped: 103626 output_compression: Snappy 2024/11/24-08:24:54.495066 139957534086720 (Original Log Time 2024/11/24-08:24:54.495029) EVENT_LOG_v1 {"time_micros": 1732407894495006, "cf": "default", "job": 43915, "event": "compaction_finished", "compaction_time_micros": 98374239, "compaction_time_cpu_micros": 41140158, "output_level": 3, "num_output_files": 29, "total_output_size": 1018563356, "num_input_records": 26855715, "num_output_records": 26752089, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "file_write_nanos": 726196396, "file_range_sync_nanos": 0, "file_fsync_nanos": 21145, "file_prepare_write_nanos": 68202, "lsm_state": [0, 0, 0, 29, 0, 0, 0]} 2024/11/24-08:24:54.622625 139957534086720 DEBG dcompact_worker.cpp:240: HttpPost: 200 OK: url = http://nlb-7zny4kaa1poal01o64.cn-shenzhen.nlb.aliyuncs.com:8443, body = {"instanceId":"nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137","labourId":"","dbId":"d89b4006-2803-486e-b7a2-759bcf348921","dbStarts":1732256054,"starts":1732407795,"executesMs":98714,"compactionJobId":43915,"attempt":0,"compactionInputRawBytes":3887950890,"compactionInputZipBytes":1043635850,"compactionOutputRawBytes":0,"compactionOutputZipBytes":1018563356,"headers":{"Accept":"*/*","Connection":"close","Host":"aliyun-topling-saas.topling.cn:18443","RemoteIp":"120.24.192.169","X-Forwarded-For":"120.24.192.169","region":"cn-shenzhen","token":"e6474c481bd4415abc537135cc03626b","instance-token":"e6474c481bd4415abc537135cc03626b","provider":"aliyun","CloudMarketInstanceId":"si-59c0ae5c955845588903","MeteringAssit":"","Transfer-Encoding":"chunked","traceparent":"00-ce96e5ff95716b829160c3d361d480e2-799b04c5cdaa9c22-00"}}, response = 2024/11/24-08:24:54.622689 139957534086720 INFO dcompact_worker.cpp:1459: finish /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-43915/att-00: olev 3, work 98.714 s, result 7.744 ms, install 1.678 ms, input{raw 3.621 GiB zip 995.289 MiB}