2024/11/23-16:11:56.633680 139957475337792 DEBG dcompact_worker.cpp:2214: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00: fork to child time = 0.023429 sec 2024/11/23-16:11:56.634622 139957475337792 DEBG dcompact_worker.cpp:1013: Beg SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00 2024/11/23-16:11:56.643029 139957475337792 DEBG dcompact_worker.cpp:1033: End SerDeRead: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00 2024/11/23-16:11:56.644278 139957475337792 TRAC dcompact_worker.cpp:1083: INFO_LOG_LEVEL: rpc = INFO_LEVEL, env_var = undefined 2024/11/23-16:11:56.644642 139957475337792 [WARN] [column_family.cc:386] multiple cf_paths/db_paths and level_compaction_dynamic_level_bytes can't be used together 2024/11/23-16:11:56.696304 139957475337792 [version_set.cc:6208] Recovering from manifest file: /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-30309/att-00/MANIFEST-206347 2024/11/23-16:11:56.732632 139957475337792 [version_set.cc:6251] Recovered from manifest file:/worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-30309/att-00/MANIFEST-206347 succeeded,manifest_file_number is 206347, next_file_number is 268721, last_sequence is 4098699922, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 268571 2024/11/23-16:11:56.732644 139957475337792 [version_set.cc:6266] Column family [default] (ID 0), log number is 0 2024/11/23-16:11:56.732848 139957475337792 [version_set.cc:5721] Creating manifest 268721 2024/11/23-16:11:56.785057 139957475337792 DEBG dcompact_worker.cpp:1218: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00: bottommost_level: fake = 1, rpc = 0 2024/11/23-16:11:56.810660 139957475337792 [compaction_job.cc:2437] [default] [JOB 30309] Compacting 1@2 + 21@3 files to L3, score 1.00, subcompactions 1 : 1 2024/11/23-16:11:56.810688 139957475337792 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 22656 Base level 2, inputs: [268704(27MB)], [268655(38MB) 268656(39MB) 268658(34MB) 268659(34MB) 268660(36MB) 268661(34MB) 268662(34MB) 268663(35MB) 268664(36MB) 268665(38MB) 268666(37MB) 268667(35MB) 268668(35MB) 268669(36MB) 268670(33MB) 268671(37MB) 268672(33MB) 268673(33MB) 268674(35MB) 268675(37MB) 268716(38MB)] 2024/11/23-16:11:56.819443 139957475337792 [top_zip_table.cc:59] core git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-16:11:56.819486 139957475337792 [top_zip_table.cc:60] fsa git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-16:11:56.819517 139957475337792 [top_zip_table.cc:61] zbs git_version_hash_info_is:commit fc4ab4f2fbfdcdfa23a955d69e26d2fc533b902d Author: leipeng Date: 2024-04-16 20:29:43 +0800 test_sso.cpp: test swap g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/re2 -I3rdparty/zstd -Iboost-include CXXFLAGS = -D TOPLING_IO_WITH_URING=1 -fPIC -time -Wno-class-memaccess -fdiagnostics-color -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -mcx16 -Wno-deprecated-declarations -Wstrict-aliasing=3 -DCLIENT_LICENSE_ID="public" -DNO_THREADS -ftls-model=initial-exec -DDIVSUFSORT_API= -fno-stack-protector RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 2024/11/23-16:11:56.819527 139957475337792 [top_zip_table.cc:62] topling-zip_table_reader: git_version_hash_info_is: commit a4a382006cb82713acf5b3425835f22711877681 Author: leipeng Date: 2024-04-11 19:44:14 +0800 fixed_len_hole_index.cc: Add env bool FixedLenHoleIndexUseAVX512 for ut & debug 1. FixedLenHoleIndexUseAVX512 is only in unit tests or debug 2. In release mode, use avx512 by compile options(-march=) g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/23-16:11:56.819544 139957475337792 [top_zip_table.cc:64] topling-rocks git_version_hash_info_is: commit feab587e468621ba0204d47b4ffacc52e7c4290d Author: leipeng Date: 2024-03-22 13:35:06 +0800 ToplingZipTableBuilder::Add: immediately return after error This function returns void, and caller does not check builder->status() after calling this function and graceful abandon. So immediately return after error, and return error status in Finish(). g++ (GCC) 12.1.0 Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/23-16:11:57.490333 139957475337792 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268722.sst) /dev/shm/ToplingTemp/Topling-109003-nbGhrt 2024/11/23-16:11:58.218022 139957475337792 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268722.sst): first pass time = 0.73's, 184.460'MB/sec 2024/11/23-16:12:00.126791 139957475337792 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268722.sst): old prealloc_size = 147639500, real_size = 36985488 2024/11/23-16:12:00.127389 139957475337792 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268722.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 927682 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0350 GB avg-val = 116.68 avg-zval = 37.72 2024/11/23-16:12:00.128185 139957475337792 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268722.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:12:01.620296 139957475337792 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268722.sst): second pass time = 1.91's, 56.752'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.49's, 27.355'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3059.045'MB/sec (index lex order gen) rebuild zvType time = 1.22's, 0.190'MB/sec write SST data time = 0.27's, 150.031'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 35926.887'MB/sec zip my value time = 1.91's, unzip length = 0.108'GB zip my value throughput = 56.752'MB/sec zip pipeline throughput = 113.900'MB/sec entries = 927682 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.68 avg-zval = 37.72 usrkeys = 927682 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.68 avg-zval = 37.72 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 927682 bytes = 3014976 } seq expand size = 6493774 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0350 GB dict = 1.08 MB all = 0.0409 GB } UnZip/Zip{ index = 10.5132 value = 3.0937 dict = 1.00 all = 3.2853 } Zip/UnZip{ index = 0.0951 value = 0.3232 dict = 1.00 all = 0.3044 } ---------------------------- total value len = 8.963356 GB avg = 0.168 KB (by entry num) total key len = 1.466796 GB avg = 0.028 KB total ukey len = 1.016432 GB avg = 0.015 KB total ukey num = 0.066478117 Billion total entry num = 0.053285846 Billion write speed all = 0.397954561 MB/sec (with seq num) write speed all = 0.381689912 MB/sec (without seq num) 2024/11/23-16:12:01.676034 139957475337792 [compaction_job.cc:1948] [default] [JOB 30309] Generated table #268722: 927682 keys, 40854486 bytes, temperature: kWarm 2024/11/23-16:12:01.676163 139957475337792 EVENT_LOG_v1 {"time_micros": 1732349521676082, "cf_name": "default", "job": 30309, "event": "table_file_creation", "file_number": 268722, "file_size": 40854486, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4051668904, "largest_seqno": 4098572731, "table_properties": {"data_size": 34988608, "index_size": 1764800, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25975096, "raw_average_key_size": 28, "raw_value_size": 108242760, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 927682, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732349517, "oldest_key_time": 0, "file_creation_time": 1732349517, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 268722, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:12:01.749110 139957475337792 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268723.sst) /dev/shm/ToplingTemp/Topling-109003-9BkGSv 2024/11/23-16:12:03.007840 139957475337792 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268723.sst): first pass time = 1.26's, 106.635'MB/sec 2024/11/23-16:12:05.003658 139957475337792 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268723.sst): old prealloc_size = 147639500, real_size = 37099712 2024/11/23-16:12:05.004259 139957475337792 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268723.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 929684 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0351 GB avg-val = 116.37 avg-zval = 37.75 2024/11/23-16:12:05.005086 139957475337792 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268723.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:12:05.916128 139957475337792 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268723.sst): second pass time = 2.00's, 54.226'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.91's, 45.292'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3096.935'MB/sec (index lex order gen) rebuild zvType time = 0.69's, 0.339'MB/sec write SST data time = 0.23's, 182.788'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 37480.596'MB/sec zip my value time = 2.00's, unzip length = 0.108'GB zip my value throughput = 54.226'MB/sec zip pipeline throughput = 120.202'MB/sec entries = 929684 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.37 avg-zval = 37.75 usrkeys = 929684 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.37 avg-zval = 37.75 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 929684 bytes = 3370112 } seq expand size = 6507788 multi value expand size = 0 cnt WriteAppend = 15 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0351 GB dict = 1.08 MB all = 0.0413 GB } UnZip/Zip{ index = 10.5134 value = 3.0824 dict = 1.00 all = 3.2478 } Zip/UnZip{ index = 0.0951 value = 0.3244 dict = 1.00 all = 0.3079 } ---------------------------- total value len = 9.078051 GB avg = 0.167 KB (by entry num) total key len = 1.492827 GB avg = 0.028 KB total ukey len = 1.035025 GB avg = 0.015 KB total ukey num = 0.067407801 Billion total entry num = 0.054215530 Billion write speed all = 0.403257740 MB/sec (with seq num) write speed all = 0.386712033 MB/sec (without seq num) 2024/11/23-16:12:05.969319 139957475337792 [compaction_job.cc:1948] [default] [JOB 30309] Generated table #268723: 929684 keys, 41325796 bytes, temperature: kWarm 2024/11/23-16:12:05.969418 139957475337792 EVENT_LOG_v1 {"time_micros": 1732349525969362, "cf_name": "default", "job": 30309, "event": "table_file_creation", "file_number": 268723, "file_size": 41325796, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3583362754, "largest_seqno": 4098572275, "table_properties": {"data_size": 35098544, "index_size": 1768576, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26031152, "raw_average_key_size": 28, "raw_value_size": 108186576, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 929684, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732349521, "oldest_key_time": 0, "file_creation_time": 1732349521, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 268723, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:12:06.041009 139957475337792 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268724.sst) /dev/shm/ToplingTemp/Topling-109003-2N4Ppv 2024/11/23-16:12:07.177678 139957475337792 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268724.sst): first pass time = 1.14's, 118.086'MB/sec 2024/11/23-16:12:08.775386 139957475337792 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268724.sst): old prealloc_size = 147639500, real_size = 33853632 2024/11/23-16:12:08.775905 139957475337792 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268724.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 930126 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0319 GB avg-val = 116.30 avg-zval = 34.24 2024/11/23-16:12:08.776703 139957475337792 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268724.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:12:09.817754 139957475337792 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268724.sst): second pass time = 1.60's, 67.742'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.04's, 36.419'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3567.176'MB/sec (index lex order gen) rebuild zvType time = 0.81's, 0.288'MB/sec write SST data time = 0.23's, 162.656'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 36556.422'MB/sec zip my value time = 1.60's, unzip length = 0.108'GB zip my value throughput = 67.742'MB/sec zip pipeline throughput = 89.278'MB/sec entries = 930126 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.30 avg-zval = 34.24 usrkeys = 930126 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.30 avg-zval = 34.24 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 930126 bytes = 3255456 } seq expand size = 6510882 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0319 GB dict = 1.08 MB all = 0.0380 GB } UnZip/Zip{ index = 10.5146 value = 3.3962 dict = 1.00 all = 3.5357 } Zip/UnZip{ index = 0.0951 value = 0.2944 dict = 1.00 all = 0.2828 } ---------------------------- total value len = 9.192736 GB avg = 0.167 KB (by entry num) total key len = 1.518871 GB avg = 0.028 KB total ukey len = 1.053628 GB avg = 0.015 KB total ukey num = 0.068337927 Billion total entry num = 0.055145656 Billion write speed all = 0.408565448 MB/sec (with seq num) write speed all = 0.391738385 MB/sec (without seq num) 2024/11/23-16:12:09.867833 139957475337792 [compaction_job.cc:1948] [default] [JOB 30309] Generated table #268724: 930126 keys, 37961164 bytes, temperature: kWarm 2024/11/23-16:12:09.867924 139957475337792 EVENT_LOG_v1 {"time_micros": 1732349529867875, "cf_name": "default", "job": 30309, "event": "table_file_creation", "file_number": 268724, "file_size": 37961164, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3801926538, "largest_seqno": 4012776192, "table_properties": {"data_size": 31851696, "index_size": 1769216, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26043528, "raw_average_key_size": 28, "raw_value_size": 108174324, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 930126, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732349526, "oldest_key_time": 0, "file_creation_time": 1732349526, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 268724, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:12:09.919657 139957475337792 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268725.sst) /dev/shm/ToplingTemp/Topling-109003-BzWuHu 2024/11/23-16:12:10.916790 139957475337792 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268725.sst): first pass time = 1.00's, 134.610'MB/sec 2024/11/23-16:12:12.376015 139957475337792 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268725.sst): old prealloc_size = 147639500, real_size = 33591952 2024/11/23-16:12:12.376656 139957475337792 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268725.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 1088338 prefix = 4 raw-key = 0.0174 GB zip-key = 0.0021 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1037 GB zip-val = 0.0312 GB avg-val = 95.32 avg-zval = 28.70 2024/11/23-16:12:12.377083 139957475337792 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268725.sst: sumWaitingMem = 0.003 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0029 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:12:13.204132 139957475337792 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268725.sst): second pass time = 1.46's, 71.134'MB/sec, value only(77.3% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.83's, 43.079'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3357.079'MB/sec (index lex order gen) rebuild zvType time = 0.61's, 0.449'MB/sec write SST data time = 0.22's, 160.688'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.038'MB, throughput = 32420.145'MB/sec zip my value time = 1.46's, unzip length = 0.104'GB zip my value throughput = 71.134'MB/sec zip pipeline throughput = 71.134'MB/sec entries = 1088338 avg-key = 28.00 avg-zkey = 1.91 avg-val = 95.32 avg-zval = 28.70 usrkeys = 1088338 avg-key = 20.00 avg-zkey = 1.91 avg-val = 97.57 avg-zval = 28.70 TagRS{ kinds = RS_Key0_TagN bytes = 170160 } TagArray{ size = 349220 bytes = 1134976 } seq expand size = 2444540 multi value expand size = 0 cnt WriteAppend = 17 UnZipSize{ index = 0.0218 GB value = 0.1037 GB dict = 1.04 MB all = 0.1342 GB } __ZipSize{ index = 0.0021 GB value = 0.0312 GB dict = 1.04 MB all = 0.0357 GB } UnZip/Zip{ index = 10.4461 value = 3.3213 dict = 1.00 all = 3.7624 } Zip/UnZip{ index = 0.0957 value = 0.3011 dict = 1.00 all = 0.2658 } ---------------------------- total value len = 9.298925 GB avg = 0.165 KB (by entry num) total key len = 1.549344 GB avg = 0.028 KB total ukey len = 1.075395 GB avg = 0.015 KB total ukey num = 0.069426265 Billion total entry num = 0.056233994 Billion write speed all = 0.413724630 MB/sec (with seq num) write speed all = 0.396567689 MB/sec (without seq num) 2024/11/23-16:12:13.250927 139957475337792 [compaction_job.cc:1948] [default] [JOB 30309] Generated table #268725: 1088338 keys, 35673687 bytes, temperature: kWarm 2024/11/23-16:12:13.251031 139957475337792 EVENT_LOG_v1 {"time_micros": 1732349533250970, "cf_name": "default", "job": 30309, "event": "table_file_creation", "file_number": 268725, "file_size": 35673687, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4012775259, "table_properties": {"data_size": 31235968, "index_size": 2083712, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 30473464, "raw_average_key_size": 28, "raw_value_size": 103744401, "raw_average_value_size": 95, "num_data_blocks": 1, "num_entries": 1088338, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732349529, "oldest_key_time": 0, "file_creation_time": 1732349529, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 268725, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:12:13.314724 139957475337792 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268726.sst) /dev/shm/ToplingTemp/Topling-109003-5TvZQv 2024/11/23-16:12:14.393649 139957475337792 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268726.sst): first pass time = 1.08's, 124.405'MB/sec 2024/11/23-16:12:16.043207 139957475337792 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268726.sst): old prealloc_size = 147639500, real_size = 36605440 2024/11/23-16:12:16.043755 139957475337792 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268726.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 924651 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0346 GB avg-val = 117.16 avg-zval = 37.44 2024/11/23-16:12:16.044104 139957475337792 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268726.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:12:16.939530 139957475337792 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268726.sst): second pass time = 1.65's, 65.707'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.90's, 43.038'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3346.580'MB/sec (index lex order gen) rebuild zvType time = 0.67's, 0.347'MB/sec write SST data time = 0.23's, 167.498'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 37220.115'MB/sec zip my value time = 1.65's, unzip length = 0.108'GB zip my value throughput = 65.707'MB/sec zip pipeline throughput = 65.707'MB/sec entries = 924651 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.16 avg-zval = 37.44 usrkeys = 924651 avg-key = 20.00 avg-zkey = 1.90 avg-val = 119.24 avg-zval = 37.44 TagRS{ kinds = RS_Key0_TagN bytes = 144560 } TagArray{ size = 275366 bytes = 963792 } seq expand size = 1927562 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0346 GB dict = 1.08 MB all = 0.0386 GB } UnZip/Zip{ index = 10.5139 value = 3.1295 dict = 1.00 all = 3.4795 } Zip/UnZip{ index = 0.0951 value = 0.3195 dict = 1.00 all = 0.2874 } ---------------------------- total value len = 9.409180 GB avg = 0.165 KB (by entry num) total key len = 1.575235 GB avg = 0.028 KB total ukey len = 1.093888 GB avg = 0.016 KB total ukey num = 0.070350916 Billion total entry num = 0.057158645 Billion write speed all = 0.418857187 MB/sec (with seq num) write speed all = 0.401420621 MB/sec (without seq num) 2024/11/23-16:12:16.991902 139957475337792 [compaction_job.cc:1948] [default] [JOB 30309] Generated table #268726: 924651 keys, 38573595 bytes, temperature: kWarm 2024/11/23-16:12:16.992000 139957475337792 EVENT_LOG_v1 {"time_micros": 1732349536991942, "cf_name": "default", "job": 30309, "event": "table_file_creation", "file_number": 268726, "file_size": 38573595, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 3434375989, "table_properties": {"data_size": 34615152, "index_size": 1758912, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25890228, "raw_average_key_size": 28, "raw_value_size": 108327538, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 924651, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732349533, "oldest_key_time": 0, "file_creation_time": 1732349533, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 268726, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:12:17.067308 139957475337792 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268727.sst) /dev/shm/ToplingTemp/Topling-109003-ZsWeju 2024/11/23-16:12:18.024706 139957475337792 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268727.sst): first pass time = 0.96's, 140.198'MB/sec 2024/11/23-16:12:19.534556 139957475337792 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268727.sst): old prealloc_size = 147639500, real_size = 31535280 2024/11/23-16:12:19.535107 139957475337792 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268727.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 931429 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1081 GB zip-val = 0.0295 GB avg-val = 116.10 avg-zval = 31.70 2024/11/23-16:12:19.535904 139957475337792 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268727.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:12:20.586679 139957475337792 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268727.sst): second pass time = 1.51's, 71.659'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.05's, 34.103'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3341.825'MB/sec (index lex order gen) rebuild zvType time = 0.82's, 0.284'MB/sec write SST data time = 0.23's, 155.765'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 35043.812'MB/sec zip my value time = 1.51's, unzip length = 0.108'GB zip my value throughput = 71.659'MB/sec zip pipeline throughput = 96.873'MB/sec entries = 931429 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.10 avg-zval = 31.70 usrkeys = 931429 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.10 avg-zval = 31.70 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 931429 bytes = 3492880 } seq expand size = 6520003 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0295 GB dict = 1.08 MB all = 0.0359 GB } UnZip/Zip{ index = 10.5145 value = 3.6619 dict = 1.00 all = 3.7408 } Zip/UnZip{ index = 0.0951 value = 0.2731 dict = 1.00 all = 0.2673 } ---------------------------- total value len = 9.523838 GB avg = 0.164 KB (by entry num) total key len = 1.601315 GB avg = 0.028 KB total ukey len = 1.112516 GB avg = 0.016 KB total ukey num = 0.071282345 Billion total entry num = 0.058090074 Billion write speed all = 0.424164804 MB/sec (with seq num) write speed all = 0.406446564 MB/sec (without seq num) 2024/11/23-16:12:20.633852 139957475337792 [compaction_job.cc:1948] [default] [JOB 30309] Generated table #268727: 931429 keys, 35879396 bytes, temperature: kWarm 2024/11/23-16:12:20.633917 139957475337792 EVENT_LOG_v1 {"time_micros": 1732349540633884, "cf_name": "default", "job": 30309, "event": "table_file_creation", "file_number": 268727, "file_size": 35879396, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3434375990, "largest_seqno": 4012775885, "table_properties": {"data_size": 29530528, "index_size": 1771712, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26080012, "raw_average_key_size": 28, "raw_value_size": 108137762, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 931429, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732349537, "oldest_key_time": 0, "file_creation_time": 1732349537, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 268727, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:12:20.671107 139957475337792 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268728.sst) /dev/shm/ToplingTemp/Topling-109003-m8fzNv 2024/11/23-16:12:21.609789 139957475337792 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268728.sst): first pass time = 0.94's, 142.991'MB/sec 2024/11/23-16:12:23.084954 139957475337792 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268728.sst): old prealloc_size = 147639500, real_size = 31251920 2024/11/23-16:12:23.085505 139957475337792 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268728.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 931309 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1081 GB zip-val = 0.0292 GB avg-val = 116.12 avg-zval = 31.40 2024/11/23-16:12:23.086296 139957475337792 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268728.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:12:24.146679 139957475337792 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268728.sst): second pass time = 1.47's, 73.379'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.06's, 33.308'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3440.059'MB/sec (index lex order gen) rebuild zvType time = 0.83's, 0.281'MB/sec write SST data time = 0.23's, 152.669'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 38603.379'MB/sec zip my value time = 1.47's, unzip length = 0.108'GB zip my value throughput = 73.379'MB/sec zip pipeline throughput = 73.379'MB/sec entries = 931309 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.12 avg-zval = 31.40 usrkeys = 931309 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.12 avg-zval = 31.40 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 931309 bytes = 3259600 } seq expand size = 6519163 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0292 GB dict = 1.08 MB all = 0.0354 GB } UnZip/Zip{ index = 10.5123 value = 3.6975 dict = 1.00 all = 3.7954 } Zip/UnZip{ index = 0.0951 value = 0.2705 dict = 1.00 all = 0.2635 } ---------------------------- total value len = 9.638498 GB avg = 0.163 KB (by entry num) total key len = 1.627391 GB avg = 0.028 KB total ukey len = 1.131142 GB avg = 0.016 KB total ukey num = 0.072213654 Billion total entry num = 0.059021383 Billion write speed all = 0.429472340 MB/sec (with seq num) write speed all = 0.411472482 MB/sec (without seq num) 2024/11/23-16:12:24.190083 139957475337792 [compaction_job.cc:1948] [default] [JOB 30309] Generated table #268728: 931309 keys, 35362920 bytes, temperature: kWarm 2024/11/23-16:12:24.190150 139957475337792 EVENT_LOG_v1 {"time_micros": 1732349544190115, "cf_name": "default", "job": 30309, "event": "table_file_creation", "file_number": 268728, "file_size": 35362920, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3807172320, "largest_seqno": 4012775902, "table_properties": {"data_size": 29247040, "index_size": 1771840, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26076652, "raw_average_key_size": 28, "raw_value_size": 108141150, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 931309, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732349540, "oldest_key_time": 0, "file_creation_time": 1732349540, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 268728, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:12:24.226933 139957475337792 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268729.sst) /dev/shm/ToplingTemp/Topling-109003-04lT6w 2024/11/23-16:12:25.151651 139957475337792 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268729.sst): first pass time = 0.92's, 145.150'MB/sec 2024/11/23-16:12:26.695394 139957475337792 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268729.sst): old prealloc_size = 147639500, real_size = 31536576 2024/11/23-16:12:26.695941 139957475337792 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268729.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 931462 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1081 GB zip-val = 0.0295 GB avg-val = 116.09 avg-zval = 31.70 2024/11/23-16:12:26.696754 139957475337792 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268729.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:12:27.739611 139957475337792 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268729.sst): second pass time = 1.54's, 70.083'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 1.04's, 34.362'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3343.230'MB/sec (index lex order gen) rebuild zvType time = 0.89's, 0.262'MB/sec write SST data time = 0.16's, 231.362'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 34617.222'MB/sec zip my value time = 1.54's, unzip length = 0.108'GB zip my value throughput = 70.083'MB/sec zip pipeline throughput = 70.083'MB/sec entries = 931462 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.09 avg-zval = 31.70 usrkeys = 931462 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.09 avg-zval = 31.70 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 931462 bytes = 3492992 } seq expand size = 6520234 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0295 GB dict = 1.08 MB all = 0.0359 GB } UnZip/Zip{ index = 10.5129 value = 3.6617 dict = 1.00 all = 3.7407 } Zip/UnZip{ index = 0.0951 value = 0.2731 dict = 1.00 all = 0.2673 } ---------------------------- total value len = 9.753155 GB avg = 0.163 KB (by entry num) total key len = 1.653472 GB avg = 0.028 KB total ukey len = 1.149772 GB avg = 0.016 KB total ukey num = 0.073145116 Billion total entry num = 0.059952845 Billion write speed all = 0.434777931 MB/sec (with seq num) write speed all = 0.416496507 MB/sec (without seq num) 2024/11/23-16:12:27.785030 139957475337792 [compaction_job.cc:1948] [default] [JOB 30309] Generated table #268729: 931462 keys, 35880764 bytes, temperature: kWarm 2024/11/23-16:12:27.785099 139957475337792 EVENT_LOG_v1 {"time_micros": 1732349547785064, "cf_name": "default", "job": 30309, "event": "table_file_creation", "file_number": 268729, "file_size": 35880764, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3273701103, "largest_seqno": 4012775918, "table_properties": {"data_size": 29531504, "index_size": 1772032, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26080936, "raw_average_key_size": 28, "raw_value_size": 108136860, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 931462, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732349544, "oldest_key_time": 0, "file_creation_time": 1732349544, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 268729, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:12:27.822760 139957475337792 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268730.sst) /dev/shm/ToplingTemp/Topling-109003-VZWNsw 2024/11/23-16:12:28.749117 139957475337792 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268730.sst): first pass time = 0.93's, 144.895'MB/sec 2024/11/23-16:12:30.321594 139957475337792 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268730.sst): old prealloc_size = 147639500, real_size = 32752768 2024/11/23-16:12:30.322146 139957475337792 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268730.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 925405 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1083 GB zip-val = 0.0308 GB avg-val = 117.04 avg-zval = 33.24 2024/11/23-16:12:30.324008 139957475337792 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268730.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:12:31.160476 139957475337792 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268730.sst): second pass time = 1.57's, 68.920'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.84's, 44.063'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3300.713'MB/sec (index lex order gen) rebuild zvType time = 0.71's, 0.326'MB/sec write SST data time = 0.13's, 288.935'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 34732.211'MB/sec zip my value time = 1.57's, unzip length = 0.108'GB zip my value throughput = 68.920'MB/sec zip pipeline throughput = 68.920'MB/sec entries = 925405 avg-key = 28.00 avg-zkey = 1.90 avg-val = 117.04 avg-zval = 33.24 usrkeys = 925405 avg-key = 20.00 avg-zkey = 1.90 avg-val = 124.04 avg-zval = 33.24 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 925405 bytes = 3354608 } seq expand size = 6477835 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0308 GB dict = 1.08 MB all = 0.0370 GB } UnZip/Zip{ index = 10.5141 value = 3.5209 dict = 1.00 all = 3.6312 } Zip/UnZip{ index = 0.0951 value = 0.2840 dict = 1.00 all = 0.2754 } ---------------------------- total value len = 9.867939 GB avg = 0.162 KB (by entry num) total key len = 1.679383 GB avg = 0.028 KB total ukey len = 1.168280 GB avg = 0.016 KB total ukey num = 0.074070521 Billion total entry num = 0.060878250 Billion write speed all = 0.440083337 MB/sec (with seq num) write speed all = 0.421522149 MB/sec (without seq num) 2024/11/23-16:12:31.206005 139957475337792 [compaction_job.cc:1948] [default] [JOB 30309] Generated table #268730: 925405 keys, 36962530 bytes, temperature: kWarm 2024/11/23-16:12:31.206073 139957475337792 EVENT_LOG_v1 {"time_micros": 1732349551206038, "cf_name": "default", "job": 30309, "event": "table_file_creation", "file_number": 268730, "file_size": 36962530, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3618484625, "largest_seqno": 4012775947, "table_properties": {"data_size": 30760944, "index_size": 1760320, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25911340, "raw_average_key_size": 28, "raw_value_size": 108306414, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 925405, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732349547, "oldest_key_time": 0, "file_creation_time": 1732349547, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 268730, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:12:31.243774 139957475337792 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268731.sst) /dev/shm/ToplingTemp/Topling-109003-Uk6xWt 2024/11/23-16:12:32.202068 139957475337792 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268731.sst): first pass time = 0.96's, 140.064'MB/sec 2024/11/23-16:12:34.023768 139957475337792 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268731.sst): old prealloc_size = 147639500, real_size = 35748976 2024/11/23-16:12:34.024309 139957475337792 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268731.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 924151 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1083 GB zip-val = 0.0337 GB avg-val = 117.23 avg-zval = 36.52 2024/11/23-16:12:34.025130 139957475337792 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268731.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:12:34.866966 139957475337792 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268731.sst): second pass time = 1.82's, 59.497'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.84's, 47.387'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3415.110'MB/sec (index lex order gen) rebuild zvType time = 0.72's, 0.322'MB/sec write SST data time = 0.13's, 316.520'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.082'MB, throughput = 37971.785'MB/sec zip my value time = 1.82's, unzip length = 0.108'GB zip my value throughput = 59.497'MB/sec zip pipeline throughput = 124.810'MB/sec entries = 924151 avg-key = 28.00 avg-zkey = 1.92 avg-val = 117.23 avg-zval = 36.52 usrkeys = 924151 avg-key = 20.00 avg-zkey = 1.92 avg-val = 124.23 avg-zval = 36.52 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 924151 bytes = 3350064 } seq expand size = 6469057 multi value expand size = 0 cnt WriteAppend = 15 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0337 GB dict = 1.08 MB all = 0.0400 GB } UnZip/Zip{ index = 10.4436 value = 3.2103 dict = 1.00 all = 3.3592 } Zip/UnZip{ index = 0.0958 value = 0.3115 dict = 1.00 all = 0.2977 } ---------------------------- total value len = 9.982750 GB avg = 0.162 KB (by entry num) total key len = 1.705260 GB avg = 0.028 KB total ukey len = 1.186763 GB avg = 0.016 KB total ukey num = 0.074994672 Billion total entry num = 0.061802401 Billion write speed all = 0.445382179 MB/sec (with seq num) write speed all = 0.426541888 MB/sec (without seq num) 2024/11/23-16:12:34.915242 139957475337792 [compaction_job.cc:1948] [default] [JOB 30309] Generated table #268731: 924151 keys, 39955750 bytes, temperature: kWarm 2024/11/23-16:12:34.915314 139957475337792 EVENT_LOG_v1 {"time_micros": 1732349554915277, "cf_name": "default", "job": 30309, "event": "table_file_creation", "file_number": 268731, "file_size": 39955750, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3514720078, "largest_seqno": 4012775967, "table_properties": {"data_size": 33747936, "index_size": 1769792, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25876228, "raw_average_key_size": 28, "raw_value_size": 108341550, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 924151, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732349551, "oldest_key_time": 0, "file_creation_time": 1732349551, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 268731, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:12:34.963265 139957475337792 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268732.sst) /dev/shm/ToplingTemp/Topling-109003-5rXHMu 2024/11/23-16:12:36.095531 139957475337792 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268732.sst): first pass time = 1.13's, 118.544'MB/sec 2024/11/23-16:12:37.422026 139957475337792 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268732.sst): old prealloc_size = 147639500, real_size = 33847424 2024/11/23-16:12:37.422566 139957475337792 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268732.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 930154 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0318 GB avg-val = 116.30 avg-zval = 34.24 2024/11/23-16:12:37.424487 139957475337792 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268732.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:12:38.265910 139957475337792 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268732.sst): second pass time = 1.33's, 81.594'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.84's, 44.901'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3406.395'MB/sec (index lex order gen) rebuild zvType time = 0.71's, 0.327'MB/sec write SST data time = 0.13's, 285.490'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 37637.892'MB/sec zip my value time = 1.33's, unzip length = 0.108'GB zip my value throughput = 81.594'MB/sec zip pipeline throughput = 81.594'MB/sec entries = 930154 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.30 avg-zval = 34.24 usrkeys = 930154 avg-key = 20.00 avg-zkey = 1.90 avg-val = 122.40 avg-zval = 34.24 TagRS{ kinds = RS_Key0_TagN bytes = 145440 } TagArray{ size = 810971 bytes = 3041152 } seq expand size = 5676797 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0318 GB dict = 1.08 MB all = 0.0379 GB } UnZip/Zip{ index = 10.5153 value = 3.3968 dict = 1.00 all = 3.5423 } Zip/UnZip{ index = 0.0951 value = 0.2944 dict = 1.00 all = 0.2823 } ---------------------------- total value len = 10.096600 GB avg = 0.161 KB (by entry num) total key len = 1.731304 GB avg = 0.028 KB total ukey len = 1.205366 GB avg = 0.016 KB total ukey num = 0.075924826 Billion total entry num = 0.062732555 Billion write speed all = 0.450654623 MB/sec (with seq num) write speed all = 0.431533254 MB/sec (without seq num) 2024/11/23-16:12:38.311867 139957475337792 [compaction_job.cc:1948] [default] [JOB 30309] Generated table #268732: 930154 keys, 37890268 bytes, temperature: kWarm 2024/11/23-16:12:38.311937 139957475337792 EVENT_LOG_v1 {"time_micros": 1732349558311902, "cf_name": "default", "job": 30309, "event": "table_file_creation", "file_number": 268732, "file_size": 37890268, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4012776021, "table_properties": {"data_size": 31845552, "index_size": 1769152, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26044312, "raw_average_key_size": 28, "raw_value_size": 108173548, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 930154, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732349554, "oldest_key_time": 0, "file_creation_time": 1732349554, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 268732, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:12:38.350120 139957475337792 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268733.sst) /dev/shm/ToplingTemp/Topling-109003-iyflGu 2024/11/23-16:12:39.365872 139957475337792 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268733.sst): first pass time = 1.02's, 132.142'MB/sec 2024/11/23-16:12:40.700672 139957475337792 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268733.sst): old prealloc_size = 147639500, real_size = 32562992 2024/11/23-16:12:40.701224 139957475337792 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268733.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 929496 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0306 GB avg-val = 116.40 avg-zval = 32.88 2024/11/23-16:12:40.702023 139957475337792 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268733.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:12:41.529998 139957475337792 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268733.sst): second pass time = 1.33's, 81.105'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.83's, 44.389'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3333.242'MB/sec (index lex order gen) rebuild zvType time = 0.70's, 0.332'MB/sec write SST data time = 0.13's, 285.572'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 34210.390'MB/sec zip my value time = 1.33's, unzip length = 0.108'GB zip my value throughput = 81.105'MB/sec zip pipeline throughput = 81.105'MB/sec entries = 929496 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.40 avg-zval = 32.88 usrkeys = 929496 avg-key = 20.00 avg-zkey = 1.90 avg-val = 122.92 avg-zval = 32.88 TagRS{ kinds = RS_Key0_TagN bytes = 145320 } TagArray{ size = 865682 bytes = 3246320 } seq expand size = 6059774 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0306 GB dict = 1.08 MB all = 0.0368 GB } UnZip/Zip{ index = 10.5139 value = 3.5400 dict = 1.00 all = 3.6461 } Zip/UnZip{ index = 0.0951 value = 0.2825 dict = 1.00 all = 0.2743 } ---------------------------- total value len = 10.210852 GB avg = 0.160 KB (by entry num) total key len = 1.757330 GB avg = 0.028 KB total ukey len = 1.223956 GB avg = 0.016 KB total ukey num = 0.076854322 Billion total entry num = 0.063662051 Billion write speed all = 0.455942633 MB/sec (with seq num) write speed all = 0.436540359 MB/sec (without seq num) 2024/11/23-16:12:41.575944 139957475337792 [compaction_job.cc:1948] [default] [JOB 30309] Generated table #268733: 929496 keys, 36811228 bytes, temperature: kWarm 2024/11/23-16:12:41.576027 139957475337792 EVENT_LOG_v1 {"time_micros": 1732349561575991, "cf_name": "default", "job": 30309, "event": "table_file_creation", "file_number": 268733, "file_size": 36811228, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4012776210, "table_properties": {"data_size": 30562336, "index_size": 1768128, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26025888, "raw_average_key_size": 28, "raw_value_size": 108191936, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 929496, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732349558, "oldest_key_time": 0, "file_creation_time": 1732349558, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 268733, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:12:41.612300 139957475337792 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268734.sst) /dev/shm/ToplingTemp/Topling-109003-5zjRsv 2024/11/23-16:12:42.620795 139957475337792 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268734.sst): first pass time = 1.01's, 133.092'MB/sec 2024/11/23-16:12:43.944413 139957475337792 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268734.sst): old prealloc_size = 147639500, real_size = 31960096 2024/11/23-16:12:43.945017 139957475337792 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268734.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 931692 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1081 GB zip-val = 0.0300 GB avg-val = 116.06 avg-zval = 32.15 2024/11/23-16:12:43.947159 139957475337792 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268734.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:12:44.786676 139957475337792 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268734.sst): second pass time = 1.32's, 81.772'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.84's, 42.966'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3075.457'MB/sec (index lex order gen) rebuild zvType time = 0.71's, 0.326'MB/sec write SST data time = 0.13's, 284.913'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 34361.116'MB/sec zip my value time = 1.32's, unzip length = 0.108'GB zip my value throughput = 81.772'MB/sec zip pipeline throughput = 81.772'MB/sec entries = 931692 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.06 avg-zval = 32.15 usrkeys = 931692 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.06 avg-zval = 32.15 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 931692 bytes = 3377392 } seq expand size = 6521844 multi value expand size = 0 cnt WriteAppend = 11 UnZipSize{ index = 0.0186 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0300 GB dict = 1.08 MB all = 0.0362 GB } UnZip/Zip{ index = 10.5136 value = 3.6098 dict = 1.00 all = 3.7089 } Zip/UnZip{ index = 0.0951 value = 0.2770 dict = 1.00 all = 0.2696 } ---------------------------- total value len = 10.325504 GB avg = 0.160 KB (by entry num) total key len = 1.783417 GB avg = 0.028 KB total ukey len = 1.242590 GB avg = 0.016 KB total ukey num = 0.077786014 Billion total entry num = 0.064593743 Billion write speed all = 0.461247056 MB/sec (with seq num) write speed all = 0.441563273 MB/sec (without seq num) 2024/11/23-16:12:44.831084 139957475337792 [compaction_job.cc:1948] [default] [JOB 30309] Generated table #268734: 931692 keys, 36188432 bytes, temperature: kWarm 2024/11/23-16:12:44.831157 139957475337792 EVENT_LOG_v1 {"time_micros": 1732349564831121, "cf_name": "default", "job": 30309, "event": "table_file_creation", "file_number": 268734, "file_size": 36188432, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3512539342, "largest_seqno": 4012776228, "table_properties": {"data_size": 29954640, "index_size": 1772352, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26087376, "raw_average_key_size": 28, "raw_value_size": 108130408, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 931692, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732349561, "oldest_key_time": 0, "file_creation_time": 1732349561, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 268734, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:12:44.872027 139957475337792 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268735.sst) /dev/shm/ToplingTemp/Topling-109003-Nwhhdv 2024/11/23-16:12:45.913581 139957475337792 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268735.sst): first pass time = 1.04's, 128.868'MB/sec 2024/11/23-16:12:47.279189 139957475337792 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268735.sst): old prealloc_size = 147639500, real_size = 33426368 2024/11/23-16:12:47.279802 139957475337792 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268735.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 933210 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1081 GB zip-val = 0.0314 GB avg-val = 115.82 avg-zval = 33.65 2024/11/23-16:12:47.281933 139957475337792 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268735.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:12:48.133523 139957475337792 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268735.sst): second pass time = 1.36's, 79.226'MB/sec, value only(80.5% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.85's, 44.082'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3024.203'MB/sec (index lex order gen) rebuild zvType time = 0.73's, 0.321'MB/sec write SST data time = 0.13's, 296.707'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.078'MB, throughput = 31932.577'MB/sec zip my value time = 1.36's, unzip length = 0.108'GB zip my value throughput = 79.226'MB/sec zip pipeline throughput = 79.226'MB/sec entries = 933210 avg-key = 28.00 avg-zkey = 1.91 avg-val = 115.82 avg-zval = 33.65 usrkeys = 933210 avg-key = 20.00 avg-zkey = 1.91 avg-val = 122.82 avg-zval = 33.65 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 933210 bytes = 3382896 } seq expand size = 6532470 multi value expand size = 0 cnt WriteAppend = 15 UnZipSize{ index = 0.0187 GB value = 0.1081 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0314 GB dict = 1.08 MB all = 0.0377 GB } UnZip/Zip{ index = 10.4448 value = 3.4416 dict = 1.00 all = 3.5640 } Zip/UnZip{ index = 0.0957 value = 0.2906 dict = 1.00 all = 0.2806 } ---------------------------- total value len = 10.440125 GB avg = 0.159 KB (by entry num) total key len = 1.809547 GB avg = 0.028 KB total ukey len = 1.261254 GB avg = 0.016 KB total ukey num = 0.078719224 Billion total entry num = 0.065526953 Billion write speed all = 0.466548965 MB/sec (with seq num) write speed all = 0.446583347 MB/sec (without seq num) 2024/11/23-16:12:48.179088 139957475337792 [compaction_job.cc:1948] [default] [JOB 30309] Generated table #268735: 933210 keys, 37659788 bytes, temperature: kWarm 2024/11/23-16:12:48.179159 139957475337792 EVENT_LOG_v1 {"time_micros": 1732349568179122, "cf_name": "default", "job": 30309, "event": "table_file_creation", "file_number": 268735, "file_size": 37659788, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3485447251, "largest_seqno": 4012776268, "table_properties": {"data_size": 31405936, "index_size": 1786944, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26129880, "raw_average_key_size": 28, "raw_value_size": 108087848, "raw_average_value_size": 115, "num_data_blocks": 1, "num_entries": 933210, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732349564, "oldest_key_time": 0, "file_creation_time": 1732349564, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 268735, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:12:48.221320 139957475337792 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268736.sst) /dev/shm/ToplingTemp/Topling-109003-GFn65t 2024/11/23-16:12:49.212302 139957475337792 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268736.sst): first pass time = 0.99's, 135.445'MB/sec 2024/11/23-16:12:50.527769 139957475337792 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268736.sst): old prealloc_size = 147639500, real_size = 32402032 2024/11/23-16:12:50.528376 139957475337792 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268736.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 925428 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1083 GB zip-val = 0.0304 GB avg-val = 117.03 avg-zval = 32.85 2024/11/23-16:12:50.530263 139957475337792 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268736.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:12:51.365639 139957475337792 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268736.sst): second pass time = 1.31's, 82.423'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.84's, 43.836'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3126.346'MB/sec (index lex order gen) rebuild zvType time = 0.71's, 0.326'MB/sec write SST data time = 0.13's, 286.270'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.081'MB, throughput = 37790.096'MB/sec zip my value time = 1.31's, unzip length = 0.108'GB zip my value throughput = 82.423'MB/sec zip pipeline throughput = 82.423'MB/sec entries = 925428 avg-key = 28.00 avg-zkey = 1.92 avg-val = 117.03 avg-zval = 32.85 usrkeys = 925428 avg-key = 20.00 avg-zkey = 1.92 avg-val = 124.03 avg-zval = 32.85 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 925428 bytes = 3470368 } seq expand size = 6477996 multi value expand size = 0 cnt WriteAppend = 15 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0304 GB dict = 1.08 MB all = 0.0367 GB } UnZip/Zip{ index = 10.4426 value = 3.5629 dict = 1.00 all = 3.6544 } Zip/UnZip{ index = 0.0958 value = 0.2807 dict = 1.00 all = 0.2736 } ---------------------------- total value len = 10.554908 GB avg = 0.159 KB (by entry num) total key len = 1.835459 GB avg = 0.028 KB total ukey len = 1.279762 GB avg = 0.016 KB total ukey num = 0.079644652 Billion total entry num = 0.066452381 Billion write speed all = 0.471849513 MB/sec (with seq num) write speed all = 0.451604416 MB/sec (without seq num) 2024/11/23-16:12:51.410713 139957475337792 [compaction_job.cc:1948] [default] [JOB 30309] Generated table #268736: 925428 keys, 36727434 bytes, temperature: kWarm 2024/11/23-16:12:51.410784 139957475337792 EVENT_LOG_v1 {"time_micros": 1732349571410748, "cf_name": "default", "job": 30309, "event": "table_file_creation", "file_number": 268736, "file_size": 36727434, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3411274482, "largest_seqno": 4012776300, "table_properties": {"data_size": 30398048, "index_size": 1772416, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25911984, "raw_average_key_size": 28, "raw_value_size": 108305856, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 925428, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732349568, "oldest_key_time": 0, "file_creation_time": 1732349568, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 268736, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:12:51.449817 139957475337792 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268737.sst) /dev/shm/ToplingTemp/Topling-109003-MH0mIu 2024/11/23-16:12:52.461032 139957475337792 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268737.sst): first pass time = 1.01's, 132.735'MB/sec 2024/11/23-16:12:53.828179 139957475337792 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268737.sst): old prealloc_size = 147639500, real_size = 34622096 2024/11/23-16:12:53.828755 139957475337792 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268737.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 928595 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0326 GB avg-val = 116.54 avg-zval = 35.13 2024/11/23-16:12:53.830598 139957475337792 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268737.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:12:54.672525 139957475337792 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268737.sst): second pass time = 1.37's, 79.220'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.84's, 46.003'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3186.325'MB/sec (index lex order gen) rebuild zvType time = 0.72's, 0.324'MB/sec write SST data time = 0.13's, 305.601'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 28580.129'MB/sec zip my value time = 1.37's, unzip length = 0.108'GB zip my value throughput = 79.220'MB/sec zip pipeline throughput = 79.220'MB/sec entries = 928595 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.54 avg-zval = 35.13 usrkeys = 928595 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.54 avg-zval = 35.13 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 928595 bytes = 3366176 } seq expand size = 6500165 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0326 GB dict = 1.08 MB all = 0.0388 GB } UnZip/Zip{ index = 10.5140 value = 3.3172 dict = 1.00 all = 3.4555 } Zip/UnZip{ index = 0.0951 value = 0.3015 dict = 1.00 all = 0.2894 } ---------------------------- total value len = 10.669626 GB avg = 0.158 KB (by entry num) total key len = 1.861460 GB avg = 0.028 KB total ukey len = 1.298334 GB avg = 0.016 KB total ukey num = 0.080573247 Billion total entry num = 0.067380976 Billion write speed all = 0.477148238 MB/sec (with seq num) write speed all = 0.456622825 MB/sec (without seq num) 2024/11/23-16:12:54.721222 139957475337792 [compaction_job.cc:1948] [default] [JOB 30309] Generated table #268737: 928595 keys, 38841236 bytes, temperature: kWarm 2024/11/23-16:12:54.721289 139957475337792 EVENT_LOG_v1 {"time_micros": 1732349574721254, "cf_name": "default", "job": 30309, "event": "table_file_creation", "file_number": 268737, "file_size": 38841236, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3525889795, "largest_seqno": 4012776316, "table_properties": {"data_size": 32623360, "index_size": 1766400, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26000660, "raw_average_key_size": 28, "raw_value_size": 108217086, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 928595, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732349571, "oldest_key_time": 0, "file_creation_time": 1732349571, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 268737, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:12:54.759641 139957475337792 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268738.sst) /dev/shm/ToplingTemp/Topling-109003-ybAGlt 2024/11/23-16:12:55.764056 139957475337792 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268738.sst): first pass time = 1.00's, 133.634'MB/sec 2024/11/23-16:12:57.055774 139957475337792 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268738.sst): old prealloc_size = 147639500, real_size = 30662480 2024/11/23-16:12:57.056340 139957475337792 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268738.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 930458 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.1082 GB zip-val = 0.0287 GB avg-val = 116.25 avg-zval = 30.80 2024/11/23-16:12:57.057198 139957475337792 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268738.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:12:57.884034 139957475337792 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268738.sst): second pass time = 1.29's, 83.827'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.83's, 42.263'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3264.050'MB/sec (index lex order gen) rebuild zvType time = 0.70's, 0.334'MB/sec write SST data time = 0.13's, 267.716'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 33175.591'MB/sec zip my value time = 1.29's, unzip length = 0.108'GB zip my value throughput = 83.827'MB/sec zip pipeline throughput = 83.827'MB/sec entries = 930458 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.25 avg-zval = 30.80 usrkeys = 930458 avg-key = 20.00 avg-zkey = 1.90 avg-val = 123.25 avg-zval = 30.80 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 930458 bytes = 3489232 } seq expand size = 6513206 multi value expand size = 0 cnt WriteAppend = 13 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0287 GB dict = 1.08 MB all = 0.0350 GB } UnZip/Zip{ index = 10.5126 value = 3.7741 dict = 1.00 all = 3.8344 } Zip/UnZip{ index = 0.0951 value = 0.2650 dict = 1.00 all = 0.2608 } ---------------------------- total value len = 10.784304 GB avg = 0.158 KB (by entry num) total key len = 1.887513 GB avg = 0.028 KB total ukey len = 1.316943 GB avg = 0.016 KB total ukey num = 0.081503705 Billion total entry num = 0.068311434 Billion write speed all = 0.482447879 MB/sec (with seq num) write speed all = 0.461641576 MB/sec (without seq num) 2024/11/23-16:12:57.928173 139957475337792 [compaction_job.cc:1948] [default] [JOB 30309] Generated table #268738: 930458 keys, 35003582 bytes, temperature: kWarm 2024/11/23-16:12:57.928254 139957475337792 EVENT_LOG_v1 {"time_micros": 1732349577928210, "cf_name": "default", "job": 30309, "event": "table_file_creation", "file_number": 268738, "file_size": 35003582, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3405268578, "largest_seqno": 4012776344, "table_properties": {"data_size": 28659520, "index_size": 1770176, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26052824, "raw_average_key_size": 28, "raw_value_size": 108164948, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 930458, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732349574, "oldest_key_time": 0, "file_creation_time": 1732349574, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 268738, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:12:57.964971 139957475337792 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268739.sst) /dev/shm/ToplingTemp/Topling-109003-ZlmH3w 2024/11/23-16:12:58.978879 139957475337792 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268739.sst): first pass time = 1.01's, 132.384'MB/sec 2024/11/23-16:13:00.281951 139957475337792 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268739.sst): old prealloc_size = 147639500, real_size = 31958912 2024/11/23-16:13:00.282521 139957475337792 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268739.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 923122 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.93 raw-val = 0.1084 GB zip-val = 0.0299 GB avg-val = 117.40 avg-zval = 32.44 2024/11/23-16:13:00.283362 139957475337792 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268739.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:13:01.114088 139957475337792 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268739.sst): second pass time = 1.30's, 83.252'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.83's, 43.598'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3394.653'MB/sec (index lex order gen) rebuild zvType time = 0.70's, 0.328'MB/sec write SST data time = 0.13's, 282.881'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.083'MB, throughput = 34975.321'MB/sec zip my value time = 1.30's, unzip length = 0.108'GB zip my value throughput = 83.252'MB/sec zip pipeline throughput = 83.252'MB/sec entries = 923122 avg-key = 28.00 avg-zkey = 1.93 avg-val = 117.40 avg-zval = 32.44 usrkeys = 923122 avg-key = 20.00 avg-zkey = 1.93 avg-val = 124.40 avg-zval = 32.44 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 923122 bytes = 3461728 } seq expand size = 6461854 multi value expand size = 0 cnt WriteAppend = 17 UnZipSize{ index = 0.0185 GB value = 0.1084 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0299 GB dict = 1.08 MB all = 0.0363 GB } UnZip/Zip{ index = 10.3757 value = 3.6186 dict = 1.00 all = 3.6997 } Zip/UnZip{ index = 0.0964 value = 0.2764 dict = 1.00 all = 0.2703 } ---------------------------- total value len = 10.899136 GB avg = 0.157 KB (by entry num) total key len = 1.913360 GB avg = 0.028 KB total ukey len = 1.335406 GB avg = 0.016 KB total ukey num = 0.082426827 Billion total entry num = 0.069234556 Billion write speed all = 0.487743928 MB/sec (with seq num) write speed all = 0.466659053 MB/sec (without seq num) 2024/11/23-16:13:01.159032 139957475337792 [compaction_job.cc:1948] [default] [JOB 30309] Generated table #268739: 923122 keys, 36278494 bytes, temperature: kWarm 2024/11/23-16:13:01.159106 139957475337792 EVENT_LOG_v1 {"time_micros": 1732349581159068, "cf_name": "default", "job": 30309, "event": "table_file_creation", "file_number": 268739, "file_size": 36278494, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 3471845708, "largest_seqno": 4012776360, "table_properties": {"data_size": 29948528, "index_size": 1779392, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25847416, "raw_average_key_size": 28, "raw_value_size": 108370436, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 923122, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732349577, "oldest_key_time": 0, "file_creation_time": 1732349577, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 268739, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:13:01.194913 139957475337792 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268740.sst) /dev/shm/ToplingTemp/Topling-109003-8IaaXu 2024/11/23-16:13:02.110182 139957475337792 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268740.sst): first pass time = 0.92's, 146.650'MB/sec 2024/11/23-16:13:03.623926 139957475337792 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268740.sst): old prealloc_size = 147639500, real_size = 36502608 2024/11/23-16:13:03.624486 139957475337792 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268740.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 929362 prefix = 4 raw-key = 0.0149 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1082 GB zip-val = 0.0345 GB avg-val = 116.42 avg-zval = 37.11 2024/11/23-16:13:03.624693 139957475337792 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268740.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:13:04.342140 139957475337792 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268740.sst): second pass time = 1.51's, 71.515'MB/sec, value only(80.6% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.72's, 52.753'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3300.868'MB/sec (index lex order gen) rebuild zvType time = 0.59's, 0.393'MB/sec write SST data time = 0.13's, 301.272'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.079'MB, throughput = 35364.867'MB/sec zip my value time = 1.51's, unzip length = 0.108'GB zip my value throughput = 71.515'MB/sec zip pipeline throughput = 71.515'MB/sec entries = 929362 avg-key = 28.00 avg-zkey = 1.92 avg-val = 116.42 avg-zval = 37.11 usrkeys = 929362 avg-key = 20.00 avg-zkey = 1.92 avg-val = 117.34 avg-zval = 37.11 TagRS{ kinds = RS_Key0_TagN bytes = 145320 } TagArray{ size = 122009 bytes = 381296 } seq expand size = 854063 multi value expand size = 0 cnt WriteAppend = 15 UnZipSize{ index = 0.0186 GB value = 0.1082 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0345 GB dict = 1.08 MB all = 0.0379 GB } UnZip/Zip{ index = 10.4428 value = 3.1370 dict = 1.00 all = 3.5427 } Zip/UnZip{ index = 0.0958 value = 0.3188 dict = 1.00 all = 0.2823 } ---------------------------- total value len = 11.008186 GB avg = 0.157 KB (by entry num) total key len = 1.939382 GB avg = 0.028 KB total ukey len = 1.353993 GB avg = 0.016 KB total ukey num = 0.083356189 Billion total entry num = 0.070163918 Billion write speed all = 0.492825258 MB/sec (with seq num) write speed all = 0.471459979 MB/sec (without seq num) 2024/11/23-16:13:04.388418 139957475337792 [compaction_job.cc:1948] [default] [JOB 30309] Generated table #268740: 929362 keys, 37886251 bytes, temperature: kWarm 2024/11/23-16:13:04.388486 139957475337792 EVENT_LOG_v1 {"time_micros": 1732349584388451, "cf_name": "default", "job": 30309, "event": "table_file_creation", "file_number": 268740, "file_size": 37886251, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4012773626, "table_properties": {"data_size": 34490176, "index_size": 1779904, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 26022136, "raw_average_key_size": 28, "raw_value_size": 108195620, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 929362, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732349581, "oldest_key_time": 0, "file_creation_time": 1732349581, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 268740, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:13:04.424418 139957475337792 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268741.sst) /dev/shm/ToplingTemp/Topling-109003-yKIxBs 2024/11/23-16:13:05.245104 139957475337792 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268741.sst): first pass time = 0.82's, 163.550'MB/sec 2024/11/23-16:13:06.692295 139957475337792 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268741.sst): old prealloc_size = 147639500, real_size = 37033408 2024/11/23-16:13:06.692842 139957475337792 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268741.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 924398 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.91 raw-val = 0.1083 GB zip-val = 0.0350 GB avg-val = 117.19 avg-zval = 37.90 2024/11/23-16:13:06.693346 139957475337792 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268741.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:13:07.447189 139957475337792 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268741.sst): second pass time = 1.45's, 74.900'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.75's, 52.526'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3384.486'MB/sec (index lex order gen) rebuild zvType time = 0.63's, 0.369'MB/sec write SST data time = 0.13's, 310.364'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.082'MB, throughput = 33415.050'MB/sec zip my value time = 1.45's, unzip length = 0.108'GB zip my value throughput = 74.900'MB/sec zip pipeline throughput = 74.900'MB/sec entries = 924398 avg-key = 28.00 avg-zkey = 1.91 avg-val = 117.19 avg-zval = 37.90 usrkeys = 924398 avg-key = 20.00 avg-zkey = 1.91 avg-val = 120.45 avg-zval = 37.90 TagRS{ kinds = RS_Key0_TagN bytes = 144520 } TagArray{ size = 430158 bytes = 1613104 } seq expand size = 3011106 multi value expand size = 0 cnt WriteAppend = 17 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0350 GB dict = 1.08 MB all = 0.0397 GB } UnZip/Zip{ index = 10.4460 value = 3.0924 dict = 1.00 all = 3.3850 } Zip/UnZip{ index = 0.0957 value = 0.3234 dict = 1.00 all = 0.2954 } ---------------------------- total value len = 11.119532 GB avg = 0.156 KB (by entry num) total key len = 1.965265 GB avg = 0.028 KB total ukey len = 1.372481 GB avg = 0.016 KB total ukey num = 0.084280587 Billion total entry num = 0.071088316 Billion write speed all = 0.497989765 MB/sec (with seq num) write speed all = 0.476345559 MB/sec (without seq num) 2024/11/23-16:13:07.495004 139957475337792 [compaction_job.cc:1948] [default] [JOB 30309] Generated table #268741: 924398 keys, 39651135 bytes, temperature: kWarm 2024/11/23-16:13:07.495076 139957475337792 EVENT_LOG_v1 {"time_micros": 1732349587495040, "cf_name": "default", "job": 30309, "event": "table_file_creation", "file_number": 268741, "file_size": 39651135, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 4066009038, "table_properties": {"data_size": 35032240, "index_size": 1769856, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25883144, "raw_average_key_size": 28, "raw_value_size": 108334608, "raw_average_value_size": 117, "num_data_blocks": 1, "num_entries": 924398, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_TagN-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732349584, "oldest_key_time": 0, "file_creation_time": 1732349584, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 268741, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:13:07.537887 139957475337792 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268742.sst) /dev/shm/ToplingTemp/Topling-109003-ZOctWs 2024/11/23-16:13:08.519037 139957475337792 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268742.sst): first pass time = 0.98's, 136.801'MB/sec 2024/11/23-16:13:09.869544 139957475337792 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268742.sst): old prealloc_size = 147639500, real_size = 36157856 2024/11/23-16:13:09.870103 139957475337792 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268742.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 926212 prefix = 4 raw-key = 0.0148 GB zip-key = 0.0018 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.1083 GB zip-val = 0.0342 GB avg-val = 116.91 avg-zval = 36.87 2024/11/23-16:13:09.870791 139957475337792 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268742.sst: sumWaitingMem = 0.002 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0023 GB, waited 0.000 sec, Key+Value = 0.134 GB 2024/11/23-16:13:10.690013 139957475337792 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268742.sst): second pass time = 1.35's, 80.254'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.82's, 48.642'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3316.194'MB/sec (index lex order gen) rebuild zvType time = 0.70's, 0.333'MB/sec write SST data time = 0.12's, 319.633'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 1.080'MB, throughput = 32412.852'MB/sec zip my value time = 1.35's, unzip length = 0.108'GB zip my value throughput = 80.254'MB/sec zip pipeline throughput = 80.254'MB/sec entries = 926212 avg-key = 28.00 avg-zkey = 1.92 avg-val = 116.91 avg-zval = 36.87 usrkeys = 926212 avg-key = 20.00 avg-zkey = 1.92 avg-val = 123.91 avg-zval = 36.87 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 926212 bytes = 2894432 } seq expand size = 6483484 multi value expand size = 0 cnt WriteAppend = 15 UnZipSize{ index = 0.0185 GB value = 0.1083 GB dict = 1.08 MB all = 0.1342 GB } __ZipSize{ index = 0.0018 GB value = 0.0342 GB dict = 1.08 MB all = 0.0399 GB } UnZip/Zip{ index = 10.4412 value = 3.1706 dict = 1.00 all = 3.3633 } Zip/UnZip{ index = 0.0958 value = 0.3154 dict = 1.00 all = 0.2973 } ---------------------------- total value len = 11.234299 GB avg = 0.156 KB (by entry num) total key len = 1.991199 GB avg = 0.028 KB total ukey len = 1.391005 GB avg = 0.016 KB total ukey num = 0.085206799 Billion total entry num = 0.072014528 Billion write speed all = 0.503282550 MB/sec (with seq num) write speed all = 0.481359047 MB/sec (without seq num) 2024/11/23-16:13:10.739212 139957475337792 [compaction_job.cc:1948] [default] [JOB 30309] Generated table #268742: 926212 keys, 39907090 bytes, temperature: kWarm 2024/11/23-16:13:10.739283 139957475337792 EVENT_LOG_v1 {"time_micros": 1732349590739245, "cf_name": "default", "job": 30309, "event": "table_file_creation", "file_number": 268742, "file_size": 39907090, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4066009039, "largest_seqno": 4098571909, "table_properties": {"data_size": 34151952, "index_size": 1774144, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 25933936, "raw_average_key_size": 28, "raw_value_size": 108283792, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 926212, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732349587, "oldest_key_time": 0, "file_creation_time": 1732349587, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 268742, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:13:10.776725 139957475337792 [top_zip_table_builder.cc:934] ToplingZipTableBuilder(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268743.sst) /dev/shm/ToplingTemp/Topling-109003-hUzhpv 2024/11/23-16:13:10.875470 139957475337792 [top_zip_table_builder.cc:1352] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268743.sst): first pass time = 0.10's, 236.231'MB/sec 2024/11/23-16:13:11.086602 139957475337792 [top_zip_table_builder.cc:2772] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268743.sst): old prealloc_size = 147639500, real_size = 6894032 2024/11/23-16:13:11.086743 139957475337792 [top_zip_table_builder.cc:1773] BuildReorderMap(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268743.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = DictZipBlobStore usrkeys = 162114 prefix = 4 raw-key = 0.0026 GB zip-key = 0.0003 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.0188 GB zip-val = 0.0065 GB avg-val = 115.84 avg-zval = 40.35 2024/11/23-16:13:11.086892 139957475337792 [top_zip_table_builder.cc:1299] /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268743.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0004 GB, waited 0.000 sec, Key+Value = 0.023 GB 2024/11/23-16:13:11.224898 139957475337792 [top_zip_table_builder.cc:3100] ToplingZipTableBuilder::Finish(/storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00/268743.sst): second pass time = 0.21's, 89.218'MB/sec, value only(80.5% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.14's, 54.368'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2685.149'MB/sec (index lex order gen) rebuild zvType time = 0.12's, 0.349'MB/sec write SST data time = 0.02's, 339.103'MB/sec dict compress time = 4356233619.02's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.196'MB, throughput = 6883.974'MB/sec zip my value time = 0.21's, unzip length = 0.019'GB zip my value throughput = 89.218'MB/sec zip pipeline throughput = 89.218'MB/sec entries = 162114 avg-key = 28.00 avg-zkey = 1.92 avg-val = 115.84 avg-zval = 40.35 usrkeys = 162114 avg-key = 20.00 avg-zkey = 1.92 avg-val = 122.84 avg-zval = 40.35 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 162114 bytes = 466096 } seq expand size = 1134798 multi value expand size = 0 cnt WriteAppend = 14 UnZipSize{ index = 0.0032 GB value = 0.0188 GB dict = 0.20 MB all = 0.0233 GB } __ZipSize{ index = 0.0003 GB value = 0.0065 GB dict = 0.20 MB all = 0.0075 GB } UnZip/Zip{ index = 10.3962 value = 2.8707 dict = 1.00 all = 3.1016 } Zip/UnZip{ index = 0.0962 value = 0.3483 dict = 1.00 all = 0.3224 } ---------------------------- total value len = 11.254212 GB avg = 0.156 KB (by entry num) total key len = 1.995738 GB avg = 0.028 KB total ukey len = 1.394248 GB avg = 0.016 KB total ukey num = 0.085368913 Billion total entry num = 0.072176642 Billion write speed all = 0.504202813 MB/sec (with seq num) write speed all = 0.482230405 MB/sec (without seq num) 2024/11/23-16:13:11.241436 139957475337792 [compaction_job.cc:1948] [default] [JOB 30309] Generated table #268743: 162114 keys, 7517937 bytes, temperature: kWarm 2024/11/23-16:13:11.241487 139957475337792 EVENT_LOG_v1 {"time_micros": 1732349591241458, "cf_name": "default", "job": 30309, "event": "table_file_creation", "file_number": 268743, "file_size": 7517937, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 4089494149, "largest_seqno": 4097054966, "table_properties": {"data_size": 6541440, "index_size": 311872, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 4539192, "raw_average_key_size": 28, "raw_value_size": 18778812, "raw_average_value_size": 115, "num_data_blocks": 1, "num_entries": 162114, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-DictZipBlobStore", "creation_time": 1732349590, "oldest_key_time": 0, "file_creation_time": 1732349590, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "U1ECJGOXSO4Y1P7ZZXV1", "orig_file_number": 268743, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/23-16:13:11.252237 139957475337792 [compaction_job.cc:703] job-30309: subcompact[0], size: 0.798793 G, files: /storage/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/mytopling/.rocksdb/job-30309/att-00 [268722,268723,268724,268725,268726,268727,268728,268729,268730,268731,268732,268733,268734,268735,268736,268737,268738,268739,268740,268741,268742,268743] 2024/11/23-16:13:11.381871 139957475337792 (Original Log Time 2024/11/23-16:11:56.810775) EVENT_LOG_v1 {"time_micros": 1732349516810712, "job": 30309, "event": "compaction_started", "compaction_reason": "FilesMarkedForCompaction", "files_L2": [268704], "files_L3": [268655, 268656, 268658, 268659, 268660, 268661, 268662, 268663, 268664, 268665, 268666, 268667, 268668, 268669, 268670, 268671, 268672, 268673, 268674, 268675, 268716], "score": 0.996317, "input_data_size": 822881368, "oldest_snapshot_seqno": 4098699922} 2024/11/23-16:13:11.381875 139957475337792 (Original Log Time 2024/11/23-16:13:11.380062) [compaction_job.cc:2022] [default] [JOB 30309] Compacted 1@2 + 21@3 files to L3 => 798792963 bytes 2024/11/23-16:13:11.381876 139957475337792 (Original Log Time 2024/11/23-16:13:11.381801) [compaction_job.cc:1224] [default] compacted to: files[0 0 0 22 0 0 0] max score 0.03, MB/sec: 11.1 rd, 10.7 wr, level 3, files in(1, 21) out(22 +0 blob) MB in(27.2, 757.6 +0.0 blob) out(761.8 +0.0 blob), read-write-amplify(56.9) write-amplify(28.0) OK, records in: 19890739, records dropped: 72261 output_compression: Snappy 2024/11/23-16:13:11.381880 139957475337792 (Original Log Time 2024/11/23-16:13:11.381847) EVENT_LOG_v1 {"time_micros": 1732349591381824, "cf": "default", "job": 30309, "event": "compaction_finished", "compaction_time_micros": 74441465, "compaction_time_cpu_micros": 31251108, "output_level": 3, "num_output_files": 22, "total_output_size": 798792963, "num_input_records": 19890739, "num_output_records": 19818478, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "file_write_nanos": 600608069, "file_range_sync_nanos": 0, "file_fsync_nanos": 18109, "file_prepare_write_nanos": 71039, "lsm_state": [0, 0, 0, 22, 0, 0, 0]} 2024/11/23-16:13:11.516664 139957475337792 DEBG dcompact_worker.cpp:240: HttpPost: 200 OK: url = http://nlb-7zny4kaa1poal01o64.cn-shenzhen.nlb.aliyuncs.com:8443, body = {"instanceId":"nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137","labourId":"","dbId":"d89b4006-2803-486e-b7a2-759bcf348921","dbStarts":1732256054,"starts":1732349516,"executesMs":74738,"compactionJobId":30309,"attempt":0,"compactionInputRawBytes":2852152679,"compactionInputZipBytes":822881368,"compactionOutputRawBytes":0,"compactionOutputZipBytes":798792963,"headers":{"Accept":"*/*","Connection":"close","Host":"aliyun-topling-saas.topling.cn:18443","RemoteIp":"120.24.192.169","X-Forwarded-For":"120.24.192.169","region":"cn-shenzhen","token":"e6474c481bd4415abc537135cc03626b","instance-token":"e6474c481bd4415abc537135cc03626b","provider":"aliyun","CloudMarketInstanceId":"si-59c0ae5c955845588903","MeteringAssit":"","Transfer-Encoding":"chunked","traceparent":"00-66f96b1322e569ce9ed6f359dd2331a8-6e14b45bf65e20bc-00"}}, response = 2024/11/23-16:13:11.516766 139957475337792 INFO dcompact_worker.cpp:1459: finish /worker/dcompact-log/nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-22T14.14.14/.rocksdb/job-30309/att-00: olev 3, work 74.738 s, result 7.716 ms, install 1.833 ms, input{raw 2.656 GiB zip 784.761 MiB}